2024-09-12T01:32:40.489 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T01:32:40.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:32:40.615 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901566' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync rbytes: false syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKefKaF0q/NSzWJtB0qezVXv0I2DzP1k7LukGwjCzIMwUj8EDB6DnrLHi/8aBXlg1jZwOaJrCpebS+wUIacvlz4= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCWAjjas7O4HQwiU/6kA9UsOlFxTw15aDGQ9XGGVaPYT3rtKiAVvjPJTGYcVgvSVWZs8w2zFESmNKc3kXp14GKQ= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHL6erMEFqEtPhN0RSolCE8FBkmmlG3YS4Iu+9+4biI/CSWIBsKFQi0GXYskXwQsOLFFAp9mLGEV8rNokEx8SVU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T01:32:40.615 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T01:32:40.616 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T01:32:40.616 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T01:32:40.618 INFO:teuthology.task.internal:Checking packages... 2024-09-12T01:32:40.645 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T01:32:40.646 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:32:40.646 INFO:teuthology.packaging:ref: None 2024-09-12T01:32:40.646 INFO:teuthology.packaging:tag: None 2024-09-12T01:32:40.646 INFO:teuthology.packaging:branch: squid 2024-09-12T01:32:40.646 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:32:40.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T01:32:40.871 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T01:32:40.873 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T01:32:40.879 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T01:32:40.879 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T01:32:40.903 INFO:teuthology.task.internal:Saving configuration 2024-09-12T01:32:40.923 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T01:32:40.930 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T01:32:40.957 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:27:25.851228', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKefKaF0q/NSzWJtB0qezVXv0I2DzP1k7LukGwjCzIMwUj8EDB6DnrLHi/8aBXlg1jZwOaJrCpebS+wUIacvlz4='} 2024-09-12T01:32:40.983 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:27:25.854203', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCWAjjas7O4HQwiU/6kA9UsOlFxTw15aDGQ9XGGVaPYT3rtKiAVvjPJTGYcVgvSVWZs8w2zFESmNKc3kXp14GKQ='} 2024-09-12T01:32:41.014 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:27:25.852837', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHL6erMEFqEtPhN0RSolCE8FBkmmlG3YS4Iu+9+4biI/CSWIBsKFQi0GXYskXwQsOLFFAp9mLGEV8rNokEx8SVU='} 2024-09-12T01:32:41.014 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T01:32:41.021 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T01:32:41.021 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T01:32:41.021 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T01:32:41.021 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T01:32:41.120 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fca0678f490>, signals=[15]) 2024-09-12T01:32:41.120 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T01:32:41.126 INFO:teuthology.task.internal:Opening connections... 2024-09-12T01:32:41.126 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:32:41.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:32:41.226 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-09-12T01:32:41.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:32:41.313 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-09-12T01:32:41.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:32:41.399 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T01:32:41.406 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-09-12T01:32:41.425 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-09-12T01:32:41.426 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-09-12T01:32:41.484 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-09-12T01:32:41.484 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-09-12T01:32:41.484 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-09-12T01:32:41.484 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:32:41.484 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-09-12T01:32:41.484 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:32:41.484 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:32:41.484 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-09-12T01:32:41.485 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:32:41.485 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:32:41.485 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:32:41.485 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:32:41.485 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:32:41.485 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:32:41.486 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-09-12T01:32:41.519 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-09-12T01:32:41.537 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-09-12T01:32:41.538 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-09-12T01:32:41.595 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:32:41.596 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:32:41.597 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-09-12T01:32:41.627 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-09-12T01:32:41.646 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-09-12T01:32:41.646 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-09-12T01:32:41.704 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-09-12T01:32:41.704 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-09-12T01:32:41.705 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-09-12T01:32:41.705 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:32:41.705 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-09-12T01:32:41.705 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:32:41.705 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:32:41.705 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-09-12T01:32:41.705 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:32:41.705 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:32:41.705 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:32:41.705 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:32:41.705 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:32:41.705 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:32:41.706 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-09-12T01:32:41.734 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T01:32:41.745 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T01:32:41.751 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T01:32:41.751 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:32:41.753 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:32:41.756 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:32:41.772 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T01:32:41.778 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T01:32:41.778 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:32:41.811 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:32:41.813 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:32:41.951 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T01:32:42.036 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T01:32:42.050 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T01:32:42.050 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-12T01:32:42.050 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-12T01:32:42.051 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:32:42.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:32:42.069 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-12T01:32:42.128 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-503.el9.x86_64 2024-09-12T01:32:42.129 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.14.0-503.el9.x86_64 2024-09-12T01:32:42.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum install -y kernel 2024-09-12T01:32:45.747 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-12T01:32:47.439 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-12T01:32:52.181 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.5 MB 00:00 2024-09-12T01:32:53.682 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-12T01:32:54.619 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T01:33:00.066 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T01:33:02.081 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T01:33:02.081 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T01:33:02.178 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-12T01:33:02.186 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-12T01:33:02.186 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-09-12T01:33:02.186 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-12T01:33:02.186 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-12T01:33:02.186 INFO:teuthology.orchestra.run.smithi070.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T01:33:02.186 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-12T01:33:02.186 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T01:33:02.186 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T01:33:02.186 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T01:33:02.187 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:33:02.187 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-12T01:33:02.187 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-12T01:33:02.187 INFO:teuthology.orchestra.run.smithi070.stdout:Install 4 Packages 2024-09-12T01:33:02.187 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:33:02.187 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 79 M 2024-09-12T01:33:02.187 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 126 M 2024-09-12T01:33:02.188 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-12T01:33:02.576 INFO:teuthology.orchestra.run.smithi070.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 79 kB/s | 23 kB 00:00 2024-09-12T01:33:06.992 INFO:teuthology.orchestra.run.smithi070.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.3 MB/s | 16 MB 00:04 2024-09-12T01:33:08.041 INFO:teuthology.orchestra.run.smithi070.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.0 MB/s | 35 MB 00:05 2024-09-12T01:33:08.558 INFO:teuthology.orchestra.run.smithi070.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.8 MB/s | 29 MB 00:05 2024-09-12T01:33:08.559 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:33:08.559 INFO:teuthology.orchestra.run.smithi070.stdout:Total 12 MB/s | 79 MB 00:06 2024-09-12T01:33:09.244 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-12T01:33:09.603 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-12T01:33:09.603 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-12T01:33:10.560 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-12T01:33:10.560 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-12T01:33:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-12T01:33:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:33:13.834 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:33:16.627 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:33:16.779 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:33:21.578 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:33:21.762 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:33:26.622 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:34:04.990 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:34:05.031 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:34:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:34:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:34:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:34:05.416 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:34:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:34:06.209 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:34:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-12T01:34:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T01:34:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T01:34:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T01:34:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T01:34:06.210 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:34:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-12T01:34:06.541 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:34:06.634 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:34:06.634 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:34:06.634 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T01:34:06.634 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T01:34:06.634 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T01:34:06.635 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-12T01:34:06.635 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T01:34:06.635 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:34:06.693 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:34:06.693 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:34:06.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo rpm -qi grub2-tools 2024-09-12T01:34:06.725 INFO:teuthology.orchestra.run.smithi070.stdout:Name : grub2-tools 2024-09-12T01:34:06.725 INFO:teuthology.orchestra.run.smithi070.stdout:Epoch : 1 2024-09-12T01:34:06.725 INFO:teuthology.orchestra.run.smithi070.stdout:Version : 2.06 2024-09-12T01:34:06.725 INFO:teuthology.orchestra.run.smithi070.stdout:Release : 82.el9 2024-09-12T01:34:06.725 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: x86_64 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:Group : Unspecified 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:Size : 8274670 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:License : GPLv3+ 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:Packager : builder@centos.org 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:Vendor : CentOS 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:Summary : Support tools for GRUB. 2024-09-12T01:34:06.726 INFO:teuthology.orchestra.run.smithi070.stdout:Description : 2024-09-12T01:34:06.727 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:34:06.727 INFO:teuthology.orchestra.run.smithi070.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T01:34:06.727 INFO:teuthology.orchestra.run.smithi070.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T01:34:06.727 INFO:teuthology.orchestra.run.smithi070.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T01:34:06.727 INFO:teuthology.orchestra.run.smithi070.stdout:hardware devices. 2024-09-12T01:34:06.727 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:34:06.727 INFO:teuthology.orchestra.run.smithi070.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T01:34:06.728 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T01:34:06.728 INFO:teuthology.task.kernel:Updating grub on smithi070 to boot 5.14.0-505.el9.x86_64 2024-09-12T01:34:06.728 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T01:34:07.311 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-09-12T01:34:08.641 INFO:teuthology.orchestra.run.smithi070.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T01:34:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-09-12T01:34:08.677 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-12T01:34:08.693 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.jwcitKSXT2 2024-09-12T01:34:08.694 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jwcitKSXT2 2024-09-12T01:34:08.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.jwcitKSXT2 2024-09-12T01:34:08.914 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.jwcitKSXT2 is 6KB 2024-09-12T01:34:08.963 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.jwcitKSXT2 2024-09-12T01:34:08.978 DEBUG:teuthology.orchestra.run.smithi070:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T01:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T01:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T01:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T01:34:09.065 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T01:34:09.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T01:34:09.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-09-12T01:34:39.177 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T01:34:39.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-12T01:34:39.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:35:39.190 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T01:35:48.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-12T01:35:48.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:35:48.567 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-12T01:35:48.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-12T01:35:48.949 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T01:35:48.949 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-12T01:35:48.963 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-505.el9.x86_64 2024-09-12T01:35:48.964 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T01:35:48.964 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T01:35:48.964 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T01:35:49.965 DEBUG:teuthology.parallel:result is None 2024-09-12T01:35:49.966 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T01:35:49.973 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T01:35:49.973 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:35:49.976 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:35:49.978 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:35:49.998 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T01:35:50.006 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T01:35:50.017 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T01:35:50.017 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:35:50.028 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:35:50.037 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:35:50.219 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T01:35:50.227 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T01:35:50.227 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:35:50.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:35:50.245 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:35:50.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:35:50.263 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:35:50.265 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:35:50.287 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:35:50.343 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:35:50.350 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:35:50.358 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:35:50.368 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:35:50.371 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:35:50.411 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:35:50.413 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T01:35:50.419 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T01:35:50.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:35:50.421 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:35:50.424 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:35:50.452 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T01:35:50.463 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T01:35:50.463 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:35:50.483 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:35:50.493 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:35:50.510 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:35:50.586 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:35:50.618 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:35:50.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:35:50.734 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:35:50.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:35:50.796 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:35:50.848 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:35:50.895 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:35:50.986 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:35:51.026 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-12T01:35:51.026 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:35:51.095 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:35:51.146 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:35:51.198 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:35:51.290 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:35:51.326 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-12T01:35:51.326 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:35:51.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-09-12T01:35:51.396 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-09-12T01:35:51.398 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-09-12T01:35:51.440 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:35:51.452 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:35:51.466 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:35:51.984 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T01:35:51.993 INFO:teuthology.task.internal:Starting timer... 2024-09-12T01:35:51.993 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T01:35:52.012 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T01:35:52.022 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T01:35:52.023 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-09-12T01:35:52.104 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-09-12T01:35:52.106 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2024-09-12T01:35:52.178 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2024-09-12T01:35:52.180 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2024-09-12T01:35:52.240 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2024-09-12T01:35:52.242 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T01:35:52.242 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-09-12T01:35:52.266 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-09-12T01:35:52.266 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2024-09-12T01:35:52.292 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2024-09-12T01:35:52.292 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2024-09-12T01:35:52.319 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2024-09-12T01:35:52.319 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2024-09-12T01:35:52.319 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:35:52.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:35:52.344 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:35:52.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:35:52.373 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:35:52.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:35:52.402 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T01:35:52.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:35:52.453 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:35:52.487 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:35:52.522 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T01:35:52.532 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T01:35:52.547 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T01:35:52.548 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi152.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T01:39:58.536 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-09-12T01:39:58.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-12T01:39:58.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:39:58.642 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-12T01:39:58.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-12T01:39:58.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-12T01:39:58.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:39:58.782 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-09-12T01:39:58.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-12T01:39:58.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-12T01:39:58.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:39:58.967 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-09-12T01:39:59.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-09-12T01:39:59.043 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T01:39:59.052 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T01:39:59.053 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:39:59.053 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:39:59.055 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:39:59.056 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:39:59.059 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:39:59.059 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:39:59.082 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:39:59.088 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:39:59.097 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:39:59.104 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:39:59.112 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:39:59.122 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-09-12T01:39:59.126 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:39:59.130 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2024-09-12T01:39:59.133 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-09-12T01:39:59.142 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2024-09-12T01:39:59.147 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:39:59.156 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:39:59.160 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2024-09-12T01:39:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:39:59.171 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:39:59.172 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2024-09-12T01:39:59.186 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:39:59.201 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:39:59.214 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:39:59.217 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:39:59.217 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-12T01:39:59.217 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:59.217 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:59.217 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:59.217 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:59.234 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:39:59.238 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:39:59.238 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-12T01:39:59.238 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:59.238 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:59.238 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:59.238 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:59.265 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:39:59.268 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:39:59.268 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-09-12T01:39:59.268 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:59.269 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:59.269 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:59.269 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:59.270 INFO:teuthology.run_tasks:Running task install... 2024-09-12T01:39:59.280 DEBUG:teuthology.task.install:project ceph 2024-09-12T01:39:59.280 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T01:39:59.280 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T01:39:59.280 INFO:teuthology.task.install:Using flavor: default 2024-09-12T01:39:59.285 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T01:39:59.285 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T01:39:59.286 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:39:59.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:39:59.288 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:39:59.288 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:39:59.289 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:39:59.290 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:39:59.440 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:39:59.441 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:39:59.456 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:39:59.456 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:39:59.467 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:39:59.468 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:39:59.566 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:39:59.566 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:39:59.566 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:39:59.577 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:39:59.578 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-12T01:39:59.578 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:39:59.584 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:39:59.584 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-12T01:39:59.584 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:39:59.592 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:39:59.593 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:39:59.604 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:39:59.604 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:39:59.610 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:39:59.610 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:39:59.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:39:59.669 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:39:59.676 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:39:59.734 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:39:59.745 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:39:59.752 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:39:59.798 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-09-12T01:39:59.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-09-12T01:39:59.809 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2024-09-12T01:39:59.810 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2024-09-12T01:39:59.816 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2024-09-12T01:39:59.818 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2024-09-12T01:40:00.040 INFO:teuthology.orchestra.run.smithi152.stdout:45 files removed 2024-09-12T01:40:00.047 INFO:teuthology.orchestra.run.smithi191.stdout:45 files removed 2024-09-12T01:40:00.068 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:40:00.074 INFO:teuthology.orchestra.run.smithi070.stdout:45 files removed 2024-09-12T01:40:00.076 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:40:00.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:40:00.614 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-12T01:40:00.632 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-09-12T01:40:00.639 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 333 kB/s | 84 kB 00:00 2024-09-12T01:40:00.898 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T01:40:00.915 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-12T01:40:00.916 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-12T01:40:01.166 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T01:40:01.182 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T01:40:01.183 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T01:40:02.685 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.2 MB 00:01 2024-09-12T01:40:02.815 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.2 MB 00:01 2024-09-12T01:40:03.290 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-09-12T01:40:04.583 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-12T01:40:07.582 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 20 MB 00:03 2024-09-12T01:40:08.967 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 3.9 MB/s | 20 MB 00:05 2024-09-12T01:40:09.867 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.5 MB 00:01 2024-09-12T01:40:11.535 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-12T01:40:11.924 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T01:40:12.464 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T01:40:13.475 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 98 kB/s | 19 kB 00:00 2024-09-12T01:40:13.535 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-12T01:40:14.354 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-12T01:40:15.310 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-12T01:40:16.240 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T01:40:17.928 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T01:40:19.826 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T01:40:20.204 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:40:20.205 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:40:20.216 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:40:20.217 INFO:teuthology.orchestra.run.smithi152.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:40:20.217 INFO:teuthology.orchestra.run.smithi152.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:40:20.218 INFO:teuthology.orchestra.run.smithi152.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:40:20.220 INFO:teuthology.orchestra.run.smithi152.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:40:20.222 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:40:20.223 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:40:20.284 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-12T01:40:20.303 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================== 2024-09-12T01:40:20.303 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-12T01:40:20.303 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================== 2024-09-12T01:40:20.304 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-12T01:40:20.304 INFO:teuthology.orchestra.run.smithi152.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:40:20.304 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:40:20.304 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:40:20.304 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:40:20.304 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:40:20.304 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:40:20.304 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:40:20.304 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:40:20.304 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:40:20.304 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:40:20.304 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:40:20.305 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:40:20.305 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:40:20.305 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:40:20.305 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:40:20.305 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:40:20.305 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:40:20.305 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:40:20.305 INFO:teuthology.orchestra.run.smithi152.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:40:20.305 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:40:20.305 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:40:20.305 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:40:20.305 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:40:20.306 INFO:teuthology.orchestra.run.smithi152.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:40:20.306 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:40:20.306 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:40:20.306 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:40:20.306 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:40:20.306 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:40:20.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:40:20.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:40:20.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:40:20.306 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:40:20.306 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:40:20.306 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-12T01:40:20.307 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:40:20.308 INFO:teuthology.orchestra.run.smithi152.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:40:20.308 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:40:20.308 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:40:20.308 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:40:20.308 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:40:20.308 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:40:20.308 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:40:20.308 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:40:20.309 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:40:20.309 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:40:20.309 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:40:20.309 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:40:20.309 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:40:20.309 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:40:20.309 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:40:20.309 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:40:20.309 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:40:20.309 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:40:20.309 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:40:20.309 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:40:20.310 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:40:20.311 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:40:20.311 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:40:20.311 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:40:20.311 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:40:20.311 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:40:20.311 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:40:20.311 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:40:20.311 INFO:teuthology.orchestra.run.smithi152.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:40:20.311 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:40:20.312 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:40:20.312 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:40:20.312 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:40:20.312 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:40:20.312 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:40:20.312 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:40:20.312 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:40:20.312 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:40:20.312 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:40:20.312 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:40:20.312 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:40:20.312 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:40:20.313 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:40:20.314 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:40:20.315 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:40:20.316 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:40:20.317 INFO:teuthology.orchestra.run.smithi152.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:40:20.317 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:40:20.317 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:40:20.317 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-09-12T01:40:20.317 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:40:20.317 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:40:20.317 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-12T01:40:20.317 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================== 2024-09-12T01:40:20.317 INFO:teuthology.orchestra.run.smithi152.stdout:Install 148 Packages 2024-09-12T01:40:20.317 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 8 Packages 2024-09-12T01:40:20.317 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:40:20.318 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 226 M 2024-09-12T01:40:20.318 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-12T01:40:21.287 INFO:teuthology.orchestra.run.smithi152.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-12T01:40:21.504 INFO:teuthology.orchestra.run.smithi152.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.0 MB/s | 897 kB 00:00 2024-09-12T01:40:21.554 INFO:teuthology.orchestra.run.smithi152.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.8 MB/s | 145 kB 00:00 2024-09-12T01:40:21.620 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-12T01:40:21.796 INFO:teuthology.orchestra.run.smithi152.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 8.6 MB/s | 5.4 MB 00:00 2024-09-12T01:40:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 8.0 MB/s | 2.4 MB 00:00 2024-09-12T01:40:21.955 INFO:teuthology.orchestra.run.smithi152.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 9.6 MB/s | 1.5 MB 00:00 2024-09-12T01:40:22.171 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:40:22.172 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:40:22.185 INFO:teuthology.orchestra.run.smithi070.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:40:22.186 INFO:teuthology.orchestra.run.smithi070.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:40:22.187 INFO:teuthology.orchestra.run.smithi070.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:40:22.188 INFO:teuthology.orchestra.run.smithi070.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:40:22.190 INFO:teuthology.orchestra.run.smithi070.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:40:22.193 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:40:22.194 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:40:22.258 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-12T01:40:22.263 INFO:teuthology.orchestra.run.smithi152.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-12T01:40:22.282 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-12T01:40:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-12T01:40:22.282 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-12T01:40:22.282 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-12T01:40:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:40:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:40:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:40:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:40:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:40:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:40:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:40:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:40:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:40:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:40:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:40:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:40:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:40:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:40:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:40:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:40:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:40:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:40:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:40:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:40:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:40:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:40:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:40:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:40:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:40:22.285 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-09-12T01:40:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:40:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:40:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:40:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:40:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:40:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:40:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:40:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:40:22.286 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-12T01:40:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:40:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:40:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:40:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:40:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:40:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:40:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:40:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:40:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:40:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:40:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:40:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:40:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:40:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:40:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:40:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:40:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:40:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:40:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:40:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:40:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:40:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:40:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:40:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:40:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:40:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:40:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:40:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:40:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:40:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:40:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:40:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:40:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:40:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:40:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:40:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:40:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:40:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout:Installing weak dependencies: 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:40:22.294 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-12T01:40:22.295 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-12T01:40:22.295 INFO:teuthology.orchestra.run.smithi070.stdout:Install 148 Packages 2024-09-12T01:40:22.295 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 8 Packages 2024-09-12T01:40:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:40:22.295 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 226 M 2024-09-12T01:40:22.295 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-12T01:40:22.689 INFO:teuthology.orchestra.run.smithi070.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-12T01:40:22.730 INFO:teuthology.orchestra.run.smithi152.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 14 MB/s | 21 MB 00:01 2024-09-12T01:40:22.831 INFO:teuthology.orchestra.run.smithi152.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 250 kB/s | 25 kB 00:00 2024-09-12T01:40:22.985 INFO:teuthology.orchestra.run.smithi070.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 2.9 MB/s | 897 kB 00:00 2024-09-12T01:40:23.006 INFO:teuthology.orchestra.run.smithi152.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 16 MB/s | 17 MB 00:01 2024-09-12T01:40:23.069 INFO:teuthology.orchestra.run.smithi070.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.7 MB/s | 145 kB 00:00 2024-09-12T01:40:23.140 INFO:teuthology.orchestra.run.smithi152.stdout:(11/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 12 MB/s | 11 MB 00:00 2024-09-12T01:40:23.165 INFO:teuthology.orchestra.run.smithi152.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.4 MB/s | 228 kB 00:00 2024-09-12T01:40:23.198 INFO:teuthology.orchestra.run.smithi152.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 462 kB/s | 27 kB 00:00 2024-09-12T01:40:23.224 INFO:teuthology.orchestra.run.smithi152.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 540 kB/s | 32 kB 00:00 2024-09-12T01:40:23.274 INFO:teuthology.orchestra.run.smithi152.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 9.8 MB/s | 752 kB 00:00 2024-09-12T01:40:23.299 INFO:teuthology.orchestra.run.smithi152.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 163 kB 00:00 2024-09-12T01:40:23.333 INFO:teuthology.orchestra.run.smithi152.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-12T01:40:23.375 INFO:teuthology.orchestra.run.smithi152.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 6.6 MB/s | 506 kB 00:00 2024-09-12T01:40:23.475 INFO:teuthology.orchestra.run.smithi152.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 451 kB/s | 45 kB 00:00 2024-09-12T01:40:23.553 INFO:teuthology.orchestra.run.smithi070.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 5.4 MB/s | 5.4 MB 00:00 2024-09-12T01:40:23.559 INFO:teuthology.orchestra.run.smithi152.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.6 MB/s | 136 kB 00:00 2024-09-12T01:40:23.594 INFO:teuthology.orchestra.run.smithi070.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 4.5 MB/s | 2.4 MB 00:00 2024-09-12T01:40:23.651 INFO:teuthology.orchestra.run.smithi152.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.7 MB/s | 162 kB 00:00 2024-09-12T01:40:23.792 INFO:teuthology.orchestra.run.smithi152.stdout:(22/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-12T01:40:23.821 INFO:teuthology.orchestra.run.smithi152.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 1.9 MB/s | 321 kB 00:00 2024-09-12T01:40:24.827 INFO:teuthology.orchestra.run.smithi070.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 5.7 MB/s | 1.5 MB 00:00 2024-09-12T01:40:24.827 INFO:teuthology.orchestra.run.smithi070.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 4.3 MB/s | 4.7 MB 00:01 2024-09-12T01:40:24.828 INFO:teuthology.orchestra.run.smithi152.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.9 MB/s | 301 kB 00:00 2024-09-12T01:40:24.828 INFO:teuthology.orchestra.run.smithi152.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.3 MB/s | 100 kB 00:00 2024-09-12T01:40:24.828 INFO:teuthology.orchestra.run.smithi152.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 928 kB/s | 85 kB 00:00 2024-09-12T01:40:24.828 INFO:teuthology.orchestra.run.smithi152.stdout:(27/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 9.5 MB/s | 3.1 MB 00:00 2024-09-12T01:40:24.828 INFO:teuthology.orchestra.run.smithi152.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 481 kB/s | 32 kB 00:00 2024-09-12T01:40:24.828 INFO:teuthology.orchestra.run.smithi152.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.9 MB/s | 146 kB 00:00 2024-09-12T01:40:24.829 INFO:teuthology.orchestra.run.smithi152.stdout:(30/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 11 MB/s | 3.6 MB 00:00 2024-09-12T01:40:24.829 INFO:teuthology.orchestra.run.smithi152.stdout:(31/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 225 kB/s | 171 kB 00:00 2024-09-12T01:40:24.829 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:40:24.829 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:40:24.829 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:40:24.829 INFO:teuthology.orchestra.run.smithi191.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout:====================================================================================== 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout:====================================================================================== 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:40:24.830 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:40:24.831 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:40:24.832 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:40:24.833 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:40:24.834 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:40:24.835 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:40:24.836 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:40:24.837 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:40:24.838 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:40:24.839 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:40:24.840 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:40:24.841 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:40:24.842 INFO:teuthology.orchestra.run.smithi191.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:40:24.842 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:40:24.842 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:40:24.842 INFO:teuthology.orchestra.run.smithi191.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:40:24.842 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:40:24.842 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:40:24.842 INFO:teuthology.orchestra.run.smithi191.stdout:Installing weak dependencies: 2024-09-12T01:40:24.842 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:40:24.842 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:40:24.843 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-09-12T01:40:24.843 INFO:teuthology.orchestra.run.smithi191.stdout:====================================================================================== 2024-09-12T01:40:24.843 INFO:teuthology.orchestra.run.smithi191.stdout:Install 148 Packages 2024-09-12T01:40:24.843 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 8 Packages 2024-09-12T01:40:24.843 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:40:24.843 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 226 M 2024-09-12T01:40:24.843 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-09-12T01:40:24.922 INFO:teuthology.orchestra.run.smithi070.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 9.0 MB/s | 21 MB 00:02 2024-09-12T01:40:24.998 INFO:teuthology.orchestra.run.smithi070.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 336 kB/s | 25 kB 00:00 2024-09-12T01:40:25.078 INFO:teuthology.orchestra.run.smithi152.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 696 kB/s | 249 kB 00:00 2024-09-12T01:40:25.173 INFO:teuthology.orchestra.run.smithi191.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 35 kB/s | 6.5 kB 00:00 2024-09-12T01:40:25.281 INFO:teuthology.orchestra.run.smithi070.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 17 MB 00:01 2024-09-12T01:40:25.340 INFO:teuthology.orchestra.run.smithi070.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-12T01:40:25.388 INFO:teuthology.orchestra.run.smithi191.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.0 MB/s | 897 kB 00:00 2024-09-12T01:40:25.390 INFO:teuthology.orchestra.run.smithi070.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 542 kB/s | 27 kB 00:00 2024-09-12T01:40:25.439 INFO:teuthology.orchestra.run.smithi191.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.8 MB/s | 145 kB 00:00 2024-09-12T01:40:25.440 INFO:teuthology.orchestra.run.smithi070.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 634 kB/s | 32 kB 00:00 2024-09-12T01:40:25.524 INFO:teuthology.orchestra.run.smithi070.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.8 MB/s | 752 kB 00:00 2024-09-12T01:40:25.554 INFO:teuthology.orchestra.run.smithi152.stdout:(33/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 18 MB/s | 49 MB 00:02 2024-09-12T01:40:25.580 INFO:teuthology.orchestra.run.smithi152.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 98 kB/s | 49 kB 00:00 2024-09-12T01:40:25.591 INFO:teuthology.orchestra.run.smithi070.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T01:40:25.658 INFO:teuthology.orchestra.run.smithi070.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 127 kB 00:00 2024-09-12T01:40:25.662 INFO:teuthology.orchestra.run.smithi152.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 7.7 MB/s | 7.4 MB 00:00 2024-09-12T01:40:25.687 INFO:teuthology.orchestra.run.smithi152.stdout:(36/156): ceph-prometheus-alerts-19.1.1-298.gb5 123 kB/s | 16 kB 00:00 2024-09-12T01:40:25.741 INFO:teuthology.orchestra.run.smithi070.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.9 MB/s | 506 kB 00:00 2024-09-12T01:40:25.747 INFO:teuthology.orchestra.run.smithi191.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 7.1 MB/s | 5.4 MB 00:00 2024-09-12T01:40:25.754 INFO:teuthology.orchestra.run.smithi152.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 273 kB/s | 18 kB 00:00 2024-09-12T01:40:25.780 INFO:teuthology.orchestra.run.smithi152.stdout:(38/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 1.4 MB/s | 285 kB 00:00 2024-09-12T01:40:25.797 INFO:teuthology.orchestra.run.smithi191.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 6.7 MB/s | 2.4 MB 00:00 2024-09-12T01:40:25.813 INFO:teuthology.orchestra.run.smithi152.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 5.0 MB/s | 765 kB 00:00 2024-09-12T01:40:25.929 INFO:teuthology.orchestra.run.smithi152.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 459 kB/s | 80 kB 00:00 2024-09-12T01:40:25.971 INFO:teuthology.orchestra.run.smithi152.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-12T01:40:25.981 INFO:teuthology.orchestra.run.smithi191.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 6.5 MB/s | 1.5 MB 00:00 2024-09-12T01:40:26.021 INFO:teuthology.orchestra.run.smithi152.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-12T01:40:26.041 INFO:teuthology.orchestra.run.smithi070.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 18 MB/s | 5.3 MB 00:00 2024-09-12T01:40:26.054 INFO:teuthology.orchestra.run.smithi152.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-12T01:40:26.080 INFO:teuthology.orchestra.run.smithi152.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-12T01:40:26.105 INFO:teuthology.orchestra.run.smithi152.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T01:40:26.116 INFO:teuthology.orchestra.run.smithi070.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 602 kB/s | 45 kB 00:00 2024-09-12T01:40:26.122 INFO:teuthology.orchestra.run.smithi152.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-12T01:40:26.155 INFO:teuthology.orchestra.run.smithi152.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 6.7 MB/s | 1.2 MB 00:00 2024-09-12T01:40:26.181 INFO:teuthology.orchestra.run.smithi152.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-12T01:40:26.192 INFO:teuthology.orchestra.run.smithi070.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-12T01:40:26.276 INFO:teuthology.orchestra.run.smithi070.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 162 kB 00:00 2024-09-12T01:40:26.359 INFO:teuthology.orchestra.run.smithi070.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 321 kB 00:00 2024-09-12T01:40:26.414 INFO:teuthology.orchestra.run.smithi191.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 7.6 MB/s | 4.7 MB 00:00 2024-09-12T01:40:26.434 INFO:teuthology.orchestra.run.smithi070.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.9 MB/s | 301 kB 00:00 2024-09-12T01:40:26.518 INFO:teuthology.orchestra.run.smithi070.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.2 MB/s | 100 kB 00:00 2024-09-12T01:40:26.610 INFO:teuthology.orchestra.run.smithi070.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 928 kB/s | 85 kB 00:00 2024-09-12T01:40:26.723 INFO:teuthology.orchestra.run.smithi152.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 197 kB/s | 107 kB 00:00 2024-09-12T01:40:26.736 INFO:teuthology.orchestra.run.smithi070.stdout:(26/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 5.2 MB/s | 11 MB 00:02 2024-09-12T01:40:26.831 INFO:teuthology.orchestra.run.smithi152.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-12T01:40:26.902 INFO:teuthology.orchestra.run.smithi070.stdout:(27/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-12T01:40:26.944 INFO:teuthology.orchestra.run.smithi070.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 766 kB/s | 32 kB 00:00 2024-09-12T01:40:26.956 INFO:teuthology.orchestra.run.smithi152.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 826 kB/s | 689 kB 00:00 2024-09-12T01:40:26.990 INFO:teuthology.orchestra.run.smithi152.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-12T01:40:26.995 INFO:teuthology.orchestra.run.smithi070.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-12T01:40:27.074 INFO:teuthology.orchestra.run.smithi152.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-12T01:40:27.106 INFO:teuthology.orchestra.run.smithi191.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 10 MB/s | 21 MB 00:02 2024-09-12T01:40:27.115 INFO:teuthology.orchestra.run.smithi152.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-09-12T01:40:27.153 INFO:teuthology.orchestra.run.smithi070.stdout:(30/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 409 kB/s | 171 kB 00:00 2024-09-12T01:40:27.182 INFO:teuthology.orchestra.run.smithi191.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 336 kB/s | 25 kB 00:00 2024-09-12T01:40:27.182 INFO:teuthology.orchestra.run.smithi152.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-12T01:40:27.233 INFO:teuthology.orchestra.run.smithi152.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-09-12T01:40:27.245 INFO:teuthology.orchestra.run.smithi070.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 14 MB/s | 3.6 MB 00:00 2024-09-12T01:40:27.295 INFO:teuthology.orchestra.run.smithi070.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-12T01:40:27.300 INFO:teuthology.orchestra.run.smithi152.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-12T01:40:27.340 INFO:teuthology.orchestra.run.smithi191.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 17 MB 00:01 2024-09-12T01:40:27.341 INFO:teuthology.orchestra.run.smithi152.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-12T01:40:27.346 INFO:teuthology.orchestra.run.smithi070.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 988 kB/s | 49 kB 00:00 2024-09-12T01:40:27.390 INFO:teuthology.orchestra.run.smithi191.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T01:40:27.412 INFO:teuthology.orchestra.run.smithi070.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 247 kB/s | 16 kB 00:00 2024-09-12T01:40:27.449 INFO:teuthology.orchestra.run.smithi191.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 463 kB/s | 27 kB 00:00 2024-09-12T01:40:27.489 INFO:teuthology.orchestra.run.smithi070.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.7 MB/s | 285 kB 00:00 2024-09-12T01:40:27.508 INFO:teuthology.orchestra.run.smithi152.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.8 MB/s | 3.0 MB 00:00 2024-09-12T01:40:27.555 INFO:teuthology.orchestra.run.smithi070.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 11 MB/s | 765 kB 00:00 2024-09-12T01:40:27.566 INFO:teuthology.orchestra.run.smithi191.stdout:(13/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 9.2 MB/s | 11 MB 00:01 2024-09-12T01:40:27.591 INFO:teuthology.orchestra.run.smithi191.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 223 kB/s | 32 kB 00:00 2024-09-12T01:40:27.597 INFO:teuthology.orchestra.run.smithi070.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 437 kB/s | 18 kB 00:00 2024-09-12T01:40:27.608 INFO:teuthology.orchestra.run.smithi152.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 662 kB 00:00 2024-09-12T01:40:27.634 INFO:teuthology.orchestra.run.smithi152.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 195 kB/s | 24 kB 00:00 2024-09-12T01:40:27.650 INFO:teuthology.orchestra.run.smithi191.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.8 MB/s | 752 kB 00:00 2024-09-12T01:40:27.675 INFO:teuthology.orchestra.run.smithi191.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.9 MB/s | 163 kB 00:00 2024-09-12T01:40:27.700 INFO:teuthology.orchestra.run.smithi191.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T01:40:27.717 INFO:teuthology.orchestra.run.smithi152.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 1.5 MB/s | 581 kB 00:00 2024-09-12T01:40:27.734 INFO:teuthology.orchestra.run.smithi191.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 8.5 MB/s | 506 kB 00:00 2024-09-12T01:40:27.742 INFO:teuthology.orchestra.run.smithi152.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 354 kB/s | 47 kB 00:00 2024-09-12T01:40:27.764 INFO:teuthology.orchestra.run.smithi070.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-12T01:40:27.768 INFO:teuthology.orchestra.run.smithi152.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-12T01:40:27.793 INFO:teuthology.orchestra.run.smithi191.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 773 kB/s | 45 kB 00:00 2024-09-12T01:40:27.827 INFO:teuthology.orchestra.run.smithi152.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-12T01:40:27.851 INFO:teuthology.orchestra.run.smithi191.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.3 MB/s | 136 kB 00:00 2024-09-12T01:40:27.852 INFO:teuthology.orchestra.run.smithi152.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 354 kB/s | 38 kB 00:00 2024-09-12T01:40:27.910 INFO:teuthology.orchestra.run.smithi191.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.7 MB/s | 162 kB 00:00 2024-09-12T01:40:27.947 INFO:teuthology.orchestra.run.smithi070.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-12T01:40:27.977 INFO:teuthology.orchestra.run.smithi191.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.7 MB/s | 321 kB 00:00 2024-09-12T01:40:28.044 INFO:teuthology.orchestra.run.smithi191.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 4.4 MB/s | 301 kB 00:00 2024-09-12T01:40:28.127 INFO:teuthology.orchestra.run.smithi191.stdout:(24/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-12T01:40:28.152 INFO:teuthology.orchestra.run.smithi191.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 918 kB/s | 100 kB 00:00 2024-09-12T01:40:28.178 INFO:teuthology.orchestra.run.smithi191.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T01:40:28.237 INFO:teuthology.orchestra.run.smithi191.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-12T01:40:28.252 INFO:teuthology.orchestra.run.smithi152.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2024-09-12T01:40:28.287 INFO:teuthology.orchestra.run.smithi191.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 638 kB/s | 32 kB 00:00 2024-09-12T01:40:28.345 INFO:teuthology.orchestra.run.smithi191.stdout:(29/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 16 MB/s | 3.1 MB 00:00 2024-09-12T01:40:28.370 INFO:teuthology.orchestra.run.smithi191.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.7 MB/s | 146 kB 00:00 2024-09-12T01:40:28.386 INFO:teuthology.orchestra.run.smithi152.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-12T01:40:28.390 INFO:teuthology.orchestra.run.smithi070.stdout:(40/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 14 MB/s | 49 MB 00:03 2024-09-12T01:40:28.406 INFO:teuthology.orchestra.run.smithi070.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 417 kB/s | 191 kB 00:00 2024-09-12T01:40:28.499 INFO:teuthology.orchestra.run.smithi070.stdout:(42/156): ceph-mgr-diskprediction-local-19.1.1- 5.5 MB/s | 7.4 MB 00:01 2024-09-12T01:40:28.502 INFO:teuthology.orchestra.run.smithi152.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-12T01:40:28.554 INFO:teuthology.orchestra.run.smithi191.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 17 MB/s | 3.6 MB 00:00 2024-09-12T01:40:28.604 INFO:teuthology.orchestra.run.smithi191.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-12T01:40:28.646 INFO:teuthology.orchestra.run.smithi191.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 1.2 MB/s | 49 kB 00:00 2024-09-12T01:40:28.665 INFO:teuthology.orchestra.run.smithi070.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 4.7 MB/s | 1.2 MB 00:00 2024-09-12T01:40:28.680 INFO:teuthology.orchestra.run.smithi191.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 493 kB/s | 16 kB 00:00 2024-09-12T01:40:28.690 INFO:teuthology.orchestra.run.smithi070.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 556 kB/s | 106 kB 00:00 2024-09-12T01:40:28.716 INFO:teuthology.orchestra.run.smithi070.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 778 kB/s | 253 kB 00:00 2024-09-12T01:40:28.730 INFO:teuthology.orchestra.run.smithi191.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.6 MB/s | 285 kB 00:00 2024-09-12T01:40:28.741 INFO:teuthology.orchestra.run.smithi070.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.7 MB/s | 135 kB 00:00 2024-09-12T01:40:28.775 INFO:teuthology.orchestra.run.smithi070.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-12T01:40:28.825 INFO:teuthology.orchestra.run.smithi070.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-12T01:40:28.839 INFO:teuthology.orchestra.run.smithi191.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-12T01:40:28.873 INFO:teuthology.orchestra.run.smithi191.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 5.3 MB/s | 765 kB 00:00 2024-09-12T01:40:28.898 INFO:teuthology.orchestra.run.smithi191.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 312 kB/s | 18 kB 00:00 2024-09-12T01:40:28.925 INFO:teuthology.orchestra.run.smithi070.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-12T01:40:28.976 INFO:teuthology.orchestra.run.smithi070.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-12T01:40:29.001 INFO:teuthology.orchestra.run.smithi070.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-12T01:40:29.043 INFO:teuthology.orchestra.run.smithi070.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-12T01:40:29.068 INFO:teuthology.orchestra.run.smithi070.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-12T01:40:29.102 INFO:teuthology.orchestra.run.smithi070.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-12T01:40:29.127 INFO:teuthology.orchestra.run.smithi070.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-12T01:40:29.152 INFO:teuthology.orchestra.run.smithi070.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-12T01:40:29.194 INFO:teuthology.orchestra.run.smithi070.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-12T01:40:29.220 INFO:teuthology.orchestra.run.smithi070.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-12T01:40:29.320 INFO:teuthology.orchestra.run.smithi070.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-12T01:40:29.362 INFO:teuthology.orchestra.run.smithi070.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 590 kB/s | 24 kB 00:00 2024-09-12T01:40:29.365 INFO:teuthology.orchestra.run.smithi191.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 162 kB/s | 80 kB 00:00 2024-09-12T01:40:29.404 INFO:teuthology.orchestra.run.smithi070.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-12T01:40:29.463 INFO:teuthology.orchestra.run.smithi070.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 2.3 MB/s | 581 kB 00:00 2024-09-12T01:40:29.504 INFO:teuthology.orchestra.run.smithi070.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2024-09-12T01:40:29.555 INFO:teuthology.orchestra.run.smithi070.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-12T01:40:29.580 INFO:teuthology.orchestra.run.smithi070.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T01:40:29.657 INFO:teuthology.orchestra.run.smithi191.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 656 kB/s | 191 kB 00:00 2024-09-12T01:40:29.707 INFO:teuthology.orchestra.run.smithi191.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 990 kB/s | 801 kB 00:00 2024-09-12T01:40:29.857 INFO:teuthology.orchestra.run.smithi191.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-12T01:40:29.938 INFO:teuthology.orchestra.run.smithi070.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-12T01:40:29.974 INFO:teuthology.orchestra.run.smithi191.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 915 kB/s | 106 kB 00:00 2024-09-12T01:40:30.008 INFO:teuthology.orchestra.run.smithi191.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 4.1 MB/s | 1.2 MB 00:00 2024-09-12T01:40:30.091 INFO:teuthology.orchestra.run.smithi191.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-12T01:40:30.117 INFO:teuthology.orchestra.run.smithi191.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-12T01:40:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 4.4 MB 00:02 2024-09-12T01:40:30.380 INFO:teuthology.orchestra.run.smithi070.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.6 MB/s | 1.6 MB 00:00 2024-09-12T01:40:30.545 INFO:teuthology.orchestra.run.smithi152.stdout:(71/156): postgresql-server-13.16-1.el9.x86_64. 2.8 MB/s | 5.8 MB 00:02 2024-09-12T01:40:30.642 INFO:teuthology.orchestra.run.smithi191.stdout:(47/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 14 MB/s | 49 MB 00:03 2024-09-12T01:40:30.656 INFO:teuthology.orchestra.run.smithi070.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.2 MB/s | 910 kB 00:00 2024-09-12T01:40:30.667 INFO:teuthology.orchestra.run.smithi191.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 373 kB/s | 215 kB 00:00 2024-09-12T01:40:30.722 INFO:teuthology.orchestra.run.smithi070.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T01:40:30.744 INFO:teuthology.orchestra.run.smithi152.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 438 kB/s | 87 kB 00:00 2024-09-12T01:40:30.778 INFO:teuthology.orchestra.run.smithi152.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.1 MB/s | 1.0 MB 00:00 2024-09-12T01:40:30.809 INFO:teuthology.orchestra.run.smithi191.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 756 kB/s | 107 kB 00:00 2024-09-12T01:40:30.831 INFO:teuthology.orchestra.run.smithi070.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.9 MB/s | 4.9 MB 00:01 2024-09-12T01:40:30.868 INFO:teuthology.orchestra.run.smithi191.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-12T01:40:30.887 INFO:teuthology.orchestra.run.smithi152.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-12T01:40:30.893 INFO:teuthology.orchestra.run.smithi191.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-12T01:40:30.915 INFO:teuthology.orchestra.run.smithi070.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2024-09-12T01:40:30.918 INFO:teuthology.orchestra.run.smithi191.stdout:(52/156): automake-1.16.2-8.el9.noarch.rpm 860 kB/s | 689 kB 00:00 2024-09-12T01:40:30.943 INFO:teuthology.orchestra.run.smithi191.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-12T01:40:30.969 INFO:teuthology.orchestra.run.smithi191.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-12T01:40:30.973 INFO:teuthology.orchestra.run.smithi070.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T01:40:30.995 INFO:teuthology.orchestra.run.smithi191.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 358 kB/s | 18 kB 00:00 2024-09-12T01:40:31.003 INFO:teuthology.orchestra.run.smithi152.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-12T01:40:31.012 INFO:teuthology.orchestra.run.smithi191.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 262 kB/s | 11 kB 00:00 2024-09-12T01:40:31.037 INFO:teuthology.orchestra.run.smithi191.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-12T01:40:31.062 INFO:teuthology.orchestra.run.smithi191.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-12T01:40:31.096 INFO:teuthology.orchestra.run.smithi191.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-12T01:40:31.120 INFO:teuthology.orchestra.run.smithi152.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-12T01:40:31.129 INFO:teuthology.orchestra.run.smithi191.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 738 kB/s | 24 kB 00:00 2024-09-12T01:40:31.163 INFO:teuthology.orchestra.run.smithi191.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-12T01:40:31.182 INFO:teuthology.orchestra.run.smithi070.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.9 MB/s | 1.0 MB 00:00 2024-09-12T01:40:31.188 INFO:teuthology.orchestra.run.smithi191.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-12T01:40:31.213 INFO:teuthology.orchestra.run.smithi191.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T01:40:31.221 INFO:teuthology.orchestra.run.smithi152.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-09-12T01:40:31.224 INFO:teuthology.orchestra.run.smithi070.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-12T01:40:31.239 INFO:teuthology.orchestra.run.smithi191.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T01:40:31.256 INFO:teuthology.orchestra.run.smithi191.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 919 kB/s | 38 kB 00:00 2024-09-12T01:40:31.316 INFO:teuthology.orchestra.run.smithi070.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-12T01:40:31.321 INFO:teuthology.orchestra.run.smithi152.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 192 kB/s | 19 kB 00:00 2024-09-12T01:40:31.400 INFO:teuthology.orchestra.run.smithi070.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-12T01:40:31.414 INFO:teuthology.orchestra.run.smithi191.stdout:(66/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-12T01:40:31.433 INFO:teuthology.orchestra.run.smithi070.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 771 kB/s | 26 kB 00:00 2024-09-12T01:40:31.438 INFO:teuthology.orchestra.run.smithi152.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-12T01:40:31.467 INFO:teuthology.orchestra.run.smithi070.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 575 kB/s | 19 kB 00:00 2024-09-12T01:40:31.481 INFO:teuthology.orchestra.run.smithi191.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-12T01:40:31.538 INFO:teuthology.orchestra.run.smithi152.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 348 kB/s | 35 kB 00:00 2024-09-12T01:40:31.542 INFO:teuthology.orchestra.run.smithi070.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-12T01:40:31.548 INFO:teuthology.orchestra.run.smithi191.stdout:(68/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.7 MB/s | 3.0 MB 00:00 2024-09-12T01:40:31.582 INFO:teuthology.orchestra.run.smithi191.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-12T01:40:31.583 INFO:teuthology.orchestra.run.smithi070.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 834 kB/s | 35 kB 00:00 2024-09-12T01:40:31.624 INFO:teuthology.orchestra.run.smithi191.stdout:(70/156): postgresql-13.16-1.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-09-12T01:40:31.657 INFO:teuthology.orchestra.run.smithi191.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-12T01:40:31.700 INFO:teuthology.orchestra.run.smithi191.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-12T01:40:31.716 INFO:teuthology.orchestra.run.smithi191.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T01:40:31.817 INFO:teuthology.orchestra.run.smithi191.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-12T01:40:31.842 INFO:teuthology.orchestra.run.smithi191.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 489 kB/s | 61 kB 00:00 2024-09-12T01:40:31.867 INFO:teuthology.orchestra.run.smithi191.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-12T01:40:31.959 INFO:teuthology.orchestra.run.smithi191.stdout:(77/156): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 6.0 MB 00:00 2024-09-12T01:40:31.984 INFO:teuthology.orchestra.run.smithi191.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-12T01:40:32.009 INFO:teuthology.orchestra.run.smithi191.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-12T01:40:32.035 INFO:teuthology.orchestra.run.smithi191.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-09-12T01:40:32.060 INFO:teuthology.orchestra.run.smithi191.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-12T01:40:32.085 INFO:teuthology.orchestra.run.smithi191.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-12T01:40:32.113 INFO:teuthology.orchestra.run.smithi191.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-12T01:40:32.136 INFO:teuthology.orchestra.run.smithi191.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-12T01:40:32.161 INFO:teuthology.orchestra.run.smithi191.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T01:40:32.186 INFO:teuthology.orchestra.run.smithi191.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-12T01:40:32.212 INFO:teuthology.orchestra.run.smithi191.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-12T01:40:32.237 INFO:teuthology.orchestra.run.smithi191.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T01:40:32.262 INFO:teuthology.orchestra.run.smithi191.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T01:40:32.284 INFO:teuthology.orchestra.run.smithi070.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 3.7 MB/s | 5.8 MB 00:01 2024-09-12T01:40:32.287 INFO:teuthology.orchestra.run.smithi191.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T01:40:32.313 INFO:teuthology.orchestra.run.smithi191.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T01:40:32.355 INFO:teuthology.orchestra.run.smithi191.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-12T01:40:32.384 INFO:teuthology.orchestra.run.smithi070.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-09-12T01:40:32.397 INFO:teuthology.orchestra.run.smithi191.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-12T01:40:32.447 INFO:teuthology.orchestra.run.smithi191.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T01:40:32.468 INFO:teuthology.orchestra.run.smithi070.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-12T01:40:32.472 INFO:teuthology.orchestra.run.smithi152.stdout:(81/156): openblas-openmp-0.3.26-2.el9.x86_64.r 1.1 MB/s | 4.9 MB 00:04 2024-09-12T01:40:32.489 INFO:teuthology.orchestra.run.smithi191.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 864 kB/s | 36 kB 00:00 2024-09-12T01:40:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:(84/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.8 MB/s | 6.0 MB 00:01 2024-09-12T01:40:32.584 INFO:teuthology.orchestra.run.smithi070.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 663 kB/s | 77 kB 00:00 2024-09-12T01:40:32.610 INFO:teuthology.orchestra.run.smithi070.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-09-12T01:40:32.656 INFO:teuthology.orchestra.run.smithi191.stdout:(96/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-09-12T01:40:32.681 INFO:teuthology.orchestra.run.smithi191.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 247 kB/s | 47 kB 00:00 2024-09-12T01:40:32.686 INFO:teuthology.orchestra.run.smithi070.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-12T01:40:32.706 INFO:teuthology.orchestra.run.smithi191.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-12T01:40:32.711 INFO:teuthology.orchestra.run.smithi070.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-12T01:40:32.731 INFO:teuthology.orchestra.run.smithi191.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T01:40:32.753 INFO:teuthology.orchestra.run.smithi070.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-12T01:40:32.757 INFO:teuthology.orchestra.run.smithi191.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T01:40:32.782 INFO:teuthology.orchestra.run.smithi191.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T01:40:32.786 INFO:teuthology.orchestra.run.smithi070.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-12T01:40:32.807 INFO:teuthology.orchestra.run.smithi191.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-12T01:40:32.811 INFO:teuthology.orchestra.run.smithi070.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 914 kB/s | 54 kB 00:00 2024-09-12T01:40:32.854 INFO:teuthology.orchestra.run.smithi070.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 998 kB/s | 42 kB 00:00 2024-09-12T01:40:32.855 INFO:teuthology.orchestra.run.smithi152.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 654 kB/s | 250 kB 00:00 2024-09-12T01:40:32.883 INFO:teuthology.orchestra.run.smithi191.stdout:(103/156): python3-numpy-1.20.1-5.el9.x86_64.rp 6.0 MB/s | 5.1 MB 00:00 2024-09-12T01:40:32.904 INFO:teuthology.orchestra.run.smithi070.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-09-12T01:40:32.933 INFO:teuthology.orchestra.run.smithi191.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T01:40:32.958 INFO:teuthology.orchestra.run.smithi191.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 127 kB/s | 22 kB 00:00 2024-09-12T01:40:32.988 INFO:teuthology.orchestra.run.smithi070.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-12T01:40:32.992 INFO:teuthology.orchestra.run.smithi191.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 5.2 MB/s | 309 kB 00:00 2024-09-12T01:40:33.009 INFO:teuthology.orchestra.run.smithi191.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-09-12T01:40:33.026 INFO:teuthology.orchestra.run.smithi191.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-12T01:40:33.029 INFO:teuthology.orchestra.run.smithi070.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 866 kB/s | 36 kB 00:00 2024-09-12T01:40:33.051 INFO:teuthology.orchestra.run.smithi191.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T01:40:33.076 INFO:teuthology.orchestra.run.smithi191.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-12T01:40:33.080 INFO:teuthology.orchestra.run.smithi070.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T01:40:33.101 INFO:teuthology.orchestra.run.smithi191.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-12T01:40:33.185 INFO:teuthology.orchestra.run.smithi191.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-12T01:40:33.205 INFO:teuthology.orchestra.run.smithi070.stdout:(97/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.1 MB/s | 5.1 MB 00:01 2024-09-12T01:40:33.210 INFO:teuthology.orchestra.run.smithi191.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-12T01:40:33.222 INFO:teuthology.orchestra.run.smithi152.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 606 kB/s | 222 kB 00:00 2024-09-12T01:40:33.231 INFO:teuthology.orchestra.run.smithi070.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-12T01:40:33.236 INFO:teuthology.orchestra.run.smithi191.stdout:(114/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-12T01:40:33.256 INFO:teuthology.orchestra.run.smithi070.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T01:40:33.261 INFO:teuthology.orchestra.run.smithi191.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 864 kB/s | 43 kB 00:00 2024-09-12T01:40:33.289 INFO:teuthology.orchestra.run.smithi152.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.9 MB/s | 5.1 MB 00:01 2024-09-12T01:40:33.294 INFO:teuthology.orchestra.run.smithi191.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 553 kB/s | 14 kB 00:00 2024-09-12T01:40:33.298 INFO:teuthology.orchestra.run.smithi070.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-12T01:40:33.320 INFO:teuthology.orchestra.run.smithi191.stdout:(117/156): python3-cachetools-4.2.4-1.el9.noarc 384 kB/s | 32 kB 00:00 2024-09-12T01:40:33.341 INFO:teuthology.orchestra.run.smithi070.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 762 kB/s | 64 kB 00:00 2024-09-12T01:40:33.345 INFO:teuthology.orchestra.run.smithi191.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.5 MB/s | 172 kB 00:00 2024-09-12T01:40:33.365 INFO:teuthology.orchestra.run.smithi070.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-12T01:40:33.370 INFO:teuthology.orchestra.run.smithi191.stdout:(119/156): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-09-12T01:40:33.397 INFO:teuthology.orchestra.run.smithi152.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-09-12T01:40:33.404 INFO:teuthology.orchestra.run.smithi191.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T01:40:33.423 INFO:teuthology.orchestra.run.smithi152.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 385 kB/s | 77 kB 00:00 2024-09-12T01:40:33.429 INFO:teuthology.orchestra.run.smithi191.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T01:40:33.454 INFO:teuthology.orchestra.run.smithi191.stdout:(122/156): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-09-12T01:40:33.480 INFO:teuthology.orchestra.run.smithi191.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-12T01:40:33.505 INFO:teuthology.orchestra.run.smithi191.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T01:40:33.530 INFO:teuthology.orchestra.run.smithi191.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-12T01:40:33.556 INFO:teuthology.orchestra.run.smithi191.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-12T01:40:33.573 INFO:teuthology.orchestra.run.smithi152.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-12T01:40:33.580 INFO:teuthology.orchestra.run.smithi191.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-12T01:40:33.606 INFO:teuthology.orchestra.run.smithi191.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T01:40:33.631 INFO:teuthology.orchestra.run.smithi191.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:40:33.657 INFO:teuthology.orchestra.run.smithi070.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 70 kB/s | 22 kB 00:00 2024-09-12T01:40:33.665 INFO:teuthology.orchestra.run.smithi191.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-12T01:40:33.690 INFO:teuthology.orchestra.run.smithi152.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-12T01:40:33.698 INFO:teuthology.orchestra.run.smithi191.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-12T01:40:33.707 INFO:teuthology.orchestra.run.smithi070.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T01:40:33.724 INFO:teuthology.orchestra.run.smithi191.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 988 kB/s | 58 kB 00:00 2024-09-12T01:40:33.741 INFO:teuthology.orchestra.run.smithi070.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-12T01:40:33.749 INFO:teuthology.orchestra.run.smithi191.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-12T01:40:33.766 INFO:teuthology.orchestra.run.smithi070.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-12T01:40:33.766 INFO:teuthology.orchestra.run.smithi191.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 5.2 MB/s | 90 kB 00:00 2024-09-12T01:40:33.791 INFO:teuthology.orchestra.run.smithi191.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-12T01:40:33.799 INFO:teuthology.orchestra.run.smithi152.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-12T01:40:33.808 INFO:teuthology.orchestra.run.smithi191.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 677 kB/s | 28 kB 00:00 2024-09-12T01:40:33.825 INFO:teuthology.orchestra.run.smithi191.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 917 kB/s | 31 kB 00:00 2024-09-12T01:40:33.851 INFO:teuthology.orchestra.run.smithi191.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T01:40:33.876 INFO:teuthology.orchestra.run.smithi191.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-09-12T01:40:33.883 INFO:teuthology.orchestra.run.smithi070.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-12T01:40:33.891 INFO:teuthology.orchestra.run.smithi152.stdout:(90/156): python3-protobuf-3.14.0-13.el9.noarch 546 kB/s | 269 kB 00:00 2024-09-12T01:40:33.901 INFO:teuthology.orchestra.run.smithi191.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-12T01:40:33.909 INFO:teuthology.orchestra.run.smithi070.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T01:40:33.916 INFO:teuthology.orchestra.run.smithi152.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 459 kB/s | 54 kB 00:00 2024-09-12T01:40:33.926 INFO:teuthology.orchestra.run.smithi191.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T01:40:33.934 INFO:teuthology.orchestra.run.smithi070.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T01:40:33.951 INFO:teuthology.orchestra.run.smithi070.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 3.9 MB/s | 67 kB 00:00 2024-09-12T01:40:33.968 INFO:teuthology.orchestra.run.smithi191.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-12T01:40:33.976 INFO:teuthology.orchestra.run.smithi070.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T01:40:33.985 INFO:teuthology.orchestra.run.smithi191.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-12T01:40:34.010 INFO:teuthology.orchestra.run.smithi070.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-12T01:40:34.010 INFO:teuthology.orchestra.run.smithi191.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-12T01:40:34.024 INFO:teuthology.orchestra.run.smithi152.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-09-12T01:40:34.036 INFO:teuthology.orchestra.run.smithi191.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T01:40:34.043 INFO:teuthology.orchestra.run.smithi070.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T01:40:34.061 INFO:teuthology.orchestra.run.smithi191.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T01:40:34.068 INFO:teuthology.orchestra.run.smithi070.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T01:40:34.094 INFO:teuthology.orchestra.run.smithi070.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T01:40:34.095 INFO:teuthology.orchestra.run.smithi191.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T01:40:34.119 INFO:teuthology.orchestra.run.smithi070.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 561 kB/s | 14 kB 00:00 2024-09-12T01:40:34.133 INFO:teuthology.orchestra.run.smithi152.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-12T01:40:34.144 INFO:teuthology.orchestra.run.smithi070.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-12T01:40:34.145 INFO:teuthology.orchestra.run.smithi191.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T01:40:34.178 INFO:teuthology.orchestra.run.smithi070.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-12T01:40:34.203 INFO:teuthology.orchestra.run.smithi070.stdout:(119/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-09-12T01:40:34.237 INFO:teuthology.orchestra.run.smithi070.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-12T01:40:34.250 INFO:teuthology.orchestra.run.smithi152.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-12T01:40:34.279 INFO:teuthology.orchestra.run.smithi070.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-12T01:40:34.330 INFO:teuthology.orchestra.run.smithi070.stdout:(122/156): python3-grpcio-1.46.7-10.el9.x86_64. 23 MB/s | 2.0 MB 00:00 2024-09-12T01:40:34.345 INFO:teuthology.orchestra.run.smithi191.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T01:40:34.355 INFO:teuthology.orchestra.run.smithi070.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-12T01:40:34.358 INFO:teuthology.orchestra.run.smithi152.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 332 kB/s | 36 kB 00:00 2024-09-12T01:40:34.380 INFO:teuthology.orchestra.run.smithi070.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T01:40:34.395 INFO:teuthology.orchestra.run.smithi191.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-12T01:40:34.405 INFO:teuthology.orchestra.run.smithi070.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-12T01:40:34.431 INFO:teuthology.orchestra.run.smithi070.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-12T01:40:34.456 INFO:teuthology.orchestra.run.smithi070.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-12T01:40:34.467 INFO:teuthology.orchestra.run.smithi152.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-12T01:40:34.481 INFO:teuthology.orchestra.run.smithi070.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-12T01:40:34.506 INFO:teuthology.orchestra.run.smithi070.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:40:34.524 INFO:teuthology.orchestra.run.smithi070.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 4.6 MB/s | 79 kB 00:00 2024-09-12T01:40:34.540 INFO:teuthology.orchestra.run.smithi070.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-12T01:40:34.574 INFO:teuthology.orchestra.run.smithi070.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-12T01:40:34.584 INFO:teuthology.orchestra.run.smithi152.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.6 MB/s | 304 kB 00:00 2024-09-12T01:40:34.599 INFO:teuthology.orchestra.run.smithi070.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-12T01:40:34.616 INFO:teuthology.orchestra.run.smithi070.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 389 kB/s | 16 kB 00:00 2024-09-12T01:40:34.642 INFO:teuthology.orchestra.run.smithi070.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-12T01:40:34.667 INFO:teuthology.orchestra.run.smithi070.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-12T01:40:34.679 INFO:teuthology.orchestra.run.smithi191.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 144 kB/s | 41 kB 00:00 2024-09-12T01:40:34.692 INFO:teuthology.orchestra.run.smithi070.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T01:40:34.693 INFO:teuthology.orchestra.run.smithi152.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-09-12T01:40:34.717 INFO:teuthology.orchestra.run.smithi070.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-12T01:40:34.743 INFO:teuthology.orchestra.run.smithi070.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-12T01:40:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T01:40:34.793 INFO:teuthology.orchestra.run.smithi070.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T01:40:34.801 INFO:teuthology.orchestra.run.smithi152.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 883 kB/s | 96 kB 00:00 2024-09-12T01:40:34.827 INFO:teuthology.orchestra.run.smithi070.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-12T01:40:34.852 INFO:teuthology.orchestra.run.smithi070.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-12T01:40:34.877 INFO:teuthology.orchestra.run.smithi070.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-12T01:40:34.903 INFO:teuthology.orchestra.run.smithi070.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-12T01:40:34.918 INFO:teuthology.orchestra.run.smithi152.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 546 kB/s | 64 kB 00:00 2024-09-12T01:40:34.928 INFO:teuthology.orchestra.run.smithi070.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T01:40:34.978 INFO:teuthology.orchestra.run.smithi070.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-12T01:40:35.035 INFO:teuthology.orchestra.run.smithi152.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 384 kB/s | 45 kB 00:00 2024-09-12T01:40:35.063 INFO:teuthology.orchestra.run.smithi191.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 649 kB/s | 249 kB 00:00 2024-09-12T01:40:35.113 INFO:teuthology.orchestra.run.smithi191.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 2.4 MB/s | 2.3 MB 00:00 2024-09-12T01:40:35.127 INFO:teuthology.orchestra.run.smithi152.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 244 kB/s | 22 kB 00:00 2024-09-12T01:40:35.237 INFO:teuthology.orchestra.run.smithi070.stdout:(148/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-12T01:40:35.294 INFO:teuthology.orchestra.run.smithi152.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 5.1 MB/s | 863 kB 00:00 2024-09-12T01:40:35.344 INFO:teuthology.orchestra.run.smithi152.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T01:40:35.355 INFO:teuthology.orchestra.run.smithi191.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.9 MB/s | 2.4 MB 00:00 2024-09-12T01:40:35.370 INFO:teuthology.orchestra.run.smithi152.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-12T01:40:35.395 INFO:teuthology.orchestra.run.smithi152.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-12T01:40:35.438 INFO:teuthology.orchestra.run.smithi191.stdout:(155/156): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-12T01:40:35.460 INFO:teuthology.orchestra.run.smithi070.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.4 MB/s | 3.4 MB 00:00 2024-09-12T01:40:35.520 INFO:teuthology.orchestra.run.smithi152.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-12T01:40:35.545 INFO:teuthology.orchestra.run.smithi152.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T01:40:35.571 INFO:teuthology.orchestra.run.smithi152.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T01:40:35.596 INFO:teuthology.orchestra.run.smithi152.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T01:40:35.597 INFO:teuthology.orchestra.run.smithi191.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 2.5 MB/s | 1.4 MB 00:00 2024-09-12T01:40:35.604 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:40:35.604 INFO:teuthology.orchestra.run.smithi191.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-12T01:40:35.621 INFO:teuthology.orchestra.run.smithi152.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T01:40:35.663 INFO:teuthology.orchestra.run.smithi152.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-12T01:40:35.696 INFO:teuthology.orchestra.run.smithi152.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T01:40:35.722 INFO:teuthology.orchestra.run.smithi152.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T01:40:35.729 INFO:teuthology.orchestra.run.smithi070.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 4.7 MB/s | 2.3 MB 00:00 2024-09-12T01:40:35.747 INFO:teuthology.orchestra.run.smithi152.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T01:40:35.772 INFO:teuthology.orchestra.run.smithi152.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-12T01:40:35.797 INFO:teuthology.orchestra.run.smithi152.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-12T01:40:35.813 INFO:teuthology.orchestra.run.smithi070.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 489 kB/s | 41 kB 00:00 2024-09-12T01:40:35.831 INFO:teuthology.orchestra.run.smithi152.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-12T01:40:35.865 INFO:teuthology.orchestra.run.smithi152.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-12T01:40:35.890 INFO:teuthology.orchestra.run.smithi152.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-12T01:40:35.897 INFO:teuthology.orchestra.run.smithi070.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 2.9 MB/s | 249 kB 00:00 2024-09-12T01:40:35.957 INFO:teuthology.orchestra.run.smithi152.stdout:(121/156): python3-grpcio-1.46.7-10.el9.x86_64. 31 MB/s | 2.0 MB 00:00 2024-09-12T01:40:35.974 INFO:teuthology.orchestra.run.smithi152.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 8.5 MB/s | 144 kB 00:00 2024-09-12T01:40:35.999 INFO:teuthology.orchestra.run.smithi152.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-12T01:40:36.022 INFO:teuthology.orchestra.run.smithi070.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 3.2 MB/s | 1.8 MB 00:00 2024-09-12T01:40:36.024 INFO:teuthology.orchestra.run.smithi152.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-12T01:40:36.050 INFO:teuthology.orchestra.run.smithi152.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 924 kB/s | 23 kB 00:00 2024-09-12T01:40:36.075 INFO:teuthology.orchestra.run.smithi152.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-12T01:40:36.100 INFO:teuthology.orchestra.run.smithi152.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-09-12T01:40:36.142 INFO:teuthology.orchestra.run.smithi152.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 24 MB/s | 1.0 MB 00:00 2024-09-12T01:40:36.156 INFO:teuthology.orchestra.run.smithi070.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 5.2 MB/s | 1.4 MB 00:00 2024-09-12T01:40:36.167 INFO:teuthology.orchestra.run.smithi152.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:40:36.185 INFO:teuthology.orchestra.run.smithi152.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 4.6 MB/s | 79 kB 00:00 2024-09-12T01:40:36.210 INFO:teuthology.orchestra.run.smithi152.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T01:40:36.235 INFO:teuthology.orchestra.run.smithi152.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-12T01:40:36.268 INFO:teuthology.orchestra.run.smithi152.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 494 kB/s | 16 kB 00:00 2024-09-12T01:40:36.294 INFO:teuthology.orchestra.run.smithi152.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T01:40:36.314 INFO:teuthology.orchestra.run.smithi070.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.2 MB/s | 2.4 MB 00:00 2024-09-12T01:40:36.319 INFO:teuthology.orchestra.run.smithi152.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T01:40:36.344 INFO:teuthology.orchestra.run.smithi152.stdout:(136/156): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T01:40:36.378 INFO:teuthology.orchestra.run.smithi152.stdout:(137/156): python3-routes-2.5.1-5.el9.noarch.rp 5.5 MB/s | 188 kB 00:00 2024-09-12T01:40:36.405 INFO:teuthology.orchestra.run.smithi152.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T01:40:36.429 INFO:teuthology.orchestra.run.smithi152.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-12T01:40:36.454 INFO:teuthology.orchestra.run.smithi152.stdout:(140/156): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-12T01:40:36.479 INFO:teuthology.orchestra.run.smithi152.stdout:(141/156): python3-webob-1.8.8-2.el9.noarch.rpm 9.0 MB/s | 230 kB 00:00 2024-09-12T01:40:36.504 INFO:teuthology.orchestra.run.smithi152.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T01:40:36.538 INFO:teuthology.orchestra.run.smithi152.stdout:(143/156): python3-werkzeug-2.0.3-3.el9.1.noarc 13 MB/s | 427 kB 00:00 2024-09-12T01:40:36.555 INFO:teuthology.orchestra.run.smithi152.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-12T01:40:36.580 INFO:teuthology.orchestra.run.smithi152.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-12T01:40:36.630 INFO:teuthology.orchestra.run.smithi152.stdout:(146/156): thrift-0.15.0-2.el9.x86_64.rpm 32 MB/s | 1.6 MB 00:00 2024-09-12T01:40:36.841 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-09-12T01:40:36.948 INFO:teuthology.orchestra.run.smithi070.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-12T01:40:36.952 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:40:36.952 INFO:teuthology.orchestra.run.smithi070.stdout:Total 15 MB/s | 226 MB 00:14 2024-09-12T01:40:36.991 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-09-12T01:40:36.992 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-09-12T01:40:37.156 INFO:teuthology.orchestra.run.smithi152.stdout:(147/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.5 MB/s | 3.4 MB 00:00 2024-09-12T01:40:37.472 INFO:teuthology.orchestra.run.smithi152.stdout:(148/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-12T01:40:37.589 INFO:teuthology.orchestra.run.smithi152.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 20 MB/s | 2.3 MB 00:00 2024-09-12T01:40:37.665 INFO:teuthology.orchestra.run.smithi152.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 24 MB/s | 1.8 MB 00:00 2024-09-12T01:40:37.707 INFO:teuthology.orchestra.run.smithi152.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 976 kB/s | 41 kB 00:00 2024-09-12T01:40:37.757 INFO:teuthology.orchestra.run.smithi152.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-12T01:40:37.824 INFO:teuthology.orchestra.run.smithi152.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-12T01:40:37.899 INFO:teuthology.orchestra.run.smithi152.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-12T01:40:38.189 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-12T01:40:38.342 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-12T01:40:38.342 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-12T01:40:38.797 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-09-12T01:40:38.798 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-09-12T01:40:40.621 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-12T01:40:40.622 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-12T01:40:41.274 INFO:teuthology.orchestra.run.smithi152.stdout:(155/156): python3-babel-2.9.1-2.el9.noarch.rpm 580 kB/s | 6.0 MB 00:10 2024-09-12T01:40:45.097 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-09-12T01:40:45.208 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:40:45.278 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:40:45.333 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:40:45.368 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:40:45.393 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:40:45.444 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:40:45.776 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:40:45.902 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:40:46.025 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:40:46.062 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:40:46.144 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:40:46.174 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:40:46.325 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:40:46.379 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:40:46.408 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:40:46.510 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:40:46.534 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:40:46.596 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:40:46.618 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:40:46.644 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:40:46.844 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:40:46.902 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-12T01:40:46.970 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:40:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:40:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:40:47.083 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:40:47.128 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:40:47.162 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:40:47.181 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:40:47.197 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:40:47.245 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:40:47.251 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:40:47.464 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:40:47.577 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:40:47.669 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:40:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:40:47.697 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:40:47.741 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:40:47.789 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:40:47.814 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:40:47.858 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:40:47.890 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:40:47.912 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:40:47.933 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:40:47.940 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:40:47.974 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:40:48.002 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:40:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:40:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:40:48.071 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:40:48.125 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:40:48.155 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:40:48.173 INFO:teuthology.orchestra.run.smithi152.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.1 MB/s | 16 MB 00:14 2024-09-12T01:40:48.178 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:40:48.179 INFO:teuthology.orchestra.run.smithi152.stdout:Total 8.1 MB/s | 226 MB 00:27 2024-09-12T01:40:48.233 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:40:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:40:48.291 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:40:48.424 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:40:48.462 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:40:48.470 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:40:48.509 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:40:48.538 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:40:48.561 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:40:48.568 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:40:48.611 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:40:48.643 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:40:48.714 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:40:48.748 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:40:48.758 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:40:48.833 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:40:48.920 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:40:48.965 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:40:49.019 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:40:49.053 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:40:49.168 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:40:49.221 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:40:49.421 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-12T01:40:49.457 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:40:49.544 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:40:49.565 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:40:49.572 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-12T01:40:49.572 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-12T01:40:49.623 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:40:49.652 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:40:49.658 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:40:49.698 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:40:49.704 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:40:49.735 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:40:49.744 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:40:49.776 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:40:49.808 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:40:49.853 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:40:49.886 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:40:49.929 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:40:49.950 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:40:49.966 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:40:49.996 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:40:49.998 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:40:50.051 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:40:50.066 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:40:50.120 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:40:50.123 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:40:50.155 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:40:50.159 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:40:50.191 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:40:50.204 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:40:50.237 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:40:50.273 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:40:50.278 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:40:50.313 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:40:50.316 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:40:50.357 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:40:50.358 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:40:50.385 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:40:50.454 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:40:50.493 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:40:50.500 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:40:50.545 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:40:50.576 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:40:50.586 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:40:50.689 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:40:50.715 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:40:50.728 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:40:50.768 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:40:50.769 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:40:50.793 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:40:50.818 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:40:50.884 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:40:51.012 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:40:51.050 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:40:51.078 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:40:51.113 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:40:51.152 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:40:51.183 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:40:51.213 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:40:51.293 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:40:51.348 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:40:51.375 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-12T01:40:51.375 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-12T01:40:51.381 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:40:51.419 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:40:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:40:51.525 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:40:51.567 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:40:51.581 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:40:51.727 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:40:51.766 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:40:51.799 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:40:51.803 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:40:51.858 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:40:51.882 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:40:51.929 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:40:51.939 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:40:51.960 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:40:51.970 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:40:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:40:52.053 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:40:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:40:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:40:52.119 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:40:52.132 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:40:52.174 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:40:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:40:52.359 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:40:52.400 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:40:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:40:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:40:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:40:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:40:52.633 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:40:52.725 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:40:52.842 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:40:52.851 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:40:52.891 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:40:52.926 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:40:53.024 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:40:53.049 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:40:53.080 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:40:53.086 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:40:53.119 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:40:53.125 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:40:53.154 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:40:53.203 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:40:53.212 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:40:53.232 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:40:53.252 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:40:53.266 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:40:53.300 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:40:53.342 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:40:53.376 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:40:53.438 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:40:53.463 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:40:53.467 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:40:53.507 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:40:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:40:53.546 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:40:53.648 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:40:53.697 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:40:54.188 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:40:54.299 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:40:54.414 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:40:54.461 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:40:54.495 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:40:54.593 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:40:54.658 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:40:54.703 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:40:54.790 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:40:54.822 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:40:54.998 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:40:55.229 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:40:55.229 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:40:55.513 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:40:55.604 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:40:55.632 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:40:55.664 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:40:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:40:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:40:55.975 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:40:56.011 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:40:56.086 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:40:56.116 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:40:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:40:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:40:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:40:56.760 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:40:56.790 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:40:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:40:57.186 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:40:57.214 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:40:57.247 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:40:57.565 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:40:57.610 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:40:57.623 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-12T01:40:57.701 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:40:57.732 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:40:57.735 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:40:57.768 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:40:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:40:57.826 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:40:57.869 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:40:57.895 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:40:57.937 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:40:58.247 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:40:58.271 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:40:58.319 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:40:58.342 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:40:58.373 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:40:58.379 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:40:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:40:58.538 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:40:58.614 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:40:58.651 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:40:58.806 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:40:58.865 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:40:58.892 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:40:58.989 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:40:59.018 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:40:59.081 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:40:59.110 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:40:59.120 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:40:59.135 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:40:59.154 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:40:59.320 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:40:59.470 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:40:59.575 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:40:59.677 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:40:59.697 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:40:59.733 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:40:59.751 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:40:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:40:59.828 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:40:59.828 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:40:59.828 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:40:59.859 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:40:59.960 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:41:00.064 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:41:00.160 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:41:00.189 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:41:00.232 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:41:00.306 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:41:00.350 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:41:00.390 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:41:00.434 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:41:00.466 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:41:00.497 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:41:00.566 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:41:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:41:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:41:00.685 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:41:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:41:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:41:00.761 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:41:00.804 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:41:00.839 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:41:00.868 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:41:00.937 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:41:00.982 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:41:01.057 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:41:01.209 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:41:01.259 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:41:01.286 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:41:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:41:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:41:01.426 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:41:01.426 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:41:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:01.458 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:41:01.798 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:41:01.880 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:41:01.909 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:41:01.951 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:41:01.990 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:41:02.055 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:41:02.206 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:41:02.251 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:41:02.305 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:41:02.378 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:41:02.410 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:41:02.446 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:41:02.501 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:41:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:41:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:41:02.622 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:41:02.758 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:41:02.807 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:41:02.848 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:41:02.951 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:41:02.981 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:41:03.021 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:41:03.055 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:41:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:41:03.154 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:41:03.281 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:41:03.312 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:41:03.340 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:41:03.374 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:41:03.413 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:41:03.444 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:41:03.474 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:41:03.509 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:41:03.542 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:41:03.575 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:41:03.609 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:41:03.697 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:41:03.740 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:41:03.787 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:41:03.890 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:41:03.939 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:41:04.683 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:41:04.727 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:41:04.760 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:41:04.861 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:41:04.907 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:41:04.952 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:41:05.039 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:41:05.080 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:41:05.263 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:41:05.294 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:41:05.371 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:41:06.021 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:41:06.142 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:41:07.382 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:41:07.463 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:41:07.491 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:41:07.524 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:41:07.835 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:41:07.869 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:41:07.952 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:41:07.982 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:41:08.019 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:41:08.497 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:41:08.522 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:41:08.577 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:41:08.607 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:41:10.940 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:41:10.987 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:41:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:41:11.573 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:41:11.668 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:41:11.669 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:41:11.669 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:41:11.669 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:11.699 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:41:12.166 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:41:12.167 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2024-09-12T01:41:12.167 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2024-09-12T01:41:12.167 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2024-09-12T01:41:12.167 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2024-09-12T01:41:12.167 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2024-09-12T01:41:12.167 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /root 2024-09-12T01:41:12.167 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2024-09-12T01:41:12.167 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:41:12.345 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:41:12.361 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:41:12.361 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:12.361 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:41:12.361 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:41:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:41:13.102 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-09-12T01:41:13.102 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-09-12T01:41:13.102 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-09-12T01:41:13.102 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-09-12T01:41:13.102 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-09-12T01:41:13.102 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-09-12T01:41:13.102 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-09-12T01:41:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:13.297 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:41:13.313 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:41:13.313 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:13.314 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:41:13.314 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:13.839 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:41:13.866 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:41:13.866 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:13.866 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:41:13.866 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:41:13.867 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:41:13.867 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:41:14.090 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:41:14.113 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:41:14.113 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:14.113 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:41:14.114 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:41:14.114 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:41:14.114 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:41:14.549 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:41:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:41:14.573 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:14.573 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:41:14.573 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:41:14.573 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:41:14.573 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:41:14.695 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:41:14.753 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:41:14.800 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:41:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:41:14.827 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:41:14.827 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:14.827 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:41:14.827 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:41:14.827 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:41:14.827 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:14.996 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:41:15.050 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:41:15.050 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:41:15.074 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:41:15.074 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:15.074 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:41:15.074 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:41:15.074 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:41:15.074 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:15.137 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:41:15.233 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:41:15.374 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:41:15.425 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:41:15.456 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:41:15.484 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:41:15.518 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:41:15.541 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:41:15.542 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:15.542 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:41:15.542 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:41:15.542 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:41:15.542 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:15.648 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:41:15.705 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:41:15.760 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:41:15.901 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:41:15.932 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:41:15.952 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:41:15.964 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:41:16.011 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:41:16.027 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:41:16.064 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:41:16.096 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:41:16.185 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:41:16.317 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:41:16.361 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:41:16.401 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:41:16.429 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:41:16.830 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:41:16.861 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:41:16.892 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:41:16.955 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:41:16.984 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:41:17.106 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:41:17.149 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:41:18.024 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:41:18.080 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:41:18.119 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:41:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:41:18.261 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:41:18.428 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:41:18.451 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:41:18.475 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:41:18.476 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:18.476 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:41:18.476 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:41:18.476 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:41:18.476 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:41:18.527 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:41:18.539 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:41:18.635 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:41:18.693 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:41:19.041 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:41:19.070 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:41:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:41:19.341 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:41:19.372 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:41:19.396 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:41:19.396 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:19.397 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:41:19.397 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:41:19.397 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:41:19.397 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:19.448 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:41:19.460 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:41:19.557 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:41:19.616 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:41:19.631 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:41:19.671 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:41:19.696 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:41:19.696 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:19.696 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:41:19.696 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:41:19.696 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:41:19.697 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:41:19.738 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:41:19.761 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:41:19.761 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:19.761 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:41:19.761 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:41:19.814 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:41:19.837 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:41:19.837 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:19.837 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:41:19.837 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:41:19.837 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:41:19.838 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:41:20.139 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:41:20.163 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:41:20.163 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:20.163 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:41:20.163 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:41:20.163 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:41:20.163 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:41:20.533 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:41:20.567 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:41:20.590 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:41:20.590 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:20.590 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:41:20.591 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:41:20.591 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:41:20.591 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:20.634 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:41:20.657 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:41:20.657 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:20.657 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:41:20.657 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:20.710 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:41:20.733 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:41:20.733 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:20.733 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:41:20.733 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:41:20.734 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:41:20.734 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:21.044 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:41:21.067 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:41:21.068 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:21.068 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:41:21.068 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:41:21.068 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:41:21.068 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:23.578 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:41:23.578 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2024-09-12T01:41:23.578 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2024-09-12T01:41:23.578 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2024-09-12T01:41:23.578 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2024-09-12T01:41:23.578 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2024-09-12T01:41:23.578 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /root 2024-09-12T01:41:23.578 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2024-09-12T01:41:23.578 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:23.749 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:41:23.766 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:41:23.766 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:23.766 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:41:23.766 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:24.718 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:41:24.759 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:41:24.809 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:41:24.849 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:41:24.876 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:41:25.062 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:41:25.106 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:41:25.136 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:41:25.166 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:41:25.212 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:41:25.226 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:41:25.253 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:41:25.254 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:25.254 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:41:25.254 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:41:25.254 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:41:25.254 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:25.486 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:41:25.510 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:41:25.510 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:25.510 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:41:25.510 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:41:25.510 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:41:25.510 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:25.670 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:41:25.714 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:41:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:41:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:41:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:41:25.835 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:41:25.868 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:41:25.889 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:41:25.957 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:41:25.980 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:41:26.018 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:26.018 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:41:26.018 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:41:26.019 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:41:26.019 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:41:26.062 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:41:26.076 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:41:26.092 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:41:26.121 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:41:26.124 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:41:26.168 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:41:26.179 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:41:26.365 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:41:26.413 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:41:26.482 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:41:26.572 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:41:26.710 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:41:26.732 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:41:26.762 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:41:26.794 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:41:26.811 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:41:26.822 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:41:26.822 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:41:26.849 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:41:26.864 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:41:26.869 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:41:26.945 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:41:26.984 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:41:27.010 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:41:27.044 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:41:27.044 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:41:27.128 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:41:27.128 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:41:27.195 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:41:27.220 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:41:27.226 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:41:27.226 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:41:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:41:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:41:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:41:27.405 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:41:27.405 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:41:27.415 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:41:27.444 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:41:27.489 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:41:27.560 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:41:27.709 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:41:27.787 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:41:27.833 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:41:27.919 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:41:27.949 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:41:27.975 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:41:28.009 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:41:28.009 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:41:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:41:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:41:28.168 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:41:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:41:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:41:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:41:28.379 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:41:28.379 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:41:28.463 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:41:28.492 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:41:28.527 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:41:28.529 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:41:29.489 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:41:29.529 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:41:29.631 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:41:29.799 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:41:29.831 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:41:29.855 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:41:29.855 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:29.855 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:41:29.856 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:41:29.856 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:41:29.856 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:29.907 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:41:29.919 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:41:30.016 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:41:30.065 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:41:30.982 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:41:31.017 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:41:31.042 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:41:31.042 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:31.042 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:41:31.042 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:41:31.042 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:41:31.042 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:31.085 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:41:31.108 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:41:31.108 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:31.108 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:41:31.108 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:31.160 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:41:31.184 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:41:31.184 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:31.184 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:41:31.184 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:41:31.185 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:41:31.185 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:31.487 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:41:31.510 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:41:31.511 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:41:31.511 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:41:31.511 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:41:31.511 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:41:31.511 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:33.420 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:41:33.421 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:41:33.421 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:41:33.421 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:41:33.421 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:41:33.421 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:41:33.421 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:41:33.421 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:41:33.421 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:41:33.421 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:41:33.421 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:41:33.421 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:41:33.421 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:41:33.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:41:33.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:41:33.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:41:33.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:41:33.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:41:33.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:41:33.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:41:33.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:41:33.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:41:33.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:41:33.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:41:33.422 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:41:33.423 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:41:33.424 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:41:33.424 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:41:33.424 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:41:33.424 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:41:33.424 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:41:33.424 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:41:33.424 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:41:33.424 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:41:33.424 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:41:33.424 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:41:33.424 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:41:33.424 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:41:33.425 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:41:33.426 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:41:33.427 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:41:33.427 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:41:33.427 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:41:33.427 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:41:33.427 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:41:33.427 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:41:33.427 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:41:33.427 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:41:33.427 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:41:33.427 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:41:33.427 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:41:33.427 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:41:33.428 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:41:33.429 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:41:33.430 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:41:33.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:41:33.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:41:33.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:41:33.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:41:33.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:41:33.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:41:33.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:41:33.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:41:33.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:41:33.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:41:33.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:41:33.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:41:33.432 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:41:33.433 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:41:33.433 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:41:33.433 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:41:33.433 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:41:33.433 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:41:33.433 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:41:33.433 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:41:33.433 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:41:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:41:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:41:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:41:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:41:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:41:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:41:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:41:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:41:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:41:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:41:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:41:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:41:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:41:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:41:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:41:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:41:34.122 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:41:34.123 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:41:34.123 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:41:34.123 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:41:34.123 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:41:34.123 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:41:34.123 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:41:34.123 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:41:34.123 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:41:34.123 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:41:34.123 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:41:34.123 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:41:34.123 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:41:34.124 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:41:34.124 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:41:34.124 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:41:34.124 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:41:34.124 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:41:34.124 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:41:34.124 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:41:34.124 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:41:34.124 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:41:34.124 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:41:34.124 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:41:34.124 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:41:34.125 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:41:34.126 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:41:34.127 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:41:34.128 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:41:34.129 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:41:34.130 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:41:34.131 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:41:34.132 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:41:35.811 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:41:35.811 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:41:35.811 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2024-09-12T01:41:35.811 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:41:35.811 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:41:35.811 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:41:35.811 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:41:35.811 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.811 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.811 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:41:35.812 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:41:35.812 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-09-12T01:41:35.812 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:41:35.812 INFO:teuthology.orchestra.run.smithi191.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:41:35.812 INFO:teuthology.orchestra.run.smithi191.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:41:35.812 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:41:35.812 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.812 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.812 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.812 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.812 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:35.812 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.813 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.813 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.813 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:35.813 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:35.813 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:35.813 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:35.813 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:35.813 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.813 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.813 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:35.813 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.814 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.814 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.814 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:35.814 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:35.814 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.814 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.814 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:35.814 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:41:35.814 INFO:teuthology.orchestra.run.smithi191.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:41:35.814 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:41:35.814 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:41:35.815 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:41:35.815 INFO:teuthology.orchestra.run.smithi191.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:41:35.815 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:41:35.815 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:41:35.815 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:41:35.815 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:41:35.815 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:41:35.815 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.815 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.815 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.815 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:41:35.816 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:41:35.816 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:41:35.816 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:41:35.816 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:41:35.816 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.816 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.816 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:41:35.816 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.816 INFO:teuthology.orchestra.run.smithi191.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:41:35.816 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:41:35.816 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:41:35.817 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:41:35.818 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:41:35.819 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:41:35.819 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:41:35.819 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:41:35.819 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:41:35.819 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:41:35.819 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:41:35.819 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:41:35.819 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:41:35.819 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:41:35.819 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:41:35.819 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:41:35.819 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:41:35.820 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:41:35.821 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:41:35.821 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:41:35.821 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:41:35.821 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:41:35.821 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:41:35.821 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:41:35.821 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:41:35.821 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:41:35.821 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:41:35.821 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:41:35.821 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:41:35.821 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:41:35.822 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:35.823 INFO:teuthology.orchestra.run.smithi191.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:41:35.824 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:41:35.824 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:41:35.824 INFO:teuthology.orchestra.run.smithi191.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:41:35.824 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:41:35.824 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:41:35.824 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:41:35.824 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:41:35.825 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-09-12T01:41:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:41:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:41:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:41:36.179 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:41:36.197 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:41:36.232 DEBUG:teuthology.parallel:result is None 2024-09-12T01:41:36.377 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:41:36.427 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:41:36.457 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:41:36.487 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:41:36.542 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:41:36.815 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:41:36.815 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:36.815 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-09-12T01:41:36.815 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:41:36.815 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:41:36.815 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:41:36.815 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:41:36.815 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.815 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.816 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:41:36.816 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:41:36.816 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-12T01:41:36.816 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:41:36.816 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:41:36.816 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:41:36.816 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:41:36.816 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.816 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.816 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.816 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.817 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:36.817 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.817 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.817 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.817 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:36.817 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:36.817 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:36.817 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:36.817 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:36.817 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.817 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.817 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:36.818 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.818 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.818 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.818 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:36.818 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:36.818 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.818 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.818 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:36.818 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:41:36.818 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:41:36.818 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:41:36.818 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:41:36.819 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:41:36.819 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:41:36.819 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:41:36.819 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:41:36.819 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:41:36.819 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:41:36.819 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:41:36.819 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.819 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.819 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.819 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:41:36.820 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:41:36.820 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:41:36.820 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:41:36.820 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:41:36.820 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.820 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.820 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:41:36.820 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.820 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:41:36.820 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:41:36.820 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:41:36.820 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:41:36.821 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:41:36.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:41:36.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:41:36.822 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:41:36.823 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:41:36.824 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:41:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:41:36.826 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:41:36.827 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.828 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.828 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:36.828 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:41:36.828 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:41:36.828 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:41:36.828 INFO:teuthology.orchestra.run.smithi070.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:41:36.828 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:41:36.828 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:41:36.828 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:41:36.828 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:41:36.828 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-12T01:41:37.157 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:41:37.189 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:41:37.210 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:41:37.266 DEBUG:teuthology.parallel:result is None 2024-09-12T01:41:38.067 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:41:38.151 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:41:38.192 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:41:38.273 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:41:38.313 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:41:38.338 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:41:38.364 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:41:38.364 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:41:38.448 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:41:38.448 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:41:38.532 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:41:38.557 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:41:38.562 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:41:38.562 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:41:38.750 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:41:38.751 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:41:38.834 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:41:38.897 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:41:44.578 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:41:44.578 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:41:44.578 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:41:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:41:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:41:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:41:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:41:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:41:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:41:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:41:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:41:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:41:44.579 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:41:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:41:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:41:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:41:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:41:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:41:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:41:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:41:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:41:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:41:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:41:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:41:44.580 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:41:44.581 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:41:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:41:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:41:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:41:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:41:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:41:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:41:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:41:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:41:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:41:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:41:44.582 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:41:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:41:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:41:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:41:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:41:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:41:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:41:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:41:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:41:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:41:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:41:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:41:44.587 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:41:44.590 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:41:47.264 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:41:47.264 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:47.264 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-09-12T01:41:47.264 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:41:47.264 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:41:47.264 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:41:47.264 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:41:47.264 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.264 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.264 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:41:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:41:47.265 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-12T01:41:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:41:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:41:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:41:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:41:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.265 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.266 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.267 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:47.267 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.267 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.267 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.267 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:47.267 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:47.267 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.267 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.267 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:41:47.267 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:41:47.267 INFO:teuthology.orchestra.run.smithi152.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:41:47.267 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:41:47.268 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:41:47.268 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:41:47.268 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:41:47.268 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:41:47.268 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:41:47.268 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:41:47.268 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:41:47.268 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:41:47.268 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.268 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.268 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.268 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:41:47.269 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:41:47.269 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:41:47.269 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:41:47.269 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:41:47.269 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.269 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.269 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:41:47.269 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.269 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:41:47.269 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:41:47.269 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:41:47.269 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:41:47.270 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:41:47.270 INFO:teuthology.orchestra.run.smithi152.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:41:47.270 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:41:47.270 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:41:47.270 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:41:47.270 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:41:47.270 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:41:47.270 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:41:47.270 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:41:47.270 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:41:47.270 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:41:47.270 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:41:47.271 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:41:47.271 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:41:47.271 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:41:47.271 INFO:teuthology.orchestra.run.smithi152.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:41:47.271 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:41:47.271 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:41:47.271 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:41:47.271 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.271 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.271 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.271 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:41:47.272 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:41:47.272 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:41:47.272 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:41:47.272 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:41:47.272 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:41:47.272 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:41:47.272 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:41:47.272 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:41:47.272 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:41:47.272 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:41:47.272 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:41:47.272 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:41:47.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:41:47.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:41:47.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:41:47.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:41:47.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:41:47.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:41:47.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:41:47.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:41:47.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:41:47.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:41:47.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:41:47.273 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:41:47.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:41:47.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:41:47.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:41:47.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:41:47.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:41:47.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:41:47.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:41:47.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:41:47.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:41:47.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:41:47.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:41:47.274 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:41:47.275 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:41:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:41:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:41:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:41:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:41:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:41:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:41:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:41:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:41:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:41:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:41:47.276 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:41:47.277 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.277 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.277 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:41:47.277 INFO:teuthology.orchestra.run.smithi152.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:41:47.277 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:41:47.277 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:41:47.277 INFO:teuthology.orchestra.run.smithi152.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:41:47.277 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:41:47.277 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:41:47.278 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:41:47.278 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:41:47.278 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-12T01:41:47.696 DEBUG:teuthology.parallel:result is None 2024-09-12T01:41:47.696 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:41:47.856 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:41:47.883 INFO:teuthology.orchestra.run.smithi070.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:41:47.884 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:41:47.884 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:41:47.886 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:41:48.037 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:41:48.060 INFO:teuthology.orchestra.run.smithi152.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:41:48.060 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:41:48.060 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:41:48.062 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:41:48.211 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:41:48.238 INFO:teuthology.orchestra.run.smithi191.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:41:48.238 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:41:48.239 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:41:48.240 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T01:41:48.241 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:41:48.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:41:48.273 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-12T01:41:48.273 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:41:48.301 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-12T01:41:48.302 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:41:48.334 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T01:41:48.334 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:41:48.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:41:48.364 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:41:48.432 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-12T01:41:48.432 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:41:48.458 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:41:48.523 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-12T01:41:48.524 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:41:48.550 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:41:48.615 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T01:41:48.615 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:41:48.615 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:41:48.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:41:48.709 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-12T01:41:48.709 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:41:48.735 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:41:48.799 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-12T01:41:48.799 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:41:48.824 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:41:48.901 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T01:41:48.902 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:41:48.902 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:41:48.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:41:48.993 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-12T01:41:48.993 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:41:49.018 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:41:49.082 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-12T01:41:49.082 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:41:49.107 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:41:49.172 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T01:41:49.277 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T01:41:49.278 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:41:49.278 INFO:tasks.cephadm:Cluster fsid is 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:41:49.278 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T01:41:49.279 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.70', 'mon.b': '172.21.15.152', 'mon.c': '172.21.15.191'} 2024-09-12T01:41:49.279 INFO:tasks.cephadm:First mon is mon.a on smithi070 2024-09-12T01:41:49.279 INFO:tasks.cephadm:First mgr is x 2024-09-12T01:41:49.279 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T01:41:49.279 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname $(hostname -s) 2024-09-12T01:41:49.307 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname $(hostname -s) 2024-09-12T01:41:49.333 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname $(hostname -s) 2024-09-12T01:41:49.358 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T01:41:49.358 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:41:49.505 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T01:41:49.647 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:41:49.649 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T01:41:49.649 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T01:41:49.649 DEBUG:teuthology.orchestra.run.smithi070:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:41:50.017 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:41 /home/ubuntu/cephtest/cephadm 2024-09-12T01:41:50.018 DEBUG:teuthology.orchestra.run.smithi152:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:41:50.401 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:41 /home/ubuntu/cephtest/cephadm 2024-09-12T01:41:50.402 DEBUG:teuthology.orchestra.run.smithi191:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:41:50.786 INFO:teuthology.orchestra.run.smithi191.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 01:41 /home/ubuntu/cephtest/cephadm 2024-09-12T01:41:50.786 DEBUG:teuthology.orchestra.run.smithi070:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:41:50.803 DEBUG:teuthology.orchestra.run.smithi152:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:41:50.822 DEBUG:teuthology.orchestra.run.smithi191:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:41:50.859 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T01:41:50.859 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:41:50.861 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:41:50.865 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T01:41:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:41:52.446 INFO:teuthology.orchestra.run.smithi152.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:41:52.596 INFO:teuthology.orchestra.run.smithi191.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:42:21.370 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:42:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:42:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:42:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: "repo_digests": [ 2024-09-12T01:42:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:42:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-12T01:42:21.371 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:42:22.558 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-09-12T01:42:22.558 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:42:22.558 INFO:teuthology.orchestra.run.smithi191.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:42:22.559 INFO:teuthology.orchestra.run.smithi191.stdout: "repo_digests": [ 2024-09-12T01:42:22.559 INFO:teuthology.orchestra.run.smithi191.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:42:22.559 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-09-12T01:42:22.559 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-09-12T01:42:25.736 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-12T01:42:25.736 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T01:42:25.736 INFO:teuthology.orchestra.run.smithi152.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T01:42:25.736 INFO:teuthology.orchestra.run.smithi152.stdout: "repo_digests": [ 2024-09-12T01:42:25.736 INFO:teuthology.orchestra.run.smithi152.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T01:42:25.736 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-12T01:42:25.737 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-12T01:42:25.762 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph 2024-09-12T01:42:25.795 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph 2024-09-12T01:42:25.823 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph 2024-09-12T01:42:25.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /etc/ceph 2024-09-12T01:42:25.885 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /etc/ceph 2024-09-12T01:42:25.910 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /etc/ceph 2024-09-12T01:42:25.938 INFO:tasks.cephadm:Writing seed config... 2024-09-12T01:42:25.939 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-12T01:42:25.940 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T01:42:25.940 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T01:42:25.940 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T01:42:25.940 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T01:42:25.940 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T01:42:25.940 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T01:42:25.940 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T01:42:25.940 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T01:42:25.940 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T01:42:25.940 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T01:42:25.940 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T01:42:25.941 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-12T01:42:25.942 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-12T01:42:25.943 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T01:42:25.943 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T01:42:25.943 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-12T01:42:25.943 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T01:42:25.943 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T01:42:25.943 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T01:42:25.943 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T01:42:25.943 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T01:42:25.943 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T01:42:25.943 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T01:42:25.943 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-12T01:42:25.944 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:42:25.944 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T01:42:25.962 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 2d8cad48-70a8-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T01:42:25.962 DEBUG:teuthology.orchestra.run.smithi070:mon.a> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T01:42:26.005 DEBUG:teuthology.orchestra.run.smithi070:mgr.x> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T01:42:26.049 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T01:42:26.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.70 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:42:26.252 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:42:26.252 INFO:teuthology.orchestra.run.smithi070.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', '2d8cad48-70a8-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.70', '--skip-admin-label'] 2024-09-12T01:42:26.252 INFO:teuthology.orchestra.run.smithi070.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T01:42:26.252 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying podman|docker is present... 2024-09-12T01:42:26.275 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:42:26.275 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying lvm2 is present... 2024-09-12T01:42:26.275 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying time synchronization is in place... 2024-09-12T01:42:26.283 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T01:42:26.283 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T01:42:26.289 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T01:42:26.289 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-12T01:42:26.296 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout enabled 2024-09-12T01:42:26.302 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout active 2024-09-12T01:42:26.302 INFO:teuthology.orchestra.run.smithi070.stdout:Unit chronyd.service is enabled and running 2024-09-12T01:42:26.302 INFO:teuthology.orchestra.run.smithi070.stdout:Repeating the final host check... 2024-09-12T01:42:26.324 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:42:26.324 INFO:teuthology.orchestra.run.smithi070.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T01:42:26.324 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl is present 2024-09-12T01:42:26.324 INFO:teuthology.orchestra.run.smithi070.stdout:lvcreate is present 2024-09-12T01:42:26.331 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T01:42:26.331 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T01:42:26.337 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T01:42:26.337 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-12T01:42:26.343 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout enabled 2024-09-12T01:42:26.351 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout active 2024-09-12T01:42:26.351 INFO:teuthology.orchestra.run.smithi070.stdout:Unit chronyd.service is enabled and running 2024-09-12T01:42:26.351 INFO:teuthology.orchestra.run.smithi070.stdout:Host looks OK 2024-09-12T01:42:26.351 INFO:teuthology.orchestra.run.smithi070.stdout:Cluster fsid: 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:42:26.352 INFO:teuthology.orchestra.run.smithi070.stdout:Acquiring lock 139642191438848 on /run/cephadm/2d8cad48-70a8-11ef-bcea-c7b262605968.lock 2024-09-12T01:42:26.352 INFO:teuthology.orchestra.run.smithi070.stdout:Lock 139642191438848 acquired on /run/cephadm/2d8cad48-70a8-11ef-bcea-c7b262605968.lock 2024-09-12T01:42:26.352 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying IP 172.21.15.70 port 3300 ... 2024-09-12T01:42:26.352 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying IP 172.21.15.70 port 6789 ... 2024-09-12T01:42:26.352 INFO:teuthology.orchestra.run.smithi070.stdout:Base mon IP(s) is [172.21.15.70:3300, 172.21.15.70:6789], mon addrv is [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-09-12T01:42:26.354 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.70 metric 100 2024-09-12T01:42:26.354 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.70 metric 100 2024-09-12T01:42:26.357 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T01:42:26.357 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-12T01:42:26.357 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-12T01:42:26.360 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T01:42:26.360 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T01:42:26.360 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T01:42:26.360 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-12T01:42:26.360 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link noprefixroute 2024-09-12T01:42:26.360 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T01:42:26.360 INFO:teuthology.orchestra.run.smithi070.stdout:Mon IP `172.21.15.70` is in CIDR network `172.21.0.0/20` 2024-09-12T01:42:26.361 INFO:teuthology.orchestra.run.smithi070.stdout:Mon IP `172.21.15.70` is in CIDR network `172.21.0.0/20` 2024-09-12T01:42:26.361 INFO:teuthology.orchestra.run.smithi070.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T01:42:26.361 INFO:teuthology.orchestra.run.smithi070.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T01:42:26.362 INFO:teuthology.orchestra.run.smithi070.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:42:27.230 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T01:42:27.230 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T01:42:27.230 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T01:42:27.230 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T01:42:27.230 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T01:42:27.230 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T01:42:27.230 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T01:42:28.084 INFO:teuthology.orchestra.run.smithi070.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:42:28.084 INFO:teuthology.orchestra.run.smithi070.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T01:42:28.084 INFO:teuthology.orchestra.run.smithi070.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T01:42:28.981 INFO:teuthology.orchestra.run.smithi070.stdout:stat: stdout 167 167 2024-09-12T01:42:28.981 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial keys... 2024-09-12T01:42:29.761 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQAFR+JmYg2zEBAATGay4alVkyhwzCjQmxG8vQ== 2024-09-12T01:42:30.742 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQAGR+Jm5hiUBxAA/9pCL6FHbm3fT2kvc7CBdQ== 2024-09-12T01:42:31.641 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQAHR+Jm+kI5AxAA5Gyh87mrw43fiB3q3CDv7w== 2024-09-12T01:42:31.641 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial monmap... 2024-09-12T01:42:32.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T01:42:32.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T01:42:32.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:42:32.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T01:42:32.520 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool for a [v2:172.21.15.70:3300,v1:172.21.15.70:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T01:42:32.520 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = quincy 2024-09-12T01:42:32.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: set fsid to 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:42:32.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T01:42:32.520 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:42:32.520 INFO:teuthology.orchestra.run.smithi070.stdout:Creating mon... 2024-09-12T01:42:33.400 INFO:teuthology.orchestra.run.smithi070.stdout:create mon.a on 2024-09-12T01:42:33.595 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T01:42:33.753 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T01:42:33.957 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-2d8cad48-70a8-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-2d8cad48-70a8-11ef-bcea-c7b262605968.target. 2024-09-12T01:42:33.957 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-2d8cad48-70a8-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-2d8cad48-70a8-11ef-bcea-c7b262605968.target. 2024-09-12T01:42:34.218 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.a 2024-09-12T01:42:34.219 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T01:42:34.389 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2d8cad48-70a8-11ef-bcea-c7b262605968.target.wants/ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@.service. 2024-09-12T01:42:34.904 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:34 smithi070 podman[30796]: 2024-09-12 01:42:34.865189837 +0000 UTC m=+0.348402712 container start 0b87a6ba2e0c9ff89369a6e7cc8b05c9ecb5c31a266fbaabc10479237d47beca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T01:42:34.904 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:34 smithi070 ceph-mon[30814]: mkfs 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:42:34.958 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:42:34.958 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-09-12T01:42:34.965 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:42:34.965 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-12T01:42:34.965 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-09-12T01:42:34.965 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T01:42:34.966 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mon to start... 2024-09-12T01:42:34.966 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mon... 2024-09-12T01:42:35.163 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:34 smithi070 ceph-mon[30814]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:42:35.163 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:34 smithi070 bash[30796]: 0b87a6ba2e0c9ff89369a6e7cc8b05c9ecb5c31a266fbaabc10479237d47beca 2024-09-12T01:42:35.163 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:34 smithi070 systemd[1]: Started Ceph mon.a for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:42:35.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T01:42:35.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout id: 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:42:35.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T01:42:35.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-12T01:42:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout services: 2024-09-12T01:42:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.508435s) 2024-09-12T01:42:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T01:42:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T01:42:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-12T01:42:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout data: 2024-09-12T01:42:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T01:42:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T01:42:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T01:42:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.341+0000 7f57bb299640 1 Processor -- start 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.341+0000 7f57bb299640 1 -- start start 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.341+0000 7f57bb299640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 0x7f57b410a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.341+0000 7f57bb299640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f57b4075a30 con 0x7f57b4108330 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.342+0000 7f57b9035640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 0x7f57b410a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.342+0000 7f57b9035640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 0x7f57b410a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50940/0 (socket says 172.21.15.70:50940) 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.342+0000 7f57b9035640 1 -- 172.21.15.70:0/35715787 learned_addr learned my addr 172.21.15.70:0/35715787 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.342+0000 7f57b9035640 1 -- 172.21.15.70:0/35715787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b410ac60 con 0x7f57b4108330 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.344+0000 7f57b9035640 1 --2- 172.21.15.70:0/35715787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 0x7f57b410a720 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009820 tx=0x7f57b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27121cc10ff3be2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.344+0000 7f57abfff640 1 -- 172.21.15.70:0/35715787 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b0037070 con 0x7f57b4108330 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.344+0000 7f57abfff640 1 -- 172.21.15.70:0/35715787 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b0032440 con 0x7f57b4108330 2024-09-12T01:42:35.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.344+0000 7f57abfff640 1 -- 172.21.15.70:0/35715787 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b0032740 con 0x7f57b4108330 2024-09-12T01:42:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.345+0000 7f57bb299640 1 -- 172.21.15.70:0/35715787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 msgr2=0x7f57b410a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.345+0000 7f57bb299640 1 --2- 172.21.15.70:0/35715787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 0x7f57b410a720 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009820 tx=0x7f57b002a270 comp rx=0 tx=0).stop 2024-09-12T01:42:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.345+0000 7f57bb299640 1 -- 172.21.15.70:0/35715787 shutdown_connections 2024-09-12T01:42:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.345+0000 7f57bb299640 1 --2- 172.21.15.70:0/35715787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 0x7f57b410a720 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.345+0000 7f57bb299640 1 -- 172.21.15.70:0/35715787 >> 172.21.15.70:0/35715787 conn(0x7f57b4101f90 msgr2=0x7f57b41043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.345+0000 7f57bb299640 1 -- 172.21.15.70:0/35715787 shutdown_connections 2024-09-12T01:42:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.345+0000 7f57bb299640 1 -- 172.21.15.70:0/35715787 wait complete. 2024-09-12T01:42:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.345+0000 7f57bb299640 1 Processor -- start 2024-09-12T01:42:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.345+0000 7f57bb299640 1 -- start start 2024-09-12T01:42:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.346+0000 7f57bb299640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 0x7f57b419afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.346+0000 7f57bb299640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f57b410b0e0 con 0x7f57b4108330 2024-09-12T01:42:35.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.346+0000 7f57b9035640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 0x7f57b419afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.913 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.346+0000 7f57b9035640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 0x7f57b419afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50946/0 (socket says 172.21.15.70:50946) 2024-09-12T01:42:35.913 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.346+0000 7f57b9035640 1 -- 172.21.15.70:0/3679176678 learned_addr learned my addr 172.21.15.70:0/3679176678 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:35.913 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.346+0000 7f57b9035640 1 -- 172.21.15.70:0/3679176678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b419b4f0 con 0x7f57b4108330 2024-09-12T01:42:35.913 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.346+0000 7f57b9035640 1 --2- 172.21.15.70:0/3679176678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 0x7f57b419afb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f57b00090b0 tx=0x7f57b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.913 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.346+0000 7f57aa7fc640 1 -- 172.21.15.70:0/3679176678 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b0041070 con 0x7f57b4108330 2024-09-12T01:42:35.913 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.346+0000 7f57aa7fc640 1 -- 172.21.15.70:0/3679176678 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b003c7a0 con 0x7f57b4108330 2024-09-12T01:42:35.913 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.346+0000 7f57bb299640 1 -- 172.21.15.70:0/3679176678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b419b780 con 0x7f57b4108330 2024-09-12T01:42:35.913 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.346+0000 7f57aa7fc640 1 -- 172.21.15.70:0/3679176678 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57b0037040 con 0x7f57b4108330 2024-09-12T01:42:35.913 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.346+0000 7f57bb299640 1 -- 172.21.15.70:0/3679176678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b419e470 con 0x7f57b4108330 2024-09-12T01:42:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.347+0000 7f57aa7fc640 1 -- 172.21.15.70:0/3679176678 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f57b0044070 con 0x7f57b4108330 2024-09-12T01:42:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.347+0000 7f57aa7fc640 1 -- 172.21.15.70:0/3679176678 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f57b003d3f0 con 0x7f57b4108330 2024-09-12T01:42:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.347+0000 7f57bb299640 1 -- 172.21.15.70:0/3679176678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b4108790 con 0x7f57b4108330 2024-09-12T01:42:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.350+0000 7f57aa7fc640 1 -- 172.21.15.70:0/3679176678 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f57b0046450 con 0x7f57b4108330 2024-09-12T01:42:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.408+0000 7f57bb299640 1 -- 172.21.15.70:0/3679176678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f57b402d940 con 0x7f57b4108330 2024-09-12T01:42:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.408+0000 7f57aa7fc640 1 -- 172.21.15.70:0/3679176678 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f57b0046630 con 0x7f57b4108330 2024-09-12T01:42:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.409+0000 7f57bb299640 1 -- 172.21.15.70:0/3679176678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 msgr2=0x7f57b419afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.409+0000 7f57bb299640 1 --2- 172.21.15.70:0/3679176678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 0x7f57b419afb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f57b00090b0 tx=0x7f57b00046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.409+0000 7f57bb299640 1 -- 172.21.15.70:0/3679176678 shutdown_connections 2024-09-12T01:42:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.409+0000 7f57bb299640 1 --2- 172.21.15.70:0/3679176678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57b4108330 0x7f57b419afb0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.409+0000 7f57bb299640 1 -- 172.21.15.70:0/3679176678 >> 172.21.15.70:0/3679176678 conn(0x7f57b4101f90 msgr2=0x7f57b4103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:35.914 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.410+0000 7f57bb299640 1 -- 172.21.15.70:0/3679176678 shutdown_connections 2024-09-12T01:42:35.915 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:35.410+0000 7f57bb299640 1 -- 172.21.15.70:0/3679176678 wait complete. 2024-09-12T01:42:35.915 INFO:teuthology.orchestra.run.smithi070.stdout:mon is available 2024-09-12T01:42:35.915 INFO:teuthology.orchestra.run.smithi070.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T01:42:36.010 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:35 smithi070 ceph-mon[30814]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:42:36.010 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:35 smithi070 ceph-mon[30814]: monmap epoch 1 2024-09-12T01:42:36.010 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:35 smithi070 ceph-mon[30814]: fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:42:36.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:35 smithi070 ceph-mon[30814]: last_changed 2024-09-12T01:42:31.968853+0000 2024-09-12T01:42:36.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:35 smithi070 ceph-mon[30814]: created 2024-09-12T01:42:31.968853+0000 2024-09-12T01:42:36.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:35 smithi070 ceph-mon[30814]: min_mon_release 19 (squid) 2024-09-12T01:42:36.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:35 smithi070 ceph-mon[30814]: election_strategy: 1 2024-09-12T01:42:36.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:35 smithi070 ceph-mon[30814]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:42:36.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:35 smithi070 ceph-mon[30814]: fsmap 2024-09-12T01:42:36.012 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:35 smithi070 ceph-mon[30814]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T01:42:36.012 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:35 smithi070 ceph-mon[30814]: mgrmap e1: no daemons active 2024-09-12T01:42:36.012 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:35 smithi070 ceph-mon[30814]: from='client.? 172.21.15.70:0/3679176678' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T01:42:36.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-12T01:42:36.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T01:42:36.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout fsid = 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:42:36.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-09-12T01:42:36.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T01:42:36.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T01:42:36.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T01:42:36.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T01:42:36.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-12T01:42:36.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T01:42:36.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T01:42:36.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-12T01:42:36.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T01:42:36.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T01:42:36.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T01:42:36.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T01:42:36.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T01:42:36.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T01:42:36.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.315+0000 7f4a1fd68640 1 Processor -- start 2024-09-12T01:42:36.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.316+0000 7f4a1fd68640 1 -- start start 2024-09-12T01:42:36.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.316+0000 7f4a1fd68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 0x7f4a18106b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:36.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.316+0000 7f4a1fd68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181070e0 con 0x7f4a18106710 2024-09-12T01:42:36.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.316+0000 7f4a1db04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 0x7f4a18106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:36.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.316+0000 7f4a1db04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 0x7f4a18106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50958/0 (socket says 172.21.15.70:50958) 2024-09-12T01:42:36.909 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.316+0000 7f4a1db04640 1 -- 172.21.15.70:0/793220701 learned_addr learned my addr 172.21.15.70:0/793220701 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:36.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.316+0000 7f4a1db04640 1 -- 172.21.15.70:0/793220701 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a18107910 con 0x7f4a18106710 2024-09-12T01:42:36.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.317+0000 7f4a1db04640 1 --2- 172.21.15.70:0/793220701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 0x7f4a18106b10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009820 tx=0x7f4a1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ab93d97e445f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:36.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.317+0000 7f4a1cb02640 1 -- 172.21.15.70:0/793220701 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a14037070 con 0x7f4a18106710 2024-09-12T01:42:36.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.317+0000 7f4a1cb02640 1 -- 172.21.15.70:0/793220701 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a14032440 con 0x7f4a18106710 2024-09-12T01:42:36.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.317+0000 7f4a1cb02640 1 -- 172.21.15.70:0/793220701 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a14032740 con 0x7f4a18106710 2024-09-12T01:42:36.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.318+0000 7f4a1fd68640 1 -- 172.21.15.70:0/793220701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 msgr2=0x7f4a18106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:36.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.318+0000 7f4a1fd68640 1 --2- 172.21.15.70:0/793220701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 0x7f4a18106b10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009820 tx=0x7f4a1402a270 comp rx=0 tx=0).stop 2024-09-12T01:42:36.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.318+0000 7f4a1fd68640 1 -- 172.21.15.70:0/793220701 shutdown_connections 2024-09-12T01:42:36.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.318+0000 7f4a1fd68640 1 --2- 172.21.15.70:0/793220701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 0x7f4a18106b10 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.318+0000 7f4a1fd68640 1 -- 172.21.15.70:0/793220701 >> 172.21.15.70:0/793220701 conn(0x7f4a18101f60 msgr2=0x7f4a18104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:36.910 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.318+0000 7f4a1fd68640 1 -- 172.21.15.70:0/793220701 shutdown_connections 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.318+0000 7f4a1fd68640 1 -- 172.21.15.70:0/793220701 wait complete. 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.318+0000 7f4a1fd68640 1 Processor -- start 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.318+0000 7f4a1fd68640 1 -- start start 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.318+0000 7f4a1fd68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 0x7f4a1819af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a1fd68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4a18107eb0 con 0x7f4a18106710 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a1db04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 0x7f4a1819af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a1db04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 0x7f4a1819af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50968/0 (socket says 172.21.15.70:50968) 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a1db04640 1 -- 172.21.15.70:0/3281367744 learned_addr learned my addr 172.21.15.70:0/3281367744 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a1db04640 1 -- 172.21.15.70:0/3281367744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1819b4b0 con 0x7f4a18106710 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a1db04640 1 --2- 172.21.15.70:0/3281367744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 0x7f4a1819af70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4a140090b0 tx=0x7f4a140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a0affd640 1 -- 172.21.15.70:0/3281367744 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a14041070 con 0x7f4a18106710 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a0affd640 1 -- 172.21.15.70:0/3281367744 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1403c7a0 con 0x7f4a18106710 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a0affd640 1 -- 172.21.15.70:0/3281367744 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a14037040 con 0x7f4a18106710 2024-09-12T01:42:36.911 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a1fd68640 1 -- 172.21.15.70:0/3281367744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1819b740 con 0x7f4a18106710 2024-09-12T01:42:36.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a1fd68640 1 -- 172.21.15.70:0/3281367744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1819e430 con 0x7f4a18106710 2024-09-12T01:42:36.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a0affd640 1 -- 172.21.15.70:0/3281367744 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4a14044070 con 0x7f4a18106710 2024-09-12T01:42:36.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.319+0000 7f4a0affd640 1 -- 172.21.15.70:0/3281367744 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4a1403d3f0 con 0x7f4a18106710 2024-09-12T01:42:36.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.320+0000 7f4a1fd68640 1 -- 172.21.15.70:0/3281367744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a18108500 con 0x7f4a18106710 2024-09-12T01:42:36.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.322+0000 7f4a0affd640 1 -- 172.21.15.70:0/3281367744 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4a14046450 con 0x7f4a18106710 2024-09-12T01:42:36.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.378+0000 7f4a1fd68640 1 -- 172.21.15.70:0/3281367744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f4a1802d910 con 0x7f4a18106710 2024-09-12T01:42:36.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.381+0000 7f4a0affd640 1 -- 172.21.15.70:0/3281367744 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f4a14046630 con 0x7f4a18106710 2024-09-12T01:42:36.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.382+0000 7f4a0affd640 1 -- 172.21.15.70:0/3281367744 <== mon.0 v2:172.21.15.70:3300/0 8 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4a14056070 con 0x7f4a18106710 2024-09-12T01:42:36.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.382+0000 7f4a1fd68640 1 -- 172.21.15.70:0/3281367744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 msgr2=0x7f4a1819af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:36.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.382+0000 7f4a1fd68640 1 --2- 172.21.15.70:0/3281367744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 0x7f4a1819af70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4a140090b0 tx=0x7f4a140046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.382+0000 7f4a1fd68640 1 -- 172.21.15.70:0/3281367744 shutdown_connections 2024-09-12T01:42:36.912 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.382+0000 7f4a1fd68640 1 --2- 172.21.15.70:0/3281367744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a18106710 0x7f4a1819af70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.913 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.382+0000 7f4a1fd68640 1 -- 172.21.15.70:0/3281367744 >> 172.21.15.70:0/3281367744 conn(0x7f4a18101f60 msgr2=0x7f4a1818e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:36.913 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.382+0000 7f4a1fd68640 1 -- 172.21.15.70:0/3281367744 shutdown_connections 2024-09-12T01:42:36.913 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:36.382+0000 7f4a1fd68640 1 -- 172.21.15.70:0/3281367744 wait complete. 2024-09-12T01:42:36.913 INFO:teuthology.orchestra.run.smithi070.stdout:Generating new minimal ceph.conf... 2024-09-12T01:42:37.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:36 smithi070 ceph-mon[30814]: from='client.? 172.21.15.70:0/3281367744' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T01:42:37.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:36 smithi070 ceph-mon[30814]: from='client.? 172.21.15.70:0/3281367744' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T01:42:37.863 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.268+0000 7f1bd30f2640 1 Processor -- start 2024-09-12T01:42:37.863 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.268+0000 7f1bd30f2640 1 -- start start 2024-09-12T01:42:37.863 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.268+0000 7f1bd30f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 0x7f1bcc105f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.863 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.268+0000 7f1bd30f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc1064f0 con 0x7f1bcc105b20 2024-09-12T01:42:37.863 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.269+0000 7f1bd0e8e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 0x7f1bcc105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.863 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.269+0000 7f1bd0e8e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 0x7f1bcc105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50978/0 (socket says 172.21.15.70:50978) 2024-09-12T01:42:37.863 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.269+0000 7f1bd0e8e640 1 -- 172.21.15.70:0/2721596349 learned_addr learned my addr 172.21.15.70:0/2721596349 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:37.863 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.269+0000 7f1bd0e8e640 1 -- 172.21.15.70:0/2721596349 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc108b00 con 0x7f1bcc105b20 2024-09-12T01:42:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.269+0000 7f1bd0e8e640 1 --2- 172.21.15.70:0/2721596349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 0x7f1bcc105f20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009820 tx=0x7f1bc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66df0671dcc7b05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.270+0000 7f1bcb7fe640 1 -- 172.21.15.70:0/2721596349 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc0037070 con 0x7f1bcc105b20 2024-09-12T01:42:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.270+0000 7f1bcb7fe640 1 -- 172.21.15.70:0/2721596349 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1bc0032920 con 0x7f1bcc105b20 2024-09-12T01:42:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.270+0000 7f1bcb7fe640 1 -- 172.21.15.70:0/2721596349 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc0030950 con 0x7f1bcc105b20 2024-09-12T01:42:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.270+0000 7f1bd30f2640 1 -- 172.21.15.70:0/2721596349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 msgr2=0x7f1bcc105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.270+0000 7f1bd30f2640 1 --2- 172.21.15.70:0/2721596349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 0x7f1bcc105f20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009820 tx=0x7f1bc002a270 comp rx=0 tx=0).stop 2024-09-12T01:42:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.270+0000 7f1bd30f2640 1 -- 172.21.15.70:0/2721596349 shutdown_connections 2024-09-12T01:42:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.270+0000 7f1bd30f2640 1 --2- 172.21.15.70:0/2721596349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 0x7f1bcc105f20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.270+0000 7f1bd30f2640 1 -- 172.21.15.70:0/2721596349 >> 172.21.15.70:0/2721596349 conn(0x7f1bcc101690 msgr2=0x7f1bcc103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.270+0000 7f1bd30f2640 1 -- 172.21.15.70:0/2721596349 shutdown_connections 2024-09-12T01:42:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.270+0000 7f1bd30f2640 1 -- 172.21.15.70:0/2721596349 wait complete. 2024-09-12T01:42:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.271+0000 7f1bd30f2640 1 Processor -- start 2024-09-12T01:42:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.271+0000 7f1bd30f2640 1 -- start start 2024-09-12T01:42:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.271+0000 7f1bd30f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 0x7f1bcc108380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.271+0000 7f1bd30f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc10bd30 con 0x7f1bcc105b20 2024-09-12T01:42:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.271+0000 7f1bd0e8e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 0x7f1bcc108380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.271+0000 7f1bd0e8e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 0x7f1bcc108380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50990/0 (socket says 172.21.15.70:50990) 2024-09-12T01:42:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.271+0000 7f1bd0e8e640 1 -- 172.21.15.70:0/1941658363 learned_addr learned my addr 172.21.15.70:0/1941658363 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.271+0000 7f1bd0e8e640 1 -- 172.21.15.70:0/1941658363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc1088c0 con 0x7f1bcc105b20 2024-09-12T01:42:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.272+0000 7f1bd0e8e640 1 --2- 172.21.15.70:0/1941658363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 0x7f1bcc108380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009940 tx=0x7f1bc0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.272+0000 7f1bc9ffb640 1 -- 172.21.15.70:0/1941658363 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc0042070 con 0x7f1bcc105b20 2024-09-12T01:42:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.272+0000 7f1bc9ffb640 1 -- 172.21.15.70:0/1941658363 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1bc00325f0 con 0x7f1bcc105b20 2024-09-12T01:42:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.272+0000 7f1bd30f2640 1 -- 172.21.15.70:0/1941658363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bcc106ab0 con 0x7f1bcc105b20 2024-09-12T01:42:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.272+0000 7f1bc9ffb640 1 -- 172.21.15.70:0/1941658363 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bc0037040 con 0x7f1bcc105b20 2024-09-12T01:42:37.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.272+0000 7f1bd30f2640 1 -- 172.21.15.70:0/1941658363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bcc106ff0 con 0x7f1bcc105b20 2024-09-12T01:42:37.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.272+0000 7f1bc9ffb640 1 -- 172.21.15.70:0/1941658363 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1bc0045070 con 0x7f1bcc105b20 2024-09-12T01:42:37.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.272+0000 7f1bc9ffb640 1 -- 172.21.15.70:0/1941658363 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1bc0047b70 con 0x7f1bcc105b20 2024-09-12T01:42:37.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.273+0000 7f1bd30f2640 1 -- 172.21.15.70:0/1941658363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bcc105fa0 con 0x7f1bcc105b20 2024-09-12T01:42:37.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.275+0000 7f1bc9ffb640 1 -- 172.21.15.70:0/1941658363 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1bc003c730 con 0x7f1bcc105b20 2024-09-12T01:42:37.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.332+0000 7f1bd30f2640 1 -- 172.21.15.70:0/1941658363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f1bcc107330 con 0x7f1bcc105b20 2024-09-12T01:42:37.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.332+0000 7f1bc9ffb640 1 -- 172.21.15.70:0/1941658363 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f1bc003c910 con 0x7f1bcc105b20 2024-09-12T01:42:37.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.333+0000 7f1bd30f2640 1 -- 172.21.15.70:0/1941658363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 msgr2=0x7f1bcc108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.333+0000 7f1bd30f2640 1 --2- 172.21.15.70:0/1941658363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 0x7f1bcc108380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009940 tx=0x7f1bc0032e40 comp rx=0 tx=0).stop 2024-09-12T01:42:37.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.333+0000 7f1bd30f2640 1 -- 172.21.15.70:0/1941658363 shutdown_connections 2024-09-12T01:42:37.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.333+0000 7f1bd30f2640 1 --2- 172.21.15.70:0/1941658363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bcc105b20 0x7f1bcc108380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.333+0000 7f1bd30f2640 1 -- 172.21.15.70:0/1941658363 >> 172.21.15.70:0/1941658363 conn(0x7f1bcc101690 msgr2=0x7f1bcc102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:37.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.333+0000 7f1bd30f2640 1 -- 172.21.15.70:0/1941658363 shutdown_connections 2024-09-12T01:42:37.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:37.333+0000 7f1bd30f2640 1 -- 172.21.15.70:0/1941658363 wait complete. 2024-09-12T01:42:37.867 INFO:teuthology.orchestra.run.smithi070.stdout:Restarting the monitor... 2024-09-12T01:42:38.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:37 smithi070 systemd[1]: Stopping Ceph mon.a for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:42:38.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:37 smithi070 ceph-mon[30814]: from='client.? 172.21.15.70:0/1941658363' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:42:38.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:38 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a[30810]: 2024-09-12T01:42:38.124+0000 7f1a606a5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:42:38.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:38 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a[30810]: 2024-09-12T01:42:38.124+0000 7f1a606a5640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T01:42:38.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:38 smithi070 podman[31056]: 2024-09-12 01:42:38.350262487 +0000 UTC m=+0.323247939 container died 0b87a6ba2e0c9ff89369a6e7cc8b05c9ecb5c31a266fbaabc10479237d47beca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T01:42:38.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:38 smithi070 podman[31056]: 2024-09-12 01:42:38.63255944 +0000 UTC m=+0.605544891 container cleanup 0b87a6ba2e0c9ff89369a6e7cc8b05c9ecb5c31a266fbaabc10479237d47beca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:42:38.947 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:38 smithi070 bash[31056]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a 2024-09-12T01:42:38.947 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:38 smithi070 podman[31068]: 2024-09-12 01:42:38.842211443 +0000 UTC m=+0.488162197 container remove 0b87a6ba2e0c9ff89369a6e7cc8b05c9ecb5c31a266fbaabc10479237d47beca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T01:42:39.236 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:38 smithi070 systemd[1]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T01:42:39.237 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:38 smithi070 systemd[1]: Stopped Ceph mon.a for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:42:39.237 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:38 smithi070 systemd[1]: Starting Ceph mon.a for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:42:39.237 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 podman[31158]: 2024-09-12 01:42:39.151224188 +0000 UTC m=+0.088884941 container create 88b95e97367a1353e941e7e1260eff825dcbf424dfca6d610f0c77a9ebd7771f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T01:42:39.237 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 podman[31158]: 2024-09-12 01:42:39.078076634 +0000 UTC m=+0.015737387 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:42:39.440 INFO:teuthology.orchestra.run.smithi070.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T01:42:39.652 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 podman[31158]: 2024-09-12 01:42:39.362413472 +0000 UTC m=+0.300074226 container init 88b95e97367a1353e941e7e1260eff825dcbf424dfca6d610f0c77a9ebd7771f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T01:42:39.652 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 podman[31158]: 2024-09-12 01:42:39.36549922 +0000 UTC m=+0.303159976 container start 88b95e97367a1353e941e7e1260eff825dcbf424dfca6d610f0c77a9ebd7771f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T01:42:39.652 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: pidfile_write: ignore empty --pid-file 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: load: jerasure load: lrc 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: RocksDB version: 7.9.2 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Git sha 0 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: DB SUMMARY 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: DB Session ID: TB2FCACT5OEKAC8CCA38 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: CURRENT file: CURRENT 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T01:42:39.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106138 ; 2024-09-12T01:42:39.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.error_if_exists: 0 2024-09-12T01:42:39.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.create_if_missing: 0 2024-09-12T01:42:39.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.paranoid_checks: 1 2024-09-12T01:42:39.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T01:42:39.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T01:42:39.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T01:42:39.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.env: 0x55690a369940 2024-09-12T01:42:39.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T01:42:39.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.info_log: 0x55690acb36e0 2024-09-12T01:42:39.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T01:42:39.654 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.statistics: (nil) 2024-09-12T01:42:39.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.use_fsync: 0 2024-09-12T01:42:39.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_log_file_size: 0 2024-09-12T01:42:39.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T01:42:39.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T01:42:39.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T01:42:39.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T01:42:39.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.allow_fallocate: 1 2024-09-12T01:42:39.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T01:42:39.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T01:42:39.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.use_direct_reads: 0 2024-09-12T01:42:39.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.db_log_dir: 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.wal_dir: 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.write_buffer_manager: 0x55690acc2dc0 2024-09-12T01:42:39.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.unordered_write: 0 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T01:42:39.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.row_cache: None 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.wal_filter: None 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.two_write_queues: 0 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.wal_compression: 0 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.atomic_flush: 0 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.log_readahead_size: 0 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T01:42:39.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_background_jobs: 2 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_background_compactions: -1 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_subcompactions: 1 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T01:42:39.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T01:42:39.661 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T01:42:39.661 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_open_files: -1 2024-09-12T01:42:39.661 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T01:42:39.661 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T01:42:39.661 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T01:42:39.661 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T01:42:39.661 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_background_flushes: -1 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Compression algorithms supported: 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: kZSTD supported: 0 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: kXpressCompression supported: 0 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: kBZip2Compression supported: 0 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: kLZ4Compression supported: 1 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: kZlibCompression supported: 1 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: kSnappyCompression supported: 1 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T01:42:39.662 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.merge_operator: 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_filter: None 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55690acb3320) 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout: cache_index_and_filter_blocks: 1 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout: pin_top_level_index_and_filter: 1 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_type: 0 2024-09-12T01:42:39.663 INFO:journalctl@ceph.mon.a.smithi070.stdout: data_block_index_type: 0 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_shortening: 1 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: checksum: 4 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: no_block_cache: 0 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache: 0x55690aca71f0 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_name: BinnedLRUCache 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_options: 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: capacity : 536870912 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: num_shard_bits : 4 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: strict_capacity_limit : 0 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: high_pri_pool_ratio: 0.000 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_compressed: (nil) 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: persistent_cache: (nil) 2024-09-12T01:42:39.664 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_size: 4096 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_size_deviation: 10 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_restart_interval: 16 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_block_restart_interval: 1 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: metadata_block_size: 4096 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: partition_filters: 0 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: use_delta_encoding: 1 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: filter_policy: bloomfilter 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: whole_key_filtering: 1 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: verify_compression: 0 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: read_amp_bytes_per_bit: 0 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: format_version: 5 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: enable_index_compression: 1 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_align: 0 2024-09-12T01:42:39.665 INFO:journalctl@ceph.mon.a.smithi070.stdout: max_auto_readahead_size: 262144 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout: prepopulate_block_cache: 0 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout: initial_auto_readahead_size: 8192 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compression: NoCompression 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.num_levels: 7 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T01:42:39.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:42:39.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:42:39.668 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:42:39.669 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:42:39.670 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.ttl: 2592000 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:42:39.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 907bfee0-6b48-446d-93af-9ff166fbcbcb 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105359391750, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105359392819, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101096, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 332, "table_properties": {"data_size": 98981, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14524, "raw_average_key_size": 49, "raw_value_size": 91149, "raw_average_value_size": 313, "num_data_blocks": 12, "num_entries": 291, "num_filter_entries": 291, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726105359, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "907bfee0-6b48-446d-93af-9ff166fbcbcb", "db_session_id": "TB2FCACT5OEKAC8CCA38", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105359392912, "job": 1, "event": "recovery_finished"} 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T01:42:39.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55690acd4e00 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: DB pointer 0x55690add0000 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** DB Stats ** 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:42:39.673 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** Compaction Stats [default] ** 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: L0 2/0 100.59 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: Sum 2/0 100.59 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** Compaction Stats [default] ** 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 136.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T01:42:39.674 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative compaction: 0.00 GB write, 30.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval compaction: 0.00 GB write, 30.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: Block cache BinnedLRUCache@0x55690aca71f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:42:39.675 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: starting mon.a rank 0 at public addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] at bind addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: mon.a@-1(???) e1 preinit fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: mon.a@-1(???).mds e1 new map 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: mon.a@-1(???).mds e1 print_map 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout: e1 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout: btime 2024-09-12T01:42:34:901597+0000 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout: legacy client fscid: -1 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout: No filesystems configured 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:42:39.676 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 bash[31158]: 88b95e97367a1353e941e7e1260eff825dcbf424dfca6d610f0c77a9ebd7771f 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 systemd[1]: Started Ceph mon.a for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: monmap epoch 1 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: last_changed 2024-09-12T01:42:31.968853+0000 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: created 2024-09-12T01:42:31.968853+0000 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: min_mon_release 19 (squid) 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: election_strategy: 1 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: fsmap 2024-09-12T01:42:39.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T01:42:39.678 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:39 smithi070 ceph-mon[31177]: mgrmap e1: no daemons active 2024-09-12T01:42:40.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.846+0000 7f08ede71640 1 Processor -- start 2024-09-12T01:42:40.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.846+0000 7f08ede71640 1 -- start start 2024-09-12T01:42:40.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.846+0000 7f08ede71640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 0x7f08e8106b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:40.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.846+0000 7f08ede71640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f08e81070e0 con 0x7f08e8106710 2024-09-12T01:42:40.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.846+0000 7f08e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 0x7f08e8106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:40.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.846+0000 7f08e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 0x7f08e8106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51006/0 (socket says 172.21.15.70:51006) 2024-09-12T01:42:40.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.846+0000 7f08e77fe640 1 -- 172.21.15.70:0/104064193 learned_addr learned my addr 172.21.15.70:0/104064193 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:40.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.847+0000 7f08e77fe640 1 -- 172.21.15.70:0/104064193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e8107910 con 0x7f08e8106710 2024-09-12T01:42:40.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.848+0000 7f08e77fe640 1 --2- 172.21.15.70:0/104064193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 0x7f08e8106b10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009820 tx=0x7f08d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc948787244ca45c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:40.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.849+0000 7f08e67fc640 1 -- 172.21.15.70:0/104064193 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8037070 con 0x7f08e8106710 2024-09-12T01:42:40.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.849+0000 7f08e67fc640 1 -- 172.21.15.70:0/104064193 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f08d8032920 con 0x7f08e8106710 2024-09-12T01:42:40.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.849+0000 7f08e67fc640 1 -- 172.21.15.70:0/104064193 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8030950 con 0x7f08e8106710 2024-09-12T01:42:40.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.849+0000 7f08ede71640 1 -- 172.21.15.70:0/104064193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 msgr2=0x7f08e8106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.849+0000 7f08ede71640 1 --2- 172.21.15.70:0/104064193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 0x7f08e8106b10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009820 tx=0x7f08d802a270 comp rx=0 tx=0).stop 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.849+0000 7f08ede71640 1 -- 172.21.15.70:0/104064193 shutdown_connections 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.849+0000 7f08ede71640 1 --2- 172.21.15.70:0/104064193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 0x7f08e8106b10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.849+0000 7f08ede71640 1 -- 172.21.15.70:0/104064193 >> 172.21.15.70:0/104064193 conn(0x7f08e8101f60 msgr2=0x7f08e8104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.849+0000 7f08ede71640 1 -- 172.21.15.70:0/104064193 shutdown_connections 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.849+0000 7f08ede71640 1 -- 172.21.15.70:0/104064193 wait complete. 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.850+0000 7f08ede71640 1 Processor -- start 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.850+0000 7f08ede71640 1 -- start start 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.850+0000 7f08ede71640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 0x7f08e819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.850+0000 7f08ede71640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f08e810acc0 con 0x7f08e8106710 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.850+0000 7f08e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 0x7f08e819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.850+0000 7f08e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 0x7f08e819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51016/0 (socket says 172.21.15.70:51016) 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.850+0000 7f08e77fe640 1 -- 172.21.15.70:0/650053000 learned_addr learned my addr 172.21.15.70:0/650053000 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:40.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.851+0000 7f08e77fe640 1 -- 172.21.15.70:0/650053000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e819be20 con 0x7f08e8106710 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.851+0000 7f08e77fe640 1 --2- 172.21.15.70:0/650053000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 0x7f08e819b8e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009940 tx=0x7f08d8032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.851+0000 7f08e4ff9640 1 -- 172.21.15.70:0/650053000 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8042070 con 0x7f08e8106710 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.851+0000 7f08e4ff9640 1 -- 172.21.15.70:0/650053000 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f08d80325f0 con 0x7f08e8106710 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.851+0000 7f08ede71640 1 -- 172.21.15.70:0/650053000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e819c0b0 con 0x7f08e8106710 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.851+0000 7f08e4ff9640 1 -- 172.21.15.70:0/650053000 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8037040 con 0x7f08e8106710 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.851+0000 7f08ede71640 1 -- 172.21.15.70:0/650053000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e819eda0 con 0x7f08e8106710 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.851+0000 7f08e4ff9640 1 -- 172.21.15.70:0/650053000 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f08d8045070 con 0x7f08e8106710 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.851+0000 7f08e4ff9640 1 -- 172.21.15.70:0/650053000 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f08d8047be0 con 0x7f08e8106710 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.852+0000 7f08ede71640 1 -- 172.21.15.70:0/650053000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e8106b90 con 0x7f08e8106710 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.854+0000 7f08e4ff9640 1 -- 172.21.15.70:0/650053000 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f08d8047440 con 0x7f08e8106710 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.911+0000 7f08ede71640 1 -- 172.21.15.70:0/650053000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f08e8195820 con 0x7f08e8106710 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.912+0000 7f08e4ff9640 1 -- 172.21.15.70:0/650053000 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f08d803c840 con 0x7f08e8106710 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.913+0000 7f08ede71640 1 -- 172.21.15.70:0/650053000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 msgr2=0x7f08e819b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:40.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.913+0000 7f08ede71640 1 --2- 172.21.15.70:0/650053000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 0x7f08e819b8e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009940 tx=0x7f08d8032e40 comp rx=0 tx=0).stop 2024-09-12T01:42:40.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.913+0000 7f08ede71640 1 -- 172.21.15.70:0/650053000 shutdown_connections 2024-09-12T01:42:40.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.913+0000 7f08ede71640 1 --2- 172.21.15.70:0/650053000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08e8106710 0x7f08e819b8e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.913+0000 7f08ede71640 1 -- 172.21.15.70:0/650053000 >> 172.21.15.70:0/650053000 conn(0x7f08e8101f60 msgr2=0x7f08e8102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:40.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.913+0000 7f08ede71640 1 -- 172.21.15.70:0/650053000 shutdown_connections 2024-09-12T01:42:40.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:39.913+0000 7f08ede71640 1 -- 172.21.15.70:0/650053000 wait complete. 2024-09-12T01:42:40.495 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T01:42:40.509 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:42:40.510 INFO:teuthology.orchestra.run.smithi070.stdout:Creating mgr... 2024-09-12T01:42:40.510 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T01:42:40.510 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T01:42:40.762 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.x 2024-09-12T01:42:40.762 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T01:42:40.908 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-2d8cad48-70a8-11ef-bcea-c7b262605968.target.wants/ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@.service. 2024-09-12T01:42:41.137 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:40 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/650053000' entity='client.admin' 2024-09-12T01:42:41.137 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:40 smithi070 systemd[1]: Starting Ceph mgr.x for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:42:41.448 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:41 smithi070 podman[31386]: 2024-09-12 01:42:41.137819359 +0000 UTC m=+0.104917229 container create d7b907f8f25794301e619104a6e9c9cdd00fa531a2850e48c6f3b0c900e622f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T01:42:41.448 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:41 smithi070 podman[31386]: 2024-09-12 01:42:41.048274011 +0000 UTC m=+0.015371878 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:42:41.449 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:41 smithi070 podman[31386]: 2024-09-12 01:42:41.381839021 +0000 UTC m=+0.348936889 container init d7b907f8f25794301e619104a6e9c9cdd00fa531a2850e48c6f3b0c900e622f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T01:42:41.449 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:41 smithi070 podman[31386]: 2024-09-12 01:42:41.384649562 +0000 UTC m=+0.351747432 container start d7b907f8f25794301e619104a6e9c9cdd00fa531a2850e48c6f3b0c900e622f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:42:41.449 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:41 smithi070 bash[31386]: d7b907f8f25794301e619104a6e9c9cdd00fa531a2850e48c6f3b0c900e622f6 2024-09-12T01:42:41.461 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:42:41.461 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-09-12T01:42:41.469 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:42:41.469 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-12T01:42:41.469 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-09-12T01:42:41.469 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T01:42:41.477 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:42:41.477 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-09-12T01:42:41.484 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:42:41.485 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-12T01:42:41.485 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-09-12T01:42:41.485 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T01:42:41.485 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr to start... 2024-09-12T01:42:41.485 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr... 2024-09-12T01:42:41.714 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:41 smithi070 systemd[1]: Started Ceph mgr.x for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:42:41.714 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:41 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:41.508+0000 7f323258a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:42:41.714 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:41 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:41.566+0000 7f323258a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:42:41.973 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:41 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:41.717+0000 7f323258a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:42:41.974 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:41 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:41.785+0000 7f323258a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:42:41.974 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:41 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:41.939+0000 7f323258a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:42:42.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:42 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/4137276193' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:42:42.269 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:42 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:42.085+0000 7f323258a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:42:42.647 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:42 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:42.404+0000 7f323258a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:42:42.647 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:42 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:42.464+0000 7f323258a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:42:43.018 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:42 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:42.647+0000 7f323258a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:42:44.018 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:43 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:43.522+0000 7f323258a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:42:44.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:43 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:43.589+0000 7f323258a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:42:44.563 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:44 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:44.300+0000 7f323258a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:42:44.563 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:44 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:44.416+0000 7f323258a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:42:44.563 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:44 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:44.563+0000 7f323258a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:42:44.840 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:44 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:44.624+0000 7f323258a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:42:44.840 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:44 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:44.772+0000 7f323258a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:42:44.840 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:44 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:44.840+0000 7f323258a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:42:45.125 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:44 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:44.900+0000 7f323258a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:42:45.125 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:45 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:45.057+0000 7f323258a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:42:45.125 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:45 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:45.125+0000 7f323258a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:42:45.350 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-12T01:42:45.360 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:42:45.360 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:42:45.360 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:42:45.360 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:42:45.360 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:42:45.360 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:42:45.361 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:42:45.362 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:42:34:901597+0000", 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:45.363 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:42:34.902315+0000", 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:42:45.364 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.905+0000 7f72bb0f0640 1 Processor -- start 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.905+0000 7f72bb0f0640 1 -- start start 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.905+0000 7f72bb0f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 0x7f72b410a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.905+0000 7f72bb0f0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72b4075af0 con 0x7f72b4108220 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.906+0000 7f72b8e8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 0x7f72b410a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.906+0000 7f72b8e8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 0x7f72b410a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51838/0 (socket says 172.21.15.70:51838) 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.906+0000 7f72b8e8c640 1 -- 172.21.15.70:0/2520121360 learned_addr learned my addr 172.21.15.70:0/2520121360 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.906+0000 7f72b8e8c640 1 -- 172.21.15.70:0/2520121360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b410ab50 con 0x7f72b4108220 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.907+0000 7f72b8e8c640 1 --2- 172.21.15.70:0/2520121360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 0x7f72b410a610 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009820 tx=0x7f72a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f100dc691d6d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.907+0000 7f72b37fe640 1 -- 172.21.15.70:0/2520121360 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a8037070 con 0x7f72b4108220 2024-09-12T01:42:45.365 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.907+0000 7f72b37fe640 1 -- 172.21.15.70:0/2520121360 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f72a8032920 con 0x7f72b4108220 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.907+0000 7f72b37fe640 1 -- 172.21.15.70:0/2520121360 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a8030950 con 0x7f72b4108220 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.907+0000 7f72bb0f0640 1 -- 172.21.15.70:0/2520121360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 msgr2=0x7f72b410a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.907+0000 7f72bb0f0640 1 --2- 172.21.15.70:0/2520121360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 0x7f72b410a610 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009820 tx=0x7f72a802a270 comp rx=0 tx=0).stop 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.908+0000 7f72bb0f0640 1 -- 172.21.15.70:0/2520121360 shutdown_connections 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.908+0000 7f72bb0f0640 1 --2- 172.21.15.70:0/2520121360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 0x7f72b410a610 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.908+0000 7f72bb0f0640 1 -- 172.21.15.70:0/2520121360 >> 172.21.15.70:0/2520121360 conn(0x7f72b4101ee0 msgr2=0x7f72b4104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.908+0000 7f72bb0f0640 1 -- 172.21.15.70:0/2520121360 shutdown_connections 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.908+0000 7f72bb0f0640 1 -- 172.21.15.70:0/2520121360 wait complete. 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.908+0000 7f72bb0f0640 1 Processor -- start 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.908+0000 7f72bb0f0640 1 -- start start 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.908+0000 7f72bb0f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 0x7f72b419da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.908+0000 7f72bb0f0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72b410bc50 con 0x7f72b4108220 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.908+0000 7f72b8e8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 0x7f72b419da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.908+0000 7f72b8e8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 0x7f72b419da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51846/0 (socket says 172.21.15.70:51846) 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.908+0000 7f72b8e8c640 1 -- 172.21.15.70:0/4137276193 learned_addr learned my addr 172.21.15.70:0/4137276193 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.909+0000 7f72b8e8c640 1 -- 172.21.15.70:0/4137276193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b419df40 con 0x7f72b4108220 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.909+0000 7f72b8e8c640 1 --2- 172.21.15.70:0/4137276193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 0x7f72b419da00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f72a8006f10 tx=0x7f72a80327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.909+0000 7f72b1ffb640 1 -- 172.21.15.70:0/4137276193 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a8037040 con 0x7f72b4108220 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.909+0000 7f72bb0f0640 1 -- 172.21.15.70:0/4137276193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b419e1d0 con 0x7f72b4108220 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.909+0000 7f72b1ffb640 1 -- 172.21.15.70:0/4137276193 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f72a8040070 con 0x7f72b4108220 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.909+0000 7f72b1ffb640 1 -- 172.21.15.70:0/4137276193 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a803a630 con 0x7f72b4108220 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.909+0000 7f72bb0f0640 1 -- 172.21.15.70:0/4137276193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b41a0ec0 con 0x7f72b4108220 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.909+0000 7f72b1ffb640 1 -- 172.21.15.70:0/4137276193 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f72a803a870 con 0x7f72b4108220 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.909+0000 7f72b1ffb640 1 -- 172.21.15.70:0/4137276193 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f72a8045b40 con 0x7f72b4108220 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.910+0000 7f72bb0f0640 1 -- 172.21.15.70:0/4137276193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b4108680 con 0x7f72b4108220 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.912+0000 7f72b1ffb640 1 -- 172.21.15.70:0/4137276193 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f72a80328e0 con 0x7f72b4108220 2024-09-12T01:42:45.367 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.973+0000 7f72bb0f0640 1 -- 172.21.15.70:0/4137276193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f72b41a1440 con 0x7f72b4108220 2024-09-12T01:42:45.368 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.974+0000 7f72b1ffb640 1 -- 172.21.15.70:0/4137276193 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f72a8032d00 con 0x7f72b4108220 2024-09-12T01:42:45.368 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.975+0000 7f72bb0f0640 1 -- 172.21.15.70:0/4137276193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 msgr2=0x7f72b419da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:45.368 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.975+0000 7f72bb0f0640 1 --2- 172.21.15.70:0/4137276193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 0x7f72b419da00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f72a8006f10 tx=0x7f72a80327d0 comp rx=0 tx=0).stop 2024-09-12T01:42:45.368 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.975+0000 7f72bb0f0640 1 -- 172.21.15.70:0/4137276193 shutdown_connections 2024-09-12T01:42:45.368 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.975+0000 7f72bb0f0640 1 --2- 172.21.15.70:0/4137276193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72b4108220 0x7f72b419da00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:45.368 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.975+0000 7f72bb0f0640 1 -- 172.21.15.70:0/4137276193 >> 172.21.15.70:0/4137276193 conn(0x7f72b4101ee0 msgr2=0x7f72b41029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:45.368 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.975+0000 7f72bb0f0640 1 -- 172.21.15.70:0/4137276193 shutdown_connections 2024-09-12T01:42:45.368 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:41.975+0000 7f72bb0f0640 1 -- 172.21.15.70:0/4137276193 wait complete. 2024-09-12T01:42:45.368 INFO:teuthology.orchestra.run.smithi070.stdout:mgr not available, waiting (1/15)... 2024-09-12T01:42:45.398 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:45 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:45.194+0000 7f323258a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:42:45.398 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:45 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:45.276+0000 7f323258a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:42:45.398 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:45 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:45.335+0000 7f323258a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:42:45.398 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:45 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:45.397+0000 7f323258a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:42:46.519 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:46.199+0000 7f323258a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:42:46.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: Activating manager daemon x 2024-09-12T01:42:46.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: mgrmap e2: x(active, starting, since 0.00334791s) 2024-09-12T01:42:46.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: from='mgr.14100 172.21.15.70:0/3812417860' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:42:46.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: from='mgr.14100 172.21.15.70:0/3812417860' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:42:46.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: from='mgr.14100 172.21.15.70:0/3812417860' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:42:46.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: from='mgr.14100 172.21.15.70:0/3812417860' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:42:46.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: from='mgr.14100 172.21.15.70:0/3812417860' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:42:46.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: Manager daemon x is now available 2024-09-12T01:42:46.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: from='mgr.14100 172.21.15.70:0/3812417860' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:42:46.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: from='mgr.14100 172.21.15.70:0/3812417860' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:42:46.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: from='mgr.14100 172.21.15.70:0/3812417860' entity='mgr.x' 2024-09-12T01:42:46.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: from='mgr.14100 172.21.15.70:0/3812417860' entity='mgr.x' 2024-09-12T01:42:46.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:46 smithi070 ceph-mon[31177]: from='mgr.14100 172.21.15.70:0/3812417860' entity='mgr.x' 2024-09-12T01:42:48.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:48 smithi070 ceph-mon[31177]: mgrmap e3: x(active, since 1.00736s) 2024-09-12T01:42:49.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:49 smithi070 ceph-mon[31177]: mgrmap e4: x(active, since 2s) 2024-09-12T01:42:51.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:51 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/972690985' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:42:51.828 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-12T01:42:51.828 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:42:51.828 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:42:51.828 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:42:51.828 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:42:51.828 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:42:51.828 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:42:51.828 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:51.829 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:42:51.829 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:42:51.829 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:42:51.829 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:42:51.829 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:42:51.829 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T01:42:51.829 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:42:51.829 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-12T01:42:51.829 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:42:51.829 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:42:51.829 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T01:42:51.830 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:42:51.830 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:51.830 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:42:51.830 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:42:51.830 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:42:51.830 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:42:51.830 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:42:51.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:42:51.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:42:51.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:42:51.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:51.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:42:51.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:42:51.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:42:51.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:42:51.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:42:51.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:42:51.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:42:51.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:42:51.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:42:51.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:51.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:42:51.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:42:51.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T01:42:34:901597+0000", 2024-09-12T01:42:51.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:42:51.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:42:51.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:51.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:42:51.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:42:51.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:42:51.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:42:51.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:42:51.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:42:51.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:42:51.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:42:51.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:42:51.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:51.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:42:51.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:42:51.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:42:34.902315+0000", 2024-09-12T01:42:51.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:42:51.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:42:51.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:42:51.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:42:51.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.878+0000 7fdf4e5b5640 1 Processor -- start 2024-09-12T01:42:51.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.878+0000 7fdf4e5b5640 1 -- start start 2024-09-12T01:42:51.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.878+0000 7fdf4e5b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 0x7fdf48106470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:51.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.878+0000 7fdf4e5b5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdf48075a90 con 0x7fdf48106070 2024-09-12T01:42:51.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.879+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 0x7fdf48106470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:51.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.879+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 0x7fdf48106470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43960/0 (socket says 172.21.15.70:43960) 2024-09-12T01:42:51.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.879+0000 7fdf47fff640 1 -- 172.21.15.70:0/3636437079 learned_addr learned my addr 172.21.15.70:0/3636437079 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:51.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.879+0000 7fdf47fff640 1 -- 172.21.15.70:0/3636437079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf481069b0 con 0x7fdf48106070 2024-09-12T01:42:51.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.880+0000 7fdf47fff640 1 --2- 172.21.15.70:0/3636437079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 0x7fdf48106470 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009820 tx=0x7fdf3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83264c9202432a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:51.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.880+0000 7fdf477fe640 1 -- 172.21.15.70:0/3636437079 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf38037070 con 0x7fdf48106070 2024-09-12T01:42:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.880+0000 7fdf477fe640 1 -- 172.21.15.70:0/3636437079 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fdf38032920 con 0x7fdf48106070 2024-09-12T01:42:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.880+0000 7fdf477fe640 1 -- 172.21.15.70:0/3636437079 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf38030950 con 0x7fdf48106070 2024-09-12T01:42:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.880+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/3636437079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 msgr2=0x7fdf48106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.880+0000 7fdf4e5b5640 1 --2- 172.21.15.70:0/3636437079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 0x7fdf48106470 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009820 tx=0x7fdf3802a270 comp rx=0 tx=0).stop 2024-09-12T01:42:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.881+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/3636437079 shutdown_connections 2024-09-12T01:42:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.881+0000 7fdf4e5b5640 1 --2- 172.21.15.70:0/3636437079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 0x7fdf48106470 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.881+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/3636437079 >> 172.21.15.70:0/3636437079 conn(0x7fdf48101ee0 msgr2=0x7fdf48104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.881+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/3636437079 shutdown_connections 2024-09-12T01:42:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.881+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/3636437079 wait complete. 2024-09-12T01:42:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.881+0000 7fdf4e5b5640 1 Processor -- start 2024-09-12T01:42:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.881+0000 7fdf4e5b5640 1 -- start start 2024-09-12T01:42:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.881+0000 7fdf4e5b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 0x7fdf4819d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.881+0000 7fdf4e5b5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdf48107b10 con 0x7fdf48106070 2024-09-12T01:42:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.881+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 0x7fdf4819d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.881+0000 7fdf47fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 0x7fdf4819d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43962/0 (socket says 172.21.15.70:43962) 2024-09-12T01:42:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.881+0000 7fdf47fff640 1 -- 172.21.15.70:0/972690985 learned_addr learned my addr 172.21.15.70:0/972690985 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.882+0000 7fdf47fff640 1 -- 172.21.15.70:0/972690985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4819df20 con 0x7fdf48106070 2024-09-12T01:42:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.882+0000 7fdf47fff640 1 --2- 172.21.15.70:0/972690985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 0x7fdf4819d9e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf38006f10 tx=0x7fdf380327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.882+0000 7fdf45ffb640 1 -- 172.21.15.70:0/972690985 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf38037040 con 0x7fdf48106070 2024-09-12T01:42:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.882+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/972690985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4819e1b0 con 0x7fdf48106070 2024-09-12T01:42:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.882+0000 7fdf45ffb640 1 -- 172.21.15.70:0/972690985 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fdf38040070 con 0x7fdf48106070 2024-09-12T01:42:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.882+0000 7fdf45ffb640 1 -- 172.21.15.70:0/972690985 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf3803a630 con 0x7fdf48106070 2024-09-12T01:42:51.846 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.882+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/972690985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf481a0ea0 con 0x7fdf48106070 2024-09-12T01:42:51.846 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.883+0000 7fdf45ffb640 1 -- 172.21.15.70:0/972690985 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fdf3803a870 con 0x7fdf48106070 2024-09-12T01:42:51.846 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.883+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/972690985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf48106470 con 0x7fdf48106070 2024-09-12T01:42:51.846 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.883+0000 7fdf45ffb640 1 --2- 172.21.15.70:0/972690985 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7fdf34038f20 0x7fdf3403b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:51.846 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.883+0000 7fdf45ffb640 1 -- 172.21.15.70:0/972690985 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdf3806c070 con 0x7fdf48106070 2024-09-12T01:42:51.846 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.883+0000 7fdf3ffff640 1 --2- 172.21.15.70:0/972690985 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7fdf34038f20 0x7fdf3403b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:51.846 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.884+0000 7fdf3ffff640 1 --2- 172.21.15.70:0/972690985 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7fdf34038f20 0x7fdf3403b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdf300098c0 tx=0x7fdf30006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:51.846 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:50.888+0000 7fdf45ffb640 1 -- 172.21.15.70:0/972690985 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf38041270 con 0x7fdf48106070 2024-09-12T01:42:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:51.127+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/972690985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fdf480008d0 con 0x7fdf48106070 2024-09-12T01:42:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:51.127+0000 7fdf45ffb640 1 -- 172.21.15.70:0/972690985 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fdf3806bdd0 con 0x7fdf48106070 2024-09-12T01:42:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:51.130+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/972690985 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7fdf34038f20 msgr2=0x7fdf3403b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:51.130+0000 7fdf4e5b5640 1 --2- 172.21.15.70:0/972690985 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7fdf34038f20 0x7fdf3403b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdf300098c0 tx=0x7fdf30006db0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:51.130+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/972690985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 msgr2=0x7fdf4819d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:51.130+0000 7fdf4e5b5640 1 --2- 172.21.15.70:0/972690985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 0x7fdf4819d9e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf38006f10 tx=0x7fdf380327d0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:51.130+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/972690985 shutdown_connections 2024-09-12T01:42:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:51.130+0000 7fdf4e5b5640 1 --2- 172.21.15.70:0/972690985 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7fdf34038f20 0x7fdf3403b3e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:51.130+0000 7fdf4e5b5640 1 --2- 172.21.15.70:0/972690985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf48106070 0x7fdf4819d9e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:51.130+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/972690985 >> 172.21.15.70:0/972690985 conn(0x7fdf48101ee0 msgr2=0x7fdf48191ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:51.130+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/972690985 shutdown_connections 2024-09-12T01:42:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:51.130+0000 7fdf4e5b5640 1 -- 172.21.15.70:0/972690985 wait complete. 2024-09-12T01:42:51.848 INFO:teuthology.orchestra.run.smithi070.stdout:mgr is available 2024-09-12T01:42:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:52 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1309706761' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T01:42:52.947 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-12T01:42:52.947 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T01:42:52.947 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout fsid = 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:42:52.947 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-09-12T01:42:52.947 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T01:42:52.947 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T01:42:52.947 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T01:42:52.947 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T01:42:52.947 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-12T01:42:52.947 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T01:42:52.947 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T01:42:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-12T01:42:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T01:42:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T01:42:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T01:42:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T01:42:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T01:42:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T01:42:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.194+0000 7f1a35cdb640 1 Processor -- start 2024-09-12T01:42:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.194+0000 7f1a35cdb640 1 -- start start 2024-09-12T01:42:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.194+0000 7f1a35cdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 0x7f1a301081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.194+0000 7f1a35cdb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301087a0 con 0x7f1a30107dd0 2024-09-12T01:42:52.948 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.195+0000 7f1a2f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 0x7f1a301081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:52.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.195+0000 7f1a2f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 0x7f1a301081d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43978/0 (socket says 172.21.15.70:43978) 2024-09-12T01:42:52.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.195+0000 7f1a2f7fe640 1 -- 172.21.15.70:0/1081815587 learned_addr learned my addr 172.21.15.70:0/1081815587 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:52.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.195+0000 7f1a2f7fe640 1 -- 172.21.15.70:0/1081815587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a301069a0 con 0x7f1a30107dd0 2024-09-12T01:42:52.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.196+0000 7f1a2f7fe640 1 --2- 172.21.15.70:0/1081815587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 0x7f1a301081d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009e80 tx=0x7f1a2002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0261015c568a83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:52.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.196+0000 7f1a2e7fc640 1 -- 172.21.15.70:0/1081815587 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a20036070 con 0x7f1a30107dd0 2024-09-12T01:42:52.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.196+0000 7f1a2e7fc640 1 -- 172.21.15.70:0/1081815587 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1a200318e0 con 0x7f1a30107dd0 2024-09-12T01:42:52.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.196+0000 7f1a2e7fc640 1 -- 172.21.15.70:0/1081815587 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a20007b00 con 0x7f1a30107dd0 2024-09-12T01:42:52.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.196+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1081815587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 msgr2=0x7f1a301081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:52.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.196+0000 7f1a35cdb640 1 --2- 172.21.15.70:0/1081815587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 0x7f1a301081d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009e80 tx=0x7f1a2002a7a0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.196+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1081815587 shutdown_connections 2024-09-12T01:42:52.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.196+0000 7f1a35cdb640 1 --2- 172.21.15.70:0/1081815587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 0x7f1a301081d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.196+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1081815587 >> 172.21.15.70:0/1081815587 conn(0x7f1a30101660 msgr2=0x7f1a30103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.196+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1081815587 shutdown_connections 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.196+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1081815587 wait complete. 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.197+0000 7f1a35cdb640 1 Processor -- start 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.197+0000 7f1a35cdb640 1 -- start start 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.197+0000 7f1a35cdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 0x7f1a30191aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.197+0000 7f1a35cdb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3010ad60 con 0x7f1a30107dd0 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.197+0000 7f1a2f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 0x7f1a30191aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.197+0000 7f1a2f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 0x7f1a30191aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43990/0 (socket says 172.21.15.70:43990) 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.197+0000 7f1a2f7fe640 1 -- 172.21.15.70:0/1309706761 learned_addr learned my addr 172.21.15.70:0/1309706761 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.198+0000 7f1a2f7fe640 1 -- 172.21.15.70:0/1309706761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a30191fe0 con 0x7f1a30107dd0 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.198+0000 7f1a2f7fe640 1 --2- 172.21.15.70:0/1309706761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 0x7f1a30191aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1a200076d0 tx=0x7f1a200316a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.198+0000 7f1a2cff9640 1 -- 172.21.15.70:0/1309706761 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a20041020 con 0x7f1a30107dd0 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.198+0000 7f1a2cff9640 1 -- 172.21.15.70:0/1309706761 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1a20007e50 con 0x7f1a30107dd0 2024-09-12T01:42:52.950 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.198+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1309706761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a301901d0 con 0x7f1a30107dd0 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.198+0000 7f1a2cff9640 1 -- 172.21.15.70:0/1309706761 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a20036040 con 0x7f1a30107dd0 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.198+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1309706761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a30190710 con 0x7f1a30107dd0 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.199+0000 7f1a2cff9640 1 -- 172.21.15.70:0/1309706761 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f1a20044020 con 0x7f1a30107dd0 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.199+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1309706761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a30108250 con 0x7f1a30107dd0 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.199+0000 7f1a2cff9640 1 --2- 172.21.15.70:0/1309706761 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f1a18038f70 0x7f1a1803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.199+0000 7f1a2effd640 1 --2- 172.21.15.70:0/1309706761 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f1a18038f70 0x7f1a1803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.199+0000 7f1a2cff9640 1 -- 172.21.15.70:0/1309706761 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1a2006cf40 con 0x7f1a30107dd0 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.200+0000 7f1a2effd640 1 --2- 172.21.15.70:0/1309706761 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f1a18038f70 0x7f1a1803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1a240098c0 tx=0x7f1a24006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.204+0000 7f1a2cff9640 1 -- 172.21.15.70:0/1309706761 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a2004b020 con 0x7f1a30107dd0 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.369+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1309706761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f1a30195880 con 0x7f1a30107dd0 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.370+0000 7f1a2cff9640 1 -- 172.21.15.70:0/1309706761 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f1a20046520 con 0x7f1a30107dd0 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.372+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1309706761 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f1a18038f70 msgr2=0x7f1a1803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:52.951 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.372+0000 7f1a35cdb640 1 --2- 172.21.15.70:0/1309706761 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f1a18038f70 0x7f1a1803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1a240098c0 tx=0x7f1a24006db0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.952 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.372+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1309706761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 msgr2=0x7f1a30191aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:52.952 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.372+0000 7f1a35cdb640 1 --2- 172.21.15.70:0/1309706761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 0x7f1a30191aa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1a200076d0 tx=0x7f1a200316a0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.952 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.372+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1309706761 shutdown_connections 2024-09-12T01:42:52.952 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.372+0000 7f1a35cdb640 1 --2- 172.21.15.70:0/1309706761 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f1a18038f70 0x7f1a1803b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.952 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.372+0000 7f1a35cdb640 1 --2- 172.21.15.70:0/1309706761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a30107dd0 0x7f1a30191aa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.952 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.372+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1309706761 >> 172.21.15.70:0/1309706761 conn(0x7f1a30101660 msgr2=0x7f1a301025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:52.952 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.372+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1309706761 shutdown_connections 2024-09-12T01:42:52.952 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:52.372+0000 7f1a35cdb640 1 -- 172.21.15.70:0/1309706761 wait complete. 2024-09-12T01:42:52.952 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling cephadm module... 2024-09-12T01:42:53.943 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:53 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1294114844' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T01:42:53.943 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:53 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: ignoring --setuser ceph since I am not root 2024-09-12T01:42:53.943 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:53 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: ignoring --setgroup ceph since I am not root 2024-09-12T01:42:53.943 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:53 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:53.739+0000 7f2be3619040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:42:53.943 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:53 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:53.795+0000 7f2be3619040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:42:53.943 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:53 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:53.943+0000 7f2be3619040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:42:54.184 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.327+0000 7f4b6e72c640 1 Processor -- start 2024-09-12T01:42:54.184 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.327+0000 7f4b6e72c640 1 -- start start 2024-09-12T01:42:54.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.327+0000 7f4b6e72c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 0x7f4b68106b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.327+0000 7f4b6e72c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b681070d0 con 0x7f4b68106700 2024-09-12T01:42:54.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.327+0000 7f4b67fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 0x7f4b68106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.327+0000 7f4b67fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 0x7f4b68106b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43994/0 (socket says 172.21.15.70:43994) 2024-09-12T01:42:54.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.327+0000 7f4b67fff640 1 -- 172.21.15.70:0/1803817525 learned_addr learned my addr 172.21.15.70:0/1803817525 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:54.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.328+0000 7f4b67fff640 1 -- 172.21.15.70:0/1803817525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b68107900 con 0x7f4b68106700 2024-09-12T01:42:54.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.328+0000 7f4b67fff640 1 --2- 172.21.15.70:0/1803817525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 0x7f4b68106b00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009820 tx=0x7f4b5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f0e5743b0fbc12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:54.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.328+0000 7f4b677fe640 1 -- 172.21.15.70:0/1803817525 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b58037070 con 0x7f4b68106700 2024-09-12T01:42:54.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.328+0000 7f4b677fe640 1 -- 172.21.15.70:0/1803817525 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4b58032920 con 0x7f4b68106700 2024-09-12T01:42:54.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.329+0000 7f4b677fe640 1 -- 172.21.15.70:0/1803817525 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b58030950 con 0x7f4b68106700 2024-09-12T01:42:54.185 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.329+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1803817525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 msgr2=0x7f4b68106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.329+0000 7f4b6e72c640 1 --2- 172.21.15.70:0/1803817525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 0x7f4b68106b00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009820 tx=0x7f4b5802a270 comp rx=0 tx=0).stop 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.329+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1803817525 shutdown_connections 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.329+0000 7f4b6e72c640 1 --2- 172.21.15.70:0/1803817525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 0x7f4b68106b00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.329+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1803817525 >> 172.21.15.70:0/1803817525 conn(0x7f4b68101f90 msgr2=0x7f4b681043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.329+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1803817525 shutdown_connections 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.329+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1803817525 wait complete. 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.330+0000 7f4b6e72c640 1 Processor -- start 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.330+0000 7f4b6e72c640 1 -- start start 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.330+0000 7f4b6e72c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 0x7f4b680756d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.330+0000 7f4b6e72c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6810acb0 con 0x7f4b68106700 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.330+0000 7f4b67fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 0x7f4b680756d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.330+0000 7f4b67fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 0x7f4b680756d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44002/0 (socket says 172.21.15.70:44002) 2024-09-12T01:42:54.186 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.330+0000 7f4b67fff640 1 -- 172.21.15.70:0/1294114844 learned_addr learned my addr 172.21.15.70:0/1294114844 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.330+0000 7f4b67fff640 1 -- 172.21.15.70:0/1294114844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6819e570 con 0x7f4b68106700 2024-09-12T01:42:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.330+0000 7f4b67fff640 1 --2- 172.21.15.70:0/1294114844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 0x7f4b680756d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009940 tx=0x7f4b58032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.331+0000 7f4b65ffb640 1 -- 172.21.15.70:0/1294114844 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b58042070 con 0x7f4b68106700 2024-09-12T01:42:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.331+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1294114844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6819e740 con 0x7f4b68106700 2024-09-12T01:42:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.331+0000 7f4b65ffb640 1 -- 172.21.15.70:0/1294114844 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4b580326b0 con 0x7f4b68106700 2024-09-12T01:42:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.331+0000 7f4b65ffb640 1 -- 172.21.15.70:0/1294114844 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b58037040 con 0x7f4b68106700 2024-09-12T01:42:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.331+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1294114844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6819eb60 con 0x7f4b68106700 2024-09-12T01:42:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.331+0000 7f4b65ffb640 1 -- 172.21.15.70:0/1294114844 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f4b58045070 con 0x7f4b68106700 2024-09-12T01:42:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.332+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1294114844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b68106b80 con 0x7f4b68106700 2024-09-12T01:42:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.332+0000 7f4b65ffb640 1 --2- 172.21.15.70:0/1294114844 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f4b54038f20 0x7f4b5403b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.332+0000 7f4b65ffb640 1 -- 172.21.15.70:0/1294114844 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4b5806bec0 con 0x7f4b68106700 2024-09-12T01:42:54.187 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.332+0000 7f4b5ffff640 1 --2- 172.21.15.70:0/1294114844 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f4b54038f20 0x7f4b5403b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.332+0000 7f4b5ffff640 1 --2- 172.21.15.70:0/1294114844 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f4b54038f20 0x7f4b5403b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4b500098c0 tx=0x7f4b50006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.337+0000 7f4b65ffb640 1 -- 172.21.15.70:0/1294114844 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b5806b8e0 con 0x7f4b68106700 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.546+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1294114844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f4b6819f3f0 con 0x7f4b68106700 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.598+0000 7f4b65ffb640 1 -- 172.21.15.70:0/1294114844 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f4b5803cd20 con 0x7f4b68106700 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.599+0000 7f4b65ffb640 1 -- 172.21.15.70:0/1294114844 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f4b58070070 con 0x7f4b68106700 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.600+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1294114844 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f4b54038f20 msgr2=0x7f4b5403b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.600+0000 7f4b6e72c640 1 --2- 172.21.15.70:0/1294114844 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f4b54038f20 0x7f4b5403b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4b500098c0 tx=0x7f4b50006db0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.600+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1294114844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 msgr2=0x7f4b680756d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.600+0000 7f4b6e72c640 1 --2- 172.21.15.70:0/1294114844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 0x7f4b680756d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009940 tx=0x7f4b58032e40 comp rx=0 tx=0).stop 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.600+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1294114844 shutdown_connections 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.600+0000 7f4b6e72c640 1 --2- 172.21.15.70:0/1294114844 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f4b54038f20 0x7f4b5403b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.600+0000 7f4b6e72c640 1 --2- 172.21.15.70:0/1294114844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b68106700 0x7f4b680756d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.188 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.600+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1294114844 >> 172.21.15.70:0/1294114844 conn(0x7f4b68101f90 msgr2=0x7f4b68102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:54.189 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.601+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1294114844 shutdown_connections 2024-09-12T01:42:54.189 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:53.601+0000 7f4b6e72c640 1 -- 172.21.15.70:0/1294114844 wait complete. 2024-09-12T01:42:54.268 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:54 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:54.011+0000 7f2be3619040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:42:54.269 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:54 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:54.160+0000 7f2be3619040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:42:54.580 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:54 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:54.306+0000 7f2be3619040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:42:54.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:54 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1294114844' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T01:42:54.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:54 smithi070 ceph-mon[31177]: mgrmap e5: x(active, since 7s) 2024-09-12T01:42:54.883 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:54 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:54.629+0000 7f2be3619040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:42:54.883 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:54 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:54.691+0000 7f2be3619040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:42:54.883 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:54 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:54.882+0000 7f2be3619040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:42:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:42:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T01:42:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:42:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T01:42:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T01:42:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:42:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.590+0000 7f13d67f2640 1 Processor -- start 2024-09-12T01:42:55.408 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.590+0000 7f13d67f2640 1 -- start start 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.590+0000 7f13d67f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 0x7f13d0106ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.590+0000 7f13d67f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13d0107080 con 0x7f13d01066b0 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.590+0000 7f13cffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 0x7f13d0106ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.590+0000 7f13cffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 0x7f13d0106ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44030/0 (socket says 172.21.15.70:44030) 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.590+0000 7f13cffff640 1 -- 172.21.15.70:0/4291575764 learned_addr learned my addr 172.21.15.70:0/4291575764 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.591+0000 7f13cffff640 1 -- 172.21.15.70:0/4291575764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d01078b0 con 0x7f13d01066b0 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.591+0000 7f13cffff640 1 --2- 172.21.15.70:0/4291575764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 0x7f13d0106ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009820 tx=0x7f13c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d8dcff8bc74766 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.592+0000 7f13cf7fe640 1 -- 172.21.15.70:0/4291575764 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c0037070 con 0x7f13d01066b0 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.592+0000 7f13cf7fe640 1 -- 172.21.15.70:0/4291575764 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f13c0032920 con 0x7f13d01066b0 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.592+0000 7f13cf7fe640 1 -- 172.21.15.70:0/4291575764 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c0030950 con 0x7f13d01066b0 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.592+0000 7f13d67f2640 1 -- 172.21.15.70:0/4291575764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 msgr2=0x7f13d0106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.592+0000 7f13d67f2640 1 --2- 172.21.15.70:0/4291575764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 0x7f13d0106ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009820 tx=0x7f13c002a270 comp rx=0 tx=0).stop 2024-09-12T01:42:55.409 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.592+0000 7f13d67f2640 1 -- 172.21.15.70:0/4291575764 shutdown_connections 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.592+0000 7f13d67f2640 1 --2- 172.21.15.70:0/4291575764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 0x7f13d0106ab0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.592+0000 7f13d67f2640 1 -- 172.21.15.70:0/4291575764 >> 172.21.15.70:0/4291575764 conn(0x7f13d0101ee0 msgr2=0x7f13d0104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.592+0000 7f13d67f2640 1 -- 172.21.15.70:0/4291575764 shutdown_connections 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.592+0000 7f13d67f2640 1 -- 172.21.15.70:0/4291575764 wait complete. 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.593+0000 7f13d67f2640 1 Processor -- start 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.593+0000 7f13d67f2640 1 -- start start 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.593+0000 7f13d67f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 0x7f13d019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.593+0000 7f13d67f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13d010ac60 con 0x7f13d01066b0 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.593+0000 7f13cffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 0x7f13d019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.593+0000 7f13cffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 0x7f13d019b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44042/0 (socket says 172.21.15.70:44042) 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.593+0000 7f13cffff640 1 -- 172.21.15.70:0/2018185691 learned_addr learned my addr 172.21.15.70:0/2018185691 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.594+0000 7f13cffff640 1 -- 172.21.15.70:0/2018185691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d019bd70 con 0x7f13d01066b0 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.594+0000 7f13cffff640 1 --2- 172.21.15.70:0/2018185691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 0x7f13d019b830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f13c0006f10 tx=0x7f13c00327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:55.410 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.594+0000 7f13cdffb640 1 -- 172.21.15.70:0/2018185691 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c0037040 con 0x7f13d01066b0 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.594+0000 7f13cdffb640 1 -- 172.21.15.70:0/2018185691 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f13c0040070 con 0x7f13d01066b0 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.594+0000 7f13d67f2640 1 -- 172.21.15.70:0/2018185691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d019c000 con 0x7f13d01066b0 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.594+0000 7f13cdffb640 1 -- 172.21.15.70:0/2018185691 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c003a610 con 0x7f13d01066b0 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.594+0000 7f13d67f2640 1 -- 172.21.15.70:0/2018185691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d019ecf0 con 0x7f13d01066b0 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.595+0000 7f13cdffb640 1 -- 172.21.15.70:0/2018185691 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f13c003a800 con 0x7f13d01066b0 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.595+0000 7f13cdffb640 1 --2- 172.21.15.70:0/2018185691 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f13bc038fc0 0x7f13bc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.595+0000 7f13d67f2640 1 -- 172.21.15.70:0/2018185691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d0106b30 con 0x7f13d01066b0 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.595+0000 7f13c7fff640 1 -- 172.21.15.70:0/2018185691 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f13bc038fc0 msgr2=0x7f13bc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1934942517 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.595+0000 7f13cdffb640 1 -- 172.21.15.70:0/2018185691 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f13c006d160 con 0x7f13d01066b0 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.595+0000 7f13c7fff640 1 --2- 172.21.15.70:0/2018185691 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f13bc038fc0 0x7f13bc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.600+0000 7f13cdffb640 1 -- 172.21.15.70:0/2018185691 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13c0036170 con 0x7f13d01066b0 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.796+0000 7f13c7fff640 1 -- 172.21.15.70:0/2018185691 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f13bc038fc0 msgr2=0x7f13bc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1934942517 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.796+0000 7f13c7fff640 1 --2- 172.21.15.70:0/2018185691 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f13bc038fc0 0x7f13bc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:42:55.411 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.817+0000 7f13d67f2640 1 -- 172.21.15.70:0/2018185691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f13d002da40 con 0x7f13d01066b0 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.817+0000 7f13cdffb640 1 -- 172.21.15.70:0/2018185691 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f13c0041270 con 0x7f13d01066b0 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.819+0000 7f13d67f2640 1 -- 172.21.15.70:0/2018185691 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f13bc038fc0 msgr2=0x7f13bc03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.819+0000 7f13d67f2640 1 --2- 172.21.15.70:0/2018185691 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f13bc038fc0 0x7f13bc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.819+0000 7f13d67f2640 1 -- 172.21.15.70:0/2018185691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 msgr2=0x7f13d019b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.819+0000 7f13d67f2640 1 --2- 172.21.15.70:0/2018185691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 0x7f13d019b830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f13c0006f10 tx=0x7f13c00327d0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.819+0000 7f13d67f2640 1 -- 172.21.15.70:0/2018185691 shutdown_connections 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.819+0000 7f13d67f2640 1 --2- 172.21.15.70:0/2018185691 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f13bc038fc0 0x7f13bc03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.819+0000 7f13d67f2640 1 --2- 172.21.15.70:0/2018185691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13d01066b0 0x7f13d019b830 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.819+0000 7f13d67f2640 1 -- 172.21.15.70:0/2018185691 >> 172.21.15.70:0/2018185691 conn(0x7f13d0101ee0 msgr2=0x7f13d0102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.819+0000 7f13d67f2640 1 -- 172.21.15.70:0/2018185691 shutdown_connections 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:54.819+0000 7f13d67f2640 1 -- 172.21.15.70:0/2018185691 wait complete. 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for the mgr to restart... 2024-09-12T01:42:55.412 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr epoch 5... 2024-09-12T01:42:55.755 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:55 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2018185691' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T01:42:56.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:55 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:55.783+0000 7f2be3619040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:42:56.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:55 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:55.849+0000 7f2be3619040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:42:56.669 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:56 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:56.553+0000 7f2be3619040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:42:57.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:56 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:56.669+0000 7f2be3619040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:42:57.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:56 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:56.811+0000 7f2be3619040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:42:57.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:56 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:56.872+0000 7f2be3619040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:42:57.306 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:57.022+0000 7f2be3619040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:42:57.306 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:57.090+0000 7f2be3619040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:42:57.307 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:57.149+0000 7f2be3619040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:42:57.307 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:57.306+0000 7f2be3619040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:42:57.577 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:57.371+0000 7f2be3619040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:42:57.577 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:57.438+0000 7f2be3619040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:42:57.577 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:57.519+0000 7f2be3619040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:42:57.577 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:57.577+0000 7f2be3619040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:42:58.018 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:57.635+0000 7f2be3619040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:42:58.769 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:42:58.410+0000 7f2be3619040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:42:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: Active manager daemon x restarted 2024-09-12T01:42:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: Activating manager daemon x 2024-09-12T01:42:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T01:42:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: mgrmap e6: x(active, starting, since 0.00340223s) 2024-09-12T01:42:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:42:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:42:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:42:58.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:42:58.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:42:58.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: Manager daemon x is now available 2024-09-12T01:42:58.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:42:58.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:42:58.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:42:58.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:42:58.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:42:58.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:58 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:42:59.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:59 smithi070 ceph-mon[31177]: Found migration_current of "None". Setting to last migration. 2024-09-12T01:42:59.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:59 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:42:59.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:59 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:42:59.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:42:59 smithi070 ceph-mon[31177]: mgrmap e7: x(active, since 1.00531s) 2024-09-12T01:42:59.986 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:42:59.986 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T01:42:59.986 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T01:42:59.986 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:42:59.986 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.755+0000 7f8a58547640 1 Processor -- start 2024-09-12T01:42:59.986 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.755+0000 7f8a58547640 1 -- start start 2024-09-12T01:42:59.986 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.756+0000 7f8a58547640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 0x7f8a5010a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:59.986 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.756+0000 7f8a58547640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5007bec0 con 0x7f8a501082f0 2024-09-12T01:42:59.986 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.756+0000 7f8a562e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 0x7f8a5010a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:59.987 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.756+0000 7f8a562e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 0x7f8a5010a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44046/0 (socket says 172.21.15.70:44046) 2024-09-12T01:42:59.987 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.756+0000 7f8a562e3640 1 -- 172.21.15.70:0/2846107866 learned_addr learned my addr 172.21.15.70:0/2846107866 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:59.987 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.756+0000 7f8a562e3640 1 -- 172.21.15.70:0/2846107866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5010ac20 con 0x7f8a501082f0 2024-09-12T01:42:59.987 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.757+0000 7f8a562e3640 1 --2- 172.21.15.70:0/2846107866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 0x7f8a5010a6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009820 tx=0x7f8a4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a98b621b55b6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:59.987 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.757+0000 7f8a552e1640 1 -- 172.21.15.70:0/2846107866 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a4c037070 con 0x7f8a501082f0 2024-09-12T01:42:59.987 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.757+0000 7f8a552e1640 1 -- 172.21.15.70:0/2846107866 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8a4c032920 con 0x7f8a501082f0 2024-09-12T01:42:59.987 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.757+0000 7f8a552e1640 1 -- 172.21.15.70:0/2846107866 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a4c030950 con 0x7f8a501082f0 2024-09-12T01:42:59.987 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.758+0000 7f8a58547640 1 -- 172.21.15.70:0/2846107866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 msgr2=0x7f8a5010a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:59.987 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.758+0000 7f8a58547640 1 --2- 172.21.15.70:0/2846107866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 0x7f8a5010a6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009820 tx=0x7f8a4c02a270 comp rx=0 tx=0).stop 2024-09-12T01:42:59.987 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.758+0000 7f8a58547640 1 -- 172.21.15.70:0/2846107866 shutdown_connections 2024-09-12T01:42:59.987 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.758+0000 7f8a58547640 1 --2- 172.21.15.70:0/2846107866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 0x7f8a5010a6e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:59.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.758+0000 7f8a58547640 1 -- 172.21.15.70:0/2846107866 >> 172.21.15.70:0/2846107866 conn(0x7f8a50101f70 msgr2=0x7f8a50104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:59.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.758+0000 7f8a58547640 1 -- 172.21.15.70:0/2846107866 shutdown_connections 2024-09-12T01:42:59.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.758+0000 7f8a58547640 1 -- 172.21.15.70:0/2846107866 wait complete. 2024-09-12T01:42:59.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.759+0000 7f8a58547640 1 Processor -- start 2024-09-12T01:42:59.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.759+0000 7f8a58547640 1 -- start start 2024-09-12T01:42:59.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.759+0000 7f8a58547640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 0x7f8a50107b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:59.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.759+0000 7f8a58547640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5010bd20 con 0x7f8a501082f0 2024-09-12T01:42:59.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.759+0000 7f8a562e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 0x7f8a50107b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:59.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.759+0000 7f8a562e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 0x7f8a50107b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44060/0 (socket says 172.21.15.70:44060) 2024-09-12T01:42:59.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.759+0000 7f8a562e3640 1 -- 172.21.15.70:0/2760428514 learned_addr learned my addr 172.21.15.70:0/2760428514 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:42:59.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.759+0000 7f8a562e3640 1 -- 172.21.15.70:0/2760428514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a501080b0 con 0x7f8a501082f0 2024-09-12T01:42:59.988 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.759+0000 7f8a562e3640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 0x7f8a50107b70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c031000 tx=0x7f8a4c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.760+0000 7f8a477fe640 1 -- 172.21.15.70:0/2760428514 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a4c042070 con 0x7f8a501082f0 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.760+0000 7f8a58547640 1 -- 172.21.15.70:0/2760428514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a501062a0 con 0x7f8a501082f0 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.760+0000 7f8a477fe640 1 -- 172.21.15.70:0/2760428514 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8a4c0325f0 con 0x7f8a501082f0 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.760+0000 7f8a477fe640 1 -- 172.21.15.70:0/2760428514 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a4c037040 con 0x7f8a501082f0 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.760+0000 7f8a58547640 1 -- 172.21.15.70:0/2760428514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a501067e0 con 0x7f8a501082f0 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.761+0000 7f8a477fe640 1 -- 172.21.15.70:0/2760428514 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f8a4c045070 con 0x7f8a501082f0 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.761+0000 7f8a477fe640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f8a3c038f70 0x7f8a3c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.761+0000 7f8a477fe640 1 -- 172.21.15.70:0/2760428514 --> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8a3c03bb40 con 0x7f8a3c038f70 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.761+0000 7f8a477fe640 1 -- 172.21.15.70:0/2760428514 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8a4c06bff0 con 0x7f8a501082f0 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.761+0000 7f8a55ae2640 1 -- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f8a3c038f70 msgr2=0x7f8a3c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1934942517 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.761+0000 7f8a55ae2640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f8a3c038f70 0x7f8a3c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.962+0000 7f8a55ae2640 1 -- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f8a3c038f70 msgr2=0x7f8a3c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1934942517 2024-09-12T01:42:59.989 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:55.962+0000 7f8a55ae2640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f8a3c038f70 0x7f8a3c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:56.363+0000 7f8a55ae2640 1 -- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f8a3c038f70 msgr2=0x7f8a3c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1934942517 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:56.363+0000 7f8a55ae2640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f8a3c038f70 0x7f8a3c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:57.164+0000 7f8a55ae2640 1 -- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f8a3c038f70 msgr2=0x7f8a3c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1934942517 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:57.164+0000 7f8a55ae2640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f8a3c038f70 0x7f8a3c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:58.413+0000 7f8a477fe640 1 -- 172.21.15.70:0/2760428514 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f8a4c06aaf0 con 0x7f8a501082f0 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:58.413+0000 7f8a477fe640 1 -- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f8a3c038f70 msgr2=0x7f8a3c03b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:58.413+0000 7f8a477fe640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f8a3c038f70 0x7f8a3c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.414+0000 7f8a477fe640 1 -- 172.21.15.70:0/2760428514 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f8a4c03c8e0 con 0x7f8a501082f0 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.414+0000 7f8a477fe640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f8a3c03c8a0 0x7f8a3c03ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.414+0000 7f8a477fe640 1 -- 172.21.15.70:0/2760428514 --> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8a3c03bb40 con 0x7f8a3c03c8a0 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.414+0000 7f8a55ae2640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f8a3c03c8a0 0x7f8a3c03ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.415+0000 7f8a55ae2640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f8a3c03c8a0 0x7f8a3c03ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8a40003980 tx=0x7f8a40006e10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:59.990 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.416+0000 7f8a477fe640 1 -- 172.21.15.70:0/2760428514 <== mgr.14116 v2:172.21.15.70:6800/1352687155 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f8a3c03bb40 con 0x7f8a3c03c8a0 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.422+0000 7f8a58547640 1 -- 172.21.15.70:0/2760428514 --> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f8a50108750 con 0x7f8a3c03c8a0 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.423+0000 7f8a477fe640 1 -- 172.21.15.70:0/2760428514 <== mgr.14116 v2:172.21.15.70:6800/1352687155 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f8a50108750 con 0x7f8a3c03c8a0 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.423+0000 7f8a58547640 1 -- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f8a3c03c8a0 msgr2=0x7f8a3c03ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.423+0000 7f8a58547640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f8a3c03c8a0 0x7f8a3c03ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8a40003980 tx=0x7f8a40006e10 comp rx=0 tx=0).stop 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.423+0000 7f8a58547640 1 -- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 msgr2=0x7f8a50107b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.423+0000 7f8a58547640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 0x7f8a50107b70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c031000 tx=0x7f8a4c032e40 comp rx=0 tx=0).stop 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.423+0000 7f8a58547640 1 -- 172.21.15.70:0/2760428514 shutdown_connections 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.423+0000 7f8a58547640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f8a3c03c8a0 0x7f8a3c03ec90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.423+0000 7f8a58547640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:6800/1934942517,v1:172.21.15.70:6801/1934942517] conn(0x7f8a3c038f70 0x7f8a3c03b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.423+0000 7f8a58547640 1 --2- 172.21.15.70:0/2760428514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a501082f0 0x7f8a50107b70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.423+0000 7f8a58547640 1 -- 172.21.15.70:0/2760428514 >> 172.21.15.70:0/2760428514 conn(0x7f8a50101f70 msgr2=0x7f8a50102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.423+0000 7f8a58547640 1 -- 172.21.15.70:0/2760428514 shutdown_connections 2024-09-12T01:42:59.991 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:42:59.423+0000 7f8a58547640 1 -- 172.21.15.70:0/2760428514 wait complete. 2024-09-12T01:42:59.992 INFO:teuthology.orchestra.run.smithi070.stdout:mgr epoch 5 is available 2024-09-12T01:42:59.992 INFO:teuthology.orchestra.run.smithi070.stdout:Setting orchestrator backend to cephadm... 2024-09-12T01:43:00.359 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:00.066+0000 7f2b5017e640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:01:43:00] ENGINE Error in HTTPServer.serve 2024-09-12T01:43:00.359 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: Traceback (most recent call last): 2024-09-12T01:43:00.359 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:43:00.359 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: self._connections.run(self.expiration_interval) 2024-09-12T01:43:00.359 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: self._run(expiration_interval) 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: s = self.context.wrap_socket( 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: return self.sslsocket_class._create( 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: self.do_handshake() 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:43:00.360 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: self._sslobj.do_handshake() 2024-09-12T01:43:00.361 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:43:00.361 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:00.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-mon[31177]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T01:43:00.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-mon[31177]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T01:43:00.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:00 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:43:01.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.359+0000 7f7e6c26b640 1 Processor -- start 2024-09-12T01:43:01.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.359+0000 7f7e6c26b640 1 -- start start 2024-09-12T01:43:01.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.359+0000 7f7e6c26b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 0x7f7e64106b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.359+0000 7f7e6c26b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7e641070d0 con 0x7f7e64106700 2024-09-12T01:43:01.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.359+0000 7f7e6a007640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 0x7f7e64106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.359+0000 7f7e6a007640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 0x7f7e64106b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44114/0 (socket says 172.21.15.70:44114) 2024-09-12T01:43:01.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.359+0000 7f7e6a007640 1 -- 172.21.15.70:0/325883480 learned_addr learned my addr 172.21.15.70:0/325883480 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:01.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.360+0000 7f7e6a007640 1 -- 172.21.15.70:0/325883480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e64107900 con 0x7f7e64106700 2024-09-12T01:43:01.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.360+0000 7f7e6a007640 1 --2- 172.21.15.70:0/325883480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 0x7f7e64106b00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009820 tx=0x7f7e6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10050e0f37a80f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.360+0000 7f7e69005640 1 -- 172.21.15.70:0/325883480 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e60037070 con 0x7f7e64106700 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.361+0000 7f7e69005640 1 -- 172.21.15.70:0/325883480 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f7e60032920 con 0x7f7e64106700 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.361+0000 7f7e69005640 1 -- 172.21.15.70:0/325883480 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e60030950 con 0x7f7e64106700 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.361+0000 7f7e6c26b640 1 -- 172.21.15.70:0/325883480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 msgr2=0x7f7e64106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.361+0000 7f7e6c26b640 1 --2- 172.21.15.70:0/325883480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 0x7f7e64106b00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009820 tx=0x7f7e6002a270 comp rx=0 tx=0).stop 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.361+0000 7f7e6c26b640 1 -- 172.21.15.70:0/325883480 shutdown_connections 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.361+0000 7f7e6c26b640 1 --2- 172.21.15.70:0/325883480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 0x7f7e64106b00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.361+0000 7f7e6c26b640 1 -- 172.21.15.70:0/325883480 >> 172.21.15.70:0/325883480 conn(0x7f7e64101f90 msgr2=0x7f7e641043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.361+0000 7f7e6c26b640 1 -- 172.21.15.70:0/325883480 shutdown_connections 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.361+0000 7f7e6c26b640 1 -- 172.21.15.70:0/325883480 wait complete. 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.362+0000 7f7e6c26b640 1 Processor -- start 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.362+0000 7f7e6c26b640 1 -- start start 2024-09-12T01:43:01.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.362+0000 7f7e6c26b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 0x7f7e64191970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.362+0000 7f7e6c26b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6410acb0 con 0x7f7e64106700 2024-09-12T01:43:01.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.362+0000 7f7e6a007640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 0x7f7e64191970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.362+0000 7f7e6a007640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 0x7f7e64191970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44128/0 (socket says 172.21.15.70:44128) 2024-09-12T01:43:01.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.362+0000 7f7e6a007640 1 -- 172.21.15.70:0/1769182123 learned_addr learned my addr 172.21.15.70:0/1769182123 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:01.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.362+0000 7f7e6a007640 1 -- 172.21.15.70:0/1769182123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e64191eb0 con 0x7f7e64106700 2024-09-12T01:43:01.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.362+0000 7f7e6a007640 1 --2- 172.21.15.70:0/1769182123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 0x7f7e64191970 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009940 tx=0x7f7e60032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:01.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.362+0000 7f7e5b7fe640 1 -- 172.21.15.70:0/1769182123 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e60042070 con 0x7f7e64106700 2024-09-12T01:43:01.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.363+0000 7f7e5b7fe640 1 -- 172.21.15.70:0/1769182123 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f7e600326b0 con 0x7f7e64106700 2024-09-12T01:43:01.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.363+0000 7f7e6c26b640 1 -- 172.21.15.70:0/1769182123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e641900a0 con 0x7f7e64106700 2024-09-12T01:43:01.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.363+0000 7f7e5b7fe640 1 -- 172.21.15.70:0/1769182123 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e60037040 con 0x7f7e64106700 2024-09-12T01:43:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.363+0000 7f7e6c26b640 1 -- 172.21.15.70:0/1769182123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e641905e0 con 0x7f7e64106700 2024-09-12T01:43:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.363+0000 7f7e5b7fe640 1 -- 172.21.15.70:0/1769182123 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f7e60045070 con 0x7f7e64106700 2024-09-12T01:43:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.363+0000 7f7e5b7fe640 1 --2- 172.21.15.70:0/1769182123 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7e50038e60 0x7f7e5003b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.364+0000 7f7e5b7fe640 1 -- 172.21.15.70:0/1769182123 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7e6006bfa0 con 0x7f7e64106700 2024-09-12T01:43:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.364+0000 7f7e6c26b640 1 -- 172.21.15.70:0/1769182123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e64106b80 con 0x7f7e64106700 2024-09-12T01:43:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.364+0000 7f7e69806640 1 --2- 172.21.15.70:0/1769182123 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7e50038e60 0x7f7e5003b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.364+0000 7f7e69806640 1 --2- 172.21.15.70:0/1769182123 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7e50038e60 0x7f7e5003b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7e540098c0 tx=0x7f7e54006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.369+0000 7f7e5b7fe640 1 -- 172.21.15.70:0/1769182123 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e6003c800 con 0x7f7e64106700 2024-09-12T01:43:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.465+0000 7f7e5b7fe640 1 -- 172.21.15.70:0/1769182123 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7e6003ccd0 con 0x7f7e64106700 2024-09-12T01:43:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.558+0000 7f7e6c26b640 1 -- 172.21.15.70:0/1769182123 --> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f7e641956e0 con 0x7f7e50038e60 2024-09-12T01:43:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.563+0000 7f7e5b7fe640 1 -- 172.21.15.70:0/1769182123 <== mgr.14116 v2:172.21.15.70:6800/1352687155 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7e641956e0 con 0x7f7e50038e60 2024-09-12T01:43:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.565+0000 7f7e6c26b640 1 -- 172.21.15.70:0/1769182123 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7e50038e60 msgr2=0x7f7e5003b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.565+0000 7f7e6c26b640 1 --2- 172.21.15.70:0/1769182123 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7e50038e60 0x7f7e5003b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7e540098c0 tx=0x7f7e54006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.565+0000 7f7e6c26b640 1 -- 172.21.15.70:0/1769182123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 msgr2=0x7f7e64191970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.565+0000 7f7e6c26b640 1 --2- 172.21.15.70:0/1769182123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 0x7f7e64191970 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009940 tx=0x7f7e60032e40 comp rx=0 tx=0).stop 2024-09-12T01:43:01.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.565+0000 7f7e6c26b640 1 -- 172.21.15.70:0/1769182123 shutdown_connections 2024-09-12T01:43:01.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.565+0000 7f7e6c26b640 1 --2- 172.21.15.70:0/1769182123 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7e50038e60 0x7f7e5003b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.565+0000 7f7e6c26b640 1 --2- 172.21.15.70:0/1769182123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e64106700 0x7f7e64191970 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.565+0000 7f7e6c26b640 1 -- 172.21.15.70:0/1769182123 >> 172.21.15.70:0/1769182123 conn(0x7f7e64101f90 msgr2=0x7f7e64102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:01.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.565+0000 7f7e6c26b640 1 -- 172.21.15.70:0/1769182123 shutdown_connections 2024-09-12T01:43:01.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:00.565+0000 7f7e6c26b640 1 -- 172.21.15.70:0/1769182123 wait complete. 2024-09-12T01:43:01.505 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:01 smithi070 ceph-mon[31177]: [12/Sep/2024:01:42:59] ENGINE Bus STARTING 2024-09-12T01:43:01.505 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:01 smithi070 ceph-mon[31177]: [12/Sep/2024:01:43:00] ENGINE Serving on https://172.21.15.70:7150 2024-09-12T01:43:01.505 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:01 smithi070 ceph-mon[31177]: [12/Sep/2024:01:43:00] ENGINE Error in HTTPServer.serve 2024-09-12T01:43:01.505 INFO:journalctl@ceph.mon.a.smithi070.stdout: Traceback (most recent call last): 2024-09-12T01:43:01.505 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:43:01.505 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:43:01.505 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:43:01.505 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._run(expiration_interval) 2024-09-12T01:43:01.505 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:43:01.505 INFO:journalctl@ceph.mon.a.smithi070.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:43:01.505 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:43:01.506 INFO:journalctl@ceph.mon.a.smithi070.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:43:01.506 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:43:01.506 INFO:journalctl@ceph.mon.a.smithi070.stdout: s = self.context.wrap_socket( 2024-09-12T01:43:01.506 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:43:01.506 INFO:journalctl@ceph.mon.a.smithi070.stdout: return self.sslsocket_class._create( 2024-09-12T01:43:01.506 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:43:01.506 INFO:journalctl@ceph.mon.a.smithi070.stdout: self.do_handshake() 2024-09-12T01:43:01.506 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:43:01.506 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._sslobj.do_handshake() 2024-09-12T01:43:01.506 INFO:journalctl@ceph.mon.a.smithi070.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:43:01.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:01 smithi070 ceph-mon[31177]: [12/Sep/2024:01:43:00] ENGINE Serving on http://172.21.15.70:8765 2024-09-12T01:43:01.507 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:01 smithi070 ceph-mon[31177]: [12/Sep/2024:01:43:00] ENGINE Bus STARTED 2024-09-12T01:43:01.507 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:01 smithi070 ceph-mon[31177]: mgrmap e8: x(active, since 2s) 2024-09-12T01:43:01.507 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:01 smithi070 ceph-mon[31177]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:01.507 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:01 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:43:01.507 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:01 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:43:02.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.504+0000 7ff799a98640 1 Processor -- start 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.505+0000 7ff799a98640 1 -- start start 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.505+0000 7ff799a98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 0x7ff79410a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.505+0000 7ff799a98640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff79407bea0 con 0x7ff7941082e0 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.505+0000 7ff7937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 0x7ff79410a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.505+0000 7ff7937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 0x7ff79410a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57400/0 (socket says 172.21.15.70:57400) 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.505+0000 7ff7937fe640 1 -- 172.21.15.70:0/3052102672 learned_addr learned my addr 172.21.15.70:0/3052102672 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.505+0000 7ff7937fe640 1 -- 172.21.15.70:0/3052102672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79410ac10 con 0x7ff7941082e0 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.506+0000 7ff7937fe640 1 --2- 172.21.15.70:0/3052102672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 0x7ff79410a6d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff784009820 tx=0x7ff78402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab30015f0ca7ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.506+0000 7ff792ffd640 1 -- 172.21.15.70:0/3052102672 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff784037070 con 0x7ff7941082e0 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.506+0000 7ff792ffd640 1 -- 172.21.15.70:0/3052102672 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff784032920 con 0x7ff7941082e0 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.506+0000 7ff792ffd640 1 -- 172.21.15.70:0/3052102672 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff784030950 con 0x7ff7941082e0 2024-09-12T01:43:02.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.507+0000 7ff799a98640 1 -- 172.21.15.70:0/3052102672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 msgr2=0x7ff79410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.507+0000 7ff799a98640 1 --2- 172.21.15.70:0/3052102672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 0x7ff79410a6d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff784009820 tx=0x7ff78402a270 comp rx=0 tx=0).stop 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.507+0000 7ff799a98640 1 -- 172.21.15.70:0/3052102672 shutdown_connections 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.507+0000 7ff799a98640 1 --2- 172.21.15.70:0/3052102672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 0x7ff79410a6d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.507+0000 7ff799a98640 1 -- 172.21.15.70:0/3052102672 >> 172.21.15.70:0/3052102672 conn(0x7ff794101f40 msgr2=0x7ff794104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.507+0000 7ff799a98640 1 -- 172.21.15.70:0/3052102672 shutdown_connections 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.507+0000 7ff799a98640 1 -- 172.21.15.70:0/3052102672 wait complete. 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.507+0000 7ff799a98640 1 Processor -- start 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.507+0000 7ff799a98640 1 -- start start 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.507+0000 7ff799a98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 0x7ff79419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.507+0000 7ff799a98640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff79410bc40 con 0x7ff7941082e0 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.507+0000 7ff7937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 0x7ff79419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.508+0000 7ff7937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 0x7ff79419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57412/0 (socket says 172.21.15.70:57412) 2024-09-12T01:43:02.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.508+0000 7ff7937fe640 1 -- 172.21.15.70:0/3349311207 learned_addr learned my addr 172.21.15.70:0/3349311207 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.508+0000 7ff7937fe640 1 -- 172.21.15.70:0/3349311207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79419bdb0 con 0x7ff7941082e0 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.508+0000 7ff7937fe640 1 --2- 172.21.15.70:0/3349311207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 0x7ff79419b870 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff7840097f0 tx=0x7ff784032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.508+0000 7ff7917fa640 1 -- 172.21.15.70:0/3349311207 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff784037040 con 0x7ff7941082e0 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.508+0000 7ff7917fa640 1 -- 172.21.15.70:0/3349311207 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff784040070 con 0x7ff7941082e0 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.508+0000 7ff7917fa640 1 -- 172.21.15.70:0/3349311207 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff78403a6d0 con 0x7ff7941082e0 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.508+0000 7ff799a98640 1 -- 172.21.15.70:0/3349311207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79419c040 con 0x7ff7941082e0 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.508+0000 7ff799a98640 1 -- 172.21.15.70:0/3349311207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff79419ed30 con 0x7ff7941082e0 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.509+0000 7ff7917fa640 1 -- 172.21.15.70:0/3349311207 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff78403b420 con 0x7ff7941082e0 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.509+0000 7ff799a98640 1 -- 172.21.15.70:0/3349311207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff794108740 con 0x7ff7941082e0 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.509+0000 7ff7917fa640 1 --2- 172.21.15.70:0/3349311207 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7ff780038f70 0x7ff78003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.509+0000 7ff7917fa640 1 -- 172.21.15.70:0/3349311207 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff78406c490 con 0x7ff7941082e0 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.509+0000 7ff78bfff640 1 --2- 172.21.15.70:0/3349311207 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7ff780038f70 0x7ff78003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.510+0000 7ff78bfff640 1 --2- 172.21.15.70:0/3349311207 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7ff780038f70 0x7ff78003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0098c0 tx=0x7ff77c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.516+0000 7ff7917fa640 1 -- 172.21.15.70:0/3349311207 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff78403b810 con 0x7ff7941082e0 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.690+0000 7ff799a98640 1 -- 172.21.15.70:0/3349311207 --> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7ff794103250 con 0x7ff780038f70 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.691+0000 7ff7917fa640 1 -- 172.21.15.70:0/3349311207 <== mgr.14116 v2:172.21.15.70:6800/1352687155 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7ff794103250 con 0x7ff780038f70 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.693+0000 7ff799a98640 1 -- 172.21.15.70:0/3349311207 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7ff780038f70 msgr2=0x7ff78003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.693+0000 7ff799a98640 1 --2- 172.21.15.70:0/3349311207 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7ff780038f70 0x7ff78003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0098c0 tx=0x7ff77c006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.693+0000 7ff799a98640 1 -- 172.21.15.70:0/3349311207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 msgr2=0x7ff79419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.693+0000 7ff799a98640 1 --2- 172.21.15.70:0/3349311207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 0x7ff79419b870 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff7840097f0 tx=0x7ff784032d00 comp rx=0 tx=0).stop 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.693+0000 7ff799a98640 1 -- 172.21.15.70:0/3349311207 shutdown_connections 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.693+0000 7ff799a98640 1 --2- 172.21.15.70:0/3349311207 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7ff780038f70 0x7ff78003b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.693+0000 7ff799a98640 1 --2- 172.21.15.70:0/3349311207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7941082e0 0x7ff79419b870 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.693+0000 7ff799a98640 1 -- 172.21.15.70:0/3349311207 >> 172.21.15.70:0/3349311207 conn(0x7ff794101f40 msgr2=0x7ff794102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.693+0000 7ff799a98640 1 -- 172.21.15.70:0/3349311207 shutdown_connections 2024-09-12T01:43:02.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:01.693+0000 7ff799a98640 1 -- 172.21.15.70:0/3349311207 wait complete. 2024-09-12T01:43:02.619 INFO:teuthology.orchestra.run.smithi070.stdout:Generating ssh key... 2024-09-12T01:43:02.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:02 smithi070 ceph-mon[31177]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:03.913 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: Generating public/private rsa key pair. 2024-09-12T01:43:03.913 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: Your identification has been saved in /tmp/tmp942unew5/key 2024-09-12T01:43:03.913 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: Your public key has been saved in /tmp/tmp942unew5/key.pub 2024-09-12T01:43:03.913 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: The key fingerprint is: 2024-09-12T01:43:03.913 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: SHA256:ZdJjz3RxQ/RNHxLtsbwl1nqm8p1ngzE1EmOwUseL0hA ceph-2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:43:03.913 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: The key's randomart image is: 2024-09-12T01:43:03.913 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: +---[RSA 3072]----+ 2024-09-12T01:43:03.914 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: | E.oo+*=o| 2024-09-12T01:43:03.914 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: | o. o=.**| 2024-09-12T01:43:03.914 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: | ..O.+ B.*| 2024-09-12T01:43:03.914 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: | *.B +o*o| 2024-09-12T01:43:03.914 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: | S . o.oo+| 2024-09-12T01:43:03.914 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: | o..o| 2024-09-12T01:43:03.914 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: | ++ | 2024-09-12T01:43:03.914 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: | ...o+| 2024-09-12T01:43:03.914 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: | o.o+| 2024-09-12T01:43:03.914 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: +----[SHA256]-----+ 2024-09-12T01:43:04.221 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.031+0000 7fdc6e419640 1 Processor -- start 2024-09-12T01:43:04.221 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.031+0000 7fdc6e419640 1 -- start start 2024-09-12T01:43:04.221 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.031+0000 7fdc6e419640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 0x7fdc68106b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.221 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.031+0000 7fdc6e419640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc681070d0 con 0x7fdc68106700 2024-09-12T01:43:04.221 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.031+0000 7fdc67fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 0x7fdc68106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.221 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.031+0000 7fdc67fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 0x7fdc68106b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57426/0 (socket says 172.21.15.70:57426) 2024-09-12T01:43:04.222 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.031+0000 7fdc67fff640 1 -- 172.21.15.70:0/1107642343 learned_addr learned my addr 172.21.15.70:0/1107642343 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:04.222 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.032+0000 7fdc67fff640 1 -- 172.21.15.70:0/1107642343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc68107900 con 0x7fdc68106700 2024-09-12T01:43:04.222 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.032+0000 7fdc67fff640 1 --2- 172.21.15.70:0/1107642343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 0x7fdc68106b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009820 tx=0x7fdc5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2497de3a4e3732 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:04.222 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.033+0000 7fdc66ffd640 1 -- 172.21.15.70:0/1107642343 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc58037070 con 0x7fdc68106700 2024-09-12T01:43:04.222 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.033+0000 7fdc66ffd640 1 -- 172.21.15.70:0/1107642343 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fdc58032920 con 0x7fdc68106700 2024-09-12T01:43:04.222 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.033+0000 7fdc66ffd640 1 -- 172.21.15.70:0/1107642343 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc58030950 con 0x7fdc68106700 2024-09-12T01:43:04.222 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.033+0000 7fdc6e419640 1 -- 172.21.15.70:0/1107642343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 msgr2=0x7fdc68106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.222 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.033+0000 7fdc6e419640 1 --2- 172.21.15.70:0/1107642343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 0x7fdc68106b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009820 tx=0x7fdc5802a270 comp rx=0 tx=0).stop 2024-09-12T01:43:04.223 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.033+0000 7fdc6e419640 1 -- 172.21.15.70:0/1107642343 shutdown_connections 2024-09-12T01:43:04.223 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.033+0000 7fdc6e419640 1 --2- 172.21.15.70:0/1107642343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 0x7fdc68106b00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.223 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.033+0000 7fdc6e419640 1 -- 172.21.15.70:0/1107642343 >> 172.21.15.70:0/1107642343 conn(0x7fdc68101f70 msgr2=0x7fdc68104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:04.223 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.033+0000 7fdc6e419640 1 -- 172.21.15.70:0/1107642343 shutdown_connections 2024-09-12T01:43:04.223 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.033+0000 7fdc6e419640 1 -- 172.21.15.70:0/1107642343 wait complete. 2024-09-12T01:43:04.223 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.034+0000 7fdc6e419640 1 Processor -- start 2024-09-12T01:43:04.223 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.034+0000 7fdc6e419640 1 -- start start 2024-09-12T01:43:04.223 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.034+0000 7fdc6e419640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 0x7fdc68191970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.223 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.034+0000 7fdc6e419640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6810acb0 con 0x7fdc68106700 2024-09-12T01:43:04.223 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.034+0000 7fdc67fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 0x7fdc68191970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.223 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.034+0000 7fdc67fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 0x7fdc68191970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57442/0 (socket says 172.21.15.70:57442) 2024-09-12T01:43:04.223 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.034+0000 7fdc67fff640 1 -- 172.21.15.70:0/1463187769 learned_addr learned my addr 172.21.15.70:0/1463187769 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.035+0000 7fdc67fff640 1 -- 172.21.15.70:0/1463187769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc68191eb0 con 0x7fdc68106700 2024-09-12T01:43:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.035+0000 7fdc67fff640 1 --2- 172.21.15.70:0/1463187769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 0x7fdc68191970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009940 tx=0x7fdc58032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.035+0000 7fdc657fa640 1 -- 172.21.15.70:0/1463187769 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc58042070 con 0x7fdc68106700 2024-09-12T01:43:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.035+0000 7fdc657fa640 1 -- 172.21.15.70:0/1463187769 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fdc580326b0 con 0x7fdc68106700 2024-09-12T01:43:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.035+0000 7fdc6e419640 1 -- 172.21.15.70:0/1463187769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc681900a0 con 0x7fdc68106700 2024-09-12T01:43:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.035+0000 7fdc657fa640 1 -- 172.21.15.70:0/1463187769 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc58037040 con 0x7fdc68106700 2024-09-12T01:43:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.035+0000 7fdc6e419640 1 -- 172.21.15.70:0/1463187769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc681905e0 con 0x7fdc68106700 2024-09-12T01:43:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.036+0000 7fdc657fa640 1 -- 172.21.15.70:0/1463187769 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fdc58045070 con 0x7fdc68106700 2024-09-12T01:43:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.036+0000 7fdc6e419640 1 -- 172.21.15.70:0/1463187769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc68106b80 con 0x7fdc68106700 2024-09-12T01:43:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.036+0000 7fdc657fa640 1 --2- 172.21.15.70:0/1463187769 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fdc50038f70 0x7fdc5003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.036+0000 7fdc657fa640 1 -- 172.21.15.70:0/1463187769 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdc5806bf60 con 0x7fdc68106700 2024-09-12T01:43:04.224 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.036+0000 7fdc677fe640 1 --2- 172.21.15.70:0/1463187769 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fdc50038f70 0x7fdc5003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.037+0000 7fdc677fe640 1 --2- 172.21.15.70:0/1463187769 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fdc50038f70 0x7fdc5003b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0098c0 tx=0x7fdc5c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.041+0000 7fdc657fa640 1 -- 172.21.15.70:0/1463187769 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc5803c800 con 0x7fdc68106700 2024-09-12T01:43:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.206+0000 7fdc6e419640 1 -- 172.21.15.70:0/1463187769 --> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fdc681957d0 con 0x7fdc50038f70 2024-09-12T01:43:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.604+0000 7fdc657fa640 1 -- 172.21.15.70:0/1463187769 <== mgr.14116 v2:172.21.15.70:6800/1352687155 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdc681957d0 con 0x7fdc50038f70 2024-09-12T01:43:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.606+0000 7fdc6e419640 1 -- 172.21.15.70:0/1463187769 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fdc50038f70 msgr2=0x7fdc5003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.606+0000 7fdc6e419640 1 --2- 172.21.15.70:0/1463187769 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fdc50038f70 0x7fdc5003b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0098c0 tx=0x7fdc5c006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.606+0000 7fdc6e419640 1 -- 172.21.15.70:0/1463187769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 msgr2=0x7fdc68191970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.606+0000 7fdc6e419640 1 --2- 172.21.15.70:0/1463187769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 0x7fdc68191970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009940 tx=0x7fdc58032e40 comp rx=0 tx=0).stop 2024-09-12T01:43:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.606+0000 7fdc6e419640 1 -- 172.21.15.70:0/1463187769 shutdown_connections 2024-09-12T01:43:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.606+0000 7fdc6e419640 1 --2- 172.21.15.70:0/1463187769 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fdc50038f70 0x7fdc5003b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.606+0000 7fdc6e419640 1 --2- 172.21.15.70:0/1463187769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68106700 0x7fdc68191970 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.225 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.606+0000 7fdc6e419640 1 -- 172.21.15.70:0/1463187769 >> 172.21.15.70:0/1463187769 conn(0x7fdc68101f70 msgr2=0x7fdc68102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:04.226 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.606+0000 7fdc6e419640 1 -- 172.21.15.70:0/1463187769 shutdown_connections 2024-09-12T01:43:04.226 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:03.606+0000 7fdc6e419640 1 -- 172.21.15.70:0/1463187769 wait complete. 2024-09-12T01:43:04.738 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:04 smithi070 ceph-mon[31177]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:04.738 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:04 smithi070 ceph-mon[31177]: Generating ssh key... 2024-09-12T01:43:04.738 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:04 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:43:04.738 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:04 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:43:05.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTZRbJxuEAmvFRcp3i9EUk1wWfLYo+tdo0+pS3oJDrwmX1heFEG8B8PZurWffSZjycROmPrOEUoRGiGOOHJ+IJjCfle90Njl+zG0Wt0tzhmPi9OUTLW6IHfdUfitBbp5PwT2esVoPo82WnvIMZXtKp5WFYEcRUc6wfpvMOgBldi12ro0ecnNBGDrtIflRgo15se9CKBhk0szLejRannOTyVVdErQotKweAoqMEeQEdprj7geMoWKtxq2ym5Mb9ic/ewAWHfEhmgceBSn9CoBcgYODLWD1lRV/bHwPMMsprx9jCPwm38v+IlaUqXtqUfoHTyU0CTum2exhbcM2u+Z605M+elOHQAFAGVdUFWRfN7kmVrs0Cz22e53SVDpBdZKYLxicShy+8xYtGEySNPpEg5NZLPygaTAn9wyuHK966aCkImrBARJ4FzrhdrFLBgvprk/taMZUwcJqDBNLuLrELQAJhBn1HjwG7nBGaw+O8cyQPyxZFKSW89BYCdLIOr9s= ceph-2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:43:05.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.560+0000 7f7404c55640 1 Processor -- start 2024-09-12T01:43:05.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.560+0000 7f7404c55640 1 -- start start 2024-09-12T01:43:05.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.560+0000 7f7404c55640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 0x7f7400107c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:05.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.560+0000 7f7404c55640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7400108200 con 0x7f7400107830 2024-09-12T01:43:05.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.560+0000 7f73fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 0x7f7400107c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:05.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.560+0000 7f73fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 0x7f7400107c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57446/0 (socket says 172.21.15.70:57446) 2024-09-12T01:43:05.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.560+0000 7f73fe59c640 1 -- 172.21.15.70:0/1083502173 learned_addr learned my addr 172.21.15.70:0/1083502173 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:05.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.560+0000 7f73fe59c640 1 -- 172.21.15.70:0/1083502173 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7400108a30 con 0x7f7400107830 2024-09-12T01:43:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.561+0000 7f73fe59c640 1 --2- 172.21.15.70:0/1083502173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 0x7f7400107c30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009820 tx=0x7f73f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405b0b0c30f99e14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.561+0000 7f73fd59a640 1 -- 172.21.15.70:0/1083502173 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f0037070 con 0x7f7400107830 2024-09-12T01:43:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.561+0000 7f73fd59a640 1 -- 172.21.15.70:0/1083502173 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f73f0032920 con 0x7f7400107830 2024-09-12T01:43:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.561+0000 7f73fd59a640 1 -- 172.21.15.70:0/1083502173 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f0030950 con 0x7f7400107830 2024-09-12T01:43:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.562+0000 7f7404c55640 1 -- 172.21.15.70:0/1083502173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 msgr2=0x7f7400107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.562+0000 7f7404c55640 1 --2- 172.21.15.70:0/1083502173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 0x7f7400107c30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009820 tx=0x7f73f002a270 comp rx=0 tx=0).stop 2024-09-12T01:43:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.562+0000 7f7404c55640 1 -- 172.21.15.70:0/1083502173 shutdown_connections 2024-09-12T01:43:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.562+0000 7f7404c55640 1 --2- 172.21.15.70:0/1083502173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 0x7f7400107c30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.562+0000 7f7404c55640 1 -- 172.21.15.70:0/1083502173 >> 172.21.15.70:0/1083502173 conn(0x7f7400102fe0 msgr2=0x7f7400105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.562+0000 7f7404c55640 1 -- 172.21.15.70:0/1083502173 shutdown_connections 2024-09-12T01:43:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.562+0000 7f7404c55640 1 -- 172.21.15.70:0/1083502173 wait complete. 2024-09-12T01:43:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.563+0000 7f7404c55640 1 Processor -- start 2024-09-12T01:43:05.286 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.563+0000 7f7404c55640 1 -- start start 2024-09-12T01:43:05.286 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.563+0000 7f7404c55640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 0x7f740019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:05.286 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.563+0000 7f7404c55640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f740010bde0 con 0x7f7400107830 2024-09-12T01:43:05.286 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.563+0000 7f73fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 0x7f740019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:05.286 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.563+0000 7f73fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 0x7f740019b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57450/0 (socket says 172.21.15.70:57450) 2024-09-12T01:43:05.286 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.563+0000 7f73fe59c640 1 -- 172.21.15.70:0/2185006603 learned_addr learned my addr 172.21.15.70:0/2185006603 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:05.286 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.563+0000 7f73fe59c640 1 -- 172.21.15.70:0/2185006603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740019be00 con 0x7f7400107830 2024-09-12T01:43:05.286 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.563+0000 7f73fe59c640 1 --2- 172.21.15.70:0/2185006603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 0x7f740019b8c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009940 tx=0x7f73f0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:05.286 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.564+0000 7f73ef7fe640 1 -- 172.21.15.70:0/2185006603 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f0042070 con 0x7f7400107830 2024-09-12T01:43:05.286 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.564+0000 7f73ef7fe640 1 -- 172.21.15.70:0/2185006603 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f73f00325f0 con 0x7f7400107830 2024-09-12T01:43:05.286 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.564+0000 7f7404c55640 1 -- 172.21.15.70:0/2185006603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740019c090 con 0x7f7400107830 2024-09-12T01:43:05.286 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.564+0000 7f73ef7fe640 1 -- 172.21.15.70:0/2185006603 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f0037040 con 0x7f7400107830 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.564+0000 7f7404c55640 1 -- 172.21.15.70:0/2185006603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f740019ed80 con 0x7f7400107830 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.564+0000 7f73ef7fe640 1 -- 172.21.15.70:0/2185006603 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f73f0045070 con 0x7f7400107830 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.565+0000 7f7404c55640 1 -- 172.21.15.70:0/2185006603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7400107cb0 con 0x7f7400107830 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.565+0000 7f73ef7fe640 1 --2- 172.21.15.70:0/2185006603 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f73e8038fc0 0x7f73e803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.565+0000 7f73ef7fe640 1 -- 172.21.15.70:0/2185006603 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f73f006c0a0 con 0x7f7400107830 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.565+0000 7f73fdd9b640 1 --2- 172.21.15.70:0/2185006603 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f73e8038fc0 0x7f73e803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.565+0000 7f73fdd9b640 1 --2- 172.21.15.70:0/2185006603 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f73e8038fc0 0x7f73e803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f73f40098c0 tx=0x7f73f4006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.569+0000 7f73ef7fe640 1 -- 172.21.15.70:0/2185006603 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73f0045360 con 0x7f7400107830 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.737+0000 7f7404c55640 1 -- 172.21.15.70:0/2185006603 --> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f7400104300 con 0x7f73e8038fc0 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.738+0000 7f73ef7fe640 1 -- 172.21.15.70:0/2185006603 <== mgr.14116 v2:172.21.15.70:6800/1352687155 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f7400104300 con 0x7f73e8038fc0 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.739+0000 7f7404c55640 1 -- 172.21.15.70:0/2185006603 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f73e8038fc0 msgr2=0x7f73e803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.739+0000 7f7404c55640 1 --2- 172.21.15.70:0/2185006603 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f73e8038fc0 0x7f73e803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f73f40098c0 tx=0x7f73f4006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:05.287 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.739+0000 7f7404c55640 1 -- 172.21.15.70:0/2185006603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 msgr2=0x7f740019b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:05.288 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.740+0000 7f7404c55640 1 --2- 172.21.15.70:0/2185006603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 0x7f740019b8c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009940 tx=0x7f73f0032e40 comp rx=0 tx=0).stop 2024-09-12T01:43:05.288 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.740+0000 7f7404c55640 1 -- 172.21.15.70:0/2185006603 shutdown_connections 2024-09-12T01:43:05.288 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.740+0000 7f7404c55640 1 --2- 172.21.15.70:0/2185006603 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f73e8038fc0 0x7f73e803b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:05.288 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.740+0000 7f7404c55640 1 --2- 172.21.15.70:0/2185006603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400107830 0x7f740019b8c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:05.288 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.740+0000 7f7404c55640 1 -- 172.21.15.70:0/2185006603 >> 172.21.15.70:0/2185006603 conn(0x7f7400102fe0 msgr2=0x7f7400103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:05.288 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.740+0000 7f7404c55640 1 -- 172.21.15.70:0/2185006603 shutdown_connections 2024-09-12T01:43:05.288 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:04.740+0000 7f7404c55640 1 -- 172.21.15.70:0/2185006603 wait complete. 2024-09-12T01:43:05.288 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:43:05.288 INFO:teuthology.orchestra.run.smithi070.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T01:43:05.288 INFO:teuthology.orchestra.run.smithi070.stdout:Adding host smithi070... 2024-09-12T01:43:05.952 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:05 smithi070 ceph-mon[31177]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:06.841 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:06 smithi070 ceph-mon[31177]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi070", "addr": "172.21.15.70", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:08.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:07 smithi070 ceph-mon[31177]: Deploying cephadm binary to smithi070 2024-09-12T01:43:09.517 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Added host 'smithi070' with addr '172.21.15.70' 2024-09-12T01:43:09.517 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.657+0000 7fb439dc0640 1 Processor -- start 2024-09-12T01:43:09.517 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.657+0000 7fb439dc0640 1 -- start start 2024-09-12T01:43:09.517 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.657+0000 7fb439dc0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 0x7fb434106b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.517 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.657+0000 7fb439dc0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb4341070d0 con 0x7fb434106700 2024-09-12T01:43:09.517 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.657+0000 7fb4337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 0x7fb434106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.517 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.657+0000 7fb4337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 0x7fb434106b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57458/0 (socket says 172.21.15.70:57458) 2024-09-12T01:43:09.517 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.657+0000 7fb4337fe640 1 -- 172.21.15.70:0/2352615124 learned_addr learned my addr 172.21.15.70:0/2352615124 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.658+0000 7fb4337fe640 1 -- 172.21.15.70:0/2352615124 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb434107900 con 0x7fb434106700 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.658+0000 7fb4337fe640 1 --2- 172.21.15.70:0/2352615124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 0x7fb434106b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb424009e80 tx=0x7fb42402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b2b85d9001cc78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.659+0000 7fb4327fc640 1 -- 172.21.15.70:0/2352615124 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb424036070 con 0x7fb434106700 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.659+0000 7fb4327fc640 1 -- 172.21.15.70:0/2352615124 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb4240318e0 con 0x7fb434106700 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.659+0000 7fb4327fc640 1 -- 172.21.15.70:0/2352615124 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb424007b00 con 0x7fb434106700 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.659+0000 7fb439dc0640 1 -- 172.21.15.70:0/2352615124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 msgr2=0x7fb434106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.659+0000 7fb439dc0640 1 --2- 172.21.15.70:0/2352615124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 0x7fb434106b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb424009e80 tx=0x7fb42402a7a0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.659+0000 7fb439dc0640 1 -- 172.21.15.70:0/2352615124 shutdown_connections 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.659+0000 7fb439dc0640 1 --2- 172.21.15.70:0/2352615124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 0x7fb434106b00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.659+0000 7fb439dc0640 1 -- 172.21.15.70:0/2352615124 >> 172.21.15.70:0/2352615124 conn(0x7fb434101f70 msgr2=0x7fb434104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.659+0000 7fb439dc0640 1 -- 172.21.15.70:0/2352615124 shutdown_connections 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.659+0000 7fb439dc0640 1 -- 172.21.15.70:0/2352615124 wait complete. 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.660+0000 7fb439dc0640 1 Processor -- start 2024-09-12T01:43:09.518 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.660+0000 7fb439dc0640 1 -- start start 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.660+0000 7fb439dc0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 0x7fb43419b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.660+0000 7fb439dc0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb43410acb0 con 0x7fb434106700 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.660+0000 7fb4337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 0x7fb43419b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.660+0000 7fb4337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 0x7fb43419b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57470/0 (socket says 172.21.15.70:57470) 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.660+0000 7fb4337fe640 1 -- 172.21.15.70:0/1082572456 learned_addr learned my addr 172.21.15.70:0/1082572456 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.660+0000 7fb4337fe640 1 -- 172.21.15.70:0/1082572456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43419bdc0 con 0x7fb434106700 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.661+0000 7fb4337fe640 1 --2- 172.21.15.70:0/1082572456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 0x7fb43419b880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb424007d30 tx=0x7fb424031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.661+0000 7fb430ff9640 1 -- 172.21.15.70:0/1082572456 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb424041020 con 0x7fb434106700 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.661+0000 7fb430ff9640 1 -- 172.21.15.70:0/1082572456 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb424007e50 con 0x7fb434106700 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.661+0000 7fb439dc0640 1 -- 172.21.15.70:0/1082572456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43419c050 con 0x7fb434106700 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.661+0000 7fb430ff9640 1 -- 172.21.15.70:0/1082572456 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb424036040 con 0x7fb434106700 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.661+0000 7fb439dc0640 1 -- 172.21.15.70:0/1082572456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43419ed40 con 0x7fb434106700 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.662+0000 7fb430ff9640 1 -- 172.21.15.70:0/1082572456 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb424044020 con 0x7fb434106700 2024-09-12T01:43:09.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.662+0000 7fb430ff9640 1 --2- 172.21.15.70:0/1082572456 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fb41c038f70 0x7fb41c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.662+0000 7fb439dc0640 1 -- 172.21.15.70:0/1082572456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb434106b80 con 0x7fb434106700 2024-09-12T01:43:09.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.662+0000 7fb430ff9640 1 -- 172.21.15.70:0/1082572456 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb42406d0f0 con 0x7fb434106700 2024-09-12T01:43:09.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.662+0000 7fb432ffd640 1 --2- 172.21.15.70:0/1082572456 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fb41c038f70 0x7fb41c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.662+0000 7fb432ffd640 1 --2- 172.21.15.70:0/1082572456 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fb41c038f70 0x7fb41c03b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb4280098c0 tx=0x7fb428006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:09.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.667+0000 7fb430ff9640 1 -- 172.21.15.70:0/1082572456 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb42404b020 con 0x7fb434106700 2024-09-12T01:43:09.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:05.837+0000 7fb439dc0640 1 -- 172.21.15.70:0/1082572456 --> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi070", "addr": "172.21.15.70", "target": ["mon-mgr", ""]}) -- 0x7fb43402db40 con 0x7fb41c038f70 2024-09-12T01:43:09.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:08.977+0000 7fb430ff9640 1 -- 172.21.15.70:0/1082572456 <== mgr.14116 v2:172.21.15.70:6800/1352687155 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fb43402db40 con 0x7fb41c038f70 2024-09-12T01:43:09.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:08.980+0000 7fb439dc0640 1 -- 172.21.15.70:0/1082572456 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fb41c038f70 msgr2=0x7fb41c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:08.980+0000 7fb439dc0640 1 --2- 172.21.15.70:0/1082572456 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fb41c038f70 0x7fb41c03b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb4280098c0 tx=0x7fb428006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.520 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:08.980+0000 7fb439dc0640 1 -- 172.21.15.70:0/1082572456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 msgr2=0x7fb43419b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.521 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:08.980+0000 7fb439dc0640 1 --2- 172.21.15.70:0/1082572456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 0x7fb43419b880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb424007d30 tx=0x7fb424031700 comp rx=0 tx=0).stop 2024-09-12T01:43:09.521 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:08.980+0000 7fb439dc0640 1 -- 172.21.15.70:0/1082572456 shutdown_connections 2024-09-12T01:43:09.521 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:08.980+0000 7fb439dc0640 1 --2- 172.21.15.70:0/1082572456 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fb41c038f70 0x7fb41c03b430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.521 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:08.980+0000 7fb439dc0640 1 --2- 172.21.15.70:0/1082572456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb434106700 0x7fb43419b880 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.521 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:08.980+0000 7fb439dc0640 1 -- 172.21.15.70:0/1082572456 >> 172.21.15.70:0/1082572456 conn(0x7fb434101f70 msgr2=0x7fb434102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:09.521 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:08.980+0000 7fb439dc0640 1 -- 172.21.15.70:0/1082572456 shutdown_connections 2024-09-12T01:43:09.521 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:08.980+0000 7fb439dc0640 1 -- 172.21.15.70:0/1082572456 wait complete. 2024-09-12T01:43:09.521 INFO:teuthology.orchestra.run.smithi070.stdout:Deploying unmanaged mon service... 2024-09-12T01:43:10.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:09 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:43:10.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:09 smithi070 ceph-mon[31177]: Added host smithi070 2024-09-12T01:43:10.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:09 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:43:10.834 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T01:43:10.834 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.883+0000 7fe27f934640 1 Processor -- start 2024-09-12T01:43:10.834 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.883+0000 7fe27f934640 1 -- start start 2024-09-12T01:43:10.834 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.883+0000 7fe27f934640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 0x7fe27807b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.834 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.883+0000 7fe27f934640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe27807b7b0 con 0x7fe27807cd80 2024-09-12T01:43:10.834 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.884+0000 7fe27d6d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 0x7fe27807b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.834 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.884+0000 7fe27d6d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 0x7fe27807b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57482/0 (socket says 172.21.15.70:57482) 2024-09-12T01:43:10.834 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.884+0000 7fe27d6d0640 1 -- 172.21.15.70:0/3399227129 learned_addr learned my addr 172.21.15.70:0/3399227129 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:10.834 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.884+0000 7fe27d6d0640 1 -- 172.21.15.70:0/3399227129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27807b930 con 0x7fe27807cd80 2024-09-12T01:43:10.834 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.885+0000 7fe27d6d0640 1 --2- 172.21.15.70:0/3399227129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 0x7fe27807b1e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe274009820 tx=0x7fe27402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b76977f1fd0745e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.834 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.885+0000 7fe26ffff640 1 -- 172.21.15.70:0/3399227129 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe274037070 con 0x7fe27807cd80 2024-09-12T01:43:10.834 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.885+0000 7fe26ffff640 1 -- 172.21.15.70:0/3399227129 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fe274032920 con 0x7fe27807cd80 2024-09-12T01:43:10.835 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.885+0000 7fe26ffff640 1 -- 172.21.15.70:0/3399227129 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe274030950 con 0x7fe27807cd80 2024-09-12T01:43:10.835 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.885+0000 7fe27f934640 1 -- 172.21.15.70:0/3399227129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 msgr2=0x7fe27807b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.835 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.885+0000 7fe27f934640 1 --2- 172.21.15.70:0/3399227129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 0x7fe27807b1e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe274009820 tx=0x7fe27402a270 comp rx=0 tx=0).stop 2024-09-12T01:43:10.835 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.886+0000 7fe27f934640 1 -- 172.21.15.70:0/3399227129 shutdown_connections 2024-09-12T01:43:10.835 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.886+0000 7fe27f934640 1 --2- 172.21.15.70:0/3399227129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 0x7fe27807b1e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.835 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.886+0000 7fe27f934640 1 -- 172.21.15.70:0/3399227129 >> 172.21.15.70:0/3399227129 conn(0x7fe278102fd0 msgr2=0x7fe278105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:10.835 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.886+0000 7fe27f934640 1 -- 172.21.15.70:0/3399227129 shutdown_connections 2024-09-12T01:43:10.835 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.886+0000 7fe27f934640 1 -- 172.21.15.70:0/3399227129 wait complete. 2024-09-12T01:43:10.835 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.886+0000 7fe27f934640 1 Processor -- start 2024-09-12T01:43:10.835 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.886+0000 7fe27f934640 1 -- start start 2024-09-12T01:43:10.835 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.886+0000 7fe27f934640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 0x7fe27819da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.835 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.886+0000 7fe27f934640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe27810ded0 con 0x7fe27807cd80 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.887+0000 7fe27d6d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 0x7fe27819da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.887+0000 7fe27d6d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 0x7fe27819da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57486/0 (socket says 172.21.15.70:57486) 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.887+0000 7fe27d6d0640 1 -- 172.21.15.70:0/3840334050 learned_addr learned my addr 172.21.15.70:0/3840334050 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.887+0000 7fe27d6d0640 1 -- 172.21.15.70:0/3840334050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27819dfa0 con 0x7fe27807cd80 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.887+0000 7fe27d6d0640 1 --2- 172.21.15.70:0/3840334050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 0x7fe27819da60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe274006f10 tx=0x7fe2740327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.887+0000 7fe26e7fc640 1 -- 172.21.15.70:0/3840334050 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe274037040 con 0x7fe27807cd80 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.887+0000 7fe27f934640 1 -- 172.21.15.70:0/3840334050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe27819e230 con 0x7fe27807cd80 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.887+0000 7fe27f934640 1 -- 172.21.15.70:0/3840334050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2781a0f20 con 0x7fe27807cd80 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.887+0000 7fe26e7fc640 1 -- 172.21.15.70:0/3840334050 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fe274040070 con 0x7fe27807cd80 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.887+0000 7fe26e7fc640 1 -- 172.21.15.70:0/3840334050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe27403a630 con 0x7fe27807cd80 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.888+0000 7fe26e7fc640 1 -- 172.21.15.70:0/3840334050 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe27403a870 con 0x7fe27807cd80 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.888+0000 7fe26e7fc640 1 --2- 172.21.15.70:0/3840334050 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fe264038f70 0x7fe26403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.836 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.888+0000 7fe26e7fc640 1 -- 172.21.15.70:0/3840334050 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe27406c5b0 con 0x7fe27807cd80 2024-09-12T01:43:10.837 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.888+0000 7fe27f934640 1 -- 172.21.15.70:0/3840334050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe27807b260 con 0x7fe27807cd80 2024-09-12T01:43:10.837 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.888+0000 7fe27cecf640 1 --2- 172.21.15.70:0/3840334050 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fe264038f70 0x7fe26403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.837 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.889+0000 7fe27cecf640 1 --2- 172.21.15.70:0/3840334050 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fe264038f70 0x7fe26403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe2680098c0 tx=0x7fe268006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.837 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:09.897+0000 7fe26e7fc640 1 -- 172.21.15.70:0/3840334050 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe27406bf40 con 0x7fe27807cd80 2024-09-12T01:43:10.837 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:10.095+0000 7fe27f934640 1 -- 172.21.15.70:0/3840334050 --> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe278104260 con 0x7fe264038f70 2024-09-12T01:43:10.837 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:10.099+0000 7fe26e7fc640 1 -- 172.21.15.70:0/3840334050 <== mgr.14116 v2:172.21.15.70:6800/1352687155 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe278104260 con 0x7fe264038f70 2024-09-12T01:43:10.837 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:10.101+0000 7fe27f934640 1 -- 172.21.15.70:0/3840334050 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fe264038f70 msgr2=0x7fe26403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.837 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:10.101+0000 7fe27f934640 1 --2- 172.21.15.70:0/3840334050 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fe264038f70 0x7fe26403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe2680098c0 tx=0x7fe268006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.837 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:10.101+0000 7fe27f934640 1 -- 172.21.15.70:0/3840334050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 msgr2=0x7fe27819da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.837 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:10.101+0000 7fe27f934640 1 --2- 172.21.15.70:0/3840334050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 0x7fe27819da60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe274006f10 tx=0x7fe2740327d0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.837 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:10.101+0000 7fe27f934640 1 -- 172.21.15.70:0/3840334050 shutdown_connections 2024-09-12T01:43:10.837 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:10.101+0000 7fe27f934640 1 --2- 172.21.15.70:0/3840334050 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fe264038f70 0x7fe26403b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.838 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:10.101+0000 7fe27f934640 1 --2- 172.21.15.70:0/3840334050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe27807cd80 0x7fe27819da60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.838 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:10.101+0000 7fe27f934640 1 -- 172.21.15.70:0/3840334050 >> 172.21.15.70:0/3840334050 conn(0x7fe278102fd0 msgr2=0x7fe278103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:10.838 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:10.101+0000 7fe27f934640 1 -- 172.21.15.70:0/3840334050 shutdown_connections 2024-09-12T01:43:10.838 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:10.101+0000 7fe27f934640 1 -- 172.21.15.70:0/3840334050 wait complete. 2024-09-12T01:43:10.838 INFO:teuthology.orchestra.run.smithi070.stdout:Deploying unmanaged mgr service... 2024-09-12T01:43:11.398 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:11 smithi070 ceph-mon[31177]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:11.398 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:11 smithi070 ceph-mon[31177]: Saving service mon spec with placement count:5 2024-09-12T01:43:11.398 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:11 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:43:12.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:12 smithi070 ceph-mon[31177]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:12.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:12 smithi070 ceph-mon[31177]: Saving service mgr spec with placement count:2 2024-09-12T01:43:12.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:12 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:43:12.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T01:43:12.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.206+0000 7f3502fe8640 1 Processor -- start 2024-09-12T01:43:12.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.206+0000 7f3502fe8640 1 -- start start 2024-09-12T01:43:12.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.207+0000 7f3502fe8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 0x7f34fc107c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.207+0000 7f3502fe8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc108200 con 0x7f34fc107830 2024-09-12T01:43:12.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.207+0000 7f3500d84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 0x7f34fc107c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.207+0000 7f3500d84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 0x7f34fc107c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57730/0 (socket says 172.21.15.70:57730) 2024-09-12T01:43:12.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.207+0000 7f3500d84640 1 -- 172.21.15.70:0/1077610704 learned_addr learned my addr 172.21.15.70:0/1077610704 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:12.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.207+0000 7f3500d84640 1 -- 172.21.15.70:0/1077610704 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34fc108a30 con 0x7f34fc107830 2024-09-12T01:43:12.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.208+0000 7f3500d84640 1 --2- 172.21.15.70:0/1077610704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 0x7f34fc107c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009820 tx=0x7f34f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ef4580e7bb82da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:12.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.208+0000 7f34fb7fe640 1 -- 172.21.15.70:0/1077610704 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f0037070 con 0x7f34fc107830 2024-09-12T01:43:12.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.208+0000 7f34fb7fe640 1 -- 172.21.15.70:0/1077610704 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f34f0032920 con 0x7f34fc107830 2024-09-12T01:43:12.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.208+0000 7f34fb7fe640 1 -- 172.21.15.70:0/1077610704 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f0030950 con 0x7f34fc107830 2024-09-12T01:43:12.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.208+0000 7f3502fe8640 1 -- 172.21.15.70:0/1077610704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 msgr2=0x7f34fc107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.208+0000 7f3502fe8640 1 --2- 172.21.15.70:0/1077610704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 0x7f34fc107c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009820 tx=0x7f34f002a270 comp rx=0 tx=0).stop 2024-09-12T01:43:12.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.209+0000 7f3502fe8640 1 -- 172.21.15.70:0/1077610704 shutdown_connections 2024-09-12T01:43:12.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.209+0000 7f3502fe8640 1 --2- 172.21.15.70:0/1077610704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 0x7f34fc107c30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.209+0000 7f3502fe8640 1 -- 172.21.15.70:0/1077610704 >> 172.21.15.70:0/1077610704 conn(0x7f34fc102fe0 msgr2=0x7f34fc105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:12.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.209+0000 7f3502fe8640 1 -- 172.21.15.70:0/1077610704 shutdown_connections 2024-09-12T01:43:12.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.209+0000 7f3502fe8640 1 -- 172.21.15.70:0/1077610704 wait complete. 2024-09-12T01:43:12.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.209+0000 7f3502fe8640 1 Processor -- start 2024-09-12T01:43:12.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.209+0000 7f3502fe8640 1 -- start start 2024-09-12T01:43:12.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.209+0000 7f3502fe8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 0x7f34fc19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.209+0000 7f3502fe8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc10bde0 con 0x7f34fc107830 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.209+0000 7f3500d84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 0x7f34fc19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.209+0000 7f3500d84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 0x7f34fc19b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57738/0 (socket says 172.21.15.70:57738) 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.209+0000 7f3500d84640 1 -- 172.21.15.70:0/1424006391 learned_addr learned my addr 172.21.15.70:0/1424006391 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.210+0000 7f3500d84640 1 -- 172.21.15.70:0/1424006391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34fc19be20 con 0x7f34fc107830 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.210+0000 7f3500d84640 1 --2- 172.21.15.70:0/1424006391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 0x7f34fc19b8e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009940 tx=0x7f34f0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.210+0000 7f34f9ffb640 1 -- 172.21.15.70:0/1424006391 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f0042070 con 0x7f34fc107830 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.210+0000 7f34f9ffb640 1 -- 172.21.15.70:0/1424006391 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f34f00325f0 con 0x7f34fc107830 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.210+0000 7f3502fe8640 1 -- 172.21.15.70:0/1424006391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34fc19c0b0 con 0x7f34fc107830 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.210+0000 7f34f9ffb640 1 -- 172.21.15.70:0/1424006391 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34f0037040 con 0x7f34fc107830 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.210+0000 7f3502fe8640 1 -- 172.21.15.70:0/1424006391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34fc19eda0 con 0x7f34fc107830 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.211+0000 7f34f9ffb640 1 -- 172.21.15.70:0/1424006391 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f34f0045070 con 0x7f34fc107830 2024-09-12T01:43:12.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.211+0000 7f3502fe8640 1 -- 172.21.15.70:0/1424006391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34fc107cb0 con 0x7f34fc107830 2024-09-12T01:43:12.818 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.211+0000 7f34f9ffb640 1 --2- 172.21.15.70:0/1424006391 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f34ec038f70 0x7f34ec03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.818 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.211+0000 7f34f9ffb640 1 -- 172.21.15.70:0/1424006391 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f34f006bf90 con 0x7f34fc107830 2024-09-12T01:43:12.818 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.211+0000 7f34fbfff640 1 --2- 172.21.15.70:0/1424006391 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f34ec038f70 0x7f34ec03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.818 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.212+0000 7f34fbfff640 1 --2- 172.21.15.70:0/1424006391 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f34ec038f70 0x7f34ec03b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f34e80098c0 tx=0x7f34e8006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:12.818 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.216+0000 7f34f9ffb640 1 -- 172.21.15.70:0/1424006391 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34f002fd90 con 0x7f34fc107830 2024-09-12T01:43:12.818 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.407+0000 7f3502fe8640 1 -- 172.21.15.70:0/1424006391 --> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f34fc1042e0 con 0x7f34ec038f70 2024-09-12T01:43:12.818 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.411+0000 7f34f9ffb640 1 -- 172.21.15.70:0/1424006391 <== mgr.14116 v2:172.21.15.70:6800/1352687155 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f34fc1042e0 con 0x7f34ec038f70 2024-09-12T01:43:12.818 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.413+0000 7f3502fe8640 1 -- 172.21.15.70:0/1424006391 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f34ec038f70 msgr2=0x7f34ec03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.818 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.413+0000 7f3502fe8640 1 --2- 172.21.15.70:0/1424006391 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f34ec038f70 0x7f34ec03b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f34e80098c0 tx=0x7f34e8006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.818 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.413+0000 7f3502fe8640 1 -- 172.21.15.70:0/1424006391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 msgr2=0x7f34fc19b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.818 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.413+0000 7f3502fe8640 1 --2- 172.21.15.70:0/1424006391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 0x7f34fc19b8e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009940 tx=0x7f34f0032e40 comp rx=0 tx=0).stop 2024-09-12T01:43:12.818 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.413+0000 7f3502fe8640 1 -- 172.21.15.70:0/1424006391 shutdown_connections 2024-09-12T01:43:12.819 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.413+0000 7f3502fe8640 1 --2- 172.21.15.70:0/1424006391 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f34ec038f70 0x7f34ec03b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.819 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.413+0000 7f3502fe8640 1 --2- 172.21.15.70:0/1424006391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34fc107830 0x7f34fc19b8e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.819 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.413+0000 7f3502fe8640 1 -- 172.21.15.70:0/1424006391 >> 172.21.15.70:0/1424006391 conn(0x7f34fc102fe0 msgr2=0x7f34fc103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:12.819 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.413+0000 7f3502fe8640 1 -- 172.21.15.70:0/1424006391 shutdown_connections 2024-09-12T01:43:12.819 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:11.413+0000 7f3502fe8640 1 -- 172.21.15.70:0/1424006391 wait complete. 2024-09-12T01:43:13.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:13 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:43:13.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:13 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:43:13.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:13 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/4126835929' entity='client.admin' 2024-09-12T01:43:14.691 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.241+0000 7facb207a640 1 Processor -- start 2024-09-12T01:43:14.691 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.241+0000 7facb207a640 1 -- start start 2024-09-12T01:43:14.691 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.241+0000 7facb207a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 0x7facac106b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.241+0000 7facb207a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7facac1070e0 con 0x7facac106710 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.241+0000 7facab7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 0x7facac106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.241+0000 7facab7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 0x7facac106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57746/0 (socket says 172.21.15.70:57746) 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.241+0000 7facab7fe640 1 -- 172.21.15.70:0/3579892128 learned_addr learned my addr 172.21.15.70:0/3579892128 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.241+0000 7facab7fe640 1 -- 172.21.15.70:0/3579892128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facac107910 con 0x7facac106710 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.242+0000 7facab7fe640 1 --2- 172.21.15.70:0/3579892128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 0x7facac106b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009820 tx=0x7fac9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51d2712c56ecb76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.242+0000 7facaaffd640 1 -- 172.21.15.70:0/3579892128 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac9c037070 con 0x7facac106710 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.242+0000 7facaaffd640 1 -- 172.21.15.70:0/3579892128 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fac9c032940 con 0x7facac106710 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.242+0000 7facaaffd640 1 -- 172.21.15.70:0/3579892128 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac9c0308b0 con 0x7facac106710 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.243+0000 7facb207a640 1 -- 172.21.15.70:0/3579892128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 msgr2=0x7facac106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.243+0000 7facb207a640 1 --2- 172.21.15.70:0/3579892128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 0x7facac106b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009820 tx=0x7fac9c02a270 comp rx=0 tx=0).stop 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.243+0000 7facb207a640 1 -- 172.21.15.70:0/3579892128 shutdown_connections 2024-09-12T01:43:14.692 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.243+0000 7facb207a640 1 --2- 172.21.15.70:0/3579892128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 0x7facac106b10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.243+0000 7facb207a640 1 -- 172.21.15.70:0/3579892128 >> 172.21.15.70:0/3579892128 conn(0x7facac101f60 msgr2=0x7facac104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.243+0000 7facb207a640 1 -- 172.21.15.70:0/3579892128 shutdown_connections 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.243+0000 7facb207a640 1 -- 172.21.15.70:0/3579892128 wait complete. 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.244+0000 7facb207a640 1 Processor -- start 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.244+0000 7facb207a640 1 -- start start 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.244+0000 7facb207a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 0x7facac1919a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.244+0000 7facb207a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7facac10acc0 con 0x7facac106710 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.244+0000 7facab7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 0x7facac1919a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.244+0000 7facab7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 0x7facac1919a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57760/0 (socket says 172.21.15.70:57760) 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.244+0000 7facab7fe640 1 -- 172.21.15.70:0/4126835929 learned_addr learned my addr 172.21.15.70:0/4126835929 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.244+0000 7facab7fe640 1 -- 172.21.15.70:0/4126835929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facac191ee0 con 0x7facac106710 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.244+0000 7facab7fe640 1 --2- 172.21.15.70:0/4126835929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 0x7facac1919a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0097f0 tx=0x7fac9c032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:14.693 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.245+0000 7faca97fa640 1 -- 172.21.15.70:0/4126835929 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac9c037040 con 0x7facac106710 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.245+0000 7faca97fa640 1 -- 172.21.15.70:0/4126835929 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fac9c040070 con 0x7facac106710 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.245+0000 7facb207a640 1 -- 172.21.15.70:0/4126835929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facac1900d0 con 0x7facac106710 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.245+0000 7faca97fa640 1 -- 172.21.15.70:0/4126835929 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac9c03a520 con 0x7facac106710 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.245+0000 7facb207a640 1 -- 172.21.15.70:0/4126835929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facac1905b0 con 0x7facac106710 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.245+0000 7faca97fa640 1 -- 172.21.15.70:0/4126835929 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fac9c03a820 con 0x7facac106710 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.246+0000 7faca97fa640 1 --2- 172.21.15.70:0/4126835929 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fac98038f20 0x7fac9803b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.246+0000 7facb207a640 1 -- 172.21.15.70:0/4126835929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facac106b90 con 0x7facac106710 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.246+0000 7faca97fa640 1 -- 172.21.15.70:0/4126835929 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fac9c06c860 con 0x7facac106710 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.246+0000 7faca3fff640 1 --2- 172.21.15.70:0/4126835929 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fac98038f20 0x7fac9803b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.246+0000 7faca3fff640 1 --2- 172.21.15.70:0/4126835929 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fac98038f20 0x7fac9803b3e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fac940098c0 tx=0x7fac94006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.250+0000 7faca97fa640 1 -- 172.21.15.70:0/4126835929 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac9c044c70 con 0x7facac106710 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.428+0000 7facb207a640 1 -- 172.21.15.70:0/4126835929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7facac195780 con 0x7facac106710 2024-09-12T01:43:14.694 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.431+0000 7faca97fa640 1 -- 172.21.15.70:0/4126835929 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fac9c042e30 con 0x7facac106710 2024-09-12T01:43:14.695 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.433+0000 7facb207a640 1 -- 172.21.15.70:0/4126835929 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fac98038f20 msgr2=0x7fac9803b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:14.695 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.433+0000 7facb207a640 1 --2- 172.21.15.70:0/4126835929 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fac98038f20 0x7fac9803b3e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fac940098c0 tx=0x7fac94006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.695 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.433+0000 7facb207a640 1 -- 172.21.15.70:0/4126835929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 msgr2=0x7facac1919a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:14.695 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.433+0000 7facb207a640 1 --2- 172.21.15.70:0/4126835929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 0x7facac1919a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0097f0 tx=0x7fac9c032e60 comp rx=0 tx=0).stop 2024-09-12T01:43:14.695 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.433+0000 7facb207a640 1 -- 172.21.15.70:0/4126835929 shutdown_connections 2024-09-12T01:43:14.695 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.433+0000 7facb207a640 1 --2- 172.21.15.70:0/4126835929 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fac98038f20 0x7fac9803b3e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.695 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.433+0000 7facb207a640 1 --2- 172.21.15.70:0/4126835929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facac106710 0x7facac1919a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.695 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.433+0000 7facb207a640 1 -- 172.21.15.70:0/4126835929 >> 172.21.15.70:0/4126835929 conn(0x7facac101f60 msgr2=0x7facac102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:14.695 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.434+0000 7facb207a640 1 -- 172.21.15.70:0/4126835929 shutdown_connections 2024-09-12T01:43:14.695 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:13.434+0000 7facb207a640 1 -- 172.21.15.70:0/4126835929 wait complete. 2024-09-12T01:43:15.581 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:15 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:43:15.582 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:15 smithi070 ceph-mon[31177]: from='mgr.14116 172.21.15.70:0/2786812809' entity='mgr.x' 2024-09-12T01:43:15.582 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:15 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3162248675' entity='client.admin' 2024-09-12T01:43:15.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.086+0000 7f6659d23640 1 Processor -- start 2024-09-12T01:43:15.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.086+0000 7f6659d23640 1 -- start start 2024-09-12T01:43:15.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.086+0000 7f6659d23640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 0x7f6654106af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:15.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.086+0000 7f6659d23640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f66541070c0 con 0x7f66541066f0 2024-09-12T01:43:15.872 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.086+0000 7f66537fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 0x7f6654106af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:15.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.086+0000 7f66537fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 0x7f6654106af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57774/0 (socket says 172.21.15.70:57774) 2024-09-12T01:43:15.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.086+0000 7f66537fe640 1 -- 172.21.15.70:0/1518505978 learned_addr learned my addr 172.21.15.70:0/1518505978 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:15.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.087+0000 7f66537fe640 1 -- 172.21.15.70:0/1518505978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66541078f0 con 0x7f66541066f0 2024-09-12T01:43:15.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.087+0000 7f66537fe640 1 --2- 172.21.15.70:0/1518505978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 0x7f6654106af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f664400bac0 tx=0x7f664402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d9fcbe895c56d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:15.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.088+0000 7f66527fc640 1 -- 172.21.15.70:0/1518505978 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66440326d0 con 0x7f66541066f0 2024-09-12T01:43:15.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.088+0000 7f66527fc640 1 -- 172.21.15.70:0/1518505978 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6644038070 con 0x7f66541066f0 2024-09-12T01:43:15.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.088+0000 7f66527fc640 1 -- 172.21.15.70:0/1518505978 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6644033db0 con 0x7f66541066f0 2024-09-12T01:43:15.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.089+0000 7f6659d23640 1 -- 172.21.15.70:0/1518505978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 msgr2=0x7f6654106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:15.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.089+0000 7f6659d23640 1 --2- 172.21.15.70:0/1518505978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 0x7f6654106af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f664400bac0 tx=0x7f664402c920 comp rx=0 tx=0).stop 2024-09-12T01:43:15.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.089+0000 7f6659d23640 1 -- 172.21.15.70:0/1518505978 shutdown_connections 2024-09-12T01:43:15.873 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.089+0000 7f6659d23640 1 --2- 172.21.15.70:0/1518505978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 0x7f6654106af0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.089+0000 7f6659d23640 1 -- 172.21.15.70:0/1518505978 >> 172.21.15.70:0/1518505978 conn(0x7f6654101f80 msgr2=0x7f66541043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.089+0000 7f6659d23640 1 -- 172.21.15.70:0/1518505978 shutdown_connections 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.089+0000 7f6659d23640 1 -- 172.21.15.70:0/1518505978 wait complete. 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.090+0000 7f6659d23640 1 Processor -- start 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.090+0000 7f6659d23640 1 -- start start 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.090+0000 7f6659d23640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 0x7f66541994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.090+0000 7f6659d23640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6654074d90 con 0x7f66541066f0 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.090+0000 7f66537fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 0x7f66541994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.090+0000 7f66537fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 0x7f66541994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57776/0 (socket says 172.21.15.70:57776) 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.090+0000 7f66537fe640 1 -- 172.21.15.70:0/3162248675 learned_addr learned my addr 172.21.15.70:0/3162248675 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.090+0000 7f66537fe640 1 -- 172.21.15.70:0/3162248675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6654199a30 con 0x7f66541066f0 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.091+0000 7f66537fe640 1 --2- 172.21.15.70:0/3162248675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 0x7f66541994f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f664400ba90 tx=0x7f6644032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:15.874 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.091+0000 7f6650ff9640 1 -- 172.21.15.70:0/3162248675 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6644042070 con 0x7f66541066f0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.091+0000 7f6659d23640 1 -- 172.21.15.70:0/3162248675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6654199cc0 con 0x7f66541066f0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.091+0000 7f6650ff9640 1 -- 172.21.15.70:0/3162248675 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6644032da0 con 0x7f66541066f0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.091+0000 7f6650ff9640 1 -- 172.21.15.70:0/3162248675 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f664403c7b0 con 0x7f66541066f0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.091+0000 7f6659d23640 1 -- 172.21.15.70:0/3162248675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665419c9b0 con 0x7f66541066f0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.092+0000 7f6650ff9640 1 -- 172.21.15.70:0/3162248675 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f664403c9d0 con 0x7f66541066f0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.092+0000 7f6659d23640 1 -- 172.21.15.70:0/3162248675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66540a7440 con 0x7f66541066f0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.092+0000 7f6650ff9640 1 --2- 172.21.15.70:0/3162248675 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f663c038fc0 0x7f663c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.093+0000 7f6650ff9640 1 -- 172.21.15.70:0/3162248675 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6644030050 con 0x7f66541066f0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.093+0000 7f6652ffd640 1 --2- 172.21.15.70:0/3162248675 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f663c038fc0 0x7f663c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.093+0000 7f6652ffd640 1 --2- 172.21.15.70:0/3162248675 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f663c038fc0 0x7f663c03b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f66480098c0 tx=0x7f6648006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.100+0000 7f6650ff9640 1 -- 172.21.15.70:0/3162248675 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66440313e0 con 0x7f66541066f0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.275+0000 7f6659d23640 1 -- 172.21.15.70:0/3162248675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f6654192960 con 0x7f66541066f0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.277+0000 7f6650ff9640 1 -- 172.21.15.70:0/3162248675 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f6644009250 con 0x7f66541066f0 2024-09-12T01:43:15.875 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.280+0000 7f6659d23640 1 -- 172.21.15.70:0/3162248675 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f663c038fc0 msgr2=0x7f663c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:15.876 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.280+0000 7f6659d23640 1 --2- 172.21.15.70:0/3162248675 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f663c038fc0 0x7f663c03b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f66480098c0 tx=0x7f6648006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:15.876 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.280+0000 7f6659d23640 1 -- 172.21.15.70:0/3162248675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 msgr2=0x7f66541994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:15.876 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.280+0000 7f6659d23640 1 --2- 172.21.15.70:0/3162248675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 0x7f66541994f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f664400ba90 tx=0x7f6644032b90 comp rx=0 tx=0).stop 2024-09-12T01:43:15.876 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.280+0000 7f6659d23640 1 -- 172.21.15.70:0/3162248675 shutdown_connections 2024-09-12T01:43:15.876 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.280+0000 7f6659d23640 1 --2- 172.21.15.70:0/3162248675 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f663c038fc0 0x7f663c03b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:15.876 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.280+0000 7f6659d23640 1 --2- 172.21.15.70:0/3162248675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66541066f0 0x7f66541994f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:15.876 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.280+0000 7f6659d23640 1 -- 172.21.15.70:0/3162248675 >> 172.21.15.70:0/3162248675 conn(0x7f6654101f80 msgr2=0x7f665418fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:15.876 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.280+0000 7f6659d23640 1 -- 172.21.15.70:0/3162248675 shutdown_connections 2024-09-12T01:43:15.876 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:15.280+0000 7f6659d23640 1 -- 172.21.15.70:0/3162248675 wait complete. 2024-09-12T01:43:15.876 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling the dashboard module... 2024-09-12T01:43:16.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:16 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1301374755' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T01:43:16.769 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:16 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: ignoring --setuser ceph since I am not root 2024-09-12T01:43:16.769 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:16 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: ignoring --setgroup ceph since I am not root 2024-09-12T01:43:16.769 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:16 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:16.624+0000 7f27d6c3f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:43:16.769 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:16 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:16.680+0000 7f27d6c3f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:43:17.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.187+0000 7fdff4d82640 1 Processor -- start 2024-09-12T01:43:17.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.187+0000 7fdff4d82640 1 -- start start 2024-09-12T01:43:17.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.187+0000 7fdff4d82640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 0x7fdff0107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.187+0000 7fdff4d82640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdff0108210 con 0x7fdff0107840 2024-09-12T01:43:17.073 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.187+0000 7fdfee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 0x7fdff0107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.187+0000 7fdfee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 0x7fdff0107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57790/0 (socket says 172.21.15.70:57790) 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.187+0000 7fdfee59c640 1 -- 172.21.15.70:0/1670989661 learned_addr learned my addr 172.21.15.70:0/1670989661 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.187+0000 7fdfee59c640 1 -- 172.21.15.70:0/1670989661 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff0108a40 con 0x7fdff0107840 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.188+0000 7fdfee59c640 1 --2- 172.21.15.70:0/1670989661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 0x7fdff0107c40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009820 tx=0x7fdfe002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22aaf2907f8ab621 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.188+0000 7fdfed59a640 1 -- 172.21.15.70:0/1670989661 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfe0037070 con 0x7fdff0107840 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.188+0000 7fdfed59a640 1 -- 172.21.15.70:0/1670989661 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdfe0032940 con 0x7fdff0107840 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.188+0000 7fdfed59a640 1 -- 172.21.15.70:0/1670989661 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfe00308b0 con 0x7fdff0107840 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.189+0000 7fdff4d82640 1 -- 172.21.15.70:0/1670989661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 msgr2=0x7fdff0107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.189+0000 7fdff4d82640 1 --2- 172.21.15.70:0/1670989661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 0x7fdff0107c40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009820 tx=0x7fdfe002a270 comp rx=0 tx=0).stop 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.189+0000 7fdff4d82640 1 -- 172.21.15.70:0/1670989661 shutdown_connections 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.189+0000 7fdff4d82640 1 --2- 172.21.15.70:0/1670989661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 0x7fdff0107c40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.189+0000 7fdff4d82640 1 -- 172.21.15.70:0/1670989661 >> 172.21.15.70:0/1670989661 conn(0x7fdff0102fd0 msgr2=0x7fdff0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:17.074 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.189+0000 7fdff4d82640 1 -- 172.21.15.70:0/1670989661 shutdown_connections 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.189+0000 7fdff4d82640 1 -- 172.21.15.70:0/1670989661 wait complete. 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.190+0000 7fdff4d82640 1 Processor -- start 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.190+0000 7fdff4d82640 1 -- start start 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.190+0000 7fdff4d82640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 0x7fdff019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.190+0000 7fdff4d82640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdff010bdf0 con 0x7fdff0107840 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.190+0000 7fdfee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 0x7fdff019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.190+0000 7fdfee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 0x7fdff019b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57806/0 (socket says 172.21.15.70:57806) 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.190+0000 7fdfee59c640 1 -- 172.21.15.70:0/1301374755 learned_addr learned my addr 172.21.15.70:0/1301374755 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.190+0000 7fdfee59c640 1 -- 172.21.15.70:0/1301374755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff019be10 con 0x7fdff0107840 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.190+0000 7fdfee59c640 1 --2- 172.21.15.70:0/1301374755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 0x7fdff019b8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009940 tx=0x7fdfe0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.191+0000 7fdfdf7fe640 1 -- 172.21.15.70:0/1301374755 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfe0042070 con 0x7fdff0107840 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.191+0000 7fdfdf7fe640 1 -- 172.21.15.70:0/1301374755 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdfe003d930 con 0x7fdff0107840 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.191+0000 7fdff4d82640 1 -- 172.21.15.70:0/1301374755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff019c0a0 con 0x7fdff0107840 2024-09-12T01:43:17.075 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.191+0000 7fdfdf7fe640 1 -- 172.21.15.70:0/1301374755 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfe0037040 con 0x7fdff0107840 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.191+0000 7fdff4d82640 1 -- 172.21.15.70:0/1301374755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff019ed90 con 0x7fdff0107840 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.192+0000 7fdfdf7fe640 1 -- 172.21.15.70:0/1301374755 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fdfe0045070 con 0x7fdff0107840 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.192+0000 7fdff4d82640 1 -- 172.21.15.70:0/1301374755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff0107cc0 con 0x7fdff0107840 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.192+0000 7fdfdf7fe640 1 --2- 172.21.15.70:0/1301374755 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fdfd8038fc0 0x7fdfd803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.192+0000 7fdfdf7fe640 1 -- 172.21.15.70:0/1301374755 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdfe006c100 con 0x7fdff0107840 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.192+0000 7fdfedd9b640 1 --2- 172.21.15.70:0/1301374755 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fdfd8038fc0 0x7fdfd803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.193+0000 7fdfedd9b640 1 --2- 172.21.15.70:0/1301374755 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fdfd8038fc0 0x7fdfd803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40098c0 tx=0x7fdfe4006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.197+0000 7fdfdf7fe640 1 -- 172.21.15.70:0/1301374755 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdfe003ae40 con 0x7fdff0107840 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.418+0000 7fdff4d82640 1 -- 172.21.15.70:0/1301374755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fdff019f380 con 0x7fdff0107840 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.469+0000 7fdfdf7fe640 1 -- 172.21.15.70:0/1301374755 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fdfe0043d20 con 0x7fdff0107840 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.471+0000 7fdfdf7fe640 1 -- 172.21.15.70:0/1301374755 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fdfe003c8d0 con 0x7fdff0107840 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.473+0000 7fdff4d82640 1 -- 172.21.15.70:0/1301374755 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fdfd8038fc0 msgr2=0x7fdfd803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.076 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.473+0000 7fdff4d82640 1 --2- 172.21.15.70:0/1301374755 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fdfd8038fc0 0x7fdfd803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40098c0 tx=0x7fdfe4006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.077 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.473+0000 7fdff4d82640 1 -- 172.21.15.70:0/1301374755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 msgr2=0x7fdff019b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.077 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.473+0000 7fdff4d82640 1 --2- 172.21.15.70:0/1301374755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 0x7fdff019b8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009940 tx=0x7fdfe0032670 comp rx=0 tx=0).stop 2024-09-12T01:43:17.077 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.473+0000 7fdff4d82640 1 -- 172.21.15.70:0/1301374755 shutdown_connections 2024-09-12T01:43:17.077 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.473+0000 7fdff4d82640 1 --2- 172.21.15.70:0/1301374755 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fdfd8038fc0 0x7fdfd803b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.077 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.473+0000 7fdff4d82640 1 --2- 172.21.15.70:0/1301374755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdff0107840 0x7fdff019b8d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.077 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.473+0000 7fdff4d82640 1 -- 172.21.15.70:0/1301374755 >> 172.21.15.70:0/1301374755 conn(0x7fdff0102fd0 msgr2=0x7fdff0103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:17.077 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.473+0000 7fdff4d82640 1 -- 172.21.15.70:0/1301374755 shutdown_connections 2024-09-12T01:43:17.077 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:16.473+0000 7fdff4d82640 1 -- 172.21.15.70:0/1301374755 wait complete. 2024-09-12T01:43:17.190 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:16 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:16.830+0000 7f27d6c3f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:43:17.190 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:16 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:16.896+0000 7f27d6c3f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:43:17.190 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:17 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:17.043+0000 7f27d6c3f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:43:17.190 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:17 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:17.189+0000 7f27d6c3f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:43:17.734 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:17 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1301374755' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T01:43:17.734 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:17 smithi070 ceph-mon[31177]: mgrmap e9: x(active, since 18s) 2024-09-12T01:43:17.734 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:17 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:17.512+0000 7f27d6c3f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:43:17.734 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:17 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:17.575+0000 7f27d6c3f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:43:18.018 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:17 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:17.774+0000 7f27d6c3f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:43:18.665 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:18 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/522040877' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T01:43:18.985 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:18 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:18.664+0000 7f27d6c3f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:43:18.985 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:18 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:18.735+0000 7f27d6c3f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.489+0000 7fec94923640 1 Processor -- start 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.489+0000 7fec94923640 1 -- start start 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.489+0000 7fec94923640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 0x7fec901081a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.489+0000 7fec94923640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec90108770 con 0x7fec90107da0 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.489+0000 7fec8e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 0x7fec901081a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.489+0000 7fec8e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 0x7fec901081a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57836/0 (socket says 172.21.15.70:57836) 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.489+0000 7fec8e59c640 1 -- 172.21.15.70:0/1588667968 learned_addr learned my addr 172.21.15.70:0/1588667968 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.489+0000 7fec8e59c640 1 -- 172.21.15.70:0/1588667968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec901088f0 con 0x7fec90107da0 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.490+0000 7fec8e59c640 1 --2- 172.21.15.70:0/1588667968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 0x7fec901081a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fec80009820 tx=0x7fec8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c36e3ebfe806748 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.490+0000 7fec8dd9b640 1 -- 172.21.15.70:0/1588667968 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec80037070 con 0x7fec90107da0 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.490+0000 7fec8dd9b640 1 -- 172.21.15.70:0/1588667968 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec80032940 con 0x7fec90107da0 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.490+0000 7fec8dd9b640 1 -- 172.21.15.70:0/1588667968 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec800308b0 con 0x7fec90107da0 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.491+0000 7fec94923640 1 -- 172.21.15.70:0/1588667968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 msgr2=0x7fec901081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.491+0000 7fec94923640 1 --2- 172.21.15.70:0/1588667968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 0x7fec901081a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fec80009820 tx=0x7fec8002a270 comp rx=0 tx=0).stop 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.491+0000 7fec94923640 1 -- 172.21.15.70:0/1588667968 shutdown_connections 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.491+0000 7fec94923640 1 --2- 172.21.15.70:0/1588667968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 0x7fec901081a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.491+0000 7fec94923640 1 -- 172.21.15.70:0/1588667968 >> 172.21.15.70:0/1588667968 conn(0x7fec90101650 msgr2=0x7fec90103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:18.998 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.491+0000 7fec94923640 1 -- 172.21.15.70:0/1588667968 shutdown_connections 2024-09-12T01:43:18.998 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.491+0000 7fec94923640 1 -- 172.21.15.70:0/1588667968 wait complete. 2024-09-12T01:43:18.998 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.492+0000 7fec94923640 1 Processor -- start 2024-09-12T01:43:18.998 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.492+0000 7fec94923640 1 -- start start 2024-09-12T01:43:18.998 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.492+0000 7fec94923640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 0x7fec9019da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.998 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.492+0000 7fec94923640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec90106860 con 0x7fec90107da0 2024-09-12T01:43:18.998 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.492+0000 7fec8e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 0x7fec9019da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.492+0000 7fec8e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 0x7fec9019da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57842/0 (socket says 172.21.15.70:57842) 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.492+0000 7fec8e59c640 1 -- 172.21.15.70:0/522040877 learned_addr learned my addr 172.21.15.70:0/522040877 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.493+0000 7fec8e59c640 1 -- 172.21.15.70:0/522040877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9019dfb0 con 0x7fec90107da0 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.493+0000 7fec8e59c640 1 --2- 172.21.15.70:0/522040877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 0x7fec9019da70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fec80032670 tx=0x7fec800326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.493+0000 7fec87fff640 1 -- 172.21.15.70:0/522040877 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec80042070 con 0x7fec90107da0 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.493+0000 7fec87fff640 1 -- 172.21.15.70:0/522040877 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec8003d930 con 0x7fec90107da0 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.493+0000 7fec94923640 1 -- 172.21.15.70:0/522040877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9019e240 con 0x7fec90107da0 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.493+0000 7fec87fff640 1 -- 172.21.15.70:0/522040877 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec80037040 con 0x7fec90107da0 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.493+0000 7fec94923640 1 -- 172.21.15.70:0/522040877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec901a0f30 con 0x7fec90107da0 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.494+0000 7fec87fff640 1 -- 172.21.15.70:0/522040877 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fec80045070 con 0x7fec90107da0 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.494+0000 7fec87fff640 1 --2- 172.21.15.70:0/522040877 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fec7c038fc0 0x7fec7c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.494+0000 7fec94923640 1 -- 172.21.15.70:0/522040877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec90108220 con 0x7fec90107da0 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.494+0000 7fec85d9b640 1 -- 172.21.15.70:0/522040877 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fec7c038fc0 msgr2=0x7fec7c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1352687155 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.494+0000 7fec87fff640 1 -- 172.21.15.70:0/522040877 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fec8006c180 con 0x7fec90107da0 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.494+0000 7fec85d9b640 1 --2- 172.21.15.70:0/522040877 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fec7c038fc0 0x7fec7c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.499+0000 7fec87fff640 1 -- 172.21.15.70:0/522040877 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec8003cdf0 con 0x7fec90107da0 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.695+0000 7fec85d9b640 1 -- 172.21.15.70:0/522040877 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fec7c038fc0 msgr2=0x7fec7c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1352687155 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.695+0000 7fec85d9b640 1 --2- 172.21.15.70:0/522040877 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fec7c038fc0 0x7fec7c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.721+0000 7fec94923640 1 -- 172.21.15.70:0/522040877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fec90196fa0 con 0x7fec90107da0 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.722+0000 7fec87fff640 1 -- 172.21.15.70:0/522040877 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fec8003dae0 con 0x7fec90107da0 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.724+0000 7fec94923640 1 -- 172.21.15.70:0/522040877 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fec7c038fc0 msgr2=0x7fec7c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.724+0000 7fec94923640 1 --2- 172.21.15.70:0/522040877 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fec7c038fc0 0x7fec7c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.724+0000 7fec94923640 1 -- 172.21.15.70:0/522040877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 msgr2=0x7fec9019da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.724+0000 7fec94923640 1 --2- 172.21.15.70:0/522040877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 0x7fec9019da70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fec80032670 tx=0x7fec800326a0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.724+0000 7fec94923640 1 -- 172.21.15.70:0/522040877 shutdown_connections 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.724+0000 7fec94923640 1 --2- 172.21.15.70:0/522040877 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7fec7c038fc0 0x7fec7c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.724+0000 7fec94923640 1 --2- 172.21.15.70:0/522040877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec90107da0 0x7fec9019da70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.724+0000 7fec94923640 1 -- 172.21.15.70:0/522040877 >> 172.21.15.70:0/522040877 conn(0x7fec90101650 msgr2=0x7fec90194110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.724+0000 7fec94923640 1 -- 172.21.15.70:0/522040877 shutdown_connections 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:17.724+0000 7fec94923640 1 -- 172.21.15.70:0/522040877 wait complete. 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for the mgr to restart... 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr epoch 9... 2024-09-12T01:43:19.587 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:19 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:19.470+0000 7f27d6c3f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:43:19.587 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:19 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:19.586+0000 7f27d6c3f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:43:19.938 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:19 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:19.728+0000 7f27d6c3f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:43:19.939 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:19 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:19.790+0000 7f27d6c3f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:43:19.939 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:19 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:19.937+0000 7f27d6c3f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:43:20.222 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:20.005+0000 7f27d6c3f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:43:20.222 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:20.065+0000 7f27d6c3f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:43:20.222 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:20.221+0000 7f27d6c3f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:43:20.503 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:20.290+0000 7f27d6c3f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:43:20.503 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:20.360+0000 7f27d6c3f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:43:20.504 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:20.446+0000 7f27d6c3f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:43:20.769 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:20.509+0000 7f27d6c3f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:43:20.769 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:20.571+0000 7f27d6c3f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:43:21.769 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:21.391+0000 7f27d6c3f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:43:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: Active manager daemon x restarted 2024-09-12T01:43:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: Activating manager daemon x 2024-09-12T01:43:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T01:43:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: mgrmap e10: x(active, starting, since 0.00345514s) 2024-09-12T01:43:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:43:21.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T01:43:21.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:43:21.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:43:21.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:43:21.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: Manager daemon x is now available 2024-09-12T01:43:21.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:43:21.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:43:21.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T01:43:23.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:22.606+0000 7f2741f53640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:01:43:22] ENGINE Error in HTTPServer.serve 2024-09-12T01:43:23.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: Traceback (most recent call last): 2024-09-12T01:43:23.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:43:23.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: self._connections.run(self.expiration_interval) 2024-09-12T01:43:23.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:43:23.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: self._run(expiration_interval) 2024-09-12T01:43:23.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:43:23.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:43:23.019 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:43:23.020 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:43:23.020 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:43:23.020 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: s = self.context.wrap_socket( 2024-09-12T01:43:23.020 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:43:23.020 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: return self.sslsocket_class._create( 2024-09-12T01:43:23.020 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:43:23.020 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: self.do_handshake() 2024-09-12T01:43:23.020 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:43:23.020 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: self._sslobj.do_handshake() 2024-09-12T01:43:23.020 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:43:23.020 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:43:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:43:23.279 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:43:23.279 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T01:43:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T01:43:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:43:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.400+0000 7f7b620a9640 1 Processor -- start 2024-09-12T01:43:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.400+0000 7f7b620a9640 1 -- start start 2024-09-12T01:43:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.400+0000 7f7b620a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 0x7f7b5c106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.400+0000 7f7b620a9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c107150 con 0x7f7b5c106780 2024-09-12T01:43:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.400+0000 7f7b5b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 0x7f7b5c106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.400+0000 7f7b5b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 0x7f7b5c106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57846/0 (socket says 172.21.15.70:57846) 2024-09-12T01:43:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.400+0000 7f7b5b7fe640 1 -- 172.21.15.70:0/1274878821 learned_addr learned my addr 172.21.15.70:0/1274878821 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.400+0000 7f7b5b7fe640 1 -- 172.21.15.70:0/1274878821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c107980 con 0x7f7b5c106780 2024-09-12T01:43:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.401+0000 7f7b5b7fe640 1 --2- 172.21.15.70:0/1274878821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 0x7f7b5c106b80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009820 tx=0x7f7b4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bd63ad2ac0fcea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.401+0000 7f7b5a7fc640 1 -- 172.21.15.70:0/1274878821 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b4c037070 con 0x7f7b5c106780 2024-09-12T01:43:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.401+0000 7f7b5a7fc640 1 -- 172.21.15.70:0/1274878821 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7b4c032940 con 0x7f7b5c106780 2024-09-12T01:43:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.401+0000 7f7b5a7fc640 1 -- 172.21.15.70:0/1274878821 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b4c0308b0 con 0x7f7b5c106780 2024-09-12T01:43:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.402+0000 7f7b620a9640 1 -- 172.21.15.70:0/1274878821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 msgr2=0x7f7b5c106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.402+0000 7f7b620a9640 1 --2- 172.21.15.70:0/1274878821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 0x7f7b5c106b80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009820 tx=0x7f7b4c02a270 comp rx=0 tx=0).stop 2024-09-12T01:43:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.402+0000 7f7b620a9640 1 -- 172.21.15.70:0/1274878821 shutdown_connections 2024-09-12T01:43:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.402+0000 7f7b620a9640 1 --2- 172.21.15.70:0/1274878821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 0x7f7b5c106b80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.402+0000 7f7b620a9640 1 -- 172.21.15.70:0/1274878821 >> 172.21.15.70:0/1274878821 conn(0x7f7b5c101f70 msgr2=0x7f7b5c104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.402+0000 7f7b620a9640 1 -- 172.21.15.70:0/1274878821 shutdown_connections 2024-09-12T01:43:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.402+0000 7f7b620a9640 1 -- 172.21.15.70:0/1274878821 wait complete. 2024-09-12T01:43:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.403+0000 7f7b620a9640 1 Processor -- start 2024-09-12T01:43:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.403+0000 7f7b620a9640 1 -- start start 2024-09-12T01:43:23.281 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.404+0000 7f7b620a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 0x7f7b5c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.404+0000 7f7b620a9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c10ad30 con 0x7f7b5c106780 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.404+0000 7f7b5b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 0x7f7b5c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.404+0000 7f7b5b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 0x7f7b5c19a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57858/0 (socket says 172.21.15.70:57858) 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.404+0000 7f7b5b7fe640 1 -- 172.21.15.70:0/1935208487 learned_addr learned my addr 172.21.15.70:0/1935208487 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.404+0000 7f7b5b7fe640 1 -- 172.21.15.70:0/1935208487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c19adb0 con 0x7f7b5c106780 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.404+0000 7f7b5b7fe640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 0x7f7b5c19a870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009940 tx=0x7f7b4c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.404+0000 7f7b58ff9640 1 -- 172.21.15.70:0/1935208487 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b4c042070 con 0x7f7b5c106780 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.404+0000 7f7b620a9640 1 -- 172.21.15.70:0/1935208487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5c19b040 con 0x7f7b5c106780 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.404+0000 7f7b58ff9640 1 -- 172.21.15.70:0/1935208487 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7b4c03d930 con 0x7f7b5c106780 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.404+0000 7f7b58ff9640 1 -- 172.21.15.70:0/1935208487 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b4c037040 con 0x7f7b5c106780 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.404+0000 7f7b620a9640 1 -- 172.21.15.70:0/1935208487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b5c19dd30 con 0x7f7b5c106780 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.405+0000 7f7b58ff9640 1 -- 172.21.15.70:0/1935208487 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f7b4c045070 con 0x7f7b5c106780 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.405+0000 7f7b58ff9640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7b44038fc0 0x7f7b4403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.405+0000 7f7b620a9640 1 -- 172.21.15.70:0/1935208487 --> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7b5c106c00 con 0x7f7b44038fc0 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.406+0000 7f7b58ff9640 1 -- 172.21.15.70:0/1935208487 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7b4c06c300 con 0x7f7b5c106780 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.406+0000 7f7b5affd640 1 -- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7b44038fc0 msgr2=0x7f7b4403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1352687155 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.406+0000 7f7b5affd640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7b44038fc0 0x7f7b4403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.607+0000 7f7b5affd640 1 -- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7b44038fc0 msgr2=0x7f7b4403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1352687155 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:19.607+0000 7f7b5affd640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7b44038fc0 0x7f7b4403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:20.008+0000 7f7b5affd640 1 -- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7b44038fc0 msgr2=0x7f7b4403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1352687155 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:20.008+0000 7f7b5affd640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7b44038fc0 0x7f7b4403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:20.809+0000 7f7b5affd640 1 -- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7b44038fc0 msgr2=0x7f7b4403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1352687155 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:20.809+0000 7f7b5affd640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7b44038fc0 0x7f7b4403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:21.395+0000 7f7b58ff9640 1 -- 172.21.15.70:0/1935208487 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f7b4c06adb0 con 0x7f7b5c106780 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:21.395+0000 7f7b58ff9640 1 -- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7b44038fc0 msgr2=0x7f7b4403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:21.395+0000 7f7b58ff9640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7b44038fc0 0x7f7b4403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.283 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.396+0000 7f7b58ff9640 1 -- 172.21.15.70:0/1935208487 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f7b4c06e2a0 con 0x7f7b5c106780 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.396+0000 7f7b58ff9640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7b4403c890 0x7f7b4403ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.396+0000 7f7b58ff9640 1 -- 172.21.15.70:0/1935208487 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7b4c041ec0 con 0x7f7b4403c890 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.397+0000 7f7b5affd640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7b4403c890 0x7f7b4403ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.397+0000 7f7b5affd640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7b4403c890 0x7f7b4403ec80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7b50003980 tx=0x7f7b50006e10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.398+0000 7f7b58ff9640 1 -- 172.21.15.70:0/1935208487 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f7b4c041ec0 con 0x7f7b4403c890 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.410+0000 7f7b620a9640 1 -- 172.21.15.70:0/1935208487 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f7b3c000d10 con 0x7f7b4403c890 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.410+0000 7f7b58ff9640 1 -- 172.21.15.70:0/1935208487 <== mgr.14148 v2:172.21.15.70:6800/633920150 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f7b3c000d10 con 0x7f7b4403c890 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.411+0000 7f7b620a9640 1 -- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7b4403c890 msgr2=0x7f7b4403ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.411+0000 7f7b620a9640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7b4403c890 0x7f7b4403ec80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7b50003980 tx=0x7f7b50006e10 comp rx=0 tx=0).stop 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.411+0000 7f7b620a9640 1 -- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 msgr2=0x7f7b5c19a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.411+0000 7f7b620a9640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 0x7f7b5c19a870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009940 tx=0x7f7b4c032670 comp rx=0 tx=0).stop 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.411+0000 7f7b620a9640 1 -- 172.21.15.70:0/1935208487 shutdown_connections 2024-09-12T01:43:23.284 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.411+0000 7f7b620a9640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7b4403c890 0x7f7b4403ec80 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.411+0000 7f7b620a9640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:6800/1352687155,v1:172.21.15.70:6801/1352687155] conn(0x7f7b44038fc0 0x7f7b4403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.411+0000 7f7b620a9640 1 --2- 172.21.15.70:0/1935208487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5c106780 0x7f7b5c19a870 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.411+0000 7f7b620a9640 1 -- 172.21.15.70:0/1935208487 >> 172.21.15.70:0/1935208487 conn(0x7f7b5c101f70 msgr2=0x7f7b5c102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:23.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.411+0000 7f7b620a9640 1 -- 172.21.15.70:0/1935208487 shutdown_connections 2024-09-12T01:43:23.285 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:22.411+0000 7f7b620a9640 1 -- 172.21.15.70:0/1935208487 wait complete. 2024-09-12T01:43:23.285 INFO:teuthology.orchestra.run.smithi070.stdout:mgr epoch 9 is available 2024-09-12T01:43:23.285 INFO:teuthology.orchestra.run.smithi070.stdout:Generating a dashboard self-signed certificate... 2024-09-12T01:43:23.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:23 smithi070 ceph-mon[31177]: mgrmap e11: x(active, since 1.00546s) 2024-09-12T01:43:23.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:23 smithi070 ceph-mon[31177]: [12/Sep/2024:01:43:22] ENGINE Bus STARTING 2024-09-12T01:43:23.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:23 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:24.452 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:24 smithi070 ceph-mon[31177]: [12/Sep/2024:01:43:22] ENGINE Serving on https://172.21.15.70:7150 2024-09-12T01:43:24.452 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:24 smithi070 ceph-mon[31177]: [12/Sep/2024:01:43:22] ENGINE Error in HTTPServer.serve 2024-09-12T01:43:24.453 INFO:journalctl@ceph.mon.a.smithi070.stdout: Traceback (most recent call last): 2024-09-12T01:43:24.453 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:43:24.453 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:43:24.453 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:43:24.453 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._run(expiration_interval) 2024-09-12T01:43:24.453 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:43:24.453 INFO:journalctl@ceph.mon.a.smithi070.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:43:24.453 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:43:24.453 INFO:journalctl@ceph.mon.a.smithi070.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:43:24.453 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:43:24.454 INFO:journalctl@ceph.mon.a.smithi070.stdout: s = self.context.wrap_socket( 2024-09-12T01:43:24.454 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:43:24.454 INFO:journalctl@ceph.mon.a.smithi070.stdout: return self.sslsocket_class._create( 2024-09-12T01:43:24.454 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:43:24.454 INFO:journalctl@ceph.mon.a.smithi070.stdout: self.do_handshake() 2024-09-12T01:43:24.454 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:43:24.454 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._sslobj.do_handshake() 2024-09-12T01:43:24.454 INFO:journalctl@ceph.mon.a.smithi070.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:43:24.454 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:24 smithi070 ceph-mon[31177]: [12/Sep/2024:01:43:22] ENGINE Serving on http://172.21.15.70:8765 2024-09-12T01:43:24.454 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:24 smithi070 ceph-mon[31177]: [12/Sep/2024:01:43:22] ENGINE Bus STARTED 2024-09-12T01:43:24.455 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:24 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:24.455 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:24 smithi070 ceph-mon[31177]: mgrmap e12: x(active, since 2s) 2024-09-12T01:43:24.455 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:24 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:24.455 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:24 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:24.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T01:43:24.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.703+0000 7f6a8f524640 1 Processor -- start 2024-09-12T01:43:24.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.704+0000 7f6a8f524640 1 -- start start 2024-09-12T01:43:24.465 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.704+0000 7f6a8f524640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 0x7f6a88106470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:24.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.704+0000 7f6a8f524640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a88075a90 con 0x7f6a88106070 2024-09-12T01:43:24.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.704+0000 7f6a8d2c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 0x7f6a88106470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:24.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.704+0000 7f6a8d2c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 0x7f6a88106470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48312/0 (socket says 172.21.15.70:48312) 2024-09-12T01:43:24.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.704+0000 7f6a8d2c0640 1 -- 172.21.15.70:0/988128827 learned_addr learned my addr 172.21.15.70:0/988128827 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:24.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.704+0000 7f6a8d2c0640 1 -- 172.21.15.70:0/988128827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a881069b0 con 0x7f6a88106070 2024-09-12T01:43:24.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.705+0000 7f6a8d2c0640 1 --2- 172.21.15.70:0/988128827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 0x7f6a88106470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009820 tx=0x7f6a8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198b05fa063f041e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:24.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.705+0000 7f6a7ffff640 1 -- 172.21.15.70:0/988128827 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a84037070 con 0x7f6a88106070 2024-09-12T01:43:24.466 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.705+0000 7f6a7ffff640 1 -- 172.21.15.70:0/988128827 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a84032940 con 0x7f6a88106070 2024-09-12T01:43:24.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.705+0000 7f6a7ffff640 1 -- 172.21.15.70:0/988128827 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a840308b0 con 0x7f6a88106070 2024-09-12T01:43:24.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.706+0000 7f6a8f524640 1 -- 172.21.15.70:0/988128827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 msgr2=0x7f6a88106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:24.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.706+0000 7f6a8f524640 1 --2- 172.21.15.70:0/988128827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 0x7f6a88106470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009820 tx=0x7f6a8402a270 comp rx=0 tx=0).stop 2024-09-12T01:43:24.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.706+0000 7f6a8f524640 1 -- 172.21.15.70:0/988128827 shutdown_connections 2024-09-12T01:43:24.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.706+0000 7f6a8f524640 1 --2- 172.21.15.70:0/988128827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 0x7f6a88106470 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:24.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.706+0000 7f6a8f524640 1 -- 172.21.15.70:0/988128827 >> 172.21.15.70:0/988128827 conn(0x7f6a88101ee0 msgr2=0x7f6a88104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:24.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.706+0000 7f6a8f524640 1 -- 172.21.15.70:0/988128827 shutdown_connections 2024-09-12T01:43:24.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.706+0000 7f6a8f524640 1 -- 172.21.15.70:0/988128827 wait complete. 2024-09-12T01:43:24.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.707+0000 7f6a8f524640 1 Processor -- start 2024-09-12T01:43:24.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.707+0000 7f6a8f524640 1 -- start start 2024-09-12T01:43:24.467 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.707+0000 7f6a8f524640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 0x7f6a8819d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:24.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.707+0000 7f6a8f524640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a88107b50 con 0x7f6a88106070 2024-09-12T01:43:24.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.707+0000 7f6a8d2c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 0x7f6a8819d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:24.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.707+0000 7f6a8d2c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 0x7f6a8819d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48326/0 (socket says 172.21.15.70:48326) 2024-09-12T01:43:24.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.707+0000 7f6a8d2c0640 1 -- 172.21.15.70:0/251386029 learned_addr learned my addr 172.21.15.70:0/251386029 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:24.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.708+0000 7f6a8d2c0640 1 -- 172.21.15.70:0/251386029 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8819df20 con 0x7f6a88106070 2024-09-12T01:43:24.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.708+0000 7f6a8d2c0640 1 --2- 172.21.15.70:0/251386029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 0x7f6a8819d9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a840097f0 tx=0x7f6a84032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:24.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.708+0000 7f6a7e7fc640 1 -- 172.21.15.70:0/251386029 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a84042070 con 0x7f6a88106070 2024-09-12T01:43:24.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.708+0000 7f6a8f524640 1 -- 172.21.15.70:0/251386029 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a8819e1b0 con 0x7f6a88106070 2024-09-12T01:43:24.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.708+0000 7f6a8f524640 1 -- 172.21.15.70:0/251386029 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a881a0ea0 con 0x7f6a88106070 2024-09-12T01:43:24.468 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.708+0000 7f6a7e7fc640 1 -- 172.21.15.70:0/251386029 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a8403d930 con 0x7f6a88106070 2024-09-12T01:43:24.469 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.708+0000 7f6a7e7fc640 1 -- 172.21.15.70:0/251386029 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a84037040 con 0x7f6a88106070 2024-09-12T01:43:24.469 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.709+0000 7f6a7e7fc640 1 -- 172.21.15.70:0/251386029 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f6a84045070 con 0x7f6a88106070 2024-09-12T01:43:24.469 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.709+0000 7f6a7e7fc640 1 --2- 172.21.15.70:0/251386029 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6a74038f00 0x7f6a7403b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:24.469 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.709+0000 7f6a8f524640 1 -- 172.21.15.70:0/251386029 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c0052c0 con 0x7f6a88106070 2024-09-12T01:43:24.469 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.709+0000 7f6a7e7fc640 1 -- 172.21.15.70:0/251386029 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6a8406c2f0 con 0x7f6a88106070 2024-09-12T01:43:24.469 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.709+0000 7f6a8cabf640 1 --2- 172.21.15.70:0/251386029 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6a74038f00 0x7f6a7403b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:24.469 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.710+0000 7f6a8cabf640 1 --2- 172.21.15.70:0/251386029 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6a74038f00 0x7f6a7403b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a780098c0 tx=0x7f6a78006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:24.469 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.715+0000 7f6a7e7fc640 1 -- 172.21.15.70:0/251386029 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a84045520 con 0x7f6a88106070 2024-09-12T01:43:24.469 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.876+0000 7f6a7e7fc640 1 -- 172.21.15.70:0/251386029 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f6a8403c940 con 0x7f6a88106070 2024-09-12T01:43:24.469 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.894+0000 7f6a8f524640 1 -- 172.21.15.70:0/251386029 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f6a6c000bf0 con 0x7f6a74038f00 2024-09-12T01:43:24.469 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.933+0000 7f6a7e7fc640 1 -- 172.21.15.70:0/251386029 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f6a6c000bf0 con 0x7f6a74038f00 2024-09-12T01:43:24.470 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.935+0000 7f6a8f524640 1 -- 172.21.15.70:0/251386029 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6a74038f00 msgr2=0x7f6a7403b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:24.470 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.935+0000 7f6a8f524640 1 --2- 172.21.15.70:0/251386029 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6a74038f00 0x7f6a7403b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a780098c0 tx=0x7f6a78006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:24.470 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.936+0000 7f6a8f524640 1 -- 172.21.15.70:0/251386029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 msgr2=0x7f6a8819d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:24.470 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.936+0000 7f6a8f524640 1 --2- 172.21.15.70:0/251386029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 0x7f6a8819d9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a840097f0 tx=0x7f6a84032670 comp rx=0 tx=0).stop 2024-09-12T01:43:24.470 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.936+0000 7f6a8f524640 1 -- 172.21.15.70:0/251386029 shutdown_connections 2024-09-12T01:43:24.470 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.936+0000 7f6a8f524640 1 --2- 172.21.15.70:0/251386029 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6a74038f00 0x7f6a7403b3c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:24.470 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.936+0000 7f6a8f524640 1 --2- 172.21.15.70:0/251386029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a88106070 0x7f6a8819d9e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:24.470 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.936+0000 7f6a8f524640 1 -- 172.21.15.70:0/251386029 >> 172.21.15.70:0/251386029 conn(0x7f6a88101ee0 msgr2=0x7f6a88191ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:24.470 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.936+0000 7f6a8f524640 1 -- 172.21.15.70:0/251386029 shutdown_connections 2024-09-12T01:43:24.470 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:23.936+0000 7f6a8f524640 1 -- 172.21.15.70:0/251386029 wait complete. 2024-09-12T01:43:24.471 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial admin user... 2024-09-12T01:43:25.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:25 smithi070 ceph-mon[31177]: from='client.14160 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:25.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:25 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:25.964 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$LxT5Dgliy6n.RlrZzczsNerDhj5Gi55uZm6oyBJMR88GryTiAdpNa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726105405, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T01:43:25.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.825+0000 7fe55f8e2640 1 Processor -- start 2024-09-12T01:43:25.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.825+0000 7fe55f8e2640 1 -- start start 2024-09-12T01:43:25.969 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.825+0000 7fe55f8e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 0x7fe55807b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.825+0000 7fe55f8e2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe55807b7b0 con 0x7fe55807cd80 2024-09-12T01:43:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.826+0000 7fe55d67e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 0x7fe55807b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.826+0000 7fe55d67e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 0x7fe55807b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48332/0 (socket says 172.21.15.70:48332) 2024-09-12T01:43:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.826+0000 7fe55d67e640 1 -- 172.21.15.70:0/2080730828 learned_addr learned my addr 172.21.15.70:0/2080730828 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.826+0000 7fe55d67e640 1 -- 172.21.15.70:0/2080730828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55807b930 con 0x7fe55807cd80 2024-09-12T01:43:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.826+0000 7fe55d67e640 1 --2- 172.21.15.70:0/2080730828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 0x7fe55807b1e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe548009e80 tx=0x7fe54802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f914889381d6c6c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.827+0000 7fe557fff640 1 -- 172.21.15.70:0/2080730828 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe548036070 con 0x7fe55807cd80 2024-09-12T01:43:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.827+0000 7fe557fff640 1 -- 172.21.15.70:0/2080730828 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe548031900 con 0x7fe55807cd80 2024-09-12T01:43:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.827+0000 7fe557fff640 1 -- 172.21.15.70:0/2080730828 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe548007ab0 con 0x7fe55807cd80 2024-09-12T01:43:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.827+0000 7fe55f8e2640 1 -- 172.21.15.70:0/2080730828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 msgr2=0x7fe55807b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.827+0000 7fe55f8e2640 1 --2- 172.21.15.70:0/2080730828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 0x7fe55807b1e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe548009e80 tx=0x7fe54802a7a0 comp rx=0 tx=0).stop 2024-09-12T01:43:25.970 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.827+0000 7fe55f8e2640 1 -- 172.21.15.70:0/2080730828 shutdown_connections 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.827+0000 7fe55f8e2640 1 --2- 172.21.15.70:0/2080730828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 0x7fe55807b1e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.827+0000 7fe55f8e2640 1 -- 172.21.15.70:0/2080730828 >> 172.21.15.70:0/2080730828 conn(0x7fe558102fd0 msgr2=0x7fe558105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.827+0000 7fe55f8e2640 1 -- 172.21.15.70:0/2080730828 shutdown_connections 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.827+0000 7fe55f8e2640 1 -- 172.21.15.70:0/2080730828 wait complete. 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.828+0000 7fe55f8e2640 1 Processor -- start 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.828+0000 7fe55f8e2640 1 -- start start 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.828+0000 7fe55f8e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 0x7fe55819da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.828+0000 7fe55f8e2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe55810df30 con 0x7fe55807cd80 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.828+0000 7fe55d67e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 0x7fe55819da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.828+0000 7fe55d67e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 0x7fe55819da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48342/0 (socket says 172.21.15.70:48342) 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.828+0000 7fe55d67e640 1 -- 172.21.15.70:0/3819221889 learned_addr learned my addr 172.21.15.70:0/3819221889 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.828+0000 7fe55d67e640 1 -- 172.21.15.70:0/3819221889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55819dfd0 con 0x7fe55807cd80 2024-09-12T01:43:25.971 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.829+0000 7fe55d67e640 1 --2- 172.21.15.70:0/3819221889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 0x7fe55819da90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe54802acc0 tx=0x7fe548007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.829+0000 7fe5567fc640 1 -- 172.21.15.70:0/3819221889 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe548036050 con 0x7fe55807cd80 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.829+0000 7fe5567fc640 1 -- 172.21.15.70:0/3819221889 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe548037040 con 0x7fe55807cd80 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.829+0000 7fe55f8e2640 1 -- 172.21.15.70:0/3819221889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55819e260 con 0x7fe55807cd80 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.829+0000 7fe5567fc640 1 -- 172.21.15.70:0/3819221889 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe54803b8d0 con 0x7fe55807cd80 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.829+0000 7fe55f8e2640 1 -- 172.21.15.70:0/3819221889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5581a0f50 con 0x7fe55807cd80 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.830+0000 7fe5567fc640 1 -- 172.21.15.70:0/3819221889 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fe548044020 con 0x7fe55807cd80 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.830+0000 7fe55f8e2640 1 -- 172.21.15.70:0/3819221889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55807b260 con 0x7fe55807cd80 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.830+0000 7fe5567fc640 1 --2- 172.21.15.70:0/3819221889 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fe540039020 0x7fe54003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.830+0000 7fe5567fc640 1 -- 172.21.15.70:0/3819221889 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe548042020 con 0x7fe55807cd80 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.830+0000 7fe55ce7d640 1 --2- 172.21.15.70:0/3819221889 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fe540039020 0x7fe54003b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.831+0000 7fe55ce7d640 1 --2- 172.21.15.70:0/3819221889 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fe540039020 0x7fe54003b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0098c0 tx=0x7fe54c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:24.835+0000 7fe5567fc640 1 -- 172.21.15.70:0/3819221889 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe54804b020 con 0x7fe55807cd80 2024-09-12T01:43:25.972 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:25.016+0000 7fe55f8e2640 1 -- 172.21.15.70:0/3819221889 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fe55819e740 con 0x7fe540039020 2024-09-12T01:43:25.973 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:25.242+0000 7fe5567fc640 1 -- 172.21.15.70:0/3819221889 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fe55819e740 con 0x7fe540039020 2024-09-12T01:43:25.973 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:25.244+0000 7fe55f8e2640 1 -- 172.21.15.70:0/3819221889 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fe540039020 msgr2=0x7fe54003b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:25.973 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:25.244+0000 7fe55f8e2640 1 --2- 172.21.15.70:0/3819221889 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fe540039020 0x7fe54003b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0098c0 tx=0x7fe54c006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:25.973 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:25.244+0000 7fe55f8e2640 1 -- 172.21.15.70:0/3819221889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 msgr2=0x7fe55819da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:25.973 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:25.244+0000 7fe55f8e2640 1 --2- 172.21.15.70:0/3819221889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 0x7fe55819da90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe54802acc0 tx=0x7fe548007410 comp rx=0 tx=0).stop 2024-09-12T01:43:25.973 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:25.244+0000 7fe55f8e2640 1 -- 172.21.15.70:0/3819221889 shutdown_connections 2024-09-12T01:43:25.973 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:25.244+0000 7fe55f8e2640 1 --2- 172.21.15.70:0/3819221889 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fe540039020 0x7fe54003b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:25.973 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:25.244+0000 7fe55f8e2640 1 --2- 172.21.15.70:0/3819221889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe55807cd80 0x7fe55819da90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:25.973 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:25.244+0000 7fe55f8e2640 1 -- 172.21.15.70:0/3819221889 >> 172.21.15.70:0/3819221889 conn(0x7fe558102fd0 msgr2=0x7fe558103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:25.973 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:25.244+0000 7fe55f8e2640 1 -- 172.21.15.70:0/3819221889 shutdown_connections 2024-09-12T01:43:25.973 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:25.244+0000 7fe55f8e2640 1 -- 172.21.15.70:0/3819221889 wait complete. 2024-09-12T01:43:25.973 INFO:teuthology.orchestra.run.smithi070.stdout:Fetching dashboard port number... 2024-09-12T01:43:26.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:26 smithi070 ceph-mon[31177]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:27.437 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T01:43:27.437 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.335+0000 7efe0105b640 1 Processor -- start 2024-09-12T01:43:27.437 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.335+0000 7efe0105b640 1 -- start start 2024-09-12T01:43:27.437 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.335+0000 7efe0105b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 0x7efdfc10a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:27.437 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.335+0000 7efe0105b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc075a90 con 0x7efdfc1082c0 2024-09-12T01:43:27.437 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.335+0000 7efdfad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 0x7efdfc10a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:27.437 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.335+0000 7efdfad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 0x7efdfc10a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48344/0 (socket says 172.21.15.70:48344) 2024-09-12T01:43:27.437 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.335+0000 7efdfad9d640 1 -- 172.21.15.70:0/1651679825 learned_addr learned my addr 172.21.15.70:0/1651679825 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:27.437 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.335+0000 7efdfad9d640 1 -- 172.21.15.70:0/1651679825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc10abf0 con 0x7efdfc1082c0 2024-09-12T01:43:27.437 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.336+0000 7efdfad9d640 1 --2- 172.21.15.70:0/1651679825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 0x7efdfc10a6b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efdec009820 tx=0x7efdec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c00d61586042f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:27.437 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.336+0000 7efdfa59c640 1 -- 172.21.15.70:0/1651679825 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdec037070 con 0x7efdfc1082c0 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.336+0000 7efdfa59c640 1 -- 172.21.15.70:0/1651679825 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efdec032940 con 0x7efdfc1082c0 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.336+0000 7efdfa59c640 1 -- 172.21.15.70:0/1651679825 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdec0308b0 con 0x7efdfc1082c0 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.337+0000 7efe0105b640 1 -- 172.21.15.70:0/1651679825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 msgr2=0x7efdfc10a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.337+0000 7efe0105b640 1 --2- 172.21.15.70:0/1651679825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 0x7efdfc10a6b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efdec009820 tx=0x7efdec02a270 comp rx=0 tx=0).stop 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.337+0000 7efe0105b640 1 -- 172.21.15.70:0/1651679825 shutdown_connections 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.337+0000 7efe0105b640 1 --2- 172.21.15.70:0/1651679825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 0x7efdfc10a6b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.337+0000 7efe0105b640 1 -- 172.21.15.70:0/1651679825 >> 172.21.15.70:0/1651679825 conn(0x7efdfc101f60 msgr2=0x7efdfc104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.337+0000 7efe0105b640 1 -- 172.21.15.70:0/1651679825 shutdown_connections 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.337+0000 7efe0105b640 1 -- 172.21.15.70:0/1651679825 wait complete. 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.338+0000 7efe0105b640 1 Processor -- start 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.338+0000 7efe0105b640 1 -- start start 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.338+0000 7efe0105b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 0x7efdfc19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:27.438 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.338+0000 7efe0105b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc10bcd0 con 0x7efdfc1082c0 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.338+0000 7efdfad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 0x7efdfc19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.338+0000 7efdfad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 0x7efdfc19b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48358/0 (socket says 172.21.15.70:48358) 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.338+0000 7efdfad9d640 1 -- 172.21.15.70:0/140327600 learned_addr learned my addr 172.21.15.70:0/140327600 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.339+0000 7efdfad9d640 1 -- 172.21.15.70:0/140327600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc19bd70 con 0x7efdfc1082c0 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.339+0000 7efdfad9d640 1 --2- 172.21.15.70:0/140327600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 0x7efdfc19b830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efdec032670 tx=0x7efdec0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.339+0000 7efdf8d99640 1 -- 172.21.15.70:0/140327600 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdec042070 con 0x7efdfc1082c0 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.339+0000 7efdf8d99640 1 -- 172.21.15.70:0/140327600 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efdec03d930 con 0x7efdfc1082c0 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.339+0000 7efdf8d99640 1 -- 172.21.15.70:0/140327600 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdec037040 con 0x7efdfc1082c0 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.339+0000 7efe0105b640 1 -- 172.21.15.70:0/140327600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc19c000 con 0x7efdfc1082c0 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.339+0000 7efe0105b640 1 -- 172.21.15.70:0/140327600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc19ecf0 con 0x7efdfc1082c0 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.340+0000 7efdf8d99640 1 -- 172.21.15.70:0/140327600 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7efdec045070 con 0x7efdfc1082c0 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.340+0000 7efdf8d99640 1 --2- 172.21.15.70:0/140327600 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7efde8039020 0x7efde803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.340+0000 7efdf8d99640 1 -- 172.21.15.70:0/140327600 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efdec03d430 con 0x7efdfc1082c0 2024-09-12T01:43:27.439 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.340+0000 7efdf3fff640 1 --2- 172.21.15.70:0/140327600 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7efde8039020 0x7efde803b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.340+0000 7efe0105b640 1 -- 172.21.15.70:0/140327600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdfc108720 con 0x7efdfc1082c0 2024-09-12T01:43:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.341+0000 7efdf3fff640 1 --2- 172.21.15.70:0/140327600 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7efde8039020 0x7efde803b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efde40098c0 tx=0x7efde4006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.345+0000 7efdf8d99640 1 -- 172.21.15.70:0/140327600 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efdec03d700 con 0x7efdfc1082c0 2024-09-12T01:43:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.516+0000 7efe0105b640 1 -- 172.21.15.70:0/140327600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7efdfc19f1d0 con 0x7efdfc1082c0 2024-09-12T01:43:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.517+0000 7efdf8d99640 1 -- 172.21.15.70:0/140327600 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7efdec045760 con 0x7efdfc1082c0 2024-09-12T01:43:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.519+0000 7efe0105b640 1 -- 172.21.15.70:0/140327600 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7efde8039020 msgr2=0x7efde803b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.519+0000 7efe0105b640 1 --2- 172.21.15.70:0/140327600 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7efde8039020 0x7efde803b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efde40098c0 tx=0x7efde4006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.519+0000 7efe0105b640 1 -- 172.21.15.70:0/140327600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 msgr2=0x7efdfc19b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.519+0000 7efe0105b640 1 --2- 172.21.15.70:0/140327600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 0x7efdfc19b830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efdec032670 tx=0x7efdec0326a0 comp rx=0 tx=0).stop 2024-09-12T01:43:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.519+0000 7efe0105b640 1 -- 172.21.15.70:0/140327600 shutdown_connections 2024-09-12T01:43:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.519+0000 7efe0105b640 1 --2- 172.21.15.70:0/140327600 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7efde8039020 0x7efde803b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:27.440 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.519+0000 7efe0105b640 1 --2- 172.21.15.70:0/140327600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc1082c0 0x7efdfc19b830 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:27.441 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.519+0000 7efe0105b640 1 -- 172.21.15.70:0/140327600 >> 172.21.15.70:0/140327600 conn(0x7efdfc101f60 msgr2=0x7efdfc102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:27.441 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.519+0000 7efe0105b640 1 -- 172.21.15.70:0/140327600 shutdown_connections 2024-09-12T01:43:27.441 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:26.519+0000 7efe0105b640 1 -- 172.21.15.70:0/140327600 wait complete. 2024-09-12T01:43:27.444 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:43:27.444 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-09-12T01:43:27.451 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:43:27.451 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-12T01:43:27.451 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-09-12T01:43:27.451 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T01:43:27.453 INFO:teuthology.orchestra.run.smithi070.stdout:Ceph Dashboard is now available at: 2024-09-12T01:43:27.453 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:43:27.453 INFO:teuthology.orchestra.run.smithi070.stdout: URL: https://smithi070.front.sepia.ceph.com:8443/ 2024-09-12T01:43:27.453 INFO:teuthology.orchestra.run.smithi070.stdout: User: admin 2024-09-12T01:43:27.453 INFO:teuthology.orchestra.run.smithi070.stdout: Password: gp8157y0po 2024-09-12T01:43:27.453 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:43:27.454 INFO:teuthology.orchestra.run.smithi070.stdout:Saving cluster configuration to /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config directory 2024-09-12T01:43:27.686 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:27 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/140327600' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T01:43:28.652 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:28 smithi070 ceph-mon[31177]: mgrmap e13: x(active, since 6s) 2024-09-12T01:43:28.653 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:28 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1552028497' entity='client.admin' 2024-09-12T01:43:28.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.844+0000 7fee84f3c640 1 Processor -- start 2024-09-12T01:43:28.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.844+0000 7fee84f3c640 1 -- start start 2024-09-12T01:43:28.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.844+0000 7fee84f3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 0x7fee8010a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:28.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.844+0000 7fee84f3c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fee80075a90 con 0x7fee80108280 2024-09-12T01:43:28.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.844+0000 7fee7e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 0x7fee8010a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:28.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.844+0000 7fee7e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 0x7fee8010a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48370/0 (socket says 172.21.15.70:48370) 2024-09-12T01:43:28.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.844+0000 7fee7e59c640 1 -- 172.21.15.70:0/4236135617 learned_addr learned my addr 172.21.15.70:0/4236135617 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:28.660 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.845+0000 7fee7e59c640 1 -- 172.21.15.70:0/4236135617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8010abb0 con 0x7fee80108280 2024-09-12T01:43:28.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.845+0000 7fee7e59c640 1 --2- 172.21.15.70:0/4236135617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 0x7fee8010a670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee70009820 tx=0x7fee7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42248344cdbb49be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:28.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.846+0000 7fee7dd9b640 1 -- 172.21.15.70:0/4236135617 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee70037070 con 0x7fee80108280 2024-09-12T01:43:28.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.846+0000 7fee7dd9b640 1 -- 172.21.15.70:0/4236135617 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee70032940 con 0x7fee80108280 2024-09-12T01:43:28.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.846+0000 7fee7dd9b640 1 -- 172.21.15.70:0/4236135617 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee700308b0 con 0x7fee80108280 2024-09-12T01:43:28.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.846+0000 7fee84f3c640 1 -- 172.21.15.70:0/4236135617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 msgr2=0x7fee8010a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:28.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.846+0000 7fee84f3c640 1 --2- 172.21.15.70:0/4236135617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 0x7fee8010a670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee70009820 tx=0x7fee7002a270 comp rx=0 tx=0).stop 2024-09-12T01:43:28.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.846+0000 7fee84f3c640 1 -- 172.21.15.70:0/4236135617 shutdown_connections 2024-09-12T01:43:28.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.846+0000 7fee84f3c640 1 --2- 172.21.15.70:0/4236135617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 0x7fee8010a670 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:28.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.846+0000 7fee84f3c640 1 -- 172.21.15.70:0/4236135617 >> 172.21.15.70:0/4236135617 conn(0x7fee80101ee0 msgr2=0x7fee80104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:28.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.846+0000 7fee84f3c640 1 -- 172.21.15.70:0/4236135617 shutdown_connections 2024-09-12T01:43:28.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.846+0000 7fee84f3c640 1 -- 172.21.15.70:0/4236135617 wait complete. 2024-09-12T01:43:28.661 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.847+0000 7fee84f3c640 1 Processor -- start 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.847+0000 7fee84f3c640 1 -- start start 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.847+0000 7fee84f3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 0x7fee8019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.847+0000 7fee84f3c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fee8010bc90 con 0x7fee80108280 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.847+0000 7fee7e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 0x7fee8019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.847+0000 7fee7e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 0x7fee8019b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48378/0 (socket says 172.21.15.70:48378) 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.847+0000 7fee7e59c640 1 -- 172.21.15.70:0/1552028497 learned_addr learned my addr 172.21.15.70:0/1552028497 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.848+0000 7fee7e59c640 1 -- 172.21.15.70:0/1552028497 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8019bd40 con 0x7fee80108280 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.848+0000 7fee7e59c640 1 --2- 172.21.15.70:0/1552028497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 0x7fee8019b800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee700097f0 tx=0x7fee70032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.848+0000 7fee777fe640 1 -- 172.21.15.70:0/1552028497 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee70042070 con 0x7fee80108280 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.848+0000 7fee777fe640 1 -- 172.21.15.70:0/1552028497 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee7003d930 con 0x7fee80108280 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.848+0000 7fee84f3c640 1 -- 172.21.15.70:0/1552028497 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8019bfd0 con 0x7fee80108280 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.848+0000 7fee777fe640 1 -- 172.21.15.70:0/1552028497 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee70037040 con 0x7fee80108280 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.848+0000 7fee84f3c640 1 -- 172.21.15.70:0/1552028497 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8019ecc0 con 0x7fee80108280 2024-09-12T01:43:28.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.849+0000 7fee777fe640 1 -- 172.21.15.70:0/1552028497 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fee70045070 con 0x7fee80108280 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.849+0000 7fee84f3c640 1 -- 172.21.15.70:0/1552028497 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee801086e0 con 0x7fee80108280 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.849+0000 7fee777fe640 1 --2- 172.21.15.70:0/1552028497 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fee6c039060 0x7fee6c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.849+0000 7fee777fe640 1 -- 172.21.15.70:0/1552028497 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fee7006c2d0 con 0x7fee80108280 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.849+0000 7fee77fff640 1 --2- 172.21.15.70:0/1552028497 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fee6c039060 0x7fee6c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.849+0000 7fee77fff640 1 --2- 172.21.15.70:0/1552028497 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fee6c039060 0x7fee6c03b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee680098c0 tx=0x7fee68006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:27.854+0000 7fee777fe640 1 -- 172.21.15.70:0/1552028497 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee700392e0 con 0x7fee80108280 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:28.106+0000 7fee84f3c640 1 -- 172.21.15.70:0/1552028497 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fee8019ee90 con 0x7fee80108280 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:28.108+0000 7fee777fe640 1 -- 172.21.15.70:0/1552028497 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fee70045520 con 0x7fee80108280 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:28.110+0000 7fee84f3c640 1 -- 172.21.15.70:0/1552028497 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fee6c039060 msgr2=0x7fee6c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:28.110+0000 7fee84f3c640 1 --2- 172.21.15.70:0/1552028497 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fee6c039060 0x7fee6c03b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee680098c0 tx=0x7fee68006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:28.110+0000 7fee84f3c640 1 -- 172.21.15.70:0/1552028497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 msgr2=0x7fee8019b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:28.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:28.110+0000 7fee84f3c640 1 --2- 172.21.15.70:0/1552028497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 0x7fee8019b800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee700097f0 tx=0x7fee70032670 comp rx=0 tx=0).stop 2024-09-12T01:43:28.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:28.110+0000 7fee84f3c640 1 -- 172.21.15.70:0/1552028497 shutdown_connections 2024-09-12T01:43:28.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:28.110+0000 7fee84f3c640 1 --2- 172.21.15.70:0/1552028497 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fee6c039060 0x7fee6c03b520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:28.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:28.110+0000 7fee84f3c640 1 --2- 172.21.15.70:0/1552028497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee80108280 0x7fee8019b800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:28.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:28.110+0000 7fee84f3c640 1 -- 172.21.15.70:0/1552028497 >> 172.21.15.70:0/1552028497 conn(0x7fee80101ee0 msgr2=0x7fee80102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:28.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:28.111+0000 7fee84f3c640 1 -- 172.21.15.70:0/1552028497 shutdown_connections 2024-09-12T01:43:28.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-12T01:43:28.111+0000 7fee84f3c640 1 -- 172.21.15.70:0/1552028497 wait complete. 2024-09-12T01:43:28.664 INFO:teuthology.orchestra.run.smithi070.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T01:43:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:43:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:43:28.664 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: ceph telemetry on 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout:For more information see: 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:43:28.665 INFO:teuthology.orchestra.run.smithi070.stdout:Bootstrap complete. 2024-09-12T01:43:28.698 INFO:tasks.cephadm:Fetching config... 2024-09-12T01:43:28.698 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:43:28.698 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T01:43:28.714 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T01:43:28.714 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:43:28.714 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T01:43:28.770 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T01:43:28.771 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:43:28.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T01:43:28.836 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T01:43:28.836 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:43:28.836 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T01:43:28.891 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T01:43:28.891 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTZRbJxuEAmvFRcp3i9EUk1wWfLYo+tdo0+pS3oJDrwmX1heFEG8B8PZurWffSZjycROmPrOEUoRGiGOOHJ+IJjCfle90Njl+zG0Wt0tzhmPi9OUTLW6IHfdUfitBbp5PwT2esVoPo82WnvIMZXtKp5WFYEcRUc6wfpvMOgBldi12ro0ecnNBGDrtIflRgo15se9CKBhk0szLejRannOTyVVdErQotKweAoqMEeQEdprj7geMoWKtxq2ym5Mb9ic/ewAWHfEhmgceBSn9CoBcgYODLWD1lRV/bHwPMMsprx9jCPwm38v+IlaUqXtqUfoHTyU0CTum2exhbcM2u+Z605M+elOHQAFAGVdUFWRfN7kmVrs0Cz22e53SVDpBdZKYLxicShy+8xYtGEySNPpEg5NZLPygaTAn9wyuHK966aCkImrBARJ4FzrhdrFLBgvprk/taMZUwcJqDBNLuLrELQAJhBn1HjwG7nBGaw+O8cyQPyxZFKSW89BYCdLIOr9s= ceph-2d8cad48-70a8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:43:28.965 INFO:teuthology.orchestra.run.smithi070.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTZRbJxuEAmvFRcp3i9EUk1wWfLYo+tdo0+pS3oJDrwmX1heFEG8B8PZurWffSZjycROmPrOEUoRGiGOOHJ+IJjCfle90Njl+zG0Wt0tzhmPi9OUTLW6IHfdUfitBbp5PwT2esVoPo82WnvIMZXtKp5WFYEcRUc6wfpvMOgBldi12ro0ecnNBGDrtIflRgo15se9CKBhk0szLejRannOTyVVdErQotKweAoqMEeQEdprj7geMoWKtxq2ym5Mb9ic/ewAWHfEhmgceBSn9CoBcgYODLWD1lRV/bHwPMMsprx9jCPwm38v+IlaUqXtqUfoHTyU0CTum2exhbcM2u+Z605M+elOHQAFAGVdUFWRfN7kmVrs0Cz22e53SVDpBdZKYLxicShy+8xYtGEySNPpEg5NZLPygaTAn9wyuHK966aCkImrBARJ4FzrhdrFLBgvprk/taMZUwcJqDBNLuLrELQAJhBn1HjwG7nBGaw+O8cyQPyxZFKSW89BYCdLIOr9s= ceph-2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:43:28.984 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTZRbJxuEAmvFRcp3i9EUk1wWfLYo+tdo0+pS3oJDrwmX1heFEG8B8PZurWffSZjycROmPrOEUoRGiGOOHJ+IJjCfle90Njl+zG0Wt0tzhmPi9OUTLW6IHfdUfitBbp5PwT2esVoPo82WnvIMZXtKp5WFYEcRUc6wfpvMOgBldi12ro0ecnNBGDrtIflRgo15se9CKBhk0szLejRannOTyVVdErQotKweAoqMEeQEdprj7geMoWKtxq2ym5Mb9ic/ewAWHfEhmgceBSn9CoBcgYODLWD1lRV/bHwPMMsprx9jCPwm38v+IlaUqXtqUfoHTyU0CTum2exhbcM2u+Z605M+elOHQAFAGVdUFWRfN7kmVrs0Cz22e53SVDpBdZKYLxicShy+8xYtGEySNPpEg5NZLPygaTAn9wyuHK966aCkImrBARJ4FzrhdrFLBgvprk/taMZUwcJqDBNLuLrELQAJhBn1HjwG7nBGaw+O8cyQPyxZFKSW89BYCdLIOr9s= ceph-2d8cad48-70a8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:43:29.025 INFO:teuthology.orchestra.run.smithi152.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTZRbJxuEAmvFRcp3i9EUk1wWfLYo+tdo0+pS3oJDrwmX1heFEG8B8PZurWffSZjycROmPrOEUoRGiGOOHJ+IJjCfle90Njl+zG0Wt0tzhmPi9OUTLW6IHfdUfitBbp5PwT2esVoPo82WnvIMZXtKp5WFYEcRUc6wfpvMOgBldi12ro0ecnNBGDrtIflRgo15se9CKBhk0szLejRannOTyVVdErQotKweAoqMEeQEdprj7geMoWKtxq2ym5Mb9ic/ewAWHfEhmgceBSn9CoBcgYODLWD1lRV/bHwPMMsprx9jCPwm38v+IlaUqXtqUfoHTyU0CTum2exhbcM2u+Z605M+elOHQAFAGVdUFWRfN7kmVrs0Cz22e53SVDpBdZKYLxicShy+8xYtGEySNPpEg5NZLPygaTAn9wyuHK966aCkImrBARJ4FzrhdrFLBgvprk/taMZUwcJqDBNLuLrELQAJhBn1HjwG7nBGaw+O8cyQPyxZFKSW89BYCdLIOr9s= ceph-2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:43:29.038 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTZRbJxuEAmvFRcp3i9EUk1wWfLYo+tdo0+pS3oJDrwmX1heFEG8B8PZurWffSZjycROmPrOEUoRGiGOOHJ+IJjCfle90Njl+zG0Wt0tzhmPi9OUTLW6IHfdUfitBbp5PwT2esVoPo82WnvIMZXtKp5WFYEcRUc6wfpvMOgBldi12ro0ecnNBGDrtIflRgo15se9CKBhk0szLejRannOTyVVdErQotKweAoqMEeQEdprj7geMoWKtxq2ym5Mb9ic/ewAWHfEhmgceBSn9CoBcgYODLWD1lRV/bHwPMMsprx9jCPwm38v+IlaUqXtqUfoHTyU0CTum2exhbcM2u+Z605M+elOHQAFAGVdUFWRfN7kmVrs0Cz22e53SVDpBdZKYLxicShy+8xYtGEySNPpEg5NZLPygaTAn9wyuHK966aCkImrBARJ4FzrhdrFLBgvprk/taMZUwcJqDBNLuLrELQAJhBn1HjwG7nBGaw+O8cyQPyxZFKSW89BYCdLIOr9s= ceph-2d8cad48-70a8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:43:29.079 INFO:teuthology.orchestra.run.smithi191.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTZRbJxuEAmvFRcp3i9EUk1wWfLYo+tdo0+pS3oJDrwmX1heFEG8B8PZurWffSZjycROmPrOEUoRGiGOOHJ+IJjCfle90Njl+zG0Wt0tzhmPi9OUTLW6IHfdUfitBbp5PwT2esVoPo82WnvIMZXtKp5WFYEcRUc6wfpvMOgBldi12ro0ecnNBGDrtIflRgo15se9CKBhk0szLejRannOTyVVdErQotKweAoqMEeQEdprj7geMoWKtxq2ym5Mb9ic/ewAWHfEhmgceBSn9CoBcgYODLWD1lRV/bHwPMMsprx9jCPwm38v+IlaUqXtqUfoHTyU0CTum2exhbcM2u+Z605M+elOHQAFAGVdUFWRfN7kmVrs0Cz22e53SVDpBdZKYLxicShy+8xYtGEySNPpEg5NZLPygaTAn9wyuHK966aCkImrBARJ4FzrhdrFLBgvprk/taMZUwcJqDBNLuLrELQAJhBn1HjwG7nBGaw+O8cyQPyxZFKSW89BYCdLIOr9s= ceph-2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:43:29.092 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T01:43:29.336 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:43:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.809+0000 7ff0e882d640 1 -- 172.21.15.70:0/969018024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e4100540 msgr2=0x7ff0e4100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.809+0000 7ff0e882d640 1 --2- 172.21.15.70:0/969018024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e4100540 0x7ff0e4100940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009880 tx=0x7ff0d402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.809+0000 7ff0e882d640 1 -- 172.21.15.70:0/969018024 shutdown_connections 2024-09-12T01:43:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.809+0000 7ff0e882d640 1 --2- 172.21.15.70:0/969018024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e4100540 0x7ff0e4100940 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.809+0000 7ff0e882d640 1 -- 172.21.15.70:0/969018024 >> 172.21.15.70:0/969018024 conn(0x7ff0e40fbcd0 msgr2=0x7ff0e40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.810+0000 7ff0e882d640 1 -- 172.21.15.70:0/969018024 shutdown_connections 2024-09-12T01:43:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.810+0000 7ff0e882d640 1 -- 172.21.15.70:0/969018024 wait complete. 2024-09-12T01:43:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.810+0000 7ff0e882d640 1 Processor -- start 2024-09-12T01:43:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.810+0000 7ff0e882d640 1 -- start start 2024-09-12T01:43:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.811+0000 7ff0e882d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e4100540 0x7ff0e406a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:29.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.811+0000 7ff0e882d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e4106740 con 0x7ff0e4100540 2024-09-12T01:43:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.811+0000 7ff0e259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e4100540 0x7ff0e406a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.811+0000 7ff0e259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e4100540 0x7ff0e406a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48400/0 (socket says 172.21.15.70:48400) 2024-09-12T01:43:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.811+0000 7ff0e259c640 1 -- 172.21.15.70:0/3119167745 learned_addr learned my addr 172.21.15.70:0/3119167745 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.811+0000 7ff0e259c640 1 -- 172.21.15.70:0/3119167745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e4199bc0 con 0x7ff0e4100540 2024-09-12T01:43:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.811+0000 7ff0e259c640 1 --2- 172.21.15.70:0/3119167745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e4100540 0x7ff0e406a130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009230 tx=0x7ff0d4032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.811+0000 7ff0db7fe640 1 -- 172.21.15.70:0/3119167745 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0d403f030 con 0x7ff0e4100540 2024-09-12T01:43:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.811+0000 7ff0db7fe640 1 -- 172.21.15.70:0/3119167745 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0d4003d00 con 0x7ff0e4100540 2024-09-12T01:43:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.811+0000 7ff0db7fe640 1 -- 172.21.15.70:0/3119167745 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0d4035070 con 0x7ff0e4100540 2024-09-12T01:43:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.811+0000 7ff0e882d640 1 -- 172.21.15.70:0/3119167745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e4199d90 con 0x7ff0e4100540 2024-09-12T01:43:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.811+0000 7ff0e882d640 1 -- 172.21.15.70:0/3119167745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e419a130 con 0x7ff0e4100540 2024-09-12T01:43:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.812+0000 7ff0db7fe640 1 -- 172.21.15.70:0/3119167745 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff0d4042030 con 0x7ff0e4100540 2024-09-12T01:43:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.812+0000 7ff0e882d640 1 -- 172.21.15.70:0/3119167745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e4106ec0 con 0x7ff0e4100540 2024-09-12T01:43:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.812+0000 7ff0db7fe640 1 --2- 172.21.15.70:0/3119167745 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff0d00390c0 0x7ff0d003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.812+0000 7ff0db7fe640 1 -- 172.21.15.70:0/3119167745 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff0d4040070 con 0x7ff0e4100540 2024-09-12T01:43:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.812+0000 7ff0dbfff640 1 --2- 172.21.15.70:0/3119167745 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff0d00390c0 0x7ff0d003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.813+0000 7ff0dbfff640 1 --2- 172.21.15.70:0/3119167745 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff0d00390c0 0x7ff0d003b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0098c0 tx=0x7ff0cc006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.817+0000 7ff0db7fe640 1 -- 172.21.15.70:0/3119167745 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0d404c350 con 0x7ff0e4100540 2024-09-12T01:43:29.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.985+0000 7ff0e882d640 1 -- 172.21.15.70:0/3119167745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7ff0e402d9c0 con 0x7ff0e4100540 2024-09-12T01:43:29.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.988+0000 7ff0db7fe640 1 -- 172.21.15.70:0/3119167745 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7ff0d403b640 con 0x7ff0e4100540 2024-09-12T01:43:29.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.991+0000 7ff0e882d640 1 -- 172.21.15.70:0/3119167745 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff0d00390c0 msgr2=0x7ff0d003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:29.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.991+0000 7ff0e882d640 1 --2- 172.21.15.70:0/3119167745 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff0d00390c0 0x7ff0d003b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0098c0 tx=0x7ff0cc006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.991+0000 7ff0e882d640 1 -- 172.21.15.70:0/3119167745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e4100540 msgr2=0x7ff0e406a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:29.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.991+0000 7ff0e882d640 1 --2- 172.21.15.70:0/3119167745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e4100540 0x7ff0e406a130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009230 tx=0x7ff0d4032d00 comp rx=0 tx=0).stop 2024-09-12T01:43:29.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.991+0000 7ff0e882d640 1 -- 172.21.15.70:0/3119167745 shutdown_connections 2024-09-12T01:43:29.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.991+0000 7ff0e882d640 1 --2- 172.21.15.70:0/3119167745 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff0d00390c0 0x7ff0d003b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.991+0000 7ff0e882d640 1 --2- 172.21.15.70:0/3119167745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0e4100540 0x7ff0e406a130 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.991+0000 7ff0e882d640 1 -- 172.21.15.70:0/3119167745 >> 172.21.15.70:0/3119167745 conn(0x7ff0e40fbcd0 msgr2=0x7ff0e40fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:29.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.991+0000 7ff0e882d640 1 -- 172.21.15.70:0/3119167745 shutdown_connections 2024-09-12T01:43:29.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:29.991+0000 7ff0e882d640 1 -- 172.21.15.70:0/3119167745 wait complete. 2024-09-12T01:43:30.551 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T01:43:30.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T01:43:31.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:30 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3119167745' entity='client.admin' 2024-09-12T01:43:31.341 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:43:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.777+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/3207047111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c94100540 msgr2=0x7f1c94100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.777+0000 7f1c9a9e7640 1 --2- 172.21.15.70:0/3207047111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c94100540 0x7f1c94100940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009c20 tx=0x7f1c8c02aa90 comp rx=0 tx=0).stop 2024-09-12T01:43:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.777+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/3207047111 shutdown_connections 2024-09-12T01:43:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.777+0000 7f1c9a9e7640 1 --2- 172.21.15.70:0/3207047111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c94100540 0x7f1c94100940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.777+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/3207047111 >> 172.21.15.70:0/3207047111 conn(0x7f1c940fbcd0 msgr2=0x7f1c940fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.777+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/3207047111 shutdown_connections 2024-09-12T01:43:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.777+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/3207047111 wait complete. 2024-09-12T01:43:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.778+0000 7f1c9a9e7640 1 Processor -- start 2024-09-12T01:43:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.778+0000 7f1c9a9e7640 1 -- start start 2024-09-12T01:43:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.778+0000 7f1c9a9e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c94100540 0x7f1c94196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.778+0000 7f1c9a9e7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1c94106740 con 0x7f1c94100540 2024-09-12T01:43:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.778+0000 7f1c93fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c94100540 0x7f1c94196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.778+0000 7f1c93fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c94100540 0x7f1c94196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40240/0 (socket says 172.21.15.70:40240) 2024-09-12T01:43:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.778+0000 7f1c93fff640 1 -- 172.21.15.70:0/1541267932 learned_addr learned my addr 172.21.15.70:0/1541267932 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:31.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.779+0000 7f1c93fff640 1 -- 172.21.15.70:0/1541267932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c941973d0 con 0x7f1c94100540 2024-09-12T01:43:31.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.779+0000 7f1c93fff640 1 --2- 172.21.15.70:0/1541267932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c94100540 0x7f1c94196e90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c005cc0 tx=0x7f1c8c02fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:31.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.779+0000 7f1c917fa640 1 -- 172.21.15.70:0/1541267932 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c8c047070 con 0x7f1c94100540 2024-09-12T01:43:31.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.779+0000 7f1c917fa640 1 -- 172.21.15.70:0/1541267932 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1c8c02e7d0 con 0x7f1c94100540 2024-09-12T01:43:31.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.779+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/1541267932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c94197660 con 0x7f1c94100540 2024-09-12T01:43:31.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.779+0000 7f1c917fa640 1 -- 172.21.15.70:0/1541267932 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c8c033050 con 0x7f1c94100540 2024-09-12T01:43:31.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.779+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/1541267932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9419a350 con 0x7f1c94100540 2024-09-12T01:43:31.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.780+0000 7f1c917fa640 1 -- 172.21.15.70:0/1541267932 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1c8c04a070 con 0x7f1c94100540 2024-09-12T01:43:31.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.780+0000 7f1c917fa640 1 --2- 172.21.15.70:0/1541267932 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1c7c0390c0 0x7f1c7c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:31.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.780+0000 7f1c917fa640 1 -- 172.21.15.70:0/1541267932 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1c8c03e030 con 0x7f1c94100540 2024-09-12T01:43:31.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.780+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/1541267932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c94197b40 con 0x7f1c94100540 2024-09-12T01:43:31.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.780+0000 7f1c937fe640 1 --2- 172.21.15.70:0/1541267932 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1c7c0390c0 0x7f1c7c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:31.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.781+0000 7f1c937fe640 1 --2- 172.21.15.70:0/1541267932 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1c7c0390c0 0x7f1c7c03b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1c880098c0 tx=0x7f1c88006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:31.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.785+0000 7f1c917fa640 1 -- 172.21.15.70:0/1541267932 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c94197b40 con 0x7f1c94100540 2024-09-12T01:43:31.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.969+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/1541267932 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f1c94062630 con 0x7f1c7c0390c0 2024-09-12T01:43:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.972+0000 7f1c917fa640 1 -- 172.21.15.70:0/1541267932 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1c94062630 con 0x7f1c7c0390c0 2024-09-12T01:43:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.974+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/1541267932 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1c7c0390c0 msgr2=0x7f1c7c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.974+0000 7f1c9a9e7640 1 --2- 172.21.15.70:0/1541267932 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1c7c0390c0 0x7f1c7c03b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1c880098c0 tx=0x7f1c88006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.975+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/1541267932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c94100540 msgr2=0x7f1c94196e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.975+0000 7f1c9a9e7640 1 --2- 172.21.15.70:0/1541267932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c94100540 0x7f1c94196e90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c005cc0 tx=0x7f1c8c02fbf0 comp rx=0 tx=0).stop 2024-09-12T01:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.975+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/1541267932 shutdown_connections 2024-09-12T01:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.975+0000 7f1c9a9e7640 1 --2- 172.21.15.70:0/1541267932 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1c7c0390c0 0x7f1c7c03b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.975+0000 7f1c9a9e7640 1 --2- 172.21.15.70:0/1541267932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c94100540 0x7f1c94196e90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.975+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/1541267932 >> 172.21.15.70:0/1541267932 conn(0x7f1c940fbcd0 msgr2=0x7f1c94069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.975+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/1541267932 shutdown_connections 2024-09-12T01:43:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:31.975+0000 7f1c9a9e7640 1 -- 172.21.15.70:0/1541267932 wait complete. 2024-09-12T01:43:32.692 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi152 2024-09-12T01:43:32.693 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-12T01:43:32.693 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.conf 2024-09-12T01:43:32.711 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-12T01:43:32.712 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:43:32.770 INFO:tasks.cephadm:Adding host smithi152 to orchestrator... 2024-09-12T01:43:32.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch host add smithi152 2024-09-12T01:43:33.102 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:43:33.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:32 smithi070 ceph-mon[31177]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:33.222 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:33.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.591+0000 7f8f6617d640 1 -- 172.21.15.70:0/1449527656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f60102c20 msgr2=0x7f8f60103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:33.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.591+0000 7f8f6617d640 1 --2- 172.21.15.70:0/1449527656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f60102c20 0x7f8f60103020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f50009880 tx=0x7f8f5002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:43:33.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.591+0000 7f8f6617d640 1 -- 172.21.15.70:0/1449527656 shutdown_connections 2024-09-12T01:43:33.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.591+0000 7f8f6617d640 1 --2- 172.21.15.70:0/1449527656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f60102c20 0x7f8f60103020 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:33.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.591+0000 7f8f6617d640 1 -- 172.21.15.70:0/1449527656 >> 172.21.15.70:0/1449527656 conn(0x7f8f600fb450 msgr2=0x7f8f600fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:33.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.591+0000 7f8f6617d640 1 -- 172.21.15.70:0/1449527656 shutdown_connections 2024-09-12T01:43:33.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.591+0000 7f8f6617d640 1 -- 172.21.15.70:0/1449527656 wait complete. 2024-09-12T01:43:33.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.592+0000 7f8f6617d640 1 Processor -- start 2024-09-12T01:43:33.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.592+0000 7f8f6617d640 1 -- start start 2024-09-12T01:43:33.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.592+0000 7f8f6617d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f60102c20 0x7f8f60196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:33.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.592+0000 7f8f6617d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f60107820 con 0x7f8f60102c20 2024-09-12T01:43:33.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.592+0000 7f8f5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f60102c20 0x7f8f60196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:33.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.592+0000 7f8f5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f60102c20 0x7f8f60196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40254/0 (socket says 172.21.15.70:40254) 2024-09-12T01:43:33.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.592+0000 7f8f5f7fe640 1 -- 172.21.15.70:0/4217693928 learned_addr learned my addr 172.21.15.70:0/4217693928 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:33.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.592+0000 7f8f5f7fe640 1 -- 172.21.15.70:0/4217693928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f601973d0 con 0x7f8f60102c20 2024-09-12T01:43:33.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.592+0000 7f8f5f7fe640 1 --2- 172.21.15.70:0/4217693928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f60102c20 0x7f8f60196e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f50009230 tx=0x7f8f50032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:33.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.593+0000 7f8f5d7fa640 1 -- 172.21.15.70:0/4217693928 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5003f030 con 0x7f8f60102c20 2024-09-12T01:43:33.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.593+0000 7f8f5d7fa640 1 -- 172.21.15.70:0/4217693928 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f50003e30 con 0x7f8f60102c20 2024-09-12T01:43:33.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.593+0000 7f8f6617d640 1 -- 172.21.15.70:0/4217693928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f60197660 con 0x7f8f60102c20 2024-09-12T01:43:33.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.593+0000 7f8f5d7fa640 1 -- 172.21.15.70:0/4217693928 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f50035070 con 0x7f8f60102c20 2024-09-12T01:43:33.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.593+0000 7f8f6617d640 1 -- 172.21.15.70:0/4217693928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f6019a350 con 0x7f8f60102c20 2024-09-12T01:43:33.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.593+0000 7f8f5d7fa640 1 -- 172.21.15.70:0/4217693928 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8f50042030 con 0x7f8f60102c20 2024-09-12T01:43:33.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.594+0000 7f8f5d7fa640 1 --2- 172.21.15.70:0/4217693928 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8f4c0390c0 0x7f8f4c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:33.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.594+0000 7f8f5d7fa640 1 -- 172.21.15.70:0/4217693928 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8f50040070 con 0x7f8f60102c20 2024-09-12T01:43:33.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.594+0000 7f8f6617d640 1 -- 172.21.15.70:0/4217693928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f60107fa0 con 0x7f8f60102c20 2024-09-12T01:43:33.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.594+0000 7f8f57fff640 1 --2- 172.21.15.70:0/4217693928 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8f4c0390c0 0x7f8f4c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:33.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.594+0000 7f8f57fff640 1 --2- 172.21.15.70:0/4217693928 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8f4c0390c0 0x7f8f4c03b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8f480098c0 tx=0x7f8f48006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:33.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.599+0000 7f8f5d7fa640 1 -- 172.21.15.70:0/4217693928 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f5002eca0 con 0x7f8f60102c20 2024-09-12T01:43:33.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:33.785+0000 7f8f6617d640 1 -- 172.21.15.70:0/4217693928 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}) -- 0x7f8f60062630 con 0x7f8f4c0390c0 2024-09-12T01:43:34.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:34.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:34.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:34.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:43:34.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:43:34.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-12T01:43:34.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: Updating smithi070:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:43:34.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:34.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:34.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:34.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:43:34.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:43:34.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:43:34.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:35.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:35 smithi070 ceph-mon[31177]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:43:35.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:35 smithi070 ceph-mon[31177]: Updating smithi070:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:43:35.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:35 smithi070 ceph-mon[31177]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:36.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:36 smithi070 ceph-mon[31177]: Deploying cephadm binary to smithi152 2024-09-12T01:43:37.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:37.117+0000 7f8f5d7fa640 1 -- 172.21.15.70:0/4217693928 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f8f60062630 con 0x7f8f4c0390c0 2024-09-12T01:43:37.117 INFO:teuthology.orchestra.run.smithi070.stdout:Added host 'smithi152' with addr '172.21.15.152' 2024-09-12T01:43:37.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:37.120+0000 7f8f6617d640 1 -- 172.21.15.70:0/4217693928 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8f4c0390c0 msgr2=0x7f8f4c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:37.120+0000 7f8f6617d640 1 --2- 172.21.15.70:0/4217693928 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8f4c0390c0 0x7f8f4c03b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8f480098c0 tx=0x7f8f48006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:37.120+0000 7f8f6617d640 1 -- 172.21.15.70:0/4217693928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f60102c20 msgr2=0x7f8f60196e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:37.120+0000 7f8f6617d640 1 --2- 172.21.15.70:0/4217693928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f60102c20 0x7f8f60196e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f50009230 tx=0x7f8f50032d00 comp rx=0 tx=0).stop 2024-09-12T01:43:37.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:37.120+0000 7f8f6617d640 1 -- 172.21.15.70:0/4217693928 shutdown_connections 2024-09-12T01:43:37.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:37.120+0000 7f8f6617d640 1 --2- 172.21.15.70:0/4217693928 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8f4c0390c0 0x7f8f4c03b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:37.120+0000 7f8f6617d640 1 --2- 172.21.15.70:0/4217693928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f60102c20 0x7f8f60196e90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:37.120+0000 7f8f6617d640 1 -- 172.21.15.70:0/4217693928 >> 172.21.15.70:0/4217693928 conn(0x7f8f600fb450 msgr2=0x7f8f600fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:37.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:37.120+0000 7f8f6617d640 1 -- 172.21.15.70:0/4217693928 shutdown_connections 2024-09-12T01:43:37.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:37.120+0000 7f8f6617d640 1 -- 172.21.15.70:0/4217693928 wait complete. 2024-09-12T01:43:37.717 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T01:43:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:43:38.335 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:38.335 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:38 smithi070 ceph-mon[31177]: Added host smithi152 2024-09-12T01:43:38.335 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:43:38.335 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:38.335 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:38.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.416+0000 7f23646b3640 1 -- 172.21.15.70:0/46945648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f235c106540 msgr2=0x7f235c106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.416+0000 7f23646b3640 1 --2- 172.21.15.70:0/46945648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f235c106540 0x7f235c106920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2358009810 tx=0x7f235802a540 comp rx=0 tx=0).stop 2024-09-12T01:43:38.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.416+0000 7f23646b3640 1 -- 172.21.15.70:0/46945648 shutdown_connections 2024-09-12T01:43:38.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.416+0000 7f23646b3640 1 --2- 172.21.15.70:0/46945648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f235c106540 0x7f235c106920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.416+0000 7f23646b3640 1 -- 172.21.15.70:0/46945648 >> 172.21.15.70:0/46945648 conn(0x7f235c077310 msgr2=0x7f235c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:38.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.416+0000 7f23646b3640 1 -- 172.21.15.70:0/46945648 shutdown_connections 2024-09-12T01:43:38.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.416+0000 7f23646b3640 1 -- 172.21.15.70:0/46945648 wait complete. 2024-09-12T01:43:38.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.417+0000 7f23646b3640 1 Processor -- start 2024-09-12T01:43:38.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.417+0000 7f23646b3640 1 -- start start 2024-09-12T01:43:38.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.417+0000 7f23646b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f235c106540 0x7f235c196100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.417+0000 7f23646b3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f235c10acb0 con 0x7f235c106540 2024-09-12T01:43:38.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.417+0000 7f236244f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f235c106540 0x7f235c196100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.418+0000 7f236244f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f235c106540 0x7f235c196100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40266/0 (socket says 172.21.15.70:40266) 2024-09-12T01:43:38.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.418+0000 7f236244f640 1 -- 172.21.15.70:0/4137430906 learned_addr learned my addr 172.21.15.70:0/4137430906 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.418+0000 7f236244f640 1 -- 172.21.15.70:0/4137430906 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235c196640 con 0x7f235c106540 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.418+0000 7f236244f640 1 --2- 172.21.15.70:0/4137430906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f235c106540 0x7f235c196100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f23580058e0 tx=0x7f23580045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.418+0000 7f23537fe640 1 -- 172.21.15.70:0/4137430906 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2358031400 con 0x7f235c106540 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.418+0000 7f23646b3640 1 -- 172.21.15.70:0/4137430906 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f235c1968d0 con 0x7f235c106540 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.418+0000 7f23537fe640 1 -- 172.21.15.70:0/4137430906 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f23580035f0 con 0x7f235c106540 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.418+0000 7f23537fe640 1 -- 172.21.15.70:0/4137430906 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f235803c480 con 0x7f235c106540 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.418+0000 7f23646b3640 1 -- 172.21.15.70:0/4137430906 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f235c19a9d0 con 0x7f235c106540 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.419+0000 7f23537fe640 1 -- 172.21.15.70:0/4137430906 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2358039040 con 0x7f235c106540 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.419+0000 7f23646b3640 1 -- 172.21.15.70:0/4137430906 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f235c101bb0 con 0x7f235c106540 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.419+0000 7f23537fe640 1 --2- 172.21.15.70:0/4137430906 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f23480390c0 0x7f234803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.419+0000 7f23537fe640 1 -- 172.21.15.70:0/4137430906 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f235806d4f0 con 0x7f235c106540 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.419+0000 7f2361c4e640 1 --2- 172.21.15.70:0/4137430906 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f23480390c0 0x7f234803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.420+0000 7f2361c4e640 1 --2- 172.21.15.70:0/4137430906 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f23480390c0 0x7f234803b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f234c0098c0 tx=0x7f234c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:38.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.424+0000 7f23537fe640 1 -- 172.21.15.70:0/4137430906 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2358040030 con 0x7f235c106540 2024-09-12T01:43:38.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.597+0000 7f23646b3640 1 -- 172.21.15.70:0/4137430906 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f235c197460 con 0x7f23480390c0 2024-09-12T01:43:38.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.598+0000 7f23537fe640 1 -- 172.21.15.70:0/4137430906 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f235c197460 con 0x7f23480390c0 2024-09-12T01:43:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:43:38.598 INFO:teuthology.orchestra.run.smithi070.stdout:[{"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}] 2024-09-12T01:43:38.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.600+0000 7f23646b3640 1 -- 172.21.15.70:0/4137430906 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f23480390c0 msgr2=0x7f234803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.600+0000 7f23646b3640 1 --2- 172.21.15.70:0/4137430906 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f23480390c0 0x7f234803b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f234c0098c0 tx=0x7f234c006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.600+0000 7f23646b3640 1 -- 172.21.15.70:0/4137430906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f235c106540 msgr2=0x7f235c196100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.600+0000 7f23646b3640 1 --2- 172.21.15.70:0/4137430906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f235c106540 0x7f235c196100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f23580058e0 tx=0x7f23580045e0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.600+0000 7f23646b3640 1 -- 172.21.15.70:0/4137430906 shutdown_connections 2024-09-12T01:43:38.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.600+0000 7f23646b3640 1 --2- 172.21.15.70:0/4137430906 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f23480390c0 0x7f234803b580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.600+0000 7f23646b3640 1 --2- 172.21.15.70:0/4137430906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f235c106540 0x7f235c196100 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.600+0000 7f23646b3640 1 -- 172.21.15.70:0/4137430906 >> 172.21.15.70:0/4137430906 conn(0x7f235c077310 msgr2=0x7f235c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:38.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.600+0000 7f23646b3640 1 -- 172.21.15.70:0/4137430906 shutdown_connections 2024-09-12T01:43:38.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:38.601+0000 7f23646b3640 1 -- 172.21.15.70:0/4137430906 wait complete. 2024-09-12T01:43:39.158 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi191 2024-09-12T01:43:39.159 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-12T01:43:39.159 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.conf 2024-09-12T01:43:39.178 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-12T01:43:39.178 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:43:39.237 INFO:tasks.cephadm:Adding host smithi191 to orchestrator... 2024-09-12T01:43:39.237 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch host add smithi191 2024-09-12T01:43:39.477 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:43:39.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:39 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:39.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.897+0000 7f791568c640 1 -- 172.21.15.70:0/1341971017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7910107660 msgr2=0x7f7910107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.897+0000 7f791568c640 1 --2- 172.21.15.70:0/1341971017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7910107660 0x7f7910107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7900009880 tx=0x7f790002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.897+0000 7f791568c640 1 -- 172.21.15.70:0/1341971017 shutdown_connections 2024-09-12T01:43:39.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.897+0000 7f791568c640 1 --2- 172.21.15.70:0/1341971017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7910107660 0x7f7910107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.897+0000 7f791568c640 1 -- 172.21.15.70:0/1341971017 >> 172.21.15.70:0/1341971017 conn(0x7f79100fd290 msgr2=0x7f79100ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:39.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.897+0000 7f791568c640 1 -- 172.21.15.70:0/1341971017 shutdown_connections 2024-09-12T01:43:39.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.897+0000 7f791568c640 1 -- 172.21.15.70:0/1341971017 wait complete. 2024-09-12T01:43:39.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.897+0000 7f791568c640 1 Processor -- start 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.898+0000 7f791568c640 1 -- start start 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.898+0000 7f791568c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7910107660 0x7f79100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.898+0000 7f791568c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f791010bdd0 con 0x7f7910107660 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.898+0000 7f790effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7910107660 0x7f79100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.898+0000 7f790effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7910107660 0x7f79100744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40286/0 (socket says 172.21.15.70:40286) 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.898+0000 7f790effd640 1 -- 172.21.15.70:0/1929846504 learned_addr learned my addr 172.21.15.70:0/1929846504 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.898+0000 7f790effd640 1 -- 172.21.15.70:0/1929846504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79100763e0 con 0x7f7910107660 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.898+0000 7f790effd640 1 --2- 172.21.15.70:0/1929846504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7910107660 0x7f79100744f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7900006010 tx=0x7f7900003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.898+0000 7f78f7fff640 1 -- 172.21.15.70:0/1929846504 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f790003f070 con 0x7f7910107660 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.899+0000 7f78f7fff640 1 -- 172.21.15.70:0/1929846504 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7900031c20 con 0x7f7910107660 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.899+0000 7f791568c640 1 -- 172.21.15.70:0/1929846504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7910074a30 con 0x7f7910107660 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.899+0000 7f78f7fff640 1 -- 172.21.15.70:0/1929846504 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7900035030 con 0x7f7910107660 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.899+0000 7f791568c640 1 -- 172.21.15.70:0/1929846504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7910074ef0 con 0x7f7910107660 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.899+0000 7f78f7fff640 1 -- 172.21.15.70:0/1929846504 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7900042070 con 0x7f7910107660 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.900+0000 7f791568c640 1 -- 172.21.15.70:0/1929846504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7910102cd0 con 0x7f7910107660 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.900+0000 7f78f7fff640 1 --2- 172.21.15.70:0/1929846504 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f78f8039060 0x7f78f803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.900+0000 7f78f7fff640 1 -- 172.21.15.70:0/1929846504 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f790006ccc0 con 0x7f7910107660 2024-09-12T01:43:39.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.900+0000 7f790e7fc640 1 --2- 172.21.15.70:0/1929846504 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f78f8039060 0x7f78f803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.900+0000 7f790e7fc640 1 --2- 172.21.15.70:0/1929846504 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f78f8039060 0x7f78f803b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f79040098c0 tx=0x7f7904006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:39.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:39.904+0000 7f78f7fff640 1 -- 172.21.15.70:0/1929846504 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f790004c350 con 0x7f7910107660 2024-09-12T01:43:40.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:40.077+0000 7f791568c640 1 -- 172.21.15.70:0/1929846504 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}) -- 0x7f7910075a90 con 0x7f78f8039060 2024-09-12T01:43:40.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:40 smithi070 ceph-mon[31177]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:43:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:41 smithi070 ceph-mon[31177]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:43:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:43:42.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:42 smithi070 ceph-mon[31177]: Deploying cephadm binary to smithi191 2024-09-12T01:43:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:42 smithi070 ceph-mon[31177]: Updating smithi152:/etc/ceph/ceph.conf 2024-09-12T01:43:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:42 smithi070 ceph-mon[31177]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:43:43.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:43.248+0000 7f78f7fff640 1 -- 172.21.15.70:0/1929846504 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f7910075a90 con 0x7f78f8039060 2024-09-12T01:43:43.249 INFO:teuthology.orchestra.run.smithi070.stdout:Added host 'smithi191' with addr '172.21.15.191' 2024-09-12T01:43:43.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:43.251+0000 7f791568c640 1 -- 172.21.15.70:0/1929846504 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f78f8039060 msgr2=0x7f78f803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:43.251+0000 7f791568c640 1 --2- 172.21.15.70:0/1929846504 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f78f8039060 0x7f78f803b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f79040098c0 tx=0x7f7904006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:43.251+0000 7f791568c640 1 -- 172.21.15.70:0/1929846504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7910107660 msgr2=0x7f79100744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:43.251+0000 7f791568c640 1 --2- 172.21.15.70:0/1929846504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7910107660 0x7f79100744f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7900006010 tx=0x7f7900003c00 comp rx=0 tx=0).stop 2024-09-12T01:43:43.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:43.251+0000 7f791568c640 1 -- 172.21.15.70:0/1929846504 shutdown_connections 2024-09-12T01:43:43.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:43.251+0000 7f791568c640 1 --2- 172.21.15.70:0/1929846504 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f78f8039060 0x7f78f803b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:43.251+0000 7f791568c640 1 --2- 172.21.15.70:0/1929846504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7910107660 0x7f79100744f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:43.251+0000 7f791568c640 1 -- 172.21.15.70:0/1929846504 >> 172.21.15.70:0/1929846504 conn(0x7f79100fd290 msgr2=0x7f79100feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:43.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:43.251+0000 7f791568c640 1 -- 172.21.15.70:0/1929846504 shutdown_connections 2024-09-12T01:43:43.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:43.251+0000 7f791568c640 1 -- 172.21.15.70:0/1929846504 wait complete. 2024-09-12T01:43:43.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:43 smithi070 ceph-mon[31177]: Updating smithi152:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:43:43.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:43 smithi070 ceph-mon[31177]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:43:43.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:43 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:43.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:43 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:43.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:43 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:43.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:43 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:43.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:43 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:43:43.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T01:43:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:43:44.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.487+0000 7fcbfc511640 1 -- 172.21.15.70:0/1360335336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf4102730 msgr2=0x7fcbf4102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.487+0000 7fcbfc511640 1 --2- 172.21.15.70:0/1360335336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf4102730 0x7fcbf4102b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009810 tx=0x7fcbec02a540 comp rx=0 tx=0).stop 2024-09-12T01:43:44.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.487+0000 7fcbfc511640 1 -- 172.21.15.70:0/1360335336 shutdown_connections 2024-09-12T01:43:44.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.487+0000 7fcbfc511640 1 --2- 172.21.15.70:0/1360335336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf4102730 0x7fcbf4102b10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.487+0000 7fcbfc511640 1 -- 172.21.15.70:0/1360335336 >> 172.21.15.70:0/1360335336 conn(0x7fcbf4077310 msgr2=0x7fcbf40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:44.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.487+0000 7fcbfc511640 1 -- 172.21.15.70:0/1360335336 shutdown_connections 2024-09-12T01:43:44.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.487+0000 7fcbfc511640 1 -- 172.21.15.70:0/1360335336 wait complete. 2024-09-12T01:43:44.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.488+0000 7fcbfc511640 1 Processor -- start 2024-09-12T01:43:44.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.488+0000 7fcbfc511640 1 -- start start 2024-09-12T01:43:44.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.488+0000 7fcbfc511640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf4102730 0x7fcbf41972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.488+0000 7fcbfc511640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf410bdd0 con 0x7fcbf4102730 2024-09-12T01:43:44.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.488+0000 7fcbfa2ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf4102730 0x7fcbf41972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.488+0000 7fcbfa2ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf4102730 0x7fcbf41972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54566/0 (socket says 172.21.15.70:54566) 2024-09-12T01:43:44.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.488+0000 7fcbfa2ad640 1 -- 172.21.15.70:0/157930624 learned_addr learned my addr 172.21.15.70:0/157930624 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.489+0000 7fcbfa2ad640 1 -- 172.21.15.70:0/157930624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf41977e0 con 0x7fcbf4102730 2024-09-12T01:43:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.489+0000 7fcbfa2ad640 1 --2- 172.21.15.70:0/157930624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf4102730 0x7fcbf41972a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0058e0 tx=0x7fcbec0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.489+0000 7fcbf37fe640 1 -- 172.21.15.70:0/157930624 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbec031400 con 0x7fcbf4102730 2024-09-12T01:43:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.489+0000 7fcbfc511640 1 -- 172.21.15.70:0/157930624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf4197a70 con 0x7fcbf4102730 2024-09-12T01:43:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.489+0000 7fcbf37fe640 1 -- 172.21.15.70:0/157930624 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbec0035f0 con 0x7fcbf4102730 2024-09-12T01:43:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.489+0000 7fcbf37fe640 1 -- 172.21.15.70:0/157930624 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbec03c480 con 0x7fcbf4102730 2024-09-12T01:43:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.489+0000 7fcbfc511640 1 -- 172.21.15.70:0/157930624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf4197ed0 con 0x7fcbf4102730 2024-09-12T01:43:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.490+0000 7fcbf37fe640 1 -- 172.21.15.70:0/157930624 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fcbec039040 con 0x7fcbf4102730 2024-09-12T01:43:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.490+0000 7fcbfc511640 1 -- 172.21.15.70:0/157930624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf4069f90 con 0x7fcbf4102730 2024-09-12T01:43:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.490+0000 7fcbf37fe640 1 --2- 172.21.15.70:0/157930624 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcbdc039060 0x7fcbdc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.490+0000 7fcbf37fe640 1 -- 172.21.15.70:0/157930624 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcbec06d4e0 con 0x7fcbf4102730 2024-09-12T01:43:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.490+0000 7fcbf9aac640 1 --2- 172.21.15.70:0/157930624 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcbdc039060 0x7fcbdc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.490+0000 7fcbf9aac640 1 --2- 172.21.15.70:0/157930624 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcbdc039060 0x7fcbdc03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800ad30 tx=0x7fcbe80093f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:44.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.495+0000 7fcbf37fe640 1 -- 172.21.15.70:0/157930624 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcbec040030 con 0x7fcbf4102730 2024-09-12T01:43:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.668+0000 7fcbfc511640 1 -- 172.21.15.70:0/157930624 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcbf4198600 con 0x7fcbdc039060 2024-09-12T01:43:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.669+0000 7fcbf37fe640 1 -- 172.21.15.70:0/157930624 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7fcbf4198600 con 0x7fcbdc039060 2024-09-12T01:43:44.669 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:43:44.669 INFO:teuthology.orchestra.run.smithi070.stdout:[{"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}, {"addr": "172.21.15.191", "hostname": "smithi191", "labels": [], "status": ""}] 2024-09-12T01:43:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.671+0000 7fcbfc511640 1 -- 172.21.15.70:0/157930624 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcbdc039060 msgr2=0x7fcbdc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.671+0000 7fcbfc511640 1 --2- 172.21.15.70:0/157930624 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcbdc039060 0x7fcbdc03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800ad30 tx=0x7fcbe80093f0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.671+0000 7fcbfc511640 1 -- 172.21.15.70:0/157930624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf4102730 msgr2=0x7fcbf41972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.671+0000 7fcbfc511640 1 --2- 172.21.15.70:0/157930624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf4102730 0x7fcbf41972a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0058e0 tx=0x7fcbec0045e0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.671+0000 7fcbfc511640 1 -- 172.21.15.70:0/157930624 shutdown_connections 2024-09-12T01:43:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.671+0000 7fcbfc511640 1 --2- 172.21.15.70:0/157930624 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcbdc039060 0x7fcbdc03b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.671+0000 7fcbfc511640 1 --2- 172.21.15.70:0/157930624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf4102730 0x7fcbf41972a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.671+0000 7fcbfc511640 1 -- 172.21.15.70:0/157930624 >> 172.21.15.70:0/157930624 conn(0x7fcbf4077310 msgr2=0x7fcbf41034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.671+0000 7fcbfc511640 1 -- 172.21.15.70:0/157930624 shutdown_connections 2024-09-12T01:43:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:44.671+0000 7fcbfc511640 1 -- 172.21.15.70:0/157930624 wait complete. 2024-09-12T01:43:44.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:44 smithi070 ceph-mon[31177]: Updating smithi152:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:43:44.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:44 smithi070 ceph-mon[31177]: Added host smithi191 2024-09-12T01:43:44.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:44 smithi070 ceph-mon[31177]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:43:44.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:44.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:45.254 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T01:43:45.254 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T01:43:45.491 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:43:45.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:45 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:45.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:45 smithi070 ceph-mon[31177]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:43:45.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:45 smithi070 ceph-mon[31177]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:43:45.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.945+0000 7f919ec0d640 1 -- 172.21.15.70:0/3127415993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91981027d0 msgr2=0x7f9198102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.945+0000 7f919ec0d640 1 --2- 172.21.15.70:0/3127415993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91981027d0 0x7f9198102bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9188009c10 tx=0x7f918802aa10 comp rx=0 tx=0).stop 2024-09-12T01:43:45.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.945+0000 7f919ec0d640 1 -- 172.21.15.70:0/3127415993 shutdown_connections 2024-09-12T01:43:45.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.945+0000 7f919ec0d640 1 --2- 172.21.15.70:0/3127415993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91981027d0 0x7f9198102bb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.945+0000 7f919ec0d640 1 -- 172.21.15.70:0/3127415993 >> 172.21.15.70:0/3127415993 conn(0x7f9198077310 msgr2=0x7f91980fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:45.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.945+0000 7f919ec0d640 1 -- 172.21.15.70:0/3127415993 shutdown_connections 2024-09-12T01:43:45.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.945+0000 7f919ec0d640 1 -- 172.21.15.70:0/3127415993 wait complete. 2024-09-12T01:43:45.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.945+0000 7f919ec0d640 1 Processor -- start 2024-09-12T01:43:45.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.945+0000 7f919ec0d640 1 -- start start 2024-09-12T01:43:45.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.945+0000 7f919ec0d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91981027d0 0x7f91981972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.945+0000 7f919ec0d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f919810bdd0 con 0x7f91981027d0 2024-09-12T01:43:45.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.946+0000 7f919c9a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91981027d0 0x7f91981972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.946+0000 7f919c9a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91981027d0 0x7f91981972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54576/0 (socket says 172.21.15.70:54576) 2024-09-12T01:43:45.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.946+0000 7f919c9a9640 1 -- 172.21.15.70:0/1063074948 learned_addr learned my addr 172.21.15.70:0/1063074948 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:43:45.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.946+0000 7f919c9a9640 1 -- 172.21.15.70:0/1063074948 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91981977e0 con 0x7f91981027d0 2024-09-12T01:43:45.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.946+0000 7f919c9a9640 1 --2- 172.21.15.70:0/1063074948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91981027d0 0x7f91981972a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9188005dd0 tx=0x7f9188003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:45.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.946+0000 7f9195ffb640 1 -- 172.21.15.70:0/1063074948 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9188034070 con 0x7f91981027d0 2024-09-12T01:43:45.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.946+0000 7f9195ffb640 1 -- 172.21.15.70:0/1063074948 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f918802f8e0 con 0x7f91981027d0 2024-09-12T01:43:45.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.946+0000 7f919ec0d640 1 -- 172.21.15.70:0/1063074948 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9198197a70 con 0x7f91981027d0 2024-09-12T01:43:45.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.946+0000 7f9195ffb640 1 -- 172.21.15.70:0/1063074948 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9188004520 con 0x7f91981027d0 2024-09-12T01:43:45.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.946+0000 7f919ec0d640 1 -- 172.21.15.70:0/1063074948 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9198197e70 con 0x7f91981027d0 2024-09-12T01:43:45.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.947+0000 7f9195ffb640 1 -- 172.21.15.70:0/1063074948 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f9188037020 con 0x7f91981027d0 2024-09-12T01:43:45.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.947+0000 7f919ec0d640 1 -- 172.21.15.70:0/1063074948 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9198069ef0 con 0x7f91981027d0 2024-09-12T01:43:45.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.948+0000 7f9195ffb640 1 --2- 172.21.15.70:0/1063074948 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9184039060 0x7f918403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.948+0000 7f9195ffb640 1 -- 172.21.15.70:0/1063074948 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f918806cfe0 con 0x7f91981027d0 2024-09-12T01:43:45.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.948+0000 7f9197fff640 1 --2- 172.21.15.70:0/1063074948 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9184039060 0x7f918403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.948+0000 7f9197fff640 1 --2- 172.21.15.70:0/1063074948 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9184039060 0x7f918403b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f91800098c0 tx=0x7f9180006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:45.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:45.952+0000 7f9195ffb640 1 -- 172.21.15.70:0/1063074948 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f918803f070 con 0x7f91981027d0 2024-09-12T01:43:46.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:46.122+0000 7f919ec0d640 1 -- 172.21.15.70:0/1063074948 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f919819bb70 con 0x7f91981027d0 2024-09-12T01:43:46.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:46.605+0000 7f9195ffb640 1 -- 172.21.15.70:0/1063074948 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f918802c040 con 0x7f91981027d0 2024-09-12T01:43:46.605 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-09-12T01:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:46.608+0000 7f919ec0d640 1 -- 172.21.15.70:0/1063074948 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9184039060 msgr2=0x7f918403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:46.608+0000 7f919ec0d640 1 --2- 172.21.15.70:0/1063074948 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9184039060 0x7f918403b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f91800098c0 tx=0x7f9180006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:46.608+0000 7f919ec0d640 1 -- 172.21.15.70:0/1063074948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91981027d0 msgr2=0x7f91981972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:46.608+0000 7f919ec0d640 1 --2- 172.21.15.70:0/1063074948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91981027d0 0x7f91981972a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9188005dd0 tx=0x7f9188003ba0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:46.608+0000 7f919ec0d640 1 -- 172.21.15.70:0/1063074948 shutdown_connections 2024-09-12T01:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:46.608+0000 7f919ec0d640 1 --2- 172.21.15.70:0/1063074948 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9184039060 0x7f918403b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:46.608+0000 7f919ec0d640 1 --2- 172.21.15.70:0/1063074948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91981027d0 0x7f91981972a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:46.608+0000 7f919ec0d640 1 -- 172.21.15.70:0/1063074948 >> 172.21.15.70:0/1063074948 conn(0x7f9198077310 msgr2=0x7f9198103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:46.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:46.608+0000 7f919ec0d640 1 -- 172.21.15.70:0/1063074948 shutdown_connections 2024-09-12T01:43:46.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:43:46.608+0000 7f919ec0d640 1 -- 172.21.15.70:0/1063074948 wait complete. 2024-09-12T01:43:46.907 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:46 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1063074948' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T01:43:47.219 INFO:tasks.cephadm:Adding mon.a on smithi070 2024-09-12T01:43:47.219 INFO:tasks.cephadm:Adding mon.b on smithi152 2024-09-12T01:43:47.219 INFO:tasks.cephadm:Adding mon.c on smithi191 2024-09-12T01:43:47.220 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi070:172.21.15.70=a;smithi152:172.21.15.152=b;smithi191:172.21.15.191=c' 2024-09-12T01:43:47.460 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:43:47.505 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:43:48.012 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.994+0000 7fac0acff640 1 -- 172.21.15.191:0/978872715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac04100540 msgr2=0x7fac04100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.012 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.994+0000 7fac0acff640 1 --2- 172.21.15.191:0/978872715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac04100540 0x7fac04100940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009880 tx=0x7fabf802a5d0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.994+0000 7fac0acff640 1 -- 172.21.15.191:0/978872715 shutdown_connections 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.994+0000 7fac0acff640 1 --2- 172.21.15.191:0/978872715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac04100540 0x7fac04100940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.994+0000 7fac0acff640 1 -- 172.21.15.191:0/978872715 >> 172.21.15.191:0/978872715 conn(0x7fac040fbcd0 msgr2=0x7fac040fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.994+0000 7fac0acff640 1 -- 172.21.15.191:0/978872715 shutdown_connections 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.994+0000 7fac0acff640 1 -- 172.21.15.191:0/978872715 wait complete. 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.995+0000 7fac0acff640 1 Processor -- start 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.995+0000 7fac0acff640 1 -- start start 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.995+0000 7fac0acff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac04100540 0x7fac0418d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.995+0000 7fac0acff640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fac04106740 con 0x7fac04100540 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.995+0000 7fac08a9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac04100540 0x7fac0418d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.995+0000 7fac08a9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac04100540 0x7fac0418d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.191:55690/0 (socket says 172.21.15.191:55690) 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.995+0000 7fac08a9b640 1 -- 172.21.15.191:0/1346531153 learned_addr learned my addr 172.21.15.191:0/1346531153 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-12T01:43:48.013 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.996+0000 7fac08a9b640 1 -- 172.21.15.191:0/1346531153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0418ddb0 con 0x7fac04100540 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.996+0000 7fac08a9b640 1 --2- 172.21.15.191:0/1346531153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac04100540 0x7fac0418d870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009230 tx=0x7fabf8032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.996+0000 7fac01ffb640 1 -- 172.21.15.191:0/1346531153 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabf803f030 con 0x7fac04100540 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.996+0000 7fac0acff640 1 -- 172.21.15.191:0/1346531153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0418bfa0 con 0x7fac04100540 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.996+0000 7fac01ffb640 1 -- 172.21.15.191:0/1346531153 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fabf8003e30 con 0x7fac04100540 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.996+0000 7fac01ffb640 1 -- 172.21.15.191:0/1346531153 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabf8035070 con 0x7fac04100540 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.996+0000 7fac0acff640 1 -- 172.21.15.191:0/1346531153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0418c4e0 con 0x7fac04100540 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.997+0000 7fac01ffb640 1 -- 172.21.15.191:0/1346531153 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fabf8042030 con 0x7fac04100540 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.997+0000 7fac0acff640 1 -- 172.21.15.191:0/1346531153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac04106ec0 con 0x7fac04100540 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.998+0000 7fac01ffb640 1 --2- 172.21.15.191:0/1346531153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fabf40390c0 0x7fabf403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.998+0000 7fac01ffb640 1 -- 172.21.15.191:0/1346531153 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fabf8040070 con 0x7fac04100540 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.998+0000 7fac03fff640 1 --2- 172.21.15.191:0/1346531153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fabf40390c0 0x7fabf403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:47.998+0000 7fac03fff640 1 --2- 172.21.15.191:0/1346531153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fabf40390c0 0x7fabf403b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fabf00098c0 tx=0x7fabf0006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:48.014 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.003+0000 7fac01ffb640 1 -- 172.21.15.191:0/1346531153 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fabf803a3c0 con 0x7fac04100540 2024-09-12T01:43:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:47 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1063074948' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T01:43:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:47 smithi070 ceph-mon[31177]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:43:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:47 smithi070 ceph-mon[31177]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:43:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:47 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:47 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:47 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:47 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:47 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:47 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:43:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:47 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:43:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:47 smithi070 ceph-mon[31177]: Updating smithi191:/etc/ceph/ceph.conf 2024-09-12T01:43:48.201 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.200+0000 7fac0acff640 1 -- 172.21.15.191:0/1346531153 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi152:172.21.15.152=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}) -- 0x7fac0418cae0 con 0x7fabf40390c0 2024-09-12T01:43:48.206 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.205+0000 7fac01ffb640 1 -- 172.21.15.191:0/1346531153 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fac0418cae0 con 0x7fabf40390c0 2024-09-12T01:43:48.206 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mon update... 2024-09-12T01:43:48.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.207+0000 7fac0acff640 1 -- 172.21.15.191:0/1346531153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fabf40390c0 msgr2=0x7fabf403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.207+0000 7fac0acff640 1 --2- 172.21.15.191:0/1346531153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fabf40390c0 0x7fabf403b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fabf00098c0 tx=0x7fabf0006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.207+0000 7fac0acff640 1 -- 172.21.15.191:0/1346531153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac04100540 msgr2=0x7fac0418d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.208 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.207+0000 7fac0acff640 1 --2- 172.21.15.191:0/1346531153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac04100540 0x7fac0418d870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009230 tx=0x7fabf8032d00 comp rx=0 tx=0).stop 2024-09-12T01:43:48.209 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.208+0000 7fac0acff640 1 -- 172.21.15.191:0/1346531153 shutdown_connections 2024-09-12T01:43:48.209 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.208+0000 7fac0acff640 1 --2- 172.21.15.191:0/1346531153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fabf40390c0 0x7fabf403b580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.209 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.208+0000 7fac0acff640 1 --2- 172.21.15.191:0/1346531153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac04100540 0x7fac0418d870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.209 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.208+0000 7fac0acff640 1 -- 172.21.15.191:0/1346531153 >> 172.21.15.191:0/1346531153 conn(0x7fac040fbcd0 msgr2=0x7fac040fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:48.209 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.208+0000 7fac0acff640 1 -- 172.21.15.191:0/1346531153 shutdown_connections 2024-09-12T01:43:48.209 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:48.208+0000 7fac0acff640 1 -- 172.21.15.191:0/1346531153 wait complete. 2024-09-12T01:43:48.794 DEBUG:teuthology.orchestra.run.smithi152:mon.b> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T01:43:48.797 DEBUG:teuthology.orchestra.run.smithi191:mon.c> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T01:43:48.800 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:43:48.800 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:43:49.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:49 smithi070 ceph-mon[31177]: Updating smithi191:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:43:49.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:49 smithi070 ceph-mon[31177]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:43:49.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:49 smithi070 ceph-mon[31177]: Updating smithi191:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:43:49.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:49 smithi070 ceph-mon[31177]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi152:172.21.15.152=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:49.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:49 smithi070 ceph-mon[31177]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi152:172.21.15.152=b;smithi191:172.21.15.191=c;count:3 2024-09-12T01:43:49.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:49.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:49.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:49.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:49.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:43:49.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:43:49.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:49 smithi070 ceph-mon[31177]: Deploying daemon mon.c on smithi191 2024-09-12T01:43:49.914 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:43:50.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:50 smithi070 ceph-mon[31177]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:43:50.932 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.930+0000 7f14c3455640 1 -- 172.21.15.191:0/3957671101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14bc106540 msgr2=0x7f14bc106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:50.932 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.930+0000 7f14c3455640 1 --2- 172.21.15.191:0/3957671101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14bc106540 0x7f14bc106920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009c10 tx=0x7f14ac02aa10 comp rx=0 tx=0).stop 2024-09-12T01:43:50.932 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.930+0000 7f14c3455640 1 -- 172.21.15.191:0/3957671101 shutdown_connections 2024-09-12T01:43:50.932 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.930+0000 7f14c3455640 1 --2- 172.21.15.191:0/3957671101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14bc106540 0x7f14bc106920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:50.932 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.930+0000 7f14c3455640 1 -- 172.21.15.191:0/3957671101 >> 172.21.15.191:0/3957671101 conn(0x7f14bc077310 msgr2=0x7f14bc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:50.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.930+0000 7f14c3455640 1 -- 172.21.15.191:0/3957671101 shutdown_connections 2024-09-12T01:43:50.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.930+0000 7f14c3455640 1 -- 172.21.15.191:0/3957671101 wait complete. 2024-09-12T01:43:50.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.931+0000 7f14c3455640 1 Processor -- start 2024-09-12T01:43:50.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.931+0000 7f14c3455640 1 -- start start 2024-09-12T01:43:50.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.931+0000 7f14c3455640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14bc106540 0x7f14bc196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:50.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.931+0000 7f14c3455640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc10acb0 con 0x7f14bc106540 2024-09-12T01:43:50.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.932+0000 7f14c11f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14bc106540 0x7f14bc196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:50.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.932+0000 7f14c11f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14bc106540 0x7f14bc196120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.191:55720/0 (socket says 172.21.15.191:55720) 2024-09-12T01:43:50.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.932+0000 7f14c11f1640 1 -- 172.21.15.191:0/314092944 learned_addr learned my addr 172.21.15.191:0/314092944 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-12T01:43:50.935 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.932+0000 7f14c11f1640 1 -- 172.21.15.191:0/314092944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14bc196660 con 0x7f14bc106540 2024-09-12T01:43:50.935 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.932+0000 7f14c11f1640 1 --2- 172.21.15.191:0/314092944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14bc106540 0x7f14bc196120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14ac005dd0 tx=0x7f14ac003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:50.935 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.932+0000 7f14ba7fc640 1 -- 172.21.15.191:0/314092944 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14ac034070 con 0x7f14bc106540 2024-09-12T01:43:50.935 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.932+0000 7f14c3455640 1 -- 172.21.15.191:0/314092944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14bc1968f0 con 0x7f14bc106540 2024-09-12T01:43:50.935 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.932+0000 7f14ba7fc640 1 -- 172.21.15.191:0/314092944 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f14ac02f8e0 con 0x7f14bc106540 2024-09-12T01:43:50.935 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.932+0000 7f14ba7fc640 1 -- 172.21.15.191:0/314092944 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14ac004520 con 0x7f14bc106540 2024-09-12T01:43:50.935 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.932+0000 7f14c3455640 1 -- 172.21.15.191:0/314092944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14bc196d70 con 0x7f14bc106540 2024-09-12T01:43:50.935 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.933+0000 7f14ba7fc640 1 -- 172.21.15.191:0/314092944 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f14ac037020 con 0x7f14bc106540 2024-09-12T01:43:50.936 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.933+0000 7f14c3455640 1 -- 172.21.15.191:0/314092944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14bc101bb0 con 0x7f14bc106540 2024-09-12T01:43:50.936 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.933+0000 7f14ba7fc640 1 --2- 172.21.15.191:0/314092944 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f14a4039060 0x7f14a403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:50.936 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.933+0000 7f14ba7fc640 1 -- 172.21.15.191:0/314092944 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f14ac06cfe0 con 0x7f14bc106540 2024-09-12T01:43:50.936 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.934+0000 7f14c09f0640 1 --2- 172.21.15.191:0/314092944 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f14a4039060 0x7f14a403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:50.936 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.934+0000 7f14c09f0640 1 --2- 172.21.15.191:0/314092944 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f14a4039060 0x7f14a403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f14b00098c0 tx=0x7f14b0006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:50.939 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:50.939+0000 7f14ba7fc640 1 -- 172.21.15.191:0/314092944 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14ac03f070 con 0x7f14bc106540 2024-09-12T01:43:51.174 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:51.173+0000 7f14c3455640 1 -- 172.21.15.191:0/314092944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f14bc19aa50 con 0x7f14bc106540 2024-09-12T01:43:51.175 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:51.173+0000 7f14ba7fc640 1 -- 172.21.15.191:0/314092944 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f14ac02c040 con 0x7f14bc106540 2024-09-12T01:43:51.175 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:43:51.175 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","modified":"2024-09-12T01:42:31.968853Z","created":"2024-09-12T01:42:31.968853Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:43:51.175 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-09-12T01:43:51.176 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:51.176+0000 7f14c3455640 1 -- 172.21.15.191:0/314092944 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f14a4039060 msgr2=0x7f14a403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:51.176 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:51.176+0000 7f14c3455640 1 --2- 172.21.15.191:0/314092944 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f14a4039060 0x7f14a403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f14b00098c0 tx=0x7f14b0006db0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.176 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:51.176+0000 7f14c3455640 1 -- 172.21.15.191:0/314092944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14bc106540 msgr2=0x7f14bc196120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:51.176 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:51.176+0000 7f14c3455640 1 --2- 172.21.15.191:0/314092944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14bc106540 0x7f14bc196120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f14ac005dd0 tx=0x7f14ac003ba0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.177 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:51.176+0000 7f14c3455640 1 -- 172.21.15.191:0/314092944 shutdown_connections 2024-09-12T01:43:51.177 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:51.176+0000 7f14c3455640 1 --2- 172.21.15.191:0/314092944 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f14a4039060 0x7f14a403b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.177 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:51.176+0000 7f14c3455640 1 --2- 172.21.15.191:0/314092944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14bc106540 0x7f14bc196120 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.177 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:51.176+0000 7f14c3455640 1 -- 172.21.15.191:0/314092944 >> 172.21.15.191:0/314092944 conn(0x7f14bc077310 msgr2=0x7f14bc0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:51.177 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:51.176+0000 7f14c3455640 1 -- 172.21.15.191:0/314092944 shutdown_connections 2024-09-12T01:43:51.177 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:51.176+0000 7f14c3455640 1 -- 172.21.15.191:0/314092944 wait complete. 2024-09-12T01:43:51.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:51 smithi070 ceph-mon[31177]: from='client.? 172.21.15.191:0/314092944' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:43:52.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:52 smithi070 ceph-mon[31177]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:43:53.170 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:43:53.171 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:43:53.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:52 smithi191 systemd[1]: Started Ceph mon.c for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:43:53.422 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:43:58.192 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.190+0000 7f80c8c95640 1 -- 172.21.15.191:0/1247299051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80b0003530 msgr2=0x7f80b00059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:58.192 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.190+0000 7f80c8c95640 1 --2- 172.21.15.191:0/1247299051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80b0003530 0x7f80b00059c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f80c41016a0 tx=0x7f80bc02bfe0 comp rx=0 tx=0).stop 2024-09-12T01:43:58.192 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.190+0000 7f80c8c95640 1 -- 172.21.15.191:0/1247299051 shutdown_connections 2024-09-12T01:43:58.192 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.190+0000 7f80c8c95640 1 --2- 172.21.15.191:0/1247299051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80b0003530 0x7f80b00059c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:58.192 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.190+0000 7f80c8c95640 1 -- 172.21.15.191:0/1247299051 >> 172.21.15.191:0/1247299051 conn(0x7f80c40fc220 msgr2=0x7f80c40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:58.192 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.191+0000 7f80c8c95640 1 -- 172.21.15.191:0/1247299051 shutdown_connections 2024-09-12T01:43:58.192 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.191+0000 7f80c8c95640 1 -- 172.21.15.191:0/1247299051 wait complete. 2024-09-12T01:43:58.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c8c95640 1 Processor -- start 2024-09-12T01:43:58.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c8c95640 1 -- start start 2024-09-12T01:43:58.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c8c95640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80b0003530 0x7f80c41972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c8c95640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80c4197800 0x7f80c419bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c8c95640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f80c41087c0 con 0x7f80b0003530 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c8c95640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4108640 con 0x7f80c4197800 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c1d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80c4197800 0x7f80c419bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c1d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80c4197800 0x7f80c419bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:34188/0 (socket says 172.21.15.191:34188) 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c1d9b640 1 -- 172.21.15.191:0/1208079588 learned_addr learned my addr 172.21.15.191:0/1208079588 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c259c640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80b0003530 0x7f80c41972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c1d9b640 1 -- 172.21.15.191:0/1208079588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80c4197800 msgr2=0x7f80c419bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c1d9b640 1 -- 172.21.15.191:0/1208079588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80c4197800 msgr2=0x7f80c419bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.192+0000 7f80c1d9b640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80c4197800 0x7f80c419bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.193+0000 7f80c1d9b640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80c4197800 0x7f80c419bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.193+0000 7f80c259c640 1 -- 172.21.15.191:0/1208079588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80c4197800 msgr2=0x7f80c419bb90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.193+0000 7f80c259c640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80c4197800 0x7f80c419bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:58.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.193+0000 7f80c259c640 1 -- 172.21.15.191:0/1208079588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c4197e20 con 0x7f80b0003530 2024-09-12T01:43:58.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.193+0000 7f80c259c640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80b0003530 0x7f80c41972c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f80bc002230 tx=0x7f80bc004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:58.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.193+0000 7f80bb7fe640 1 -- 172.21.15.191:0/1208079588 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f80bc0348b0 con 0x7f80b0003530 2024-09-12T01:43:58.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.193+0000 7f80bb7fe640 1 -- 172.21.15.191:0/1208079588 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80bc042070 con 0x7f80b0003530 2024-09-12T01:43:58.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.193+0000 7f80bb7fe640 1 -- 172.21.15.191:0/1208079588 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f80bc03d650 con 0x7f80b0003530 2024-09-12T01:43:58.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.193+0000 7f80c8c95640 1 -- 172.21.15.191:0/1208079588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c419c0d0 con 0x7f80b0003530 2024-09-12T01:43:58.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.193+0000 7f80c8c95640 1 -- 172.21.15.191:0/1208079588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c419c610 con 0x7f80b0003530 2024-09-12T01:43:58.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.194+0000 7f80bb7fe640 1 -- 172.21.15.191:0/1208079588 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f80bc03dad0 con 0x7f80b0003530 2024-09-12T01:43:58.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.195+0000 7f80c8c95640 1 -- 172.21.15.191:0/1208079588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c4101ca0 con 0x7f80b0003530 2024-09-12T01:43:58.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.195+0000 7f80bb7fe640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f80a4038e50 0x7f80a403b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:58.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.195+0000 7f80bb7fe640 1 -- 172.21.15.191:0/1208079588 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f80bc06e210 con 0x7f80b0003530 2024-09-12T01:43:58.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.195+0000 7f80c1d9b640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f80a4038e50 0x7f80a403b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:58.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.195+0000 7f80c1d9b640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f80a4038e50 0x7f80a403b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009100 tx=0x7f80ac008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:58.200 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.200+0000 7f80bb7fe640 1 -- 172.21.15.191:0/1208079588 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f80bc03bba0 con 0x7f80b0003530 2024-09-12T01:43:58.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:43:58.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:58.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: mon.a calling monitor election 2024-09-12T01:43:58.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:43:58.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:58.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:58.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: mon.c calling monitor election 2024-09-12T01:43:58.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:43:58.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:58.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:58.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:43:58.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:58.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:43:58.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: monmap epoch 2 2024-09-12T01:43:58.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:43:58.271 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: last_changed 2024-09-12T01:43:52.940529+0000 2024-09-12T01:43:58.271 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: created 2024-09-12T01:42:31.968853+0000 2024-09-12T01:43:58.271 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: min_mon_release 19 (squid) 2024-09-12T01:43:58.271 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: election_strategy: 1 2024-09-12T01:43:58.271 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:43:58.271 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-12T01:43:58.271 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: fsmap 2024-09-12T01:43:58.271 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:43:58.271 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: mgrmap e13: x(active, since 36s) 2024-09-12T01:43:58.271 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: overall HEALTH_OK 2024-09-12T01:43:58.271 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:58.271 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:58.272 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:58.272 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:43:58.272 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:43:58.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:43:58.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:58.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: mon.a calling monitor election 2024-09-12T01:43:58.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:43:58.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:58.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:58.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: mon.c calling monitor election 2024-09-12T01:43:58.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:43:58.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: monmap epoch 2 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: last_changed 2024-09-12T01:43:52.940529+0000 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: created 2024-09-12T01:42:31.968853+0000 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: min_mon_release 19 (squid) 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: election_strategy: 1 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: fsmap 2024-09-12T01:43:58.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:43:58.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: mgrmap e13: x(active, since 36s) 2024-09-12T01:43:58.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: overall HEALTH_OK 2024-09-12T01:43:58.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:58.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:58.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:43:58.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:43:58.440 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:43:58.440 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.437+0000 7f80c8c95640 1 -- 172.21.15.191:0/1208079588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f80c419c8c0 con 0x7f80b0003530 2024-09-12T01:43:58.441 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.438+0000 7f80bb7fe640 1 -- 172.21.15.191:0/1208079588 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f80bc039230 con 0x7f80b0003530 2024-09-12T01:43:58.441 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:43:58.441 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":2,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","modified":"2024-09-12T01:43:52.940529Z","created":"2024-09-12T01:42:31.968853Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:43:58.442 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 2 2024-09-12T01:43:58.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.441+0000 7f80c8c95640 1 -- 172.21.15.191:0/1208079588 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f80a4038e50 msgr2=0x7f80a403b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:58.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.441+0000 7f80c8c95640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f80a4038e50 0x7f80a403b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009100 tx=0x7f80ac008040 comp rx=0 tx=0).stop 2024-09-12T01:43:58.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.441+0000 7f80c8c95640 1 -- 172.21.15.191:0/1208079588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80b0003530 msgr2=0x7f80c41972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:58.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.441+0000 7f80c8c95640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80b0003530 0x7f80c41972c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f80bc002230 tx=0x7f80bc004c10 comp rx=0 tx=0).stop 2024-09-12T01:43:58.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.441+0000 7f80c8c95640 1 -- 172.21.15.191:0/1208079588 shutdown_connections 2024-09-12T01:43:58.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.441+0000 7f80c8c95640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f80a4038e50 0x7f80a403b310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:58.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.441+0000 7f80c8c95640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80c4197800 0x7f80c419bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:58.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.441+0000 7f80c8c95640 1 --2- 172.21.15.191:0/1208079588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80b0003530 0x7f80c41972c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:58.442 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.441+0000 7f80c8c95640 1 -- 172.21.15.191:0/1208079588 >> 172.21.15.191:0/1208079588 conn(0x7f80c40fc220 msgr2=0x7f80c406a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:58.443 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.441+0000 7f80c8c95640 1 -- 172.21.15.191:0/1208079588 shutdown_connections 2024-09-12T01:43:58.443 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:43:58.441+0000 7f80c8c95640 1 -- 172.21.15.191:0/1208079588 wait complete. 2024-09-12T01:43:59.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:59 smithi070 ceph-mon[31177]: Deploying daemon mon.b on smithi152 2024-09-12T01:43:59.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:59 smithi070 ceph-mon[31177]: from='client.? 172.21.15.191:0/1208079588' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:43:59.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:43:59 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:59.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:59 smithi191 ceph-mon[35770]: Deploying daemon mon.b on smithi152 2024-09-12T01:43:59.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:59 smithi191 ceph-mon[35770]: from='client.? 172.21.15.191:0/1208079588' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:43:59.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:43:59 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:43:59.976 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:43:59.976 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:44:00.231 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:44:00.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:00 smithi070 ceph-mon[31177]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:00.350 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:00 smithi191 ceph-mon[35770]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:00.634 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.633+0000 7f7ed17bf640 1 -- 172.21.15.191:0/3954176457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc106650 msgr2=0x7f7ecc106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.634 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.633+0000 7f7ed17bf640 1 --2- 172.21.15.191:0/3954176457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc106650 0x7f7ecc106a30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009880 tx=0x7f7ebc02a5d0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.634 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.633+0000 7f7ed17bf640 1 -- 172.21.15.191:0/3954176457 shutdown_connections 2024-09-12T01:44:00.634 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.633+0000 7f7ed17bf640 1 --2- 172.21.15.191:0/3954176457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc106650 0x7f7ecc106a30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.635 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.633+0000 7f7ed17bf640 1 -- 172.21.15.191:0/3954176457 >> 172.21.15.191:0/3954176457 conn(0x7f7ecc0fc280 msgr2=0x7f7ecc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:00.635 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.633+0000 7f7ed17bf640 1 -- 172.21.15.191:0/3954176457 shutdown_connections 2024-09-12T01:44:00.635 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.633+0000 7f7ed17bf640 1 -- 172.21.15.191:0/3954176457 wait complete. 2024-09-12T01:44:00.635 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.634+0000 7f7ed17bf640 1 Processor -- start 2024-09-12T01:44:00.636 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.634+0000 7f7ed17bf640 1 -- start start 2024-09-12T01:44:00.636 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.634+0000 7f7ed17bf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc106650 0x7f7ecc1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.634+0000 7f7ed17bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1979e0 0x7f7ecc19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.634+0000 7f7ed17bf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc10adc0 con 0x7f7ecc1979e0 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.634+0000 7f7ed17bf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc10ac40 con 0x7f7ecc106650 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.634+0000 7f7ecaffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc106650 0x7f7ecc1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.634+0000 7f7ecaffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc106650 0x7f7ecc1974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:34192/0 (socket says 172.21.15.191:34192) 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.634+0000 7f7ecaffd640 1 -- 172.21.15.191:0/1064811312 learned_addr learned my addr 172.21.15.191:0/1064811312 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ecaffd640 1 -- 172.21.15.191:0/1064811312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc106650 msgr2=0x7f7ecc1974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ecaffd640 1 -- 172.21.15.191:0/1064811312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc106650 msgr2=0x7f7ecc1974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ecaffd640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc106650 0x7f7ecc1974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ecaffd640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc106650 0x7f7ecc1974a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ec27fc640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1979e0 0x7f7ecc19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ec27fc640 1 -- 172.21.15.191:0/1064811312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc106650 msgr2=0x7f7ecc1974a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:44:00.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ec27fc640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc106650 0x7f7ecc1974a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ec27fc640 1 -- 172.21.15.191:0/1064811312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc198000 con 0x7f7ecc1979e0 2024-09-12T01:44:00.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ec27fc640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1979e0 0x7f7ecc19bd70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400b3d0 tx=0x7f7eb400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:00.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ec8ff9640 1 -- 172.21.15.191:0/1064811312 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7eb4011630 con 0x7f7ecc1979e0 2024-09-12T01:44:00.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ed17bf640 1 -- 172.21.15.191:0/1064811312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ecc19c2b0 con 0x7f7ecc1979e0 2024-09-12T01:44:00.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ec8ff9640 1 -- 172.21.15.191:0/1064811312 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7eb4011cd0 con 0x7f7ecc1979e0 2024-09-12T01:44:00.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ec8ff9640 1 -- 172.21.15.191:0/1064811312 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7eb400f2e0 con 0x7f7ecc1979e0 2024-09-12T01:44:00.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.635+0000 7f7ed17bf640 1 -- 172.21.15.191:0/1064811312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ecc19c870 con 0x7f7ecc1979e0 2024-09-12T01:44:00.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.636+0000 7f7ec8ff9640 1 -- 172.21.15.191:0/1064811312 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7eb4018020 con 0x7f7ecc1979e0 2024-09-12T01:44:00.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.636+0000 7f7ed17bf640 1 -- 172.21.15.191:0/1064811312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ecc19cb80 con 0x7f7ecc1979e0 2024-09-12T01:44:00.640 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.637+0000 7f7ec8ff9640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7eb8038e00 0x7f7eb803b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.640 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.637+0000 7f7ec8ff9640 1 -- 172.21.15.191:0/1064811312 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7eb404bd70 con 0x7f7ecc1979e0 2024-09-12T01:44:00.640 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.637+0000 7f7ecaffd640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7eb8038e00 0x7f7eb803b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.640 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.637+0000 7f7ecaffd640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7eb8038e00 0x7f7eb803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc031520 tx=0x7f7ebc02aaf0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:00.642 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.642+0000 7f7ec8ff9640 1 -- 172.21.15.191:0/1064811312 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7eb401f020 con 0x7f7ecc1979e0 2024-09-12T01:44:00.868 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.867+0000 7f7ed17bf640 1 -- 172.21.15.191:0/1064811312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7ecc198800 con 0x7f7ecc1979e0 2024-09-12T01:44:00.868 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.868+0000 7f7ec8ff9640 1 -- 172.21.15.191:0/1064811312 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f7eb40172c0 con 0x7f7ecc1979e0 2024-09-12T01:44:00.869 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:44:00.869 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":2,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","modified":"2024-09-12T01:43:52.940529Z","created":"2024-09-12T01:42:31.968853Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:44:00.869 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 2 2024-09-12T01:44:00.870 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.870+0000 7f7ed17bf640 1 -- 172.21.15.191:0/1064811312 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7eb8038e00 msgr2=0x7f7eb803b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.870 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.870+0000 7f7ed17bf640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7eb8038e00 0x7f7eb803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc031520 tx=0x7f7ebc02aaf0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.870 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.870+0000 7f7ed17bf640 1 -- 172.21.15.191:0/1064811312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1979e0 msgr2=0x7f7ecc19bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.871 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.870+0000 7f7ed17bf640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1979e0 0x7f7ecc19bd70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400b3d0 tx=0x7f7eb400b890 comp rx=0 tx=0).stop 2024-09-12T01:44:00.871 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.870+0000 7f7ed17bf640 1 -- 172.21.15.191:0/1064811312 shutdown_connections 2024-09-12T01:44:00.871 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.870+0000 7f7ed17bf640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7eb8038e00 0x7f7eb803b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.871 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.870+0000 7f7ed17bf640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ecc1979e0 0x7f7ecc19bd70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.871 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.870+0000 7f7ed17bf640 1 --2- 172.21.15.191:0/1064811312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ecc106650 0x7f7ecc1974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.871 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.870+0000 7f7ed17bf640 1 -- 172.21.15.191:0/1064811312 >> 172.21.15.191:0/1064811312 conn(0x7f7ecc0fc280 msgr2=0x7f7ecc0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:00.871 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.870+0000 7f7ed17bf640 1 -- 172.21.15.191:0/1064811312 shutdown_connections 2024-09-12T01:44:00.871 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:00.870+0000 7f7ed17bf640 1 -- 172.21.15.191:0/1064811312 wait complete. 2024-09-12T01:44:01.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:01 smithi191 ceph-mon[35770]: from='client.? 172.21.15.191:0/1064811312' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:44:01.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:01 smithi070 ceph-mon[31177]: from='client.? 172.21.15.191:0/1064811312' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:44:02.436 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T01:44:02.437 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:44:02.685 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:44:06.713 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.712+0000 7fb26d687640 1 -- 172.21.15.191:0/3386451415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb268102840 msgr2=0x7fb254005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:06.713 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.712+0000 7fb26d687640 1 --2- 172.21.15.191:0/3386451415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb268102840 0x7fb254005580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb258014d10 tx=0x7fb25802c570 comp rx=0 tx=0).stop 2024-09-12T01:44:06.713 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.712+0000 7fb26d687640 1 -- 172.21.15.191:0/3386451415 shutdown_connections 2024-09-12T01:44:06.713 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.712+0000 7fb26d687640 1 --2- 172.21.15.191:0/3386451415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb268102840 0x7fb254005580 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.714 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.712+0000 7fb26d687640 1 -- 172.21.15.191:0/3386451415 >> 172.21.15.191:0/3386451415 conn(0x7fb2680fc280 msgr2=0x7fb2680fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:06.714 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.712+0000 7fb26d687640 1 -- 172.21.15.191:0/3386451415 shutdown_connections 2024-09-12T01:44:06.714 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.712+0000 7fb26d687640 1 -- 172.21.15.191:0/3386451415 wait complete. 2024-09-12T01:44:06.714 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.712+0000 7fb26d687640 1 Processor -- start 2024-09-12T01:44:06.717 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb26d687640 1 -- start start 2024-09-12T01:44:06.717 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb26d687640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb268102840 0x7fb2681973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:06.717 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb26d687640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268197910 0x7fb26819bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:06.717 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb26d687640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb26819c1e0 0x7fb26819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:06.717 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb26d687640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb2681098f0 con 0x7fb268102840 2024-09-12T01:44:06.717 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb26d687640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb268109770 con 0x7fb268197910 2024-09-12T01:44:06.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb26d687640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb268109a70 con 0x7fb26819c1e0 2024-09-12T01:44:06.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb266ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb268102840 0x7fb2681973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:06.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb2677fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb26819c1e0 0x7fb26819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:06.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb266ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb268102840 0x7fb2681973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.191:46454/0 (socket says 172.21.15.191:46454) 2024-09-12T01:44:06.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb266ffd640 1 -- 172.21.15.191:0/1252290256 learned_addr learned my addr 172.21.15.191:0/1252290256 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-12T01:44:06.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb2677fe640 1 -- 172.21.15.191:0/1252290256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb26819c1e0 msgr2=0x7fb26819c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-12T01:44:06.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb2677fe640 1 -- 172.21.15.191:0/1252290256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb26819c1e0 msgr2=0x7fb26819c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:44:06.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb25e7fc640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268197910 0x7fb26819bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:06.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb2677fe640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb26819c1e0 0x7fb26819c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:44:06.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb2677fe640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb26819c1e0 0x7fb26819c690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:44:06.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb25e7fc640 1 -- 172.21.15.191:0/1252290256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268197910 msgr2=0x7fb26819bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T01:44:06.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb25e7fc640 1 -- 172.21.15.191:0/1252290256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268197910 msgr2=0x7fb26819bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:44:06.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.713+0000 7fb25e7fc640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268197910 0x7fb26819bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:44:06.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.714+0000 7fb25e7fc640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268197910 0x7fb26819bca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:44:06.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.714+0000 7fb266ffd640 1 -- 172.21.15.191:0/1252290256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb26819c1e0 msgr2=0x7fb26819c690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:44:06.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.714+0000 7fb266ffd640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb26819c1e0 0x7fb26819c690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.714+0000 7fb266ffd640 1 -- 172.21.15.191:0/1252290256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268197910 msgr2=0x7fb26819bca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:44:06.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.714+0000 7fb266ffd640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268197910 0x7fb26819bca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.714+0000 7fb266ffd640 1 -- 172.21.15.191:0/1252290256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2681a3f50 con 0x7fb268102840 2024-09-12T01:44:06.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.714+0000 7fb266ffd640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb268102840 0x7fb2681973d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb258035040 tx=0x7fb258004890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:06.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.714+0000 7fb264ff9640 1 -- 172.21.15.191:0/1252290256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258041070 con 0x7fb268102840 2024-09-12T01:44:06.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.714+0000 7fb264ff9640 1 -- 172.21.15.191:0/1252290256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb258004c90 con 0x7fb268102840 2024-09-12T01:44:06.720 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.714+0000 7fb26d687640 1 -- 172.21.15.191:0/1252290256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2681a4120 con 0x7fb268102840 2024-09-12T01:44:06.721 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.714+0000 7fb264ff9640 1 -- 172.21.15.191:0/1252290256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258012450 con 0x7fb268102840 2024-09-12T01:44:06.721 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.714+0000 7fb26d687640 1 -- 172.21.15.191:0/1252290256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2681a4630 con 0x7fb268102840 2024-09-12T01:44:06.721 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.715+0000 7fb264ff9640 1 -- 172.21.15.191:0/1252290256 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb2580125f0 con 0x7fb268102840 2024-09-12T01:44:06.721 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.716+0000 7fb264ff9640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb2480394f0 0x7fb24803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:06.721 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.716+0000 7fb26d687640 1 -- 172.21.15.191:0/1252290256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26810aa90 con 0x7fb268102840 2024-09-12T01:44:06.721 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.716+0000 7fb264ff9640 1 -- 172.21.15.191:0/1252290256 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb25806e550 con 0x7fb268102840 2024-09-12T01:44:06.721 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.716+0000 7fb25e7fc640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb2480394f0 0x7fb24803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:06.721 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.716+0000 7fb25e7fc640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb2480394f0 0x7fb24803b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb250006fd0 tx=0x7fb250008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:06.722 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.723+0000 7fb264ff9640 1 -- 172.21.15.191:0/1252290256 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb258043310 con 0x7fb268102840 2024-09-12T01:44:06.964 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.963+0000 7fb26d687640 1 -- 172.21.15.191:0/1252290256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb268198730 con 0x7fb268102840 2024-09-12T01:44:06.964 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.963+0000 7fb264ff9640 1 -- 172.21.15.191:0/1252290256 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7fb268198730 con 0x7fb268102840 2024-09-12T01:44:06.965 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:44:06.965 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":3,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","modified":"2024-09-12T01:44:01.699851Z","created":"2024-09-12T01:42:31.968853Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:44:06.965 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 3 2024-09-12T01:44:06.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:44:06.965 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: mon.a calling monitor election 2024-09-12T01:44:06.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: mon.c calling monitor election 2024-09-12T01:44:06.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:06.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:44:06.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:06.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:06.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:06.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:06.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:06.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:06.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:06.966 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: monmap epoch 3 2024-09-12T01:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: last_changed 2024-09-12T01:44:01.699851+0000 2024-09-12T01:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: created 2024-09-12T01:42:31.968853+0000 2024-09-12T01:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: min_mon_release 19 (squid) 2024-09-12T01:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: election_strategy: 1 2024-09-12T01:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-12T01:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: 2: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-12T01:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: fsmap 2024-09-12T01:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:44:06.967 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: mgrmap e13: x(active, since 45s) 2024-09-12T01:44:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: overall HEALTH_OK 2024-09-12T01:44:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:06.968 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:06.968 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.966+0000 7fb26d687640 1 -- 172.21.15.191:0/1252290256 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb2480394f0 msgr2=0x7fb24803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.966+0000 7fb26d687640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb2480394f0 0x7fb24803b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb250006fd0 tx=0x7fb250008040 comp rx=0 tx=0).stop 2024-09-12T01:44:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.966+0000 7fb26d687640 1 -- 172.21.15.191:0/1252290256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb268102840 msgr2=0x7fb2681973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.966+0000 7fb26d687640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb268102840 0x7fb2681973d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb258035040 tx=0x7fb258004890 comp rx=0 tx=0).stop 2024-09-12T01:44:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.966+0000 7fb26d687640 1 -- 172.21.15.191:0/1252290256 shutdown_connections 2024-09-12T01:44:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.966+0000 7fb26d687640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb2480394f0 0x7fb24803b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.966+0000 7fb26d687640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb26819c1e0 0x7fb26819c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.966+0000 7fb26d687640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb268197910 0x7fb26819bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.966+0000 7fb26d687640 1 --2- 172.21.15.191:0/1252290256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb268102840 0x7fb2681973d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.966+0000 7fb26d687640 1 -- 172.21.15.191:0/1252290256 >> 172.21.15.191:0/1252290256 conn(0x7fb2680fc280 msgr2=0x7fb2680fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.966+0000 7fb26d687640 1 -- 172.21.15.191:0/1252290256 shutdown_connections 2024-09-12T01:44:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:06.966+0000 7fb26d687640 1 -- 172.21.15.191:0/1252290256 wait complete. 2024-09-12T01:44:07.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:44:07.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: mon.a calling monitor election 2024-09-12T01:44:07.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: mon.c calling monitor election 2024-09-12T01:44:07.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:07.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:44:07.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:07.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:07.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:07.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:07.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:07.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:07.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:07.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T01:44:07.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: monmap epoch 3 2024-09-12T01:44:07.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:44:07.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: last_changed 2024-09-12T01:44:01.699851+0000 2024-09-12T01:44:07.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: created 2024-09-12T01:42:31.968853+0000 2024-09-12T01:44:07.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: min_mon_release 19 (squid) 2024-09-12T01:44:07.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: election_strategy: 1 2024-09-12T01:44:07.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:44:07.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-12T01:44:07.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: 2: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-12T01:44:07.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: fsmap 2024-09-12T01:44:07.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:44:07.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: mgrmap e13: x(active, since 45s) 2024-09-12T01:44:07.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: overall HEALTH_OK 2024-09-12T01:44:07.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:07.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:07.022 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:07.022 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:07.489 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T01:44:07.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T01:44:07.741 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:44:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:07 smithi070 ceph-mon[31177]: from='client.? 172.21.15.191:0/1252290256' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:44:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:07 smithi070 ceph-mon[31177]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:08.073 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:08.073 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:07 smithi191 ceph-mon[35770]: from='client.? 172.21.15.191:0/1252290256' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:44:08.073 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:07 smithi191 ceph-mon[35770]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:08.073 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:08.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.180+0000 7ff38f9b2640 1 -- 172.21.15.70:0/1789362248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff388106560 msgr2=0x7ff388106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:08.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.180+0000 7ff38f9b2640 1 --2- 172.21.15.70:0/1789362248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff388106560 0x7ff388106940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff384009880 tx=0x7ff38402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:44:08.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.180+0000 7ff38f9b2640 1 -- 172.21.15.70:0/1789362248 shutdown_connections 2024-09-12T01:44:08.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.180+0000 7ff38f9b2640 1 --2- 172.21.15.70:0/1789362248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff388106560 0x7ff388106940 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:08.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.180+0000 7ff38f9b2640 1 -- 172.21.15.70:0/1789362248 >> 172.21.15.70:0/1789362248 conn(0x7ff3880fc1b0 msgr2=0x7ff3880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:08.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.180+0000 7ff38f9b2640 1 -- 172.21.15.70:0/1789362248 shutdown_connections 2024-09-12T01:44:08.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.180+0000 7ff38f9b2640 1 -- 172.21.15.70:0/1789362248 wait complete. 2024-09-12T01:44:08.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.180+0000 7ff38f9b2640 1 Processor -- start 2024-09-12T01:44:08.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.180+0000 7ff38f9b2640 1 -- start start 2024-09-12T01:44:08.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38f9b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff388106560 0x7ff3881974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:08.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38f9b2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388197a10 0x7ff38819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:08.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38f9b2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff38819c2e0 0x7ff38819c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:08.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38f9b2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff38810ac80 con 0x7ff388106560 2024-09-12T01:44:08.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38f9b2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff38810ab00 con 0x7ff388197a10 2024-09-12T01:44:08.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38f9b2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff38810ae00 con 0x7ff38819c2e0 2024-09-12T01:44:08.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38d74e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff388106560 0x7ff3881974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:08.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38d74e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff388106560 0x7ff3881974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57264/0 (socket says 172.21.15.70:57264) 2024-09-12T01:44:08.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38d74e640 1 -- 172.21.15.70:0/2936932418 learned_addr learned my addr 172.21.15.70:0/2936932418 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:44:08.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38cf4d640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388197a10 0x7ff38819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:08.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38df4f640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff38819c2e0 0x7ff38819c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:08.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38cf4d640 1 -- 172.21.15.70:0/2936932418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388197a10 msgr2=0x7ff38819bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T01:44:08.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38cf4d640 1 -- 172.21.15.70:0/2936932418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388197a10 msgr2=0x7ff38819bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:44:08.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38cf4d640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388197a10 0x7ff38819bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:44:08.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38d74e640 1 -- 172.21.15.70:0/2936932418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff38819c2e0 msgr2=0x7ff38819c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:08.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38d74e640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff38819c2e0 0x7ff38819c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:08.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38cf4d640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388197a10 0x7ff38819bda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:44:08.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38d74e640 1 -- 172.21.15.70:0/2936932418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388197a10 msgr2=0x7ff38819bda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:44:08.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38d74e640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388197a10 0x7ff38819bda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38d74e640 1 -- 172.21.15.70:0/2936932418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3881a4050 con 0x7ff388106560 2024-09-12T01:44:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.181+0000 7ff38d74e640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff388106560 0x7ff3881974d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff384000c00 tx=0x7ff3840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.182+0000 7ff37e7fc640 1 -- 172.21.15.70:0/2936932418 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38403f030 con 0x7ff388106560 2024-09-12T01:44:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.182+0000 7ff37e7fc640 1 -- 172.21.15.70:0/2936932418 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff384003d00 con 0x7ff388106560 2024-09-12T01:44:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.182+0000 7ff38f9b2640 1 -- 172.21.15.70:0/2936932418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3881a4220 con 0x7ff388106560 2024-09-12T01:44:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.182+0000 7ff37e7fc640 1 -- 172.21.15.70:0/2936932418 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384035070 con 0x7ff388106560 2024-09-12T01:44:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.182+0000 7ff38f9b2640 1 -- 172.21.15.70:0/2936932418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3881a4720 con 0x7ff388106560 2024-09-12T01:44:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.182+0000 7ff37e7fc640 1 -- 172.21.15.70:0/2936932418 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff384042030 con 0x7ff388106560 2024-09-12T01:44:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.183+0000 7ff37e7fc640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff3740394f0 0x7ff37403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.183+0000 7ff38f9b2640 1 -- 172.21.15.70:0/2936932418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3881069c0 con 0x7ff388106560 2024-09-12T01:44:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.183+0000 7ff37e7fc640 1 -- 172.21.15.70:0/2936932418 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff38406caa0 con 0x7ff388106560 2024-09-12T01:44:08.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.183+0000 7ff38cf4d640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff3740394f0 0x7ff37403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:08.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.183+0000 7ff38cf4d640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff3740394f0 0x7ff37403b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff378006fd0 tx=0x7ff378008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:08.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.188+0000 7ff37e7fc640 1 -- 172.21.15.70:0/2936932418 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff38403bdc0 con 0x7ff388106560 2024-09-12T01:44:08.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.361+0000 7ff38f9b2640 1 -- 172.21.15.70:0/2936932418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7ff3881a49b0 con 0x7ff388106560 2024-09-12T01:44:08.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.361+0000 7ff37e7fc640 1 -- 172.21.15.70:0/2936932418 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7ff38404ad50 con 0x7ff388106560 2024-09-12T01:44:08.361 INFO:teuthology.orchestra.run.smithi070.stdout:# minimal ceph.conf for 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:44:08.361 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-09-12T01:44:08.361 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:44:08.361 INFO:teuthology.orchestra.run.smithi070.stdout: mon_host = [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] 2024-09-12T01:44:08.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.363+0000 7ff38f9b2640 1 -- 172.21.15.70:0/2936932418 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff3740394f0 msgr2=0x7ff37403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:08.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.363+0000 7ff38f9b2640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff3740394f0 0x7ff37403b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff378006fd0 tx=0x7ff378008040 comp rx=0 tx=0).stop 2024-09-12T01:44:08.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.363+0000 7ff38f9b2640 1 -- 172.21.15.70:0/2936932418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff388106560 msgr2=0x7ff3881974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:08.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.363+0000 7ff38f9b2640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff388106560 0x7ff3881974d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff384000c00 tx=0x7ff3840042f0 comp rx=0 tx=0).stop 2024-09-12T01:44:08.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.363+0000 7ff38f9b2640 1 -- 172.21.15.70:0/2936932418 shutdown_connections 2024-09-12T01:44:08.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.363+0000 7ff38f9b2640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff3740394f0 0x7ff37403b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:08.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.363+0000 7ff38f9b2640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff38819c2e0 0x7ff38819c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:08.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.363+0000 7ff38f9b2640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff388197a10 0x7ff38819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:08.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.363+0000 7ff38f9b2640 1 --2- 172.21.15.70:0/2936932418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff388106560 0x7ff3881974d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:08.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.363+0000 7ff38f9b2640 1 -- 172.21.15.70:0/2936932418 >> 172.21.15.70:0/2936932418 conn(0x7ff3880fc1b0 msgr2=0x7ff3880fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:08.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.363+0000 7ff38f9b2640 1 -- 172.21.15.70:0/2936932418 shutdown_connections 2024-09-12T01:44:08.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:08.363+0000 7ff38f9b2640 1 -- 172.21.15.70:0/2936932418 wait complete. 2024-09-12T01:44:09.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:09.070 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T01:44:09.071 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:44:09.071 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:44:09.097 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:44:09.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:44:09.164 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-12T01:44:09.164 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:44:09.192 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-12T01:44:09.192 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:44:09.257 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-12T01:44:09.257 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:44:09.283 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-12T01:44:09.283 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:44:09.348 INFO:tasks.cephadm:Adding mgr.x on smithi070 2024-09-12T01:44:09.349 INFO:tasks.cephadm:Adding mgr.y on smithi152 2024-09-12T01:44:09.349 INFO:tasks.cephadm:Adding mgr.z on smithi191 2024-09-12T01:44:09.349 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi070=x;smithi152=y;smithi191=z' 2024-09-12T01:44:09.416 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: mon.b calling monitor election 2024-09-12T01:44:09.416 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: mon.b calling monitor election 2024-09-12T01:44:09.416 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: mon.c calling monitor election 2024-09-12T01:44:09.416 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: mon.a calling monitor election 2024-09-12T01:44:09.416 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:44:09.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: monmap epoch 3 2024-09-12T01:44:09.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:44:09.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: last_changed 2024-09-12T01:44:01.699851+0000 2024-09-12T01:44:09.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: created 2024-09-12T01:42:31.968853+0000 2024-09-12T01:44:09.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: min_mon_release 19 (squid) 2024-09-12T01:44:09.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: election_strategy: 1 2024-09-12T01:44:09.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:44:09.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-12T01:44:09.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: 2: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-12T01:44:09.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: fsmap 2024-09-12T01:44:09.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:44:09.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: mgrmap e13: x(active, since 47s) 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: overall HEALTH_OK 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.418 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:44:09.419 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:44:09.419 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:09.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: mon.b calling monitor election 2024-09-12T01:44:09.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: mon.b calling monitor election 2024-09-12T01:44:09.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: mon.c calling monitor election 2024-09-12T01:44:09.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: mon.a calling monitor election 2024-09-12T01:44:09.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:44:09.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: monmap epoch 3 2024-09-12T01:44:09.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:44:09.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: last_changed 2024-09-12T01:44:01.699851+0000 2024-09-12T01:44:09.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: created 2024-09-12T01:42:31.968853+0000 2024-09-12T01:44:09.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: min_mon_release 19 (squid) 2024-09-12T01:44:09.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: election_strategy: 1 2024-09-12T01:44:09.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:44:09.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: 2: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: fsmap 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: mgrmap e13: x(active, since 47s) 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: overall HEALTH_OK 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.514 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.515 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.515 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.516 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:44:09.516 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:44:09.516 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:09.622 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:44:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: mon.b calling monitor election 2024-09-12T01:44:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: mon.b calling monitor election 2024-09-12T01:44:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: mon.c calling monitor election 2024-09-12T01:44:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: mon.a calling monitor election 2024-09-12T01:44:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T01:44:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: monmap epoch 3 2024-09-12T01:44:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:44:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: last_changed 2024-09-12T01:44:01.699851+0000 2024-09-12T01:44:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: created 2024-09-12T01:42:31.968853+0000 2024-09-12T01:44:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: min_mon_release 19 (squid) 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: election_strategy: 1 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: 2: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: fsmap 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: mgrmap e13: x(active, since 47s) 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: overall HEALTH_OK 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:09.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:44:09.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:44:09.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:09.985 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.985+0000 7f3649b3f640 1 -- 172.21.15.191:0/2608654436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36441005e0 msgr2=0x7f36441009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:09.985 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.985+0000 7f3649b3f640 1 --2- 172.21.15.191:0/2608654436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36441005e0 0x7f36441009e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3634009880 tx=0x7f363402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:44:09.986 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.985+0000 7f3649b3f640 1 -- 172.21.15.191:0/2608654436 shutdown_connections 2024-09-12T01:44:09.986 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.985+0000 7f3649b3f640 1 --2- 172.21.15.191:0/2608654436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36441005e0 0x7f36441009e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:09.986 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.985+0000 7f3649b3f640 1 -- 172.21.15.191:0/2608654436 >> 172.21.15.191:0/2608654436 conn(0x7f36440fbdb0 msgr2=0x7f36440fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:09.986 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.985+0000 7f3649b3f640 1 -- 172.21.15.191:0/2608654436 shutdown_connections 2024-09-12T01:44:09.986 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.985+0000 7f3649b3f640 1 -- 172.21.15.191:0/2608654436 wait complete. 2024-09-12T01:44:09.986 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.986+0000 7f3649b3f640 1 Processor -- start 2024-09-12T01:44:09.986 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.986+0000 7f3649b3f640 1 -- start start 2024-09-12T01:44:09.988 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.986+0000 7f3649b3f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36441005e0 0x7f36441970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:09.988 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.986+0000 7f3649b3f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36441975e0 0x7f364419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:09.988 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.986+0000 7f3649b3f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3644197a60 0x7f364419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.986+0000 7f3649b3f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3644106800 con 0x7f36441975e0 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.986+0000 7f3649b3f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3644106680 con 0x7f3644197a60 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.986+0000 7f3649b3f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3644106980 con 0x7f36441005e0 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.986+0000 7f36437fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36441005e0 0x7f36441970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.986+0000 7f36437fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36441005e0 0x7f36441970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:43438/0 (socket says 172.21.15.191:43438) 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.986+0000 7f36437fe640 1 -- 172.21.15.191:0/114309403 learned_addr learned my addr 172.21.15.191:0/114309403 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f363affd640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36441975e0 0x7f364419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f3643fff640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3644197a60 0x7f364419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f36437fe640 1 -- 172.21.15.191:0/114309403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3644197a60 msgr2=0x7f364419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f36437fe640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3644197a60 0x7f364419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f36437fe640 1 -- 172.21.15.191:0/114309403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36441975e0 msgr2=0x7f364419c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f36437fe640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36441975e0 0x7f364419c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:09.989 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f36437fe640 1 -- 172.21.15.191:0/114309403 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364419f4a0 con 0x7f36441005e0 2024-09-12T01:44:09.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f36437fe640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36441005e0 0x7f36441970a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3634005ab0 tx=0x7f3634004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:09.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f36417fa640 1 -- 172.21.15.191:0/114309403 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363403f030 con 0x7f36441005e0 2024-09-12T01:44:09.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f36417fa640 1 -- 172.21.15.191:0/114309403 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3634003dc0 con 0x7f36441005e0 2024-09-12T01:44:09.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f3649b3f640 1 -- 172.21.15.191:0/114309403 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364419f730 con 0x7f36441005e0 2024-09-12T01:44:09.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f36417fa640 1 -- 172.21.15.191:0/114309403 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634035070 con 0x7f36441005e0 2024-09-12T01:44:09.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.987+0000 7f3649b3f640 1 -- 172.21.15.191:0/114309403 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f364419fc90 con 0x7f36441005e0 2024-09-12T01:44:09.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.988+0000 7f36417fa640 1 -- 172.21.15.191:0/114309403 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3634042030 con 0x7f36441005e0 2024-09-12T01:44:09.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.988+0000 7f36417fa640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f36300394f0 0x7f363003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:09.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.988+0000 7f36417fa640 1 -- 172.21.15.191:0/114309403 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f363406df20 con 0x7f36441005e0 2024-09-12T01:44:09.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.988+0000 7f3649b3f640 1 -- 172.21.15.191:0/114309403 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3644100a60 con 0x7f36441005e0 2024-09-12T01:44:09.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.988+0000 7f363affd640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f36300394f0 0x7f363003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:09.990 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.989+0000 7f363affd640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f36300394f0 0x7f363003b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f36441985c0 tx=0x7f362c009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:09.993 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:09.994+0000 7f36417fa640 1 -- 172.21.15.191:0/114309403 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f363404c350 con 0x7f36441005e0 2024-09-12T01:44:10.181 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.181+0000 7f3649b3f640 1 -- 172.21.15.191:0/114309403 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi152=y;smithi191=z", "target": ["mon-mgr", ""]}) -- 0x7f36440626c0 con 0x7f36300394f0 2024-09-12T01:44:10.187 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.187+0000 7f36417fa640 1 -- 172.21.15.191:0/114309403 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f36440626c0 con 0x7f36300394f0 2024-09-12T01:44:10.187 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mgr update... 2024-09-12T01:44:10.189 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.189+0000 7f3649b3f640 1 -- 172.21.15.191:0/114309403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f36300394f0 msgr2=0x7f363003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:10.189 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.189+0000 7f3649b3f640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f36300394f0 0x7f363003b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f36441985c0 tx=0x7f362c009190 comp rx=0 tx=0).stop 2024-09-12T01:44:10.189 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.189+0000 7f3649b3f640 1 -- 172.21.15.191:0/114309403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36441005e0 msgr2=0x7f36441970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:10.189 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.189+0000 7f3649b3f640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36441005e0 0x7f36441970a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3634005ab0 tx=0x7f3634004430 comp rx=0 tx=0).stop 2024-09-12T01:44:10.189 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.189+0000 7f3649b3f640 1 -- 172.21.15.191:0/114309403 shutdown_connections 2024-09-12T01:44:10.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.189+0000 7f3649b3f640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f36300394f0 0x7f363003b9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:10.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.189+0000 7f3649b3f640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3644197a60 0x7f364419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:10.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.189+0000 7f3649b3f640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36441975e0 0x7f364419c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:10.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.189+0000 7f3649b3f640 1 --2- 172.21.15.191:0/114309403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36441005e0 0x7f36441970a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:10.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.189+0000 7f3649b3f640 1 -- 172.21.15.191:0/114309403 >> 172.21.15.191:0/114309403 conn(0x7f36440fbdb0 msgr2=0x7f364406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:10.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.189+0000 7f3649b3f640 1 -- 172.21.15.191:0/114309403 shutdown_connections 2024-09-12T01:44:10.190 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:44:10.189+0000 7f3649b3f640 1 -- 172.21.15.191:0/114309403 wait complete. 2024-09-12T01:44:10.572 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: Updating smithi070:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:10.572 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: Updating smithi191:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:10.572 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: Updating smithi152:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:10.572 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:44:10.572 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: Reconfiguring daemon mon.a on smithi070 2024-09-12T01:44:10.572 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:10.572 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:10.573 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:10.573 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:10.573 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:10.573 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:10.573 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:44:10.573 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:10 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:10.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: Updating smithi070:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: Updating smithi191:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: Updating smithi152:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:44:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: Reconfiguring daemon mon.a on smithi070 2024-09-12T01:44:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:44:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:10 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:10.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: Updating smithi070:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:10.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: Updating smithi191:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: Updating smithi152:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T01:44:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: Reconfiguring daemon mon.a on smithi070 2024-09-12T01:44:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:44:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:44:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:10 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:10.810 DEBUG:teuthology.orchestra.run.smithi152:mgr.y> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T01:44:10.812 DEBUG:teuthology.orchestra.run.smithi191:mgr.z> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T01:44:10.815 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T01:44:10.815 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:44:10.815 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:44:10.831 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:44:10.831 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-09-12T01:44:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:44:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:44:10.887 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T01:44:10.887 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:44:10.887 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:44:10.887 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-12 01:43:31.703601704 +0000 2024-09-12T01:44:10.887 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-12 01:39:26.861469308 +0000 2024-09-12T01:44:10.887 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-12 01:39:26.861469308 +0000 2024-09-12T01:44:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-12 01:39:26.861469308 +0000 2024-09-12T01:44:10.887 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:44:10.951 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-12T01:44:10.952 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-12T01:44:10.952 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.00018813 s, 2.7 MB/s 2024-09-12T01:44:10.953 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:44:11.009 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-09-12T01:44:11.064 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:44:11.064 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:44:11.064 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T01:44:11.064 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:44:11.064 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:44:11.064 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-12 01:43:31.735601278 +0000 2024-09-12T01:44:11.064 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-12 01:39:27.188465279 +0000 2024-09-12T01:44:11.065 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-12 01:39:27.188465279 +0000 2024-09-12T01:44:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-12 01:39:27.188465279 +0000 2024-09-12T01:44:11.065 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:44:11.127 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-12T01:44:11.127 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-12T01:44:11.127 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000105192 s, 4.9 MB/s 2024-09-12T01:44:11.128 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:44:11.185 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-09-12T01:44:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:44:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:44:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T01:44:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:44:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:44:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-12 01:43:31.769600824 +0000 2024-09-12T01:44:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-12 01:39:27.511461298 +0000 2024-09-12T01:44:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-12 01:39:27.511461298 +0000 2024-09-12T01:44:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-12 01:39:27.511461298 +0000 2024-09-12T01:44:11.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:44:11.304 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-12T01:44:11.304 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-12T01:44:11.304 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000106103 s, 4.8 MB/s 2024-09-12T01:44:11.305 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:44:11.362 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-09-12T01:44:11.416 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:44:11.417 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:44:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T01:44:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:44:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:44:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-12 01:43:31.803600371 +0000 2024-09-12T01:44:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-12 01:39:27.819457503 +0000 2024-09-12T01:44:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-12 01:39:27.819457503 +0000 2024-09-12T01:44:11.417 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-12 01:39:27.819457503 +0000 2024-09-12T01:44:11.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:44:11.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:11 smithi070 ceph-mon[31177]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi152=y;smithi191=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:11.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:11 smithi070 ceph-mon[31177]: Saving service mgr spec with placement smithi070=x;smithi152=y;smithi191=z;count:3 2024-09-12T01:44:11.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:11 smithi070 ceph-mon[31177]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:44:11.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:11 smithi070 ceph-mon[31177]: Reconfiguring daemon mgr.x on smithi070 2024-09-12T01:44:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-12T01:44:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-12T01:44:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000110087 s, 4.7 MB/s 2024-09-12T01:44:11.481 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:44:11.537 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-12T01:44:11.538 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:44:11.554 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:44:11.554 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-09-12T01:44:11.609 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:44:11.610 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:44:11.610 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-12T01:44:11.610 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:44:11.610 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:44:11.610 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-12 01:44:01.163514858 +0000 2024-09-12T01:44:11.610 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-12 01:39:32.316075497 +0000 2024-09-12T01:44:11.610 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-12 01:39:32.316075497 +0000 2024-09-12T01:44:11.610 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-12 01:39:32.316075497 +0000 2024-09-12T01:44:11.610 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:44:11.671 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:11 smithi152 ceph-mon[35055]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi152=y;smithi191=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:11.671 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:11 smithi152 ceph-mon[35055]: Saving service mgr spec with placement smithi070=x;smithi152=y;smithi191=z;count:3 2024-09-12T01:44:11.671 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:11 smithi152 ceph-mon[35055]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:44:11.672 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:11 smithi152 ceph-mon[35055]: Reconfiguring daemon mgr.x on smithi070 2024-09-12T01:44:11.673 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-12T01:44:11.674 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-12T01:44:11.674 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000247348 s, 2.1 MB/s 2024-09-12T01:44:11.675 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:44:11.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:11 smithi191 ceph-mon[35770]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi152=y;smithi191=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:11.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:11 smithi191 ceph-mon[35770]: Saving service mgr spec with placement smithi070=x;smithi152=y;smithi191=z;count:3 2024-09-12T01:44:11.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:11 smithi191 ceph-mon[35770]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T01:44:11.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:11 smithi191 ceph-mon[35770]: Reconfiguring daemon mgr.x on smithi070 2024-09-12T01:44:11.732 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-09-12T01:44:11.788 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:44:11.789 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:44:11.789 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T01:44:11.789 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:44:11.789 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:44:11.789 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-12 01:44:01.164514846 +0000 2024-09-12T01:44:11.789 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-12 01:39:32.642071712 +0000 2024-09-12T01:44:11.789 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-12 01:39:32.642071712 +0000 2024-09-12T01:44:11.789 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-12 01:39:32.642071712 +0000 2024-09-12T01:44:11.789 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:44:11.856 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-12T01:44:11.856 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-12T01:44:11.857 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000205822 s, 2.5 MB/s 2024-09-12T01:44:11.858 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:44:11.914 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-09-12T01:44:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:44:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:44:11.969 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T01:44:11.969 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:44:11.970 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:44:11.970 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-12 01:44:01.164514846 +0000 2024-09-12T01:44:11.970 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-12 01:39:32.965067961 +0000 2024-09-12T01:44:11.970 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-12 01:39:32.965067961 +0000 2024-09-12T01:44:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-12 01:39:32.965067961 +0000 2024-09-12T01:44:11.970 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:44:12.033 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-12T01:44:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-12T01:44:12.034 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000170946 s, 3.0 MB/s 2024-09-12T01:44:12.035 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:44:12.091 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-09-12T01:44:12.147 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:44:12.148 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:44:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T01:44:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:44:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:44:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-12 01:44:01.165514833 +0000 2024-09-12T01:44:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-12 01:39:33.294064140 +0000 2024-09-12T01:44:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-12 01:39:33.294064140 +0000 2024-09-12T01:44:12.148 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-12 01:39:33.294064140 +0000 2024-09-12T01:44:12.148 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:44:12.211 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-12T01:44:12.211 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-12T01:44:12.211 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000193357 s, 2.6 MB/s 2024-09-12T01:44:12.213 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:44:12.269 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-09-12T01:44:12.269 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:44:12.289 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:44:12.289 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2024-09-12T01:44:12.348 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:44:12.349 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:44:12.349 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T01:44:12.349 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:44:12.349 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:44:12.349 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-12 01:43:52.387844559 +0000 2024-09-12T01:44:12.349 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-12 01:39:37.850391410 +0000 2024-09-12T01:44:12.349 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-12 01:39:37.850391410 +0000 2024-09-12T01:44:12.349 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-12 01:39:37.850391410 +0000 2024-09-12T01:44:12.349 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:44:12.417 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-12T01:44:12.417 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-12T01:44:12.417 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000293607 s, 1.7 MB/s 2024-09-12T01:44:12.418 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:44:12.477 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2024-09-12T01:44:12.535 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:44:12.535 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:44:12.535 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T01:44:12.535 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:44:12.535 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:44:12.535 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-12 01:43:52.387844559 +0000 2024-09-12T01:44:12.535 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-12 01:39:38.176385603 +0000 2024-09-12T01:44:12.535 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-12 01:39:38.176385603 +0000 2024-09-12T01:44:12.536 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-12 01:39:38.176385603 +0000 2024-09-12T01:44:12.536 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:44:12.602 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-12T01:44:12.602 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-12T01:44:12.602 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000211393 s, 2.4 MB/s 2024-09-12T01:44:12.604 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:44:12.662 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2024-09-12T01:44:12.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:12 smithi191 ceph-mon[35770]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:12.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:12.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:12.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:12.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:44:12.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:44:12.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:12.704 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:44:12.704 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:44:12.704 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T01:44:12.704 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:44:12.704 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:44:12.705 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-12 01:43:52.387844559 +0000 2024-09-12T01:44:12.705 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-12 01:39:38.534379224 +0000 2024-09-12T01:44:12.705 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-12 01:39:38.534379224 +0000 2024-09-12T01:44:12.705 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-12 01:39:38.534379224 +0000 2024-09-12T01:44:12.705 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:44:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:12 smithi152 ceph-mon[35055]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:44:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:44:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:12.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:12 smithi070 ceph-mon[31177]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:12.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:12.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:12.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:12.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:44:12.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:44:12.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:12.770 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-12T01:44:12.770 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-12T01:44:12.770 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000244113 s, 2.1 MB/s 2024-09-12T01:44:12.771 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:44:12.827 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2024-09-12T01:44:12.883 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:44:12.883 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:44:12.884 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-12T01:44:12.884 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:44:12.884 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:44:12.884 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-09-12 01:43:52.388844541 +0000 2024-09-12T01:44:12.884 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-09-12 01:39:38.862373381 +0000 2024-09-12T01:44:12.884 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-09-12 01:39:38.862373381 +0000 2024-09-12T01:44:12.884 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-09-12 01:39:38.862373381 +0000 2024-09-12T01:44:12.884 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:44:12.947 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-09-12T01:44:12.948 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-09-12T01:44:12.948 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000209932 s, 2.4 MB/s 2024-09-12T01:44:12.949 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:44:13.006 INFO:tasks.cephadm:Deploying osd.0 on smithi070 with /dev/vg_nvme/lv_4... 2024-09-12T01:44:13.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:44:13.254 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:44:13.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:13 smithi191 ceph-mon[35770]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:44:13.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:13 smithi191 ceph-mon[35770]: Reconfiguring daemon mon.b on smithi152 2024-09-12T01:44:13.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:13 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:13.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:13 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:13.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:13 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:44:13.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:13 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:44:13.603 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:13 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:13.664 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:13 smithi070 ceph-mon[31177]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:44:13.665 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:13 smithi070 ceph-mon[31177]: Reconfiguring daemon mon.b on smithi152 2024-09-12T01:44:13.665 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:13 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:13.665 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:13 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:13.665 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:13 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:44:13.665 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:13 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:44:13.665 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:13 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:13.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:13 smithi152 ceph-mon[35055]: Reconfiguring mon.b (monmap changed)... 2024-09-12T01:44:13.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:13 smithi152 ceph-mon[35055]: Reconfiguring daemon mon.b on smithi152 2024-09-12T01:44:13.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:13 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:13.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:13 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:13.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:13 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:44:13.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:13 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:44:13.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:13 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:14.545 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:44:14.545 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: Reconfiguring daemon mon.c on smithi191 2024-09-12T01:44:14.545 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:14.545 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:14.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:14.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:14.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:14.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:14.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:14.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:14.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:44:14.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:44:14.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:14 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:14.670 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:44:14.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: Reconfiguring daemon mon.c on smithi191 2024-09-12T01:44:14.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:14.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:14.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:14.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:14.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:14.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:14.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:14.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:14.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:44:14.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:44:14.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:14 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:14.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: Reconfiguring mon.c (monmap changed)... 2024-09-12T01:44:14.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: Reconfiguring daemon mon.c on smithi191 2024-09-12T01:44:14.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:14.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:14.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:14.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:14.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:14.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:14.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:14.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:14.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:44:14.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:44:14.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:14 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:15.569 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:44:15.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_4 2024-09-12T01:44:15.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:15 smithi191 ceph-mon[35770]: Deploying daemon mgr.z on smithi191 2024-09-12T01:44:15.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:15 smithi152 ceph-mon[35055]: Deploying daemon mgr.z on smithi191 2024-09-12T01:44:15.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:15 smithi070 ceph-mon[31177]: Deploying daemon mgr.z on smithi191 2024-09-12T01:44:15.832 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:44:16.100 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:15 smithi191 systemd[1]: Starting Ceph mgr.z for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:44:16.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.245+0000 7fbb5b416640 1 -- 172.21.15.70:0/1696347309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb54100b10 msgr2=0x7fbb54100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:16.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.245+0000 7fbb5b416640 1 --2- 172.21.15.70:0/1696347309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb54100b10 0x7fbb54100f10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009900 tx=0x7fbb4802a410 comp rx=0 tx=0).stop 2024-09-12T01:44:16.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.245+0000 7fbb5b416640 1 -- 172.21.15.70:0/1696347309 shutdown_connections 2024-09-12T01:44:16.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.245+0000 7fbb5b416640 1 --2- 172.21.15.70:0/1696347309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb541026d0 0x7fbb54108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:16.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.245+0000 7fbb5b416640 1 --2- 172.21.15.70:0/1696347309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb54101d10 0x7fbb54102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:16.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.245+0000 7fbb5b416640 1 --2- 172.21.15.70:0/1696347309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb54100b10 0x7fbb54100f10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:16.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.245+0000 7fbb5b416640 1 -- 172.21.15.70:0/1696347309 >> 172.21.15.70:0/1696347309 conn(0x7fbb540fc2a0 msgr2=0x7fbb540fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:16.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.245+0000 7fbb5b416640 1 -- 172.21.15.70:0/1696347309 shutdown_connections 2024-09-12T01:44:16.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.245+0000 7fbb5b416640 1 -- 172.21.15.70:0/1696347309 wait complete. 2024-09-12T01:44:16.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb5b416640 1 Processor -- start 2024-09-12T01:44:16.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb5b416640 1 -- start start 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb5b416640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb54100b10 0x7fbb54104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb5b416640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb54101d10 0x7fbb541030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb5b416640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb541026d0 0x7fbb54103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb5b416640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5410c8d0 con 0x7fbb541026d0 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb5b416640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5410c750 con 0x7fbb54100b10 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb5b416640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5410ca50 con 0x7fbb54101d10 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb599b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb541026d0 0x7fbb54103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb589b1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb54101d10 0x7fbb541030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb599b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb541026d0 0x7fbb54103630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58896/0 (socket says 172.21.15.70:58896) 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb599b3640 1 -- 172.21.15.70:0/1811748629 learned_addr learned my addr 172.21.15.70:0/1811748629 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb591b2640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb54100b10 0x7fbb54104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb599b3640 1 -- 172.21.15.70:0/1811748629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb54101d10 msgr2=0x7fbb541030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:16.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb599b3640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb54101d10 0x7fbb541030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:16.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb599b3640 1 -- 172.21.15.70:0/1811748629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb54100b10 msgr2=0x7fbb54104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:16.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb599b3640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb54100b10 0x7fbb54104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:16.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb599b3640 1 -- 172.21.15.70:0/1811748629 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb54103ef0 con 0x7fbb541026d0 2024-09-12T01:44:16.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.246+0000 7fbb589b1640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb54101d10 0x7fbb541030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:16.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.247+0000 7fbb599b3640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb541026d0 0x7fbb54103630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00eb10 tx=0x7fbb4c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:16.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.247+0000 7fbb467fc640 1 -- 172.21.15.70:0/1811748629 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c004b20 con 0x7fbb541026d0 2024-09-12T01:44:16.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.247+0000 7fbb5b416640 1 -- 172.21.15.70:0/1811748629 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb541a2180 con 0x7fbb541026d0 2024-09-12T01:44:16.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.247+0000 7fbb467fc640 1 -- 172.21.15.70:0/1811748629 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb4c004cc0 con 0x7fbb541026d0 2024-09-12T01:44:16.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.247+0000 7fbb467fc640 1 -- 172.21.15.70:0/1811748629 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0107f0 con 0x7fbb541026d0 2024-09-12T01:44:16.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.247+0000 7fbb5b416640 1 -- 172.21.15.70:0/1811748629 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb541a2690 con 0x7fbb541026d0 2024-09-12T01:44:16.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.248+0000 7fbb467fc640 1 -- 172.21.15.70:0/1811748629 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fbb4c0109b0 con 0x7fbb541026d0 2024-09-12T01:44:16.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.248+0000 7fbb5b416640 1 -- 172.21.15.70:0/1811748629 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb541a2920 con 0x7fbb541026d0 2024-09-12T01:44:16.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.248+0000 7fbb467fc640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb40039290 0x7fbb4003b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:16.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.248+0000 7fbb467fc640 1 -- 172.21.15.70:0/1811748629 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbb4c04c9d0 con 0x7fbb541026d0 2024-09-12T01:44:16.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.248+0000 7fbb591b2640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb40039290 0x7fbb4003b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:16.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.248+0000 7fbb591b2640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb40039290 0x7fbb4003b750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb48031570 tx=0x7fbb48031640 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:16.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.253+0000 7fbb467fc640 1 -- 172.21.15.70:0/1811748629 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb4c005020 con 0x7fbb541026d0 2024-09-12T01:44:16.392 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 podman[37569]: 2024-09-12 01:44:16.002885182 +0000 UTC m=+0.015810818 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:44:16.392 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 podman[37569]: 2024-09-12 01:44:16.106933858 +0000 UTC m=+0.119859480 container create b867e3395aeb5d02699ea74f96da8b17b45f2d742ad784f6ff0a0bf5dad4ff5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:44:16.393 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 podman[37569]: 2024-09-12 01:44:16.317839539 +0000 UTC m=+0.330765162 container init b867e3395aeb5d02699ea74f96da8b17b45f2d742ad784f6ff0a0bf5dad4ff5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T01:44:16.393 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 podman[37569]: 2024-09-12 01:44:16.320714154 +0000 UTC m=+0.333639779 container start b867e3395aeb5d02699ea74f96da8b17b45f2d742ad784f6ff0a0bf5dad4ff5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-12T01:44:16.393 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 ceph-mgr[37588]: -- 172.21.15.191:0/2011127859 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d129cad0e0 con 0x55d129c8b000 2024-09-12T01:44:16.393 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 bash[37569]: b867e3395aeb5d02699ea74f96da8b17b45f2d742ad784f6ff0a0bf5dad4ff5e 2024-09-12T01:44:16.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:16.430+0000 7fbb5b416640 1 -- 172.21.15.70:0/1811748629 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fbb540fe4f0 con 0x7fbb40039290 2024-09-12T01:44:16.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:16 smithi070 ceph-mon[31177]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:16.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:44:16.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:44:16.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:16.650 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:16 smithi191 ceph-mon[35770]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:16.650 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:44:16.650 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:44:16.650 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:16.650 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 systemd[1]: Started Ceph mgr.z for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:44:16.651 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:16.444+0000 7f6aaabaa040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:44:16.651 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:16.503+0000 7f6aaabaa040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:44:16.651 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:16.650+0000 7f6aaabaa040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:44:16.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:16 smithi152 ceph-mon[35055]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:16.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:44:16.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:44:16.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:16.937 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:16.716+0000 7f6aaabaa040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:44:16.937 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:16.860+0000 7f6aaabaa040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:44:17.306 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:16 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:16.998+0000 7f6aaabaa040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:44:17.307 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:17 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:17.306+0000 7f6aaabaa040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:44:17.687 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:17 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:17.367+0000 7f6aaabaa040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:44:17.687 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:17 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:17.549+0000 7f6aaabaa040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:44:17.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:17 smithi191 ceph-mon[35770]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:17.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:17 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:17.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:17 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:17.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:17 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:17.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:17 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:17.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:17 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:44:17.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:17 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:44:17.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:17 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:17.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:17 smithi191 ceph-mon[35770]: Deploying daemon mgr.y on smithi152 2024-09-12T01:44:17.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:17 smithi070 ceph-mon[31177]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:17.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:17 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:17.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:17 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:17.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:17 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:17.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:17 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:17.726 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:17 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:44:17.727 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:17 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:44:17.727 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:17 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:17.727 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:17 smithi070 ceph-mon[31177]: Deploying daemon mgr.y on smithi152 2024-09-12T01:44:17.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:17 smithi152 ceph-mon[35055]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:17.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:17 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:17.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:17 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:17.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:17 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:17.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:17 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:17.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:17 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:44:17.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:17 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:44:17.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:17 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:17.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:17 smithi152 ceph-mon[35055]: Deploying daemon mgr.y on smithi152 2024-09-12T01:44:18.479 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:18 smithi152 systemd[1]: Starting Ceph mgr.y for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:44:18.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:18 smithi191 ceph-mon[35770]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:18.687 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:18 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:18.420+0000 7f6aaabaa040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:44:18.687 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:18 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:18.487+0000 7f6aaabaa040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:44:18.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:18 smithi152 ceph-mon[35055]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:18.762 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:18 smithi152 podman[36406]: 2024-09-12 01:44:18.388340236 +0000 UTC m=+0.016179424 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:44:18.762 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:18 smithi152 podman[36406]: 2024-09-12 01:44:18.495767392 +0000 UTC m=+0.123606613 container create fbb0fe756767e871f68e2ecf93634d83db004119410a2d35c5b4d75c6acb9791 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:44:18.762 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:18 smithi152 podman[36406]: 2024-09-12 01:44:18.681460207 +0000 UTC m=+0.309299383 container init fbb0fe756767e871f68e2ecf93634d83db004119410a2d35c5b4d75c6acb9791 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:44:18.762 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:18 smithi152 podman[36406]: 2024-09-12 01:44:18.684406775 +0000 UTC m=+0.312245954 container start fbb0fe756767e871f68e2ecf93634d83db004119410a2d35c5b4d75c6acb9791 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T01:44:18.763 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:18 smithi152 ceph-mgr[36425]: -- 172.21.15.152:0/3096023165 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556f6f90b0e0 con 0x556f6f8e8800 2024-09-12T01:44:18.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:18 smithi070 ceph-mon[31177]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:19.100 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:18 smithi152 bash[36406]: fbb0fe756767e871f68e2ecf93634d83db004119410a2d35c5b4d75c6acb9791 2024-09-12T01:44:19.100 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:18 smithi152 systemd[1]: Started Ceph mgr.y for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:44:19.100 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:18 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:18.807+0000 7f090d9d6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:44:19.100 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:18 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:18.875+0000 7f090d9d6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:44:19.100 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:19.030+0000 7f090d9d6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:44:19.100 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:19.099+0000 7f090d9d6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:44:19.412 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:19.257+0000 7f090d9d6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:44:19.412 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:19.412+0000 7f090d9d6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:44:19.479 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:19.215+0000 7f6aaabaa040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:44:19.480 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:19.345+0000 7f6aaabaa040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:44:19.669 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/705305055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8"}]: dispatch 2024-09-12T01:44:19.670 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/705305055' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8"}]': finished 2024-09-12T01:44:19.670 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-mon[35055]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:44:19.670 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:19.670 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:19.670 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:19.670 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:19.670 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:19.670 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:19.670 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/47571014' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:44:19.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:19 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/705305055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8"}]: dispatch 2024-09-12T01:44:19.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:19 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/705305055' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8"}]': finished 2024-09-12T01:44:19.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:19 smithi070 ceph-mon[31177]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:44:19.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:19 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:19.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:19 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:19.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:19 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:19.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:19 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:19.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:19 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:19.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:19 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:19.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:19 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/47571014' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:44:19.775 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:19.489+0000 7f6aaabaa040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:44:19.775 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:19.553+0000 7f6aaabaa040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:44:19.775 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:19.707+0000 7f6aaabaa040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:44:19.776 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:19.775+0000 7f6aaabaa040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:44:19.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/705305055' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8"}]: dispatch 2024-09-12T01:44:19.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/705305055' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8"}]': finished 2024-09-12T01:44:19.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-mon[35770]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T01:44:19.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:19.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:19.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:19.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:19.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:19.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:19.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/47571014' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:44:20.006 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:19.741+0000 7f090d9d6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:44:20.006 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:19.804+0000 7f090d9d6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:44:20.069 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:19 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:19.836+0000 7f6aaabaa040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:44:20.069 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:20.003+0000 7f6aaabaa040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:44:20.069 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:20.069+0000 7f6aaabaa040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:44:20.262 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:20.006+0000 7f090d9d6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:44:20.342 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:20.138+0000 7f6aaabaa040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:44:20.342 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:20.223+0000 7f6aaabaa040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:44:20.342 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:20.283+0000 7f6aaabaa040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:44:20.342 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:20.342+0000 7f6aaabaa040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:44:20.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-mon[35770]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-mon[35055]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:20.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:20.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:20.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:20.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:20.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:20.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:20 smithi070 ceph-mon[31177]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:20.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:21.262 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:20.903+0000 7f090d9d6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:44:21.262 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:20.969+0000 7f090d9d6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:44:21.437 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:44:21 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z[37584]: 2024-09-12T01:44:21.119+0000 7f6aaabaa040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:44:21.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:21.487+0000 7fbb467fc640 1 -- 172.21.15.70:0/1811748629 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7fbb4c010ca0 con 0x7fbb541026d0 2024-09-12T01:44:21.762 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:21 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:21.683+0000 7f090d9d6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:44:21.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:21 smithi152 ceph-mon[35055]: Standby manager daemon z started 2024-09-12T01:44:21.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:21 smithi152 ceph-mon[35055]: from='mgr.? 172.21.15.191:0/136020042' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:44:21.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:21 smithi152 ceph-mon[35055]: from='mgr.? 172.21.15.191:0/136020042' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:44:21.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:21 smithi152 ceph-mon[35055]: from='mgr.? 172.21.15.191:0/136020042' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:44:21.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:21 smithi152 ceph-mon[35055]: from='mgr.? 172.21.15.191:0/136020042' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:44:21.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:21.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:21 smithi070 ceph-mon[31177]: Standby manager daemon z started 2024-09-12T01:44:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:21 smithi070 ceph-mon[31177]: from='mgr.? 172.21.15.191:0/136020042' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:44:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:21 smithi070 ceph-mon[31177]: from='mgr.? 172.21.15.191:0/136020042' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:44:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:21 smithi070 ceph-mon[31177]: from='mgr.? 172.21.15.191:0/136020042' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:44:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:21 smithi070 ceph-mon[31177]: from='mgr.? 172.21.15.191:0/136020042' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:44:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:21.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:21 smithi191 ceph-mon[35770]: Standby manager daemon z started 2024-09-12T01:44:21.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:21 smithi191 ceph-mon[35770]: from='mgr.? 172.21.15.191:0/136020042' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T01:44:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:21 smithi191 ceph-mon[35770]: from='mgr.? 172.21.15.191:0/136020042' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:44:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:21 smithi191 ceph-mon[35770]: from='mgr.? 172.21.15.191:0/136020042' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T01:44:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:21 smithi191 ceph-mon[35770]: from='mgr.? 172.21.15.191:0/136020042' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:44:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:22.150 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:21 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:21.800+0000 7f090d9d6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:44:22.150 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:21 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:21.943+0000 7f090d9d6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:44:22.150 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:22.003+0000 7f090d9d6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:44:22.150 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:22.149+0000 7f090d9d6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:44:22.437 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:22.218+0000 7f090d9d6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:44:22.437 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:22.279+0000 7f090d9d6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:44:22.438 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:22.437+0000 7f090d9d6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:44:22.710 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-mon[35055]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:22.711 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-mon[35055]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-12T01:44:22.711 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:44:22.711 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:22.503+0000 7f090d9d6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:44:22.711 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:22.569+0000 7f090d9d6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:44:22.711 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:22.651+0000 7f090d9d6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:44:22.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:22 smithi070 ceph-mon[31177]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:22.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:22 smithi070 ceph-mon[31177]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-12T01:44:22.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:22 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:44:22.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:22 smithi191 ceph-mon[35770]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:22 smithi191 ceph-mon[35770]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-12T01:44:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:22 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T01:44:23.012 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:22.710+0000 7f090d9d6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:44:23.012 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:22.769+0000 7f090d9d6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:44:24.012 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:44:23 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y[36421]: 2024-09-12T01:44:23.554+0000 7f090d9d6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:44:24.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:24.496+0000 7fbb467fc640 1 -- 172.21.15.70:0/1811748629 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fbb4c016330 con 0x7fbb541026d0 2024-09-12T01:44:24.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:24 smithi152 ceph-mon[35055]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:24.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:24 smithi152 ceph-mon[35055]: Standby manager daemon y started 2024-09-12T01:44:24.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:24 smithi152 ceph-mon[35055]: from='mgr.? 172.21.15.152:0/194755800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:44:24.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:24 smithi152 ceph-mon[35055]: from='mgr.? 172.21.15.152:0/194755800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:44:24.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:24 smithi152 ceph-mon[35055]: from='mgr.? 172.21.15.152:0/194755800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:44:24.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:24 smithi152 ceph-mon[35055]: from='mgr.? 172.21.15.152:0/194755800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:44:24.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:24 smithi070 ceph-mon[31177]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:24.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:24 smithi070 ceph-mon[31177]: Standby manager daemon y started 2024-09-12T01:44:24.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:24 smithi070 ceph-mon[31177]: from='mgr.? 172.21.15.152:0/194755800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:44:24.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:24 smithi070 ceph-mon[31177]: from='mgr.? 172.21.15.152:0/194755800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:44:24.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:24 smithi070 ceph-mon[31177]: from='mgr.? 172.21.15.152:0/194755800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:44:24.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:24 smithi070 ceph-mon[31177]: from='mgr.? 172.21.15.152:0/194755800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:44:24.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:24 smithi191 ceph-mon[35770]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:24 smithi191 ceph-mon[35770]: Standby manager daemon y started 2024-09-12T01:44:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:24 smithi191 ceph-mon[35770]: from='mgr.? 172.21.15.152:0/194755800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T01:44:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:24 smithi191 ceph-mon[35770]: from='mgr.? 172.21.15.152:0/194755800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:44:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:24 smithi191 ceph-mon[35770]: from='mgr.? 172.21.15.152:0/194755800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T01:44:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:24 smithi191 ceph-mon[35770]: from='mgr.? 172.21.15.152:0/194755800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:44:25.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:25 smithi152 ceph-mon[35055]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-12T01:44:25.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:25 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:44:25.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:25 smithi070 ceph-mon[31177]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-12T01:44:25.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:25 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:44:25.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:25 smithi191 ceph-mon[35770]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-12T01:44:25.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:25 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T01:44:26.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:26 smithi152 ceph-mon[35055]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:26.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:26 smithi070 ceph-mon[31177]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:26.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:26 smithi191 ceph-mon[35770]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:27.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:27 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:44:27.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:27 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:27.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:27 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:44:27.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:27 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:27.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:27 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:44:27.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:27 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:28.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:28 smithi152 ceph-mon[35055]: Deploying daemon osd.0 on smithi070 2024-09-12T01:44:28.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:28 smithi152 ceph-mon[35055]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:28.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:28 smithi070 ceph-mon[31177]: Deploying daemon osd.0 on smithi070 2024-09-12T01:44:28.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:28 smithi070 ceph-mon[31177]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:28.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:28 smithi191 ceph-mon[35770]: Deploying daemon osd.0 on smithi070 2024-09-12T01:44:28.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:28 smithi191 ceph-mon[35770]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:30.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:30 smithi152 ceph-mon[35055]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:30 smithi070 ceph-mon[31177]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:30.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:30 smithi191 ceph-mon[35770]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:32.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:32 smithi070 ceph-mon[31177]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:32.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:32 smithi152 ceph-mon[35055]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:32.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:32 smithi191 ceph-mon[35770]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:33.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:33 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:33.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:33 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:33.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:33 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:33.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:33 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:33.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:33 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:33.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:33 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:33.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:33 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:33.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:33 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:33.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:33 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:34.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:34 smithi070 ceph-mon[31177]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:34.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:34 smithi191 ceph-mon[35770]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:34 smithi152 ceph-mon[35055]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:36.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:36 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:36.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:36 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:36.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:36 smithi191 ceph-mon[35770]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:36.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:36 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:36.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:36 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:36.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:36 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:36.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:36 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:36.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:36 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:36.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:36 smithi152 ceph-mon[35055]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:36.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:36 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:36.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:36 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:36.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:36 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:36.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:36 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:36.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:36 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:36.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:36 smithi070 ceph-mon[31177]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:36.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:36 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:36.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:36 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:36.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:36 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:37.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.093+0000 7fbb467fc640 1 -- 172.21.15.70:0/1811748629 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbb540fe4f0 con 0x7fbb40039290 2024-09-12T01:44:37.094 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 0 on host 'smithi070' 2024-09-12T01:44:37.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.095+0000 7fbb5b416640 1 -- 172.21.15.70:0/1811748629 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb40039290 msgr2=0x7fbb4003b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.095+0000 7fbb5b416640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb40039290 0x7fbb4003b750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb48031570 tx=0x7fbb48031640 comp rx=0 tx=0).stop 2024-09-12T01:44:37.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.095+0000 7fbb5b416640 1 -- 172.21.15.70:0/1811748629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb541026d0 msgr2=0x7fbb54103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.095+0000 7fbb5b416640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb541026d0 0x7fbb54103630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00eb10 tx=0x7fbb4c00c2d0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.095+0000 7fbb5b416640 1 -- 172.21.15.70:0/1811748629 shutdown_connections 2024-09-12T01:44:37.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.095+0000 7fbb5b416640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb40039290 0x7fbb4003b750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.095+0000 7fbb5b416640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb541026d0 0x7fbb54103630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.095+0000 7fbb5b416640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb54101d10 0x7fbb541030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.095+0000 7fbb5b416640 1 --2- 172.21.15.70:0/1811748629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb54100b10 0x7fbb54104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.095+0000 7fbb5b416640 1 -- 172.21.15.70:0/1811748629 >> 172.21.15.70:0/1811748629 conn(0x7fbb540fc2a0 msgr2=0x7fbb540fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:37.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.096+0000 7fbb5b416640 1 -- 172.21.15.70:0/1811748629 shutdown_connections 2024-09-12T01:44:37.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:44:37.096+0000 7fbb5b416640 1 -- 172.21.15.70:0/1811748629 wait complete. 2024-09-12T01:44:37.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:37.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:37.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:37.693 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:37.693 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:37.693 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:37.720 DEBUG:teuthology.orchestra.run.smithi070:osd.0> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T01:44:37.722 INFO:tasks.cephadm:Deploying osd.1 on smithi152 with /dev/vg_nvme/lv_4... 2024-09-12T01:44:37.722 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:44:37.751 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:37.751 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:37.751 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:37.978 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:44:38.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:38 smithi191 ceph-mon[35770]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:38.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:38 smithi152 ceph-mon[35055]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:38.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:38 smithi070 ceph-mon[31177]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:39.444 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:39 smithi070 ceph-mon[31177]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:44:39.445 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:44:39 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0[44877]: 2024-09-12T01:44:39.263+0000 7f6ae1802640 -1 osd.0 0 log_to_monitors true 2024-09-12T01:44:39.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:39 smithi191 ceph-mon[35770]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:44:39.723 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:39 smithi152 ceph-mon[35055]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:44:40.440 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:40 smithi070 ceph-mon[31177]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:44:40.440 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:40 smithi070 ceph-mon[31177]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:44:40.440 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:40 smithi070 ceph-mon[31177]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-12T01:44:40.440 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:40.440 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:40 smithi070 ceph-mon[31177]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:40.455 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:40 smithi152 ceph-mon[35055]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:44:40.455 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:40 smithi152 ceph-mon[35055]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:44:40.455 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:40 smithi152 ceph-mon[35055]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-12T01:44:40.456 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:40.456 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:40 smithi152 ceph-mon[35055]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:44:40.484 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_4 2024-09-12T01:44:40.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:40 smithi191 ceph-mon[35770]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:44:40.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:40 smithi191 ceph-mon[35770]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:44:40.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:40 smithi191 ceph-mon[35770]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-12T01:44:40.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:40.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:40 smithi191 ceph-mon[35770]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:40.771 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:44:41.070 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0[44877]: 2024-09-12T01:44:41.017+0000 7f6adcf62640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T01:44:41.070 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0[44877]: 2024-09-12T01:44:41.020+0000 7f6ad5594640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:44:41.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.208+0000 7f1aa672c640 1 -- 172.21.15.152:0/2655864047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa0101c00 msgr2=0x7f1aa0102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:41.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.208+0000 7f1aa672c640 1 --2- 172.21.15.152:0/2655864047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa0101c00 0x7f1aa0102000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009900 tx=0x7f1a9002a410 comp rx=0 tx=0).stop 2024-09-12T01:44:41.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.208+0000 7f1aa672c640 1 -- 172.21.15.152:0/2655864047 shutdown_connections 2024-09-12T01:44:41.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.208+0000 7f1aa672c640 1 --2- 172.21.15.152:0/2655864047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa01037c0 0x7f1aa010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:41.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.209+0000 7f1aa672c640 1 --2- 172.21.15.152:0/2655864047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aa0102e00 0x7f1aa0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:41.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.209+0000 7f1aa672c640 1 --2- 172.21.15.152:0/2655864047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa0101c00 0x7f1aa0102000 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:41.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.209+0000 7f1aa672c640 1 -- 172.21.15.152:0/2655864047 >> 172.21.15.152:0/2655864047 conn(0x7f1aa00fd390 msgr2=0x7f1aa00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:41.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.209+0000 7f1aa672c640 1 -- 172.21.15.152:0/2655864047 shutdown_connections 2024-09-12T01:44:41.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.209+0000 7f1aa672c640 1 -- 172.21.15.152:0/2655864047 wait complete. 2024-09-12T01:44:41.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.209+0000 7f1aa672c640 1 Processor -- start 2024-09-12T01:44:41.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.209+0000 7f1aa672c640 1 -- start start 2024-09-12T01:44:41.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1aa672c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa0101c00 0x7f1aa0198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:41.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1aa672c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0102e00 0x7f1aa0198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:41.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1aa672c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aa01037c0 0x7f1aa019f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:41.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1aa672c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa010d9c0 con 0x7f1aa0102e00 2024-09-12T01:44:41.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1aa672c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa010d840 con 0x7f1aa0101c00 2024-09-12T01:44:41.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1aa672c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa010db40 con 0x7f1aa01037c0 2024-09-12T01:44:41.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa0101c00 0x7f1aa0198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:41.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa0101c00 0x7f1aa0198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:40914/0 (socket says 172.21.15.152:40914) 2024-09-12T01:44:41.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1a9ffff640 1 -- 172.21.15.152:0/581935844 learned_addr learned my addr 172.21.15.152:0/581935844 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-12T01:44:41.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1a9f7fe640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0102e00 0x7f1aa0198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:41.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1aa4cc9640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aa01037c0 0x7f1aa019f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:41.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1a9ffff640 1 -- 172.21.15.152:0/581935844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aa01037c0 msgr2=0x7f1aa019f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:41.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1a9ffff640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aa01037c0 0x7f1aa019f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:41.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1a9ffff640 1 -- 172.21.15.152:0/581935844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0102e00 msgr2=0x7f1aa0198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:41.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1a9ffff640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0102e00 0x7f1aa0198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:41.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1a9ffff640 1 -- 172.21.15.152:0/581935844 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa019fc40 con 0x7f1aa0101c00 2024-09-12T01:44:41.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1a9f7fe640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0102e00 0x7f1aa0198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:41.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.210+0000 7f1a9ffff640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa0101c00 0x7f1aa0198010 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005ab0 tx=0x7f1a900042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:41.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.211+0000 7f1a9d7fa640 1 -- 172.21.15.152:0/581935844 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9003f030 con 0x7f1aa0101c00 2024-09-12T01:44:41.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.211+0000 7f1aa672c640 1 -- 172.21.15.152:0/581935844 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa019fed0 con 0x7f1aa0101c00 2024-09-12T01:44:41.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.211+0000 7f1a9d7fa640 1 -- 172.21.15.152:0/581935844 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1a90003d00 con 0x7f1aa0101c00 2024-09-12T01:44:41.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.211+0000 7f1a9d7fa640 1 -- 172.21.15.152:0/581935844 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90035070 con 0x7f1aa0101c00 2024-09-12T01:44:41.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.211+0000 7f1aa672c640 1 -- 172.21.15.152:0/581935844 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa01a0320 con 0x7f1aa0101c00 2024-09-12T01:44:41.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.212+0000 7f1aa672c640 1 -- 172.21.15.152:0/581935844 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa0108fb0 con 0x7f1aa0101c00 2024-09-12T01:44:41.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.213+0000 7f1a9d7fa640 1 -- 172.21.15.152:0/581935844 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f1a90042030 con 0x7f1aa0101c00 2024-09-12T01:44:41.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.213+0000 7f1a9d7fa640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1a880a2b20 0x7f1a880a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:41.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.213+0000 7f1a9d7fa640 1 -- 172.21.15.152:0/581935844 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f1a900ed6e0 con 0x7f1aa0101c00 2024-09-12T01:44:41.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.214+0000 7f1a9f7fe640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1a880a2b20 0x7f1a880a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:41.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.214+0000 7f1a9f7fe640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1a880a2b20 0x7f1a880a4fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1a940058c0 tx=0x7f1a94005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:41.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.218+0000 7f1a9d7fa640 1 -- 172.21.15.152:0/581935844 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a900bc1d0 con 0x7f1aa0101c00 2024-09-12T01:44:41.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:44:41.391+0000 7f1aa672c640 1 -- 172.21.15.152:0/581935844 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1aa0062630 con 0x7f1a880a2b20 2024-09-12T01:44:41.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-12T01:44:41.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:44:41.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:41.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:41.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: Detected new or changed devices on smithi070 2024-09-12T01:44:41.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:41.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:41.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:44:41.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: Adjusting osd_memory_target on smithi070 to 17088M 2024-09-12T01:44:41.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:41.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:41.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:41.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:41.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:41 smithi152 ceph-mon[35055]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' 2024-09-12T01:44:41.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-12T01:44:41.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:44:41.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:41.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:41.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: Detected new or changed devices on smithi070 2024-09-12T01:44:41.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:41.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:41.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:44:41.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: Adjusting osd_memory_target on smithi070 to 17088M 2024-09-12T01:44:41.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:41.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:41.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:41.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:41.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:41 smithi191 ceph-mon[35770]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' 2024-09-12T01:44:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-12T01:44:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:44:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:41.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: Detected new or changed devices on smithi070 2024-09-12T01:44:41.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:41.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:41.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:44:41.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: Adjusting osd_memory_target on smithi070 to 17088M 2024-09-12T01:44:41.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:41.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:41.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:41.771 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:41.771 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:41 smithi070 ceph-mon[31177]: from='osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837]' entity='osd.0' 2024-09-12T01:44:42.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:42 smithi191 ceph-mon[35770]: purged_snaps scrub starts 2024-09-12T01:44:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:42 smithi191 ceph-mon[35770]: purged_snaps scrub ok 2024-09-12T01:44:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:42 smithi191 ceph-mon[35770]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:44:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:44:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:42 smithi191 ceph-mon[35770]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:42 smithi191 ceph-mon[35770]: osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837] boot 2024-09-12T01:44:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:42 smithi191 ceph-mon[35770]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:44:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:42.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:42 smithi152 ceph-mon[35055]: purged_snaps scrub starts 2024-09-12T01:44:42.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:42 smithi152 ceph-mon[35055]: purged_snaps scrub ok 2024-09-12T01:44:42.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:42.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:42 smithi152 ceph-mon[35055]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:42.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:44:42.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:44:42.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:42.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:42 smithi152 ceph-mon[35055]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:42.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:42 smithi152 ceph-mon[35055]: osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837] boot 2024-09-12T01:44:42.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:42 smithi152 ceph-mon[35055]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:44:42.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:42 smithi070 ceph-mon[31177]: purged_snaps scrub starts 2024-09-12T01:44:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:42 smithi070 ceph-mon[31177]: purged_snaps scrub ok 2024-09-12T01:44:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:42 smithi070 ceph-mon[31177]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:44:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:44:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:42 smithi070 ceph-mon[31177]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:44:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:42 smithi070 ceph-mon[31177]: osd.0 [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837] boot 2024-09-12T01:44:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:42 smithi070 ceph-mon[31177]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T01:44:42.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:44.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:44 smithi152 ceph-mon[35055]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:44:44.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:44 smithi152 ceph-mon[35055]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:44.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:44 smithi152 ceph-mon[35055]: from='client.? 172.21.15.152:0/272213522' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "77805875-8e33-446f-8ab1-c4304ce84ac9"}]: dispatch 2024-09-12T01:44:44.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:44 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "77805875-8e33-446f-8ab1-c4304ce84ac9"}]: dispatch 2024-09-12T01:44:44.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:44 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "77805875-8e33-446f-8ab1-c4304ce84ac9"}]': finished 2024-09-12T01:44:44.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:44 smithi152 ceph-mon[35055]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:44:44.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:44:44.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:44 smithi191 ceph-mon[35770]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:44:44.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:44 smithi191 ceph-mon[35770]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:44.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:44 smithi191 ceph-mon[35770]: from='client.? 172.21.15.152:0/272213522' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "77805875-8e33-446f-8ab1-c4304ce84ac9"}]: dispatch 2024-09-12T01:44:44.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:44 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "77805875-8e33-446f-8ab1-c4304ce84ac9"}]: dispatch 2024-09-12T01:44:44.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:44 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "77805875-8e33-446f-8ab1-c4304ce84ac9"}]': finished 2024-09-12T01:44:44.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:44 smithi191 ceph-mon[35770]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:44:44.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:44:44.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:44 smithi070 ceph-mon[31177]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:44:44.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:44 smithi070 ceph-mon[31177]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:44.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:44 smithi070 ceph-mon[31177]: from='client.? 172.21.15.152:0/272213522' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "77805875-8e33-446f-8ab1-c4304ce84ac9"}]: dispatch 2024-09-12T01:44:44.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:44 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "77805875-8e33-446f-8ab1-c4304ce84ac9"}]: dispatch 2024-09-12T01:44:44.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:44 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "77805875-8e33-446f-8ab1-c4304ce84ac9"}]': finished 2024-09-12T01:44:44.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:44 smithi070 ceph-mon[31177]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T01:44:44.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:44:45.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:45 smithi191 ceph-mon[35770]: from='client.? 172.21.15.152:0/629737417' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:44:45.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:45 smithi152 ceph-mon[35055]: from='client.? 172.21.15.152:0/629737417' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:44:45.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:45 smithi070 ceph-mon[31177]: from='client.? 172.21.15.152:0/629737417' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:44:46.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:46 smithi191 ceph-mon[35770]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:46.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:46 smithi152 ceph-mon[35055]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:46.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:46 smithi070 ceph-mon[31177]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:48.754 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:48 smithi152 ceph-mon[35055]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:48.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:48 smithi070 ceph-mon[31177]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:48 smithi191 ceph-mon[35770]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:50.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:50 smithi152 ceph-mon[35055]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:50.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:50 smithi070 ceph-mon[31177]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:50.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:50 smithi191 ceph-mon[35770]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:52.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:52 smithi152 ceph-mon[35055]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:52.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:44:52.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:52 smithi070 ceph-mon[31177]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:44:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:52.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:52 smithi191 ceph-mon[35770]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:44:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:53.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:53 smithi152 ceph-mon[35055]: Deploying daemon osd.1 on smithi152 2024-09-12T01:44:53.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:53 smithi070 ceph-mon[31177]: Deploying daemon osd.1 on smithi152 2024-09-12T01:44:53.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:53 smithi191 ceph-mon[35770]: Deploying daemon osd.1 on smithi152 2024-09-12T01:44:54.745 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:54 smithi152 ceph-mon[35055]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:54.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:54 smithi070 ceph-mon[31177]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:54.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:54 smithi191 ceph-mon[35770]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:56.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:56 smithi152 ceph-mon[35055]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:56.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:56 smithi070 ceph-mon[31177]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:56.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:56 smithi191 ceph-mon[35770]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:58.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:58 smithi152 ceph-mon[35055]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:58 smithi070 ceph-mon[31177]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:58.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:58 smithi191 ceph-mon[35770]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:44:59.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:59 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:59.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:59 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:59.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:44:59 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:59.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:59 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:59.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:59 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:59.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:44:59 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:59.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:59 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:59.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:59 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:44:59.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:44:59 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:00.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:00 smithi152 ceph-mon[35055]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:00.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:00 smithi070 ceph-mon[31177]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:00.839 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:00 smithi191 ceph-mon[35770]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:02.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.282+0000 7f1a9d7fa640 1 -- 172.21.15.152:0/581935844 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1aa0062630 con 0x7f1a880a2b20 2024-09-12T01:45:02.283 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 1 on host 'smithi152' 2024-09-12T01:45:02.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.285+0000 7f1aa672c640 1 -- 172.21.15.152:0/581935844 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1a880a2b20 msgr2=0x7f1a880a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:02.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.285+0000 7f1aa672c640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1a880a2b20 0x7f1a880a4fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1a940058c0 tx=0x7f1a94005850 comp rx=0 tx=0).stop 2024-09-12T01:45:02.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.285+0000 7f1aa672c640 1 -- 172.21.15.152:0/581935844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa0101c00 msgr2=0x7f1aa0198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:02.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.285+0000 7f1aa672c640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa0101c00 0x7f1aa0198010 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005ab0 tx=0x7f1a900042f0 comp rx=0 tx=0).stop 2024-09-12T01:45:02.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.285+0000 7f1aa672c640 1 -- 172.21.15.152:0/581935844 shutdown_connections 2024-09-12T01:45:02.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.285+0000 7f1aa672c640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1a880a2b20 0x7f1a880a4fe0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:02.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.285+0000 7f1aa672c640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1aa01037c0 0x7f1aa019f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:02.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.285+0000 7f1aa672c640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0102e00 0x7f1aa0198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:02.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.285+0000 7f1aa672c640 1 --2- 172.21.15.152:0/581935844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1aa0101c00 0x7f1aa0198010 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:02.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.285+0000 7f1aa672c640 1 -- 172.21.15.152:0/581935844 >> 172.21.15.152:0/581935844 conn(0x7f1aa00fd390 msgr2=0x7f1aa0106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:02.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.285+0000 7f1aa672c640 1 -- 172.21.15.152:0/581935844 shutdown_connections 2024-09-12T01:45:02.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:02.285+0000 7f1aa672c640 1 -- 172.21.15.152:0/581935844 wait complete. 2024-09-12T01:45:02.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:02 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:02 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:02 smithi152 ceph-mon[35055]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:02.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:02 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:02.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:02 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:02.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:02 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:02 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:02.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:02 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:02 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:02 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:02 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:02 smithi191 ceph-mon[35770]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:02 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:02 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:02 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:02 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:02 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:02 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:02 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:02 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:02 smithi070 ceph-mon[31177]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:02 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:02 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:02 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:02 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:02 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:02 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:02.915 DEBUG:teuthology.orchestra.run.smithi152:osd.1> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T01:45:02.918 INFO:tasks.cephadm:Deploying osd.2 on smithi191 with /dev/vg_nvme/lv_4... 2024-09-12T01:45:02.918 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:45:03.167 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:45:04.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:04 smithi191 ceph-mon[35770]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:04.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:04 smithi152 ceph-mon[35055]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:04.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:04 smithi070 ceph-mon[31177]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:05.263 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:45:04 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1[39427]: 2024-09-12T01:45:04.935+0000 7f5807ec8640 -1 osd.1 0 log_to_monitors true 2024-09-12T01:45:05.491 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:45:05.516 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi191:vg_nvme/lv_4 2024-09-12T01:45:05.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:05 smithi191 ceph-mon[35770]: from='osd.1 [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:45:05.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:05 smithi191 ceph-mon[35770]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:45:05.752 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:05 smithi152 ceph-mon[35055]: from='osd.1 [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:45:05.753 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:05 smithi152 ceph-mon[35055]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:45:05.756 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:45:05.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:05 smithi070 ceph-mon[31177]: from='osd.1 [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:45:05.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:05 smithi070 ceph-mon[31177]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:45:06.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.192+0000 7ffb61a29640 1 -- 172.21.15.191:0/3014057692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c102e00 msgr2=0x7ffb5c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:06.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.192+0000 7ffb61a29640 1 --2- 172.21.15.191:0/3014057692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c102e00 0x7ffb5c103280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009900 tx=0x7ffb4402a410 comp rx=0 tx=0).stop 2024-09-12T01:45:06.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.192+0000 7ffb61a29640 1 -- 172.21.15.191:0/3014057692 shutdown_connections 2024-09-12T01:45:06.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.192+0000 7ffb61a29640 1 --2- 172.21.15.191:0/3014057692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb5c1037c0 0x7ffb5c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:06.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.192+0000 7ffb61a29640 1 --2- 172.21.15.191:0/3014057692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c102e00 0x7ffb5c103280 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:06.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.192+0000 7ffb61a29640 1 --2- 172.21.15.191:0/3014057692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb5c101c00 0x7ffb5c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:06.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.192+0000 7ffb61a29640 1 -- 172.21.15.191:0/3014057692 >> 172.21.15.191:0/3014057692 conn(0x7ffb5c0fd390 msgr2=0x7ffb5c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:06.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.192+0000 7ffb61a29640 1 -- 172.21.15.191:0/3014057692 shutdown_connections 2024-09-12T01:45:06.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.192+0000 7ffb61a29640 1 -- 172.21.15.191:0/3014057692 wait complete. 2024-09-12T01:45:06.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.192+0000 7ffb61a29640 1 Processor -- start 2024-09-12T01:45:06.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.192+0000 7ffb61a29640 1 -- start start 2024-09-12T01:45:06.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb61a29640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb5c101c00 0x7ffb5c197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:06.194 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb61a29640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c102e00 0x7ffb5c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb61a29640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb5c1037c0 0x7ffb5c19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb61a29640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c10d9c0 con 0x7ffb5c1037c0 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb61a29640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c10d840 con 0x7ffb5c101c00 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb61a29640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c10db40 con 0x7ffb5c102e00 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb527fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c102e00 0x7ffb5c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb527fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c102e00 0x7ffb5c1984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:39904/0 (socket says 172.21.15.191:39904) 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb527fc640 1 -- 172.21.15.191:0/357383548 learned_addr learned my addr 172.21.15.191:0/357383548 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb5b7fe640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb5c1037c0 0x7ffb5c19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb5affd640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb5c101c00 0x7ffb5c197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb527fc640 1 -- 172.21.15.191:0/357383548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb5c101c00 msgr2=0x7ffb5c197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb527fc640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb5c101c00 0x7ffb5c197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb527fc640 1 -- 172.21.15.191:0/357383548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb5c1037c0 msgr2=0x7ffb5c19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb527fc640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb5c1037c0 0x7ffb5c19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:06.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb527fc640 1 -- 172.21.15.191:0/357383548 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c19fbb0 con 0x7ffb5c102e00 2024-09-12T01:45:06.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb5affd640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb5c101c00 0x7ffb5c197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:45:06.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb527fc640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c102e00 0x7ffb5c1984c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009a20 tx=0x7ffb44004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:06.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb60a27640 1 -- 172.21.15.191:0/357383548 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4403f030 con 0x7ffb5c102e00 2024-09-12T01:45:06.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.193+0000 7ffb60a27640 1 -- 172.21.15.191:0/357383548 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb44003dc0 con 0x7ffb5c102e00 2024-09-12T01:45:06.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.194+0000 7ffb61a29640 1 -- 172.21.15.191:0/357383548 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5c19fe40 con 0x7ffb5c102e00 2024-09-12T01:45:06.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.194+0000 7ffb60a27640 1 -- 172.21.15.191:0/357383548 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44035070 con 0x7ffb5c102e00 2024-09-12T01:45:06.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.194+0000 7ffb61a29640 1 -- 172.21.15.191:0/357383548 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5c1a0290 con 0x7ffb5c102e00 2024-09-12T01:45:06.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.195+0000 7ffb61a29640 1 -- 172.21.15.191:0/357383548 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5c108fb0 con 0x7ffb5c102e00 2024-09-12T01:45:06.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.196+0000 7ffb60a27640 1 -- 172.21.15.191:0/357383548 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7ffb44042030 con 0x7ffb5c102e00 2024-09-12T01:45:06.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.196+0000 7ffb60a27640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffb480a2b20 0x7ffb480a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:06.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.196+0000 7ffb60a27640 1 -- 172.21.15.191:0/357383548 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7ffb440edab0 con 0x7ffb5c102e00 2024-09-12T01:45:06.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.196+0000 7ffb5affd640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffb480a2b20 0x7ffb480a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:06.197 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.197+0000 7ffb5affd640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffb480a2b20 0x7ffb480a4fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c102c60 tx=0x7ffb4c005db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:06.200 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.201+0000 7ffb60a27640 1 -- 172.21.15.191:0/357383548 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb440bc400 con 0x7ffb5c102e00 2024-09-12T01:45:06.376 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:06.376+0000 7ffb61a29640 1 -- 172.21.15.191:0/357383548 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ffb5c062630 con 0x7ffb480a2b20 2024-09-12T01:45:06.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:06.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:45:06.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:45:06.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:06.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='osd.1 [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:45:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:45:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:45:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:45:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:45:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:45:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:45:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='osd.1 [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:45:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:45:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:45:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:06.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:06.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:06.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:06.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:45:06.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:45:06.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='osd.1 [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:06.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:06.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:45:06.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:45:06.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:07.512 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:45:07 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1[39427]: 2024-09-12T01:45:07.253+0000 7f5803628640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T01:45:07.512 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:45:07 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1[39427]: 2024-09-12T01:45:07.261+0000 7f57fbc5a640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:45:07.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:07 smithi152 ceph-mon[35055]: Detected new or changed devices on smithi152 2024-09-12T01:45:07.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:07 smithi152 ceph-mon[35055]: Adjusting osd_memory_target on smithi152 to 17088M 2024-09-12T01:45:07.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:07 smithi152 ceph-mon[35055]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:07.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:07 smithi152 ceph-mon[35055]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-12T01:45:07.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:07 smithi152 ceph-mon[35055]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:45:07.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:07.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:07.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:07 smithi152 ceph-mon[35055]: from='osd.1 ' entity='osd.1' 2024-09-12T01:45:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:07 smithi070 ceph-mon[31177]: Detected new or changed devices on smithi152 2024-09-12T01:45:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:07 smithi070 ceph-mon[31177]: Adjusting osd_memory_target on smithi152 to 17088M 2024-09-12T01:45:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:07 smithi070 ceph-mon[31177]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:07 smithi070 ceph-mon[31177]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-12T01:45:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:07 smithi070 ceph-mon[31177]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:45:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:07 smithi070 ceph-mon[31177]: from='osd.1 ' entity='osd.1' 2024-09-12T01:45:07.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:07 smithi191 ceph-mon[35770]: Detected new or changed devices on smithi152 2024-09-12T01:45:07.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:07 smithi191 ceph-mon[35770]: Adjusting osd_memory_target on smithi152 to 17088M 2024-09-12T01:45:07.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:07 smithi191 ceph-mon[35770]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:07.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:07 smithi191 ceph-mon[35770]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-12T01:45:07.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:07 smithi191 ceph-mon[35770]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:45:07.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:07.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:07.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:07 smithi191 ceph-mon[35770]: from='osd.1 ' entity='osd.1' 2024-09-12T01:45:08.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:08 smithi152 ceph-mon[35055]: purged_snaps scrub starts 2024-09-12T01:45:08.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:08 smithi152 ceph-mon[35055]: purged_snaps scrub ok 2024-09-12T01:45:08.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:08 smithi152 ceph-mon[35055]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:08.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:08.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:08 smithi152 ceph-mon[35055]: osd.1 [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241] boot 2024-09-12T01:45:08.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:08 smithi152 ceph-mon[35055]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T01:45:08.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:08 smithi070 ceph-mon[31177]: purged_snaps scrub starts 2024-09-12T01:45:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:08 smithi070 ceph-mon[31177]: purged_snaps scrub ok 2024-09-12T01:45:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:08 smithi070 ceph-mon[31177]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:08 smithi070 ceph-mon[31177]: osd.1 [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241] boot 2024-09-12T01:45:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:08 smithi070 ceph-mon[31177]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T01:45:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:08.826 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:08 smithi191 ceph-mon[35770]: purged_snaps scrub starts 2024-09-12T01:45:08.826 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:08 smithi191 ceph-mon[35770]: purged_snaps scrub ok 2024-09-12T01:45:08.826 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:08 smithi191 ceph-mon[35770]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:45:08.826 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:08.826 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:08 smithi191 ceph-mon[35770]: osd.1 [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241] boot 2024-09-12T01:45:08.826 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:08 smithi191 ceph-mon[35770]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T01:45:08.826 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:45:09.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:09 smithi152 ceph-mon[35055]: from='client.? 172.21.15.191:0/3247807562' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87e4206e-8a05-4e9c-ac94-0d55652e9263"}]: dispatch 2024-09-12T01:45:09.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:09 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87e4206e-8a05-4e9c-ac94-0d55652e9263"}]: dispatch 2024-09-12T01:45:09.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:09 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87e4206e-8a05-4e9c-ac94-0d55652e9263"}]': finished 2024-09-12T01:45:09.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:09 smithi152 ceph-mon[35055]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T01:45:09.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:09.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:09 smithi152 ceph-mon[35055]: from='client.? 172.21.15.191:0/2480943866' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:45:09.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:09 smithi070 ceph-mon[31177]: from='client.? 172.21.15.191:0/3247807562' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87e4206e-8a05-4e9c-ac94-0d55652e9263"}]: dispatch 2024-09-12T01:45:09.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:09 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87e4206e-8a05-4e9c-ac94-0d55652e9263"}]: dispatch 2024-09-12T01:45:09.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:09 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87e4206e-8a05-4e9c-ac94-0d55652e9263"}]': finished 2024-09-12T01:45:09.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:09 smithi070 ceph-mon[31177]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T01:45:09.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:09.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:09 smithi070 ceph-mon[31177]: from='client.? 172.21.15.191:0/2480943866' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:45:09.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:09 smithi191 ceph-mon[35770]: from='client.? 172.21.15.191:0/3247807562' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87e4206e-8a05-4e9c-ac94-0d55652e9263"}]: dispatch 2024-09-12T01:45:09.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:09 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87e4206e-8a05-4e9c-ac94-0d55652e9263"}]: dispatch 2024-09-12T01:45:09.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:09 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87e4206e-8a05-4e9c-ac94-0d55652e9263"}]': finished 2024-09-12T01:45:09.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:09 smithi191 ceph-mon[35770]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T01:45:09.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:09.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:09 smithi191 ceph-mon[35770]: from='client.? 172.21.15.191:0/2480943866' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:45:10.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:10 smithi152 ceph-mon[35055]: pgmap v58: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:10.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:10 smithi152 ceph-mon[35055]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T01:45:10.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:10 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:10.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:10 smithi070 ceph-mon[31177]: pgmap v58: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:10.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:10 smithi070 ceph-mon[31177]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T01:45:10.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:10 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:10.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:10 smithi191 ceph-mon[35770]: pgmap v58: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:10.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:10 smithi191 ceph-mon[35770]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T01:45:10.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:10 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:12 smithi152 ceph-mon[35055]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:12.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:12 smithi070 ceph-mon[31177]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:12.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:12 smithi191 ceph-mon[35770]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:14.607 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:14 smithi191 ceph-mon[35770]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:14.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:14 smithi070 ceph-mon[31177]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:15.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:14 smithi152 ceph-mon[35055]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:16.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:16 smithi191 ceph-mon[35770]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:16.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:16 smithi070 ceph-mon[31177]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:17.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:16 smithi152 ceph-mon[35055]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:17.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:17 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:45:17.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:17 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:18.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:17 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:45:18.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:17 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:18.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:17 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:45:18.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:17 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:18.625 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:18 smithi191 ceph-mon[35770]: Deploying daemon osd.2 on smithi191 2024-09-12T01:45:18.626 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:18 smithi191 ceph-mon[35770]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:19.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:18 smithi152 ceph-mon[35055]: Deploying daemon osd.2 on smithi191 2024-09-12T01:45:19.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:18 smithi152 ceph-mon[35055]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:19.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:18 smithi070 ceph-mon[31177]: Deploying daemon osd.2 on smithi191 2024-09-12T01:45:19.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:18 smithi070 ceph-mon[31177]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:20 smithi191 ceph-mon[35770]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:20.821 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:20 smithi070 ceph-mon[31177]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:21.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:20 smithi152 ceph-mon[35055]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:22.583 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:22 smithi191 ceph-mon[35770]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:23.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:22 smithi152 ceph-mon[35055]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:23.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:22 smithi070 ceph-mon[31177]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:23.831 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:23 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:23.831 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:23 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:23.831 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:23 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:24.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:23 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:24.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:23 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:24.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:23 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:24.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:23 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:24.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:23 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:24.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:23 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:24.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:24 smithi191 ceph-mon[35770]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:25.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:24 smithi152 ceph-mon[35055]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:25.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:24 smithi070 ceph-mon[31177]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:26.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:26 smithi191 ceph-mon[35770]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:26.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:26 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:26.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:26 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:26.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:26 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:26.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:26 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:26.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:26 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:26.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:26 smithi152 ceph-mon[35055]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:26.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:26 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:26.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:26 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:26.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:26 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:26.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:26 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:26.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:26 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:26.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:26 smithi070 ceph-mon[31177]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:26.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:26 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:26.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:26 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:26.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:26 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:26.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:26 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:26.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:26 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:27.193 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.193+0000 7ffb60a27640 1 -- 172.21.15.191:0/357383548 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ffb5c062630 con 0x7ffb480a2b20 2024-09-12T01:45:27.193 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 2 on host 'smithi191' 2024-09-12T01:45:27.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.195+0000 7ffb61a29640 1 -- 172.21.15.191:0/357383548 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffb480a2b20 msgr2=0x7ffb480a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:27.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.195+0000 7ffb61a29640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffb480a2b20 0x7ffb480a4fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c102c60 tx=0x7ffb4c005db0 comp rx=0 tx=0).stop 2024-09-12T01:45:27.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.195+0000 7ffb61a29640 1 -- 172.21.15.191:0/357383548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c102e00 msgr2=0x7ffb5c1984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:27.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.195+0000 7ffb61a29640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c102e00 0x7ffb5c1984c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009a20 tx=0x7ffb44004430 comp rx=0 tx=0).stop 2024-09-12T01:45:27.195 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.195+0000 7ffb61a29640 1 -- 172.21.15.191:0/357383548 shutdown_connections 2024-09-12T01:45:27.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.195+0000 7ffb61a29640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffb480a2b20 0x7ffb480a4fe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:27.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.195+0000 7ffb61a29640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb5c1037c0 0x7ffb5c19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:27.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.195+0000 7ffb61a29640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c102e00 0x7ffb5c1984c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:27.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.195+0000 7ffb61a29640 1 --2- 172.21.15.191:0/357383548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb5c101c00 0x7ffb5c197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:27.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.195+0000 7ffb61a29640 1 -- 172.21.15.191:0/357383548 >> 172.21.15.191:0/357383548 conn(0x7ffb5c0fd390 msgr2=0x7ffb5c106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:27.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.195+0000 7ffb61a29640 1 -- 172.21.15.191:0/357383548 shutdown_connections 2024-09-12T01:45:27.196 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:45:27.195+0000 7ffb61a29640 1 -- 172.21.15.191:0/357383548 wait complete. 2024-09-12T01:45:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:27 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:27 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:27 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:27.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:27 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:27.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:27 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:27.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:27 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:27.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:27 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:27.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:27 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:27.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:27 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:27.810 DEBUG:teuthology.orchestra.run.smithi191:osd.2> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T01:45:27.812 INFO:tasks.cephadm:Deploying osd.3 on smithi070 with /dev/vg_nvme/lv_3... 2024-09-12T01:45:27.813 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:45:28.067 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:45:28.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:28 smithi070 ceph-mon[31177]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:28.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:28 smithi191 ceph-mon[35770]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:28.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:28 smithi152 ceph-mon[35055]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:29.794 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:45:29 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2[40746]: 2024-09-12T01:45:29.535+0000 7f964b7dc640 -1 osd.2 0 log_to_monitors true 2024-09-12T01:45:30.182 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:45:30.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_3 2024-09-12T01:45:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:45:30.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:30 smithi070 ceph-mon[31177]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:30.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:30 smithi070 ceph-mon[31177]: from='osd.2 [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:45:30.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:30 smithi070 ceph-mon[31177]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:45:30.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:30.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:30.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:45:30.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:30.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:30.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:30.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:30.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:30 smithi152 ceph-mon[35055]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:30.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:30 smithi152 ceph-mon[35055]: from='osd.2 [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:45:30.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:30 smithi152 ceph-mon[35055]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:45:30.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:30.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:45:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:30.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.917+0000 7f77fb3af640 1 -- 172.21.15.70:0/1945883180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77f4102690 msgr2=0x7f77f4108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.917+0000 7f77fb3af640 1 --2- 172.21.15.70:0/1945883180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77f4102690 0x7f77f4108f20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009ca0 tx=0x7f77ec02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:45:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.917+0000 7f77fb3af640 1 -- 172.21.15.70:0/1945883180 shutdown_connections 2024-09-12T01:45:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.917+0000 7f77fb3af640 1 --2- 172.21.15.70:0/1945883180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77f4102690 0x7f77f4108f20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.917+0000 7f77fb3af640 1 --2- 172.21.15.70:0/1945883180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4101cd0 0x7f77f4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.917+0000 7f77fb3af640 1 --2- 172.21.15.70:0/1945883180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4100ad0 0x7f77f4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.918+0000 7f77fb3af640 1 -- 172.21.15.70:0/1945883180 >> 172.21.15.70:0/1945883180 conn(0x7f77f40fc280 msgr2=0x7f77f40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.918+0000 7f77fb3af640 1 -- 172.21.15.70:0/1945883180 shutdown_connections 2024-09-12T01:45:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.918+0000 7f77fb3af640 1 -- 172.21.15.70:0/1945883180 wait complete. 2024-09-12T01:45:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.918+0000 7f77fb3af640 1 Processor -- start 2024-09-12T01:45:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.918+0000 7f77fb3af640 1 -- start start 2024-09-12T01:45:30.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.918+0000 7f77fb3af640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4100ad0 0x7f77f41a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.918+0000 7f77fb3af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77f4101cd0 0x7f77f41a32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.918+0000 7f77fb3af640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4102690 0x7f77f41a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.918+0000 7f77fb3af640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77f410c890 con 0x7f77f4101cd0 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.918+0000 7f77fb3af640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f77f410c710 con 0x7f77f4100ad0 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.918+0000 7f77fb3af640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f77f410ca10 con 0x7f77f4102690 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77f894a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77f4101cd0 0x7f77f41a32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77f894a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77f4101cd0 0x7f77f41a32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54290/0 (socket says 172.21.15.70:54290) 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77f894a640 1 -- 172.21.15.70:0/3530815099 learned_addr learned my addr 172.21.15.70:0/3530815099 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77f914b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4100ad0 0x7f77f41a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77f994c640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4102690 0x7f77f41a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77f894a640 1 -- 172.21.15.70:0/3530815099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4102690 msgr2=0x7f77f41a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77f894a640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4102690 0x7f77f41a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:30.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77f894a640 1 -- 172.21.15.70:0/3530815099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4100ad0 msgr2=0x7f77f41a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77f894a640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4100ad0 0x7f77f41a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77f894a640 1 -- 172.21.15.70:0/3530815099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f41a6130 con 0x7f77f4101cd0 2024-09-12T01:45:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77f914b640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4100ad0 0x7f77f41a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:45:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77f894a640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77f4101cd0 0x7f77f41a32a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f77e400e9f0 tx=0x7f77e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77ea7fc640 1 -- 172.21.15.70:0/3530815099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e400cd80 con 0x7f77f4101cd0 2024-09-12T01:45:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77fb3af640 1 -- 172.21.15.70:0/3530815099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f41a6420 con 0x7f77f4101cd0 2024-09-12T01:45:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77ea7fc640 1 -- 172.21.15.70:0/3530815099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f77e4010930 con 0x7f77f4101cd0 2024-09-12T01:45:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77ea7fc640 1 -- 172.21.15.70:0/3530815099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4018b00 con 0x7f77f4101cd0 2024-09-12T01:45:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.919+0000 7f77fb3af640 1 -- 172.21.15.70:0/3530815099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f41a69b0 con 0x7f77f4101cd0 2024-09-12T01:45:30.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.921+0000 7f77fb3af640 1 -- 172.21.15.70:0/3530815099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f41a6cd0 con 0x7f77f4101cd0 2024-09-12T01:45:30.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.921+0000 7f77ea7fc640 1 -- 172.21.15.70:0/3530815099 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f77e4018ca0 con 0x7f77f4101cd0 2024-09-12T01:45:30.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.922+0000 7f77ea7fc640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f77e00a2af0 0x7f77e00a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:30.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.922+0000 7f77f914b640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f77e00a2af0 0x7f77e00a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:30.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.923+0000 7f77ea7fc640 1 -- 172.21.15.70:0/3530815099 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2445+0+0 (secure 0 0 0) 0x7f77e40cdbc0 con 0x7f77f4101cd0 2024-09-12T01:45:30.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.923+0000 7f77f914b640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f77e00a2af0 0x7f77e00a4fb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f77f4109310 tx=0x7f77f0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:30.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:30.927+0000 7f77ea7fc640 1 -- 172.21.15.70:0/3530815099 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77e409bca0 con 0x7f77f4101cd0 2024-09-12T01:45:30.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:30 smithi191 ceph-mon[35770]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:30.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:30 smithi191 ceph-mon[35770]: from='osd.2 [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:45:30.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:30 smithi191 ceph-mon[35770]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:45:30.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:30.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:30.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:45:30.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:30.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:30.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:30.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:31.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:31.123+0000 7f77fb3af640 1 -- 172.21.15.70:0/3530815099 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f77f41a6ea0 con 0x7f77e00a2af0 2024-09-12T01:45:31.705 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:31 smithi070 ceph-mon[31177]: Detected new or changed devices on smithi191 2024-09-12T01:45:31.705 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:31 smithi070 ceph-mon[31177]: Adjusting osd_memory_target on smithi191 to 17088M 2024-09-12T01:45:31.705 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:31 smithi070 ceph-mon[31177]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:45:31.705 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:31 smithi070 ceph-mon[31177]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:45:31.705 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:31 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:31.705 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:31 smithi070 ceph-mon[31177]: from='osd.2 [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:45:31.706 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:31 smithi070 ceph-mon[31177]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:45:31.706 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:31 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:45:31.706 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:31 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:45:31.706 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:31 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:31.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:31 smithi152 ceph-mon[35055]: Detected new or changed devices on smithi191 2024-09-12T01:45:31.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:31 smithi152 ceph-mon[35055]: Adjusting osd_memory_target on smithi191 to 17088M 2024-09-12T01:45:31.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:31 smithi152 ceph-mon[35055]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:45:31.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:31 smithi152 ceph-mon[35055]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:45:31.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:31 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:31.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:31 smithi152 ceph-mon[35055]: from='osd.2 [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:45:31.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:31 smithi152 ceph-mon[35055]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:45:31.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:31 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:45:31.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:31 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:45:31.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:31 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:31.820 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:31 smithi191 ceph-mon[35770]: Detected new or changed devices on smithi191 2024-09-12T01:45:31.820 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:31 smithi191 ceph-mon[35770]: Adjusting osd_memory_target on smithi191 to 17088M 2024-09-12T01:45:31.820 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:31 smithi191 ceph-mon[35770]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:45:31.820 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:31 smithi191 ceph-mon[35770]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:45:31.820 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:31 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:31.820 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:31 smithi191 ceph-mon[35770]: from='osd.2 [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:45:31.820 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:31 smithi191 ceph-mon[35770]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:45:31.820 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:31 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:45:31.820 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:31 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:45:31.821 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:31 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:32.437 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:45:32 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2[40746]: 2024-09-12T01:45:32.236+0000 7f9647f73640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T01:45:32.438 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:45:32 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2[40746]: 2024-09-12T01:45:32.242+0000 7f963f56e640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:45:32.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:32 smithi070 ceph-mon[31177]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:32.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:32 smithi070 ceph-mon[31177]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:32.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:32 smithi070 ceph-mon[31177]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-12T01:45:32.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:32 smithi070 ceph-mon[31177]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T01:45:32.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:32.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:32.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:32 smithi070 ceph-mon[31177]: from='osd.2 ' entity='osd.2' 2024-09-12T01:45:32.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:32 smithi152 ceph-mon[35055]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:32.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:32 smithi152 ceph-mon[35055]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:32.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:32 smithi152 ceph-mon[35055]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-12T01:45:32.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:32 smithi152 ceph-mon[35055]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T01:45:32.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:32.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:32.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:32 smithi152 ceph-mon[35055]: from='osd.2 ' entity='osd.2' 2024-09-12T01:45:32.901 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:32 smithi191 ceph-mon[35770]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:32.902 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:32 smithi191 ceph-mon[35770]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:32.902 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:32 smithi191 ceph-mon[35770]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-12T01:45:32.902 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:32 smithi191 ceph-mon[35770]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T01:45:32.902 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:32.902 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:32.902 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:32 smithi191 ceph-mon[35770]: from='osd.2 ' entity='osd.2' 2024-09-12T01:45:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:33 smithi152 ceph-mon[35055]: purged_snaps scrub starts 2024-09-12T01:45:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:33 smithi152 ceph-mon[35055]: purged_snaps scrub ok 2024-09-12T01:45:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:33 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:33 smithi152 ceph-mon[35055]: osd.2 [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083] boot 2024-09-12T01:45:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:33 smithi152 ceph-mon[35055]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T01:45:34.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:33 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:34.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:33 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1061843130' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e03f26a7-5373-473a-a56d-978c040682b3"}]: dispatch 2024-09-12T01:45:34.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:33 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1061843130' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e03f26a7-5373-473a-a56d-978c040682b3"}]': finished 2024-09-12T01:45:34.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:33 smithi152 ceph-mon[35055]: osdmap e19: 4 total, 3 up, 4 in 2024-09-12T01:45:34.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:33 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:34.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:33 smithi070 ceph-mon[31177]: purged_snaps scrub starts 2024-09-12T01:45:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:33 smithi070 ceph-mon[31177]: purged_snaps scrub ok 2024-09-12T01:45:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:33 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:33 smithi070 ceph-mon[31177]: osd.2 [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083] boot 2024-09-12T01:45:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:33 smithi070 ceph-mon[31177]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T01:45:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:33 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:33 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1061843130' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e03f26a7-5373-473a-a56d-978c040682b3"}]: dispatch 2024-09-12T01:45:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:33 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1061843130' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e03f26a7-5373-473a-a56d-978c040682b3"}]': finished 2024-09-12T01:45:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:33 smithi070 ceph-mon[31177]: osdmap e19: 4 total, 3 up, 4 in 2024-09-12T01:45:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:33 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:34.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:33 smithi191 ceph-mon[35770]: purged_snaps scrub starts 2024-09-12T01:45:34.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:33 smithi191 ceph-mon[35770]: purged_snaps scrub ok 2024-09-12T01:45:34.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:33 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:34.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:33 smithi191 ceph-mon[35770]: osd.2 [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083] boot 2024-09-12T01:45:34.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:33 smithi191 ceph-mon[35770]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T01:45:34.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:33 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:45:34.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:33 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1061843130' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e03f26a7-5373-473a-a56d-978c040682b3"}]: dispatch 2024-09-12T01:45:34.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:33 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1061843130' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e03f26a7-5373-473a-a56d-978c040682b3"}]': finished 2024-09-12T01:45:34.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:33 smithi191 ceph-mon[35770]: osdmap e19: 4 total, 3 up, 4 in 2024-09-12T01:45:34.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:33 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:34 smithi152 ceph-mon[35055]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:34 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:45:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:34 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3837758923' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:45:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:34 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T01:45:35.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:34 smithi152 ceph-mon[35055]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T01:45:35.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:34 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:35.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:34 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:45:35.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:34 smithi070 ceph-mon[31177]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:45:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:34 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3837758923' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:45:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T01:45:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:34 smithi070 ceph-mon[31177]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T01:45:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:45:35.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:34 smithi191 ceph-mon[35770]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T01:45:35.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:34 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:45:35.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:34 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3837758923' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:45:35.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:34 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T01:45:35.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:34 smithi191 ceph-mon[35770]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T01:45:35.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:34 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:35.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:34 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:45:36.061 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:45:35 smithi070 sudo[49756]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:45:36.061 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:45:35 smithi070 sudo[49756]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:45:36.062 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:45:35 smithi070 sudo[49756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:45:36.062 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:45:35 smithi070 sudo[49756]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:45:36.461 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:45:36 smithi070 sudo[49762]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:45:36.461 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:45:36 smithi070 sudo[49762]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:45:36.461 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:45:36 smithi070 sudo[49762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:45:36.461 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:45:36 smithi070 sudo[49762]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:45:36.590 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:45:36 smithi152 sudo[43698]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:45:36.590 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:45:36 smithi152 sudo[43698]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:45:36.590 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:45:36 smithi152 sudo[43698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:45:36.590 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:45:36 smithi152 sudo[43698]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:45:36.591 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:36 smithi152 ceph-mon[35055]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:36.591 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:36 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:45:36.591 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:36 smithi152 ceph-mon[35055]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T01:45:36.591 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:36 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:36.591 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:36 smithi152 ceph-mon[35055]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:45:36.591 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:36 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:36.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:36 smithi070 ceph-mon[31177]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:36.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:36 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:45:36.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:36 smithi070 ceph-mon[31177]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T01:45:36.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:36 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:36.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:36 smithi070 ceph-mon[31177]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:45:36.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:36 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:36.860 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:36 smithi191 ceph-mon[35770]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:36.860 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:36 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:45:36.860 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:36 smithi191 ceph-mon[35770]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T01:45:36.860 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:36 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:36.860 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:36 smithi191 ceph-mon[35770]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:45:36.860 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:36 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:37.012 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:45:36 smithi152 sudo[43701]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:45:37.012 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:45:36 smithi152 sudo[43701]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:45:37.012 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:45:36 smithi152 sudo[43701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:45:37.012 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:45:36 smithi152 sudo[43701]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:45:37.116 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:45:36 smithi191 sudo[44823]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:45:37.116 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:45:36 smithi191 sudo[44823]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:45:37.116 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:45:36 smithi191 sudo[44823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:45:37.116 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:45:36 smithi191 sudo[44823]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:45:37.437 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:45:37 smithi191 sudo[44826]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:45:37.437 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:45:37 smithi191 sudo[44826]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:45:37.438 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:45:37 smithi191 sudo[44826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:45:37.438 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:45:37 smithi191 sudo[44826]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:45:37.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 sudo[50141]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:45:37.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 sudo[50141]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:45:37.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 sudo[50141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:45:37.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 sudo[50141]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:45:37.911 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:37 smithi191 ceph-mon[35770]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T01:45:37.911 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:37.911 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:37.911 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:37.911 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:37 smithi191 ceph-mon[35770]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:45:37.911 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:37 smithi191 sudo[44829]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:45:37.911 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:37 smithi191 sudo[44829]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:45:37.911 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:37 smithi191 sudo[44829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:45:37.912 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:37 smithi191 sudo[44829]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:45:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:37 smithi152 ceph-mon[35055]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T01:45:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:37 smithi152 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:45:38.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 sudo[50329]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:45:38.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 sudo[50329]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:45:38.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 sudo[50329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:45:38.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 sudo[50329]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:45:38.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 ceph-mon[31177]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T01:45:38.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:38.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:38.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:38.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:37 smithi070 ceph-mon[31177]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:45:38.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 sudo[44832]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:45:38.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 sudo[44832]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:45:38.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 sudo[44832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:45:38.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 sudo[44832]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:45:38.645 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 sudo[43704]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:45:38.645 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 sudo[43704]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:45:38.646 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 sudo[43704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:45:38.646 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 sudo[43704]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:45:38.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:38.660+0000 7f77ea7fc640 1 -- 172.21.15.70:0/3530815099 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f77e4098310 con 0x7f77f4101cd0 2024-09-12T01:45:38.905 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:38.905 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:45:38.905 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:45:38.905 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:45:38.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:45:38.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:45:38.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:45:38.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:45:38.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:45:38.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T01:45:38.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: Cluster is now healthy 2024-09-12T01:45:38.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:45:38.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:45:38.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:45:38.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:45:38.906 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:45:38.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:45:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:45:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:45:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:45:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:45:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:45:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:45:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:45:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T01:45:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: Cluster is now healthy 2024-09-12T01:45:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:45:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:45:38.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:45:38.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:45:38.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:38 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:45:39.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 sudo[43707]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:45:39.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 sudo[43707]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:45:39.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 sudo[43707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:45:39.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 sudo[43707]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:45:39.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 97 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:39.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:45:39.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:45:39.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:45:39.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:45:39.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:45:39.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:45:39.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:45:39.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:45:39.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T01:45:39.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: Cluster is now healthy 2024-09-12T01:45:39.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:45:39.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:45:39.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T01:45:39.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T01:45:39.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:38 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T01:45:39.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:39 smithi191 ceph-mon[35770]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:45:39.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:39 smithi191 ceph-mon[35770]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T01:45:39.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:39 smithi191 ceph-mon[35770]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:39.949 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:39 smithi070 ceph-mon[31177]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:45:39.949 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:39 smithi070 ceph-mon[31177]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T01:45:39.949 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:39 smithi070 ceph-mon[31177]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:40.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:39 smithi152 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:45:40.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:39 smithi152 ceph-mon[35055]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T01:45:40.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:39 smithi152 ceph-mon[35055]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:42.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:42 smithi191 ceph-mon[35770]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:45:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:42.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:42 smithi152 ceph-mon[35055]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:42.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:45:42.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:42 smithi070 ceph-mon[31177]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:45:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:43.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:43 smithi070 ceph-mon[31177]: Deploying daemon osd.3 on smithi070 2024-09-12T01:45:43.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:43 smithi152 ceph-mon[35055]: Deploying daemon osd.3 on smithi070 2024-09-12T01:45:43.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:43 smithi191 ceph-mon[35770]: Deploying daemon osd.3 on smithi070 2024-09-12T01:45:44.751 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:44 smithi070 ceph-mon[31177]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:44.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:44 smithi152 ceph-mon[35055]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:44.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:44 smithi191 ceph-mon[35770]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:46.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:46 smithi070 ceph-mon[31177]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-12T01:45:46.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:46 smithi152 ceph-mon[35055]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-12T01:45:46.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:46 smithi191 ceph-mon[35770]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-12T01:45:48.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:48 smithi152 ceph-mon[35055]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-12T01:45:48.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:48 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:48.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:48 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:48.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:48 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:48.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:48 smithi070 ceph-mon[31177]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-12T01:45:48.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:48 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:48.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:48 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:48.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:48 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:48 smithi191 ceph-mon[35770]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-12T01:45:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:48 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:48.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:48 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:48.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:48 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:50.541 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:50 smithi070 ceph-mon[31177]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T01:45:50.541 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:50 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:50.541 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:50 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:50.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:50 smithi152 ceph-mon[35055]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T01:45:50.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:50 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:50.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:50 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:50.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:50 smithi191 ceph-mon[35770]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T01:45:50.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:50 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:50.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:50 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:51.515 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:51 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:51.516 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:51 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:51.516 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:51 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:51.516 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 3 on host 'smithi070' 2024-09-12T01:45:51.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.514+0000 7f77ea7fc640 1 -- 172.21.15.70:0/3530815099 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f77f41a6ea0 con 0x7f77e00a2af0 2024-09-12T01:45:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.517+0000 7f77fb3af640 1 -- 172.21.15.70:0/3530815099 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f77e00a2af0 msgr2=0x7f77e00a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.517+0000 7f77fb3af640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f77e00a2af0 0x7f77e00a4fb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f77f4109310 tx=0x7f77f0005f90 comp rx=0 tx=0).stop 2024-09-12T01:45:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.517+0000 7f77fb3af640 1 -- 172.21.15.70:0/3530815099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77f4101cd0 msgr2=0x7f77f41a32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.517+0000 7f77fb3af640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77f4101cd0 0x7f77f41a32a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f77e400e9f0 tx=0x7f77e400eeb0 comp rx=0 tx=0).stop 2024-09-12T01:45:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.517+0000 7f77fb3af640 1 -- 172.21.15.70:0/3530815099 shutdown_connections 2024-09-12T01:45:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.517+0000 7f77fb3af640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f77e00a2af0 0x7f77e00a4fb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.517+0000 7f77fb3af640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77f4102690 0x7f77f41a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.517+0000 7f77fb3af640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77f4101cd0 0x7f77f41a32a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.517+0000 7f77fb3af640 1 --2- 172.21.15.70:0/3530815099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f4100ad0 0x7f77f41a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.517+0000 7f77fb3af640 1 -- 172.21.15.70:0/3530815099 >> 172.21.15.70:0/3530815099 conn(0x7f77f40fc280 msgr2=0x7f77f40fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.517+0000 7f77fb3af640 1 -- 172.21.15.70:0/3530815099 shutdown_connections 2024-09-12T01:45:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:45:51.517+0000 7f77fb3af640 1 -- 172.21.15.70:0/3530815099 wait complete. 2024-09-12T01:45:51.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:51 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:51.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:51 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:51.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:51 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:51.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:51 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:51.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:51 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:51.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:51 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:52.081 DEBUG:teuthology.orchestra.run.smithi070:osd.3> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T01:45:52.084 INFO:tasks.cephadm:Deploying osd.4 on smithi152 with /dev/vg_nvme/lv_3... 2024-09-12T01:45:52.084 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:45:52.342 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:45:52.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:52 smithi152 ceph-mon[35055]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T01:45:52.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:52.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:52.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:52.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:52 smithi070 ceph-mon[31177]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T01:45:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:52.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:52 smithi191 ceph-mon[35770]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T01:45:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:53.769 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:45:53 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3[51367]: 2024-09-12T01:45:53.637+0000 7f7f9be47640 -1 osd.3 0 log_to_monitors true 2024-09-12T01:45:54.658 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:54 smithi070 ceph-mon[31177]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T01:45:54.659 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:54 smithi070 ceph-mon[31177]: from='osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:45:54.664 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:54 smithi152 ceph-mon[35055]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T01:45:54.665 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:54 smithi152 ceph-mon[35055]: from='osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:45:54.668 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:45:54.695 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_3 2024-09-12T01:45:54.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:54 smithi191 ceph-mon[35770]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-12T01:45:54.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:54 smithi191 ceph-mon[35770]: from='osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:45:54.947 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:45:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.370+0000 7effaceec640 1 -- 172.21.15.152:0/1921598089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effa8102690 msgr2=0x7effa8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.370+0000 7effaceec640 1 --2- 172.21.15.152:0/1921598089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effa8102690 0x7effa8108f20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7effa0009be0 tx=0x7effa002a6c0 comp rx=0 tx=0).stop 2024-09-12T01:45:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.370+0000 7effaceec640 1 -- 172.21.15.152:0/1921598089 shutdown_connections 2024-09-12T01:45:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.370+0000 7effaceec640 1 --2- 172.21.15.152:0/1921598089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effa8102690 0x7effa8108f20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.370+0000 7effaceec640 1 --2- 172.21.15.152:0/1921598089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa8101cd0 0x7effa8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:55.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.370+0000 7effaceec640 1 --2- 172.21.15.152:0/1921598089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa8100ad0 0x7effa8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.370+0000 7effaceec640 1 -- 172.21.15.152:0/1921598089 >> 172.21.15.152:0/1921598089 conn(0x7effa80fc280 msgr2=0x7effa80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.370+0000 7effaceec640 1 -- 172.21.15.152:0/1921598089 shutdown_connections 2024-09-12T01:45:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.370+0000 7effaceec640 1 -- 172.21.15.152:0/1921598089 wait complete. 2024-09-12T01:45:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.370+0000 7effaceec640 1 Processor -- start 2024-09-12T01:45:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effaceec640 1 -- start start 2024-09-12T01:45:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effaceec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa8100ad0 0x7effa819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effaceec640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa8101cd0 0x7effa819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effaceec640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effa8102690 0x7effa81a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effaceec640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7effa810c890 con 0x7effa8100ad0 2024-09-12T01:45:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effaceec640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7effa810c710 con 0x7effa8102690 2024-09-12T01:45:55.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effaceec640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7effa810ca10 con 0x7effa8101cd0 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effa6d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effa8102690 0x7effa81a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effa6d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effa8102690 0x7effa81a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36384/0 (socket says 172.21.15.152:36384) 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effa6d9d640 1 -- 172.21.15.152:0/1791270460 learned_addr learned my addr 172.21.15.152:0/1791270460 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effa659c640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa8100ad0 0x7effa819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effa5d9b640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa8101cd0 0x7effa819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effa6d9d640 1 -- 172.21.15.152:0/1791270460 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa8101cd0 msgr2=0x7effa819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effa6d9d640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa8101cd0 0x7effa819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effa6d9d640 1 -- 172.21.15.152:0/1791270460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa8100ad0 msgr2=0x7effa819a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effa6d9d640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa8100ad0 0x7effa819a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effa6d9d640 1 -- 172.21.15.152:0/1791270460 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa81a1d80 con 0x7effa8102690 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.371+0000 7effa6d9d640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effa8102690 0x7effa81a1710 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7effa0034040 tx=0x7effa0030650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.372+0000 7eff977fe640 1 -- 172.21.15.152:0/1791270460 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0041020 con 0x7effa8102690 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.372+0000 7eff977fe640 1 -- 172.21.15.152:0/1791270460 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7effa002f370 con 0x7effa8102690 2024-09-12T01:45:55.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.372+0000 7effaceec640 1 -- 172.21.15.152:0/1791270460 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa81a2010 con 0x7effa8102690 2024-09-12T01:45:55.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.372+0000 7eff977fe640 1 -- 172.21.15.152:0/1791270460 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0036040 con 0x7effa8102690 2024-09-12T01:45:55.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.372+0000 7effaceec640 1 -- 172.21.15.152:0/1791270460 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa81a24f0 con 0x7effa8102690 2024-09-12T01:45:55.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.373+0000 7effaceec640 1 -- 172.21.15.152:0/1791270460 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa81a2750 con 0x7effa8102690 2024-09-12T01:45:55.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.374+0000 7eff977fe640 1 -- 172.21.15.152:0/1791270460 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7effa0044020 con 0x7effa8102690 2024-09-12T01:45:55.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.374+0000 7eff977fe640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7eff900a2bb0 0x7eff900a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:55.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.375+0000 7eff977fe640 1 -- 172.21.15.152:0/1791270460 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3373+0+0 (secure 0 0 0) 0x7effa00ee890 con 0x7effa8102690 2024-09-12T01:45:55.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.375+0000 7effa659c640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7eff900a2bb0 0x7eff900a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:55.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.375+0000 7effa659c640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7eff900a2bb0 0x7eff900a5070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7effa8101b30 tx=0x7eff98005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:55.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.379+0000 7eff977fe640 1 -- 172.21.15.152:0/1791270460 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7effa004b030 con 0x7effa8102690 2024-09-12T01:45:55.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:45:55.560+0000 7effaceec640 1 -- 172.21.15.152:0/1791270460 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7effa80fe450 con 0x7eff900a2bb0 2024-09-12T01:45:55.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: from='osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:45:55.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T01:45:55.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: from='osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-12T01:45:55.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:55.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:55.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:55.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:45:55.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:45:55.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:55.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:55.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:55.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:55.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:55 smithi152 ceph-mon[35055]: from='osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-12T01:45:55.769 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3[51367]: 2024-09-12T01:45:55.502+0000 7f7f975a7640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T01:45:55.769 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3[51367]: 2024-09-12T01:45:55.507+0000 7f7f93be1640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: from='osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: from='osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:55.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:55 smithi070 ceph-mon[31177]: from='osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-12T01:45:55.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: from='osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:45:55.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T01:45:55.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: from='osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-12T01:45:55.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:55.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:55.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:55.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:45:55.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:45:55.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:55.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:55.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:55.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:45:55.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:55 smithi191 ceph-mon[35770]: from='osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-12T01:45:56.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:56 smithi152 ceph-mon[35055]: Detected new or changed devices on smithi070 2024-09-12T01:45:56.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:56 smithi152 ceph-mon[35055]: Adjusting osd_memory_target on smithi070 to 8544M 2024-09-12T01:45:56.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:56 smithi152 ceph-mon[35055]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:56.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:56 smithi152 ceph-mon[35055]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T01:45:56.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:56.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:56.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:45:56.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:45:56.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:56.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:56 smithi070 ceph-mon[31177]: Detected new or changed devices on smithi070 2024-09-12T01:45:56.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:56 smithi070 ceph-mon[31177]: Adjusting osd_memory_target on smithi070 to 8544M 2024-09-12T01:45:56.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:56 smithi070 ceph-mon[31177]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:56.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:56 smithi070 ceph-mon[31177]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T01:45:56.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:56.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:56.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:45:56.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:45:56.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:56.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:56 smithi191 ceph-mon[35770]: Detected new or changed devices on smithi070 2024-09-12T01:45:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:56 smithi191 ceph-mon[35770]: Adjusting osd_memory_target on smithi070 to 8544M 2024-09-12T01:45:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:56 smithi191 ceph-mon[35770]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:56 smithi191 ceph-mon[35770]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T01:45:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:45:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:45:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:57.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:57 smithi152 ceph-mon[35055]: purged_snaps scrub starts 2024-09-12T01:45:57.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:57 smithi152 ceph-mon[35055]: purged_snaps scrub ok 2024-09-12T01:45:57.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:57 smithi152 ceph-mon[35055]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:57.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:57 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:57.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:57 smithi152 ceph-mon[35055]: osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909] boot 2024-09-12T01:45:57.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:57 smithi152 ceph-mon[35055]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T01:45:57.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:57 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:57.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:57 smithi070 ceph-mon[31177]: purged_snaps scrub starts 2024-09-12T01:45:57.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:57 smithi070 ceph-mon[31177]: purged_snaps scrub ok 2024-09-12T01:45:57.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:57 smithi070 ceph-mon[31177]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:57.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:57 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:57.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:57 smithi070 ceph-mon[31177]: osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909] boot 2024-09-12T01:45:57.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:57 smithi070 ceph-mon[31177]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T01:45:57.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:57 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:57.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:57 smithi191 ceph-mon[35770]: purged_snaps scrub starts 2024-09-12T01:45:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:57 smithi191 ceph-mon[35770]: purged_snaps scrub ok 2024-09-12T01:45:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:57 smithi191 ceph-mon[35770]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:57 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:57 smithi191 ceph-mon[35770]: osd.3 [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909] boot 2024-09-12T01:45:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:57 smithi191 ceph-mon[35770]: osdmap e25: 4 total, 4 up, 4 in 2024-09-12T01:45:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:57 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:45:58.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:58 smithi152 ceph-mon[35055]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:58.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:58 smithi152 ceph-mon[35055]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T01:45:58.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:58 smithi152 ceph-mon[35055]: from='client.? 172.21.15.152:0/2365754724' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a"}]: dispatch 2024-09-12T01:45:58.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:58 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a"}]: dispatch 2024-09-12T01:45:58.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:58 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a"}]': finished 2024-09-12T01:45:58.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:58 smithi152 ceph-mon[35055]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T01:45:58.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:58 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:45:58.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:58 smithi152 ceph-mon[35055]: from='client.? 172.21.15.152:0/292224353' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:45:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:58 smithi070 ceph-mon[31177]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:58 smithi070 ceph-mon[31177]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T01:45:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:58 smithi070 ceph-mon[31177]: from='client.? 172.21.15.152:0/2365754724' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a"}]: dispatch 2024-09-12T01:45:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:58 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a"}]: dispatch 2024-09-12T01:45:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:58 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a"}]': finished 2024-09-12T01:45:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:58 smithi070 ceph-mon[31177]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T01:45:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:45:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:58 smithi070 ceph-mon[31177]: from='client.? 172.21.15.152:0/292224353' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:45:58.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:58 smithi191 ceph-mon[35770]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-12T01:45:58.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:58 smithi191 ceph-mon[35770]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T01:45:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:58 smithi191 ceph-mon[35770]: from='client.? 172.21.15.152:0/2365754724' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a"}]: dispatch 2024-09-12T01:45:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:58 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a"}]: dispatch 2024-09-12T01:45:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:58 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a"}]': finished 2024-09-12T01:45:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:58 smithi191 ceph-mon[35770]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T01:45:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:45:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:58 smithi191 ceph-mon[35770]: from='client.? 172.21.15.152:0/292224353' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:46:00.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:59 smithi191 ceph-mon[35770]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T01:46:00.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:59 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:00.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:45:59 smithi191 ceph-mon[35770]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-09-12T01:46:00.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:59 smithi152 ceph-mon[35055]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T01:46:00.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:59 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:00.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:45:59 smithi152 ceph-mon[35055]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-09-12T01:46:00.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:59 smithi070 ceph-mon[31177]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T01:46:00.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:59 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:00.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:45:59 smithi070 ceph-mon[31177]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-09-12T01:46:01.089 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:00 smithi191 ceph-mon[35770]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:46:01.089 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:00 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:01.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:00 smithi152 ceph-mon[35055]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:46:01.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:00 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:01.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:00 smithi070 ceph-mon[31177]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:46:01.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:00 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:02.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:01 smithi070 ceph-mon[31177]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:46:02.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:01 smithi191 ceph-mon[35770]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:46:02.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:01 smithi152 ceph-mon[35055]: pgmap v99: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:46:04.580 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:04 smithi152 ceph-mon[35055]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-12T01:46:04.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:04 smithi070 ceph-mon[31177]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-12T01:46:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:04 smithi191 ceph-mon[35770]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-12T01:46:06.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:06 smithi152 ceph-mon[35055]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-12T01:46:06.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:46:06.749 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:06 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:06 smithi070 ceph-mon[31177]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-12T01:46:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:46:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:06 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:06.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:06 smithi191 ceph-mon[35770]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-12T01:46:06.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:46:06.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:06 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:07.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:07 smithi152 ceph-mon[35055]: Deploying daemon osd.4 on smithi152 2024-09-12T01:46:07.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:07 smithi070 ceph-mon[31177]: Deploying daemon osd.4 on smithi152 2024-09-12T01:46:07.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:07 smithi191 ceph-mon[35770]: Deploying daemon osd.4 on smithi152 2024-09-12T01:46:08.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:08 smithi152 ceph-mon[35055]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:08 smithi070 ceph-mon[31177]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:08.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:08 smithi191 ceph-mon[35770]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:10 smithi152 ceph-mon[35055]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:10.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:10 smithi070 ceph-mon[31177]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:10.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:10 smithi191 ceph-mon[35770]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:12 smithi152 ceph-mon[35055]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:12.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:12 smithi070 ceph-mon[31177]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:12.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:12.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:12.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:12.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:12 smithi191 ceph-mon[35770]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:14.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:14 smithi152 ceph-mon[35055]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:14.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:14 smithi070 ceph-mon[31177]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:14.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:14 smithi191 ceph-mon[35770]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:16.195 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:15 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:16.195 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:15 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:16.195 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:15 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:16.195 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:15 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:16.195 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:15 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:16.195 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:15 smithi152 ceph-mon[35055]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:16.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.238+0000 7eff977fe640 1 -- 172.21.15.152:0/1791270460 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7effa80fe450 con 0x7eff900a2bb0 2024-09-12T01:46:16.239 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 4 on host 'smithi152' 2024-09-12T01:46:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.240+0000 7effaceec640 1 -- 172.21.15.152:0/1791270460 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7eff900a2bb0 msgr2=0x7eff900a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.240+0000 7effaceec640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7eff900a2bb0 0x7eff900a5070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7effa8101b30 tx=0x7eff98005f90 comp rx=0 tx=0).stop 2024-09-12T01:46:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.240+0000 7effaceec640 1 -- 172.21.15.152:0/1791270460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effa8102690 msgr2=0x7effa81a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.240+0000 7effaceec640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effa8102690 0x7effa81a1710 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7effa0034040 tx=0x7effa0030650 comp rx=0 tx=0).stop 2024-09-12T01:46:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.241+0000 7effaceec640 1 -- 172.21.15.152:0/1791270460 shutdown_connections 2024-09-12T01:46:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.241+0000 7effaceec640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7eff900a2bb0 0x7eff900a5070 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.241+0000 7effaceec640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effa8102690 0x7effa81a1710 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.241+0000 7effaceec640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa8101cd0 0x7effa819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.241+0000 7effaceec640 1 --2- 172.21.15.152:0/1791270460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effa8100ad0 0x7effa819a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:16.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.241+0000 7effaceec640 1 -- 172.21.15.152:0/1791270460 >> 172.21.15.152:0/1791270460 conn(0x7effa80fc280 msgr2=0x7effa80fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:16.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.241+0000 7effaceec640 1 -- 172.21.15.152:0/1791270460 shutdown_connections 2024-09-12T01:46:16.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:46:16.241+0000 7effaceec640 1 -- 172.21.15.152:0/1791270460 wait complete. 2024-09-12T01:46:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:15 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:15 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:15 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:15 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:15 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:15 smithi070 ceph-mon[31177]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:16.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:15 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:16.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:15 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:16.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:15 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:16.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:15 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:16.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:15 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:16.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:15 smithi191 ceph-mon[35770]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:16.850 DEBUG:teuthology.orchestra.run.smithi152:osd.4> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T01:46:16.852 INFO:tasks.cephadm:Deploying osd.5 on smithi191 with /dev/vg_nvme/lv_3... 2024-09-12T01:46:16.852 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:46:17.080 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:17.080 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:17.080 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:17.106 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:46:17.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:17.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:17.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:17.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:17.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:17.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:18.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:17 smithi152 ceph-mon[35055]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:18.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:17 smithi070 ceph-mon[31177]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:18.359 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:17 smithi191 ceph-mon[35770]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:18.762 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:46:18 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4[46386]: 2024-09-12T01:46:18.358+0000 7f318fb86640 -1 osd.4 0 log_to_monitors true 2024-09-12T01:46:19.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:18 smithi191 ceph-mon[35770]: from='osd.4 [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:46:19.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:18 smithi191 ceph-mon[35770]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:46:19.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:18 smithi152 ceph-mon[35055]: from='osd.4 [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:46:19.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:18 smithi152 ceph-mon[35055]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:46:19.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:18 smithi070 ceph-mon[31177]: from='osd.4 [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:46:19.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:18 smithi070 ceph-mon[31177]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:46:19.492 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:46:19.520 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi191:vg_nvme/lv_3 2024-09-12T01:46:19.760 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:46:20.135 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:46:20.135 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T01:46:20.136 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:20.136 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: from='osd.4 [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:46:20.136 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:46:20.136 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:20.136 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:20.136 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:20.136 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:46:20.136 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:46:20.136 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:20.136 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:20.136 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:20.136 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:20.234 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.218+0000 7f4dd81f6640 1 -- 172.21.15.191:0/264356148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd01026a0 msgr2=0x7f4dd0104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.234 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.218+0000 7f4dd81f6640 1 --2- 172.21.15.191:0/264356148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd01026a0 0x7f4dd0104a90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009900 tx=0x7f4dcc02a410 comp rx=0 tx=0).stop 2024-09-12T01:46:20.234 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.218+0000 7f4dd81f6640 1 -- 172.21.15.191:0/264356148 shutdown_connections 2024-09-12T01:46:20.234 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.218+0000 7f4dd81f6640 1 --2- 172.21.15.191:0/264356148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd0107900 0x7f4dd0109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.234 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.218+0000 7f4dd81f6640 1 --2- 172.21.15.191:0/264356148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4dd0104fd0 0x7f4dd01073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.234 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.218+0000 7f4dd81f6640 1 --2- 172.21.15.191:0/264356148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd01026a0 0x7f4dd0104a90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.234 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.218+0000 7f4dd81f6640 1 -- 172.21.15.191:0/264356148 >> 172.21.15.191:0/264356148 conn(0x7f4dd00fc2a0 msgr2=0x7f4dd00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:20.234 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.218+0000 7f4dd81f6640 1 -- 172.21.15.191:0/264356148 shutdown_connections 2024-09-12T01:46:20.235 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.218+0000 7f4dd81f6640 1 -- 172.21.15.191:0/264356148 wait complete. 2024-09-12T01:46:20.235 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd81f6640 1 Processor -- start 2024-09-12T01:46:20.235 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd81f6640 1 -- start start 2024-09-12T01:46:20.235 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd81f6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd01026a0 0x7f4dd0198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.235 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd81f6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4dd0104fd0 0x7f4dd0198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.235 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd81f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd0107900 0x7f4dd019f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.235 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd81f6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd010d9d0 con 0x7f4dd0107900 2024-09-12T01:46:20.235 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd81f6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd010d850 con 0x7f4dd0104fd0 2024-09-12T01:46:20.235 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd81f6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd010db50 con 0x7f4dd01026a0 2024-09-12T01:46:20.235 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd5f92640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd01026a0 0x7f4dd0198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.235 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd5f92640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd01026a0 0x7f4dd0198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:38334/0 (socket says 172.21.15.191:38334) 2024-09-12T01:46:20.235 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd5f92640 1 -- 172.21.15.191:0/4021307542 learned_addr learned my addr 172.21.15.191:0/4021307542 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-12T01:46:20.236 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd5791640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4dd0104fd0 0x7f4dd0198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.236 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd6793640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd0107900 0x7f4dd019f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.236 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd5f92640 1 -- 172.21.15.191:0/4021307542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4dd0104fd0 msgr2=0x7f4dd0198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.236 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd5f92640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4dd0104fd0 0x7f4dd0198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.236 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd5f92640 1 -- 172.21.15.191:0/4021307542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd0107900 msgr2=0x7f4dd019f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.236 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd5f92640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd0107900 0x7f4dd019f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.236 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd5f92640 1 -- 172.21.15.191:0/4021307542 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd019fc30 con 0x7f4dd01026a0 2024-09-12T01:46:20.236 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.219+0000 7f4dd6793640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd0107900 0x7f4dd019f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:46:20.236 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.220+0000 7f4dd5f92640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd01026a0 0x7f4dd0198000 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009a20 tx=0x7f4dcc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:20.236 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.220+0000 7f4dc6ffd640 1 -- 172.21.15.191:0/4021307542 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc03f030 con 0x7f4dd01026a0 2024-09-12T01:46:20.236 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.220+0000 7f4dc6ffd640 1 -- 172.21.15.191:0/4021307542 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4dcc003d00 con 0x7f4dd01026a0 2024-09-12T01:46:20.236 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.220+0000 7f4dd81f6640 1 -- 172.21.15.191:0/4021307542 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd019fec0 con 0x7f4dd01026a0 2024-09-12T01:46:20.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.220+0000 7f4dc6ffd640 1 -- 172.21.15.191:0/4021307542 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc035070 con 0x7f4dd01026a0 2024-09-12T01:46:20.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.220+0000 7f4dd81f6640 1 -- 172.21.15.191:0/4021307542 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd01a0310 con 0x7f4dd01026a0 2024-09-12T01:46:20.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.221+0000 7f4dd81f6640 1 -- 172.21.15.191:0/4021307542 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd00fdd90 con 0x7f4dd01026a0 2024-09-12T01:46:20.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.222+0000 7f4dc6ffd640 1 -- 172.21.15.191:0/4021307542 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4dcc042030 con 0x7f4dd01026a0 2024-09-12T01:46:20.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.223+0000 7f4dc6ffd640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4dbc0a2c30 0x7f4dbc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.223+0000 7f4dc6ffd640 1 -- 172.21.15.191:0/4021307542 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7f4dcc0ee490 con 0x7f4dd01026a0 2024-09-12T01:46:20.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.223+0000 7f4dd5791640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4dbc0a2c30 0x7f4dbc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.223+0000 7f4dd5791640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4dbc0a2c30 0x7f4dbc0a50f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0199520 tx=0x7f4dc0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:20.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.227+0000 7f4dc6ffd640 1 -- 172.21.15.191:0/4021307542 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4dcc0bc580 con 0x7f4dd01026a0 2024-09-12T01:46:20.262 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4[46386]: 2024-09-12T01:46:20.005+0000 7f318b2e6640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T01:46:20.262 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4[46386]: 2024-09-12T01:46:20.013+0000 7f3187920640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:46:20.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:46:20.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T01:46:20.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:20.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: from='osd.4 [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:46:20.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:46:20.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:20.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:20.264 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:20.264 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:46:20.264 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:46:20.264 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:20.264 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:20.264 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:20.264 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:20.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:46:20.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T01:46:20.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:20.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: from='osd.4 [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:46:20.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:46:20.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:20.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:20.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:20.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:46:20.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:46:20.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:20.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:20.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:20.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:20.401 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:20.401+0000 7f4dd81f6640 1 -- 172.21.15.191:0/4021307542 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4dd0062630 con 0x7f4dbc0a2c30 2024-09-12T01:46:21.080 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:21 smithi191 ceph-mon[35770]: Detected new or changed devices on smithi152 2024-09-12T01:46:21.080 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:21 smithi191 ceph-mon[35770]: Adjusting osd_memory_target on smithi152 to 8544M 2024-09-12T01:46:21.080 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:21 smithi191 ceph-mon[35770]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-12T01:46:21.080 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:21 smithi191 ceph-mon[35770]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T01:46:21.080 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:21.080 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:21.080 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:21 smithi191 ceph-mon[35770]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:21.080 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:46:21.080 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:46:21.080 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:21.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:21 smithi152 ceph-mon[35055]: Detected new or changed devices on smithi152 2024-09-12T01:46:21.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:21 smithi152 ceph-mon[35055]: Adjusting osd_memory_target on smithi152 to 8544M 2024-09-12T01:46:21.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:21 smithi152 ceph-mon[35055]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-12T01:46:21.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:21 smithi152 ceph-mon[35055]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T01:46:21.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:21.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:21.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:21 smithi152 ceph-mon[35055]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:21.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:46:21.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:46:21.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:21.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:21 smithi070 ceph-mon[31177]: Detected new or changed devices on smithi152 2024-09-12T01:46:21.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:21 smithi070 ceph-mon[31177]: Adjusting osd_memory_target on smithi152 to 8544M 2024-09-12T01:46:21.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:21 smithi070 ceph-mon[31177]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-12T01:46:21.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:21 smithi070 ceph-mon[31177]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T01:46:21.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:21.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:21.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:21 smithi070 ceph-mon[31177]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:21.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:46:21.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:46:21.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:22.144 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:22 smithi191 ceph-mon[35770]: purged_snaps scrub starts 2024-09-12T01:46:22.145 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:22 smithi191 ceph-mon[35770]: purged_snaps scrub ok 2024-09-12T01:46:22.145 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:22 smithi191 ceph-mon[35770]: osd.4 [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857] boot 2024-09-12T01:46:22.145 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:22 smithi191 ceph-mon[35770]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T01:46:22.145 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:22 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:22.145 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:22 smithi191 ceph-mon[35770]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:22.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:22 smithi070 ceph-mon[31177]: purged_snaps scrub starts 2024-09-12T01:46:22.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:22 smithi070 ceph-mon[31177]: purged_snaps scrub ok 2024-09-12T01:46:22.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:22 smithi070 ceph-mon[31177]: osd.4 [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857] boot 2024-09-12T01:46:22.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:22 smithi070 ceph-mon[31177]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T01:46:22.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:22 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:22.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:22 smithi070 ceph-mon[31177]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:22.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:22 smithi152 ceph-mon[35055]: purged_snaps scrub starts 2024-09-12T01:46:22.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:22 smithi152 ceph-mon[35055]: purged_snaps scrub ok 2024-09-12T01:46:22.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:22 smithi152 ceph-mon[35055]: osd.4 [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857] boot 2024-09-12T01:46:22.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:22 smithi152 ceph-mon[35055]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T01:46:22.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:22 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:46:22.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:22 smithi152 ceph-mon[35055]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T01:46:23.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:23 smithi191 ceph-mon[35770]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T01:46:23.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:23 smithi191 ceph-mon[35770]: from='client.? 172.21.15.191:0/4217453260' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61d3e716-b2e4-4cd0-b90d-10c0d588e5bc"}]: dispatch 2024-09-12T01:46:23.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:23 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61d3e716-b2e4-4cd0-b90d-10c0d588e5bc"}]: dispatch 2024-09-12T01:46:23.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:23 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61d3e716-b2e4-4cd0-b90d-10c0d588e5bc"}]': finished 2024-09-12T01:46:23.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:23 smithi191 ceph-mon[35770]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T01:46:23.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:23 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:23.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:23 smithi070 ceph-mon[31177]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T01:46:23.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:23 smithi070 ceph-mon[31177]: from='client.? 172.21.15.191:0/4217453260' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61d3e716-b2e4-4cd0-b90d-10c0d588e5bc"}]: dispatch 2024-09-12T01:46:23.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:23 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61d3e716-b2e4-4cd0-b90d-10c0d588e5bc"}]: dispatch 2024-09-12T01:46:23.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:23 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61d3e716-b2e4-4cd0-b90d-10c0d588e5bc"}]': finished 2024-09-12T01:46:23.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:23 smithi070 ceph-mon[31177]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T01:46:23.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:23 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:23.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:23 smithi152 ceph-mon[35055]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T01:46:23.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:23 smithi152 ceph-mon[35055]: from='client.? 172.21.15.191:0/4217453260' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61d3e716-b2e4-4cd0-b90d-10c0d588e5bc"}]: dispatch 2024-09-12T01:46:23.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:23 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61d3e716-b2e4-4cd0-b90d-10c0d588e5bc"}]: dispatch 2024-09-12T01:46:23.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:23 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61d3e716-b2e4-4cd0-b90d-10c0d588e5bc"}]': finished 2024-09-12T01:46:23.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:23 smithi152 ceph-mon[35055]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T01:46:23.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:23 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:24.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:24 smithi191 ceph-mon[35770]: from='client.? 172.21.15.191:0/2756185376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:46:24.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:24 smithi191 ceph-mon[35770]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:24.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:24 smithi152 ceph-mon[35055]: from='client.? 172.21.15.191:0/2756185376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:46:24.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:24 smithi152 ceph-mon[35055]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:24.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:24 smithi070 ceph-mon[31177]: from='client.? 172.21.15.191:0/2756185376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:46:24.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:24 smithi070 ceph-mon[31177]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:26.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:26 smithi152 ceph-mon[35055]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:26.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:26 smithi070 ceph-mon[31177]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:26.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:26 smithi191 ceph-mon[35770]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:28.633 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:28 smithi191 ceph-mon[35770]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:28.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:28 smithi152 ceph-mon[35055]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:28.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:28 smithi070 ceph-mon[31177]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:30.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:30 smithi191 ceph-mon[35770]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:30.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:30 smithi152 ceph-mon[35055]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:30.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:30 smithi070 ceph-mon[31177]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:31.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:31 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:46:31.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:31 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:31.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:31 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:46:31.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:31 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:31.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:31 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:46:31.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:31 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:32.681 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:32 smithi191 ceph-mon[35770]: Deploying daemon osd.5 on smithi191 2024-09-12T01:46:32.682 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:32 smithi191 ceph-mon[35770]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:32.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:32 smithi152 ceph-mon[35055]: Deploying daemon osd.5 on smithi191 2024-09-12T01:46:32.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:32 smithi152 ceph-mon[35055]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:32 smithi070 ceph-mon[31177]: Deploying daemon osd.5 on smithi191 2024-09-12T01:46:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:32 smithi070 ceph-mon[31177]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:34.574 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:34 smithi191 ceph-mon[35770]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:34.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:34 smithi152 ceph-mon[35055]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:34.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:34 smithi070 ceph-mon[31177]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:36.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:36 smithi191 ceph-mon[35770]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:36.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:36 smithi152 ceph-mon[35055]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:36.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:36 smithi070 ceph-mon[31177]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:37.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:37.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:37.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:37.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:37.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:37.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:37.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:37.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:37.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:38.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:38 smithi152 ceph-mon[35055]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:38.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:38 smithi070 ceph-mon[31177]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:38 smithi191 ceph-mon[35770]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:40.360 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.359+0000 7f4dc6ffd640 1 -- 172.21.15.191:0/4021307542 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4dd0062630 con 0x7f4dbc0a2c30 2024-09-12T01:46:40.360 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 5 on host 'smithi191' 2024-09-12T01:46:40.362 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.361+0000 7f4dd81f6640 1 -- 172.21.15.191:0/4021307542 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4dbc0a2c30 msgr2=0x7f4dbc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:40.362 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.361+0000 7f4dd81f6640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4dbc0a2c30 0x7f4dbc0a50f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0199520 tx=0x7f4dc0005f90 comp rx=0 tx=0).stop 2024-09-12T01:46:40.362 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.361+0000 7f4dd81f6640 1 -- 172.21.15.191:0/4021307542 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd01026a0 msgr2=0x7f4dd0198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:40.362 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.361+0000 7f4dd81f6640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd01026a0 0x7f4dd0198000 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009a20 tx=0x7f4dcc004270 comp rx=0 tx=0).stop 2024-09-12T01:46:40.363 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.361+0000 7f4dd81f6640 1 -- 172.21.15.191:0/4021307542 shutdown_connections 2024-09-12T01:46:40.363 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.361+0000 7f4dd81f6640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4dbc0a2c30 0x7f4dbc0a50f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:40.363 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.361+0000 7f4dd81f6640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd0107900 0x7f4dd019f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:40.363 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.361+0000 7f4dd81f6640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4dd0104fd0 0x7f4dd0198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:40.363 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.361+0000 7f4dd81f6640 1 --2- 172.21.15.191:0/4021307542 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4dd01026a0 0x7f4dd0198000 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:40.363 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.361+0000 7f4dd81f6640 1 -- 172.21.15.191:0/4021307542 >> 172.21.15.191:0/4021307542 conn(0x7f4dd00fc2a0 msgr2=0x7f4dd0103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:40.363 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.361+0000 7f4dd81f6640 1 -- 172.21.15.191:0/4021307542 shutdown_connections 2024-09-12T01:46:40.363 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:46:40.361+0000 7f4dd81f6640 1 -- 172.21.15.191:0/4021307542 wait complete. 2024-09-12T01:46:40.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:40 smithi191 ceph-mon[35770]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:40.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:40.618 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:40.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:40 smithi152 ceph-mon[35055]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:40.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:40.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:40.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:40 smithi070 ceph-mon[31177]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:40.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:40.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:41.022 DEBUG:teuthology.orchestra.run.smithi191:osd.5> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T01:46:41.024 INFO:tasks.cephadm:Deploying osd.6 on smithi070 with /dev/vg_nvme/lv_2... 2024-09-12T01:46:41.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:46:41.281 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:46:41.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:41 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:41.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:41 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:41.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:41 smithi191 ceph-mon[35770]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:42.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:41 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:42.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:41 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:42.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:41 smithi152 ceph-mon[35055]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:42.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:42.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:41 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:42.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:41 smithi070 ceph-mon[31177]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:43.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:43 smithi070 ceph-mon[31177]: from='osd.5 [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:46:43.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:43 smithi070 ceph-mon[31177]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:46:43.444 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:46:43.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_2 2024-09-12T01:46:43.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:43 smithi191 ceph-mon[35770]: from='osd.5 [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:46:43.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:43 smithi191 ceph-mon[35770]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:46:43.594 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:46:43 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:46:43.304+0000 7fecea32c640 -1 osd.5 0 log_to_monitors true 2024-09-12T01:46:43.729 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:46:43.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:43 smithi152 ceph-mon[35055]: from='osd.5 [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:46:43.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:43 smithi152 ceph-mon[35055]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:46:44.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.189+0000 7f6f77e61640 1 -- 172.21.15.70:0/2251898012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f701037e0 msgr2=0x7f6f7010a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:44.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.189+0000 7f6f77e61640 1 --2- 172.21.15.70:0/2251898012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f701037e0 0x7f6f7010a070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009ca0 tx=0x7f6f6802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:46:44.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.189+0000 7f6f77e61640 1 -- 172.21.15.70:0/2251898012 shutdown_connections 2024-09-12T01:46:44.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.189+0000 7f6f77e61640 1 --2- 172.21.15.70:0/2251898012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f701037e0 0x7f6f7010a070 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:44.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.189+0000 7f6f77e61640 1 --2- 172.21.15.70:0/2251898012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f70102e20 0x7f6f701032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:44.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.189+0000 7f6f77e61640 1 --2- 172.21.15.70:0/2251898012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f70101c20 0x7f6f70102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:44.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.189+0000 7f6f77e61640 1 -- 172.21.15.70:0/2251898012 >> 172.21.15.70:0/2251898012 conn(0x7f6f700fd3b0 msgr2=0x7f6f700ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:44.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.189+0000 7f6f77e61640 1 -- 172.21.15.70:0/2251898012 shutdown_connections 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.189+0000 7f6f77e61640 1 -- 172.21.15.70:0/2251898012 wait complete. 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f77e61640 1 Processor -- start 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f77e61640 1 -- start start 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f77e61640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f70101c20 0x7f6f70075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f77e61640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f70102e20 0x7f6f700745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f77e61640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f701037e0 0x7f6f70074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f77e61640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7010da60 con 0x7f6f70101c20 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f77e61640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7010d8e0 con 0x7f6f70102e20 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f77e61640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7010dbe0 con 0x7f6f701037e0 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f75bfd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f70101c20 0x7f6f70075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f75bfd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f70101c20 0x7f6f70075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58584/0 (socket says 172.21.15.70:58584) 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f75bfd640 1 -- 172.21.15.70:0/2902456403 learned_addr learned my addr 172.21.15.70:0/2902456403 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:46:44.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f753fc640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f70102e20 0x7f6f700745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f763fe640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f701037e0 0x7f6f70074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f75bfd640 1 -- 172.21.15.70:0/2902456403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f701037e0 msgr2=0x7f6f70074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f75bfd640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f701037e0 0x7f6f70074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f75bfd640 1 -- 172.21.15.70:0/2902456403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f70102e20 msgr2=0x7f6f700745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f75bfd640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f70102e20 0x7f6f700745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.190+0000 7f6f75bfd640 1 -- 172.21.15.70:0/2902456403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f700753e0 con 0x7f6f70101c20 2024-09-12T01:46:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.191+0000 7f6f75bfd640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f70101c20 0x7f6f70075f90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00b450 tx=0x7f6f6c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.191+0000 7f6f66ffd640 1 -- 172.21.15.70:0/2902456403 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c015020 con 0x7f6f70101c20 2024-09-12T01:46:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.191+0000 7f6f77e61640 1 -- 172.21.15.70:0/2902456403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f701a2180 con 0x7f6f70101c20 2024-09-12T01:46:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.191+0000 7f6f66ffd640 1 -- 172.21.15.70:0/2902456403 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f6c011d90 con 0x7f6f70101c20 2024-09-12T01:46:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.191+0000 7f6f77e61640 1 -- 172.21.15.70:0/2902456403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f701a2710 con 0x7f6f70101c20 2024-09-12T01:46:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.191+0000 7f6f66ffd640 1 -- 172.21.15.70:0/2902456403 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00f340 con 0x7f6f70101c20 2024-09-12T01:46:44.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.192+0000 7f6f77e61640 1 -- 172.21.15.70:0/2902456403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f54005290 con 0x7f6f70101c20 2024-09-12T01:46:44.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.194+0000 7f6f66ffd640 1 -- 172.21.15.70:0/2902456403 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6f6c018020 con 0x7f6f70101c20 2024-09-12T01:46:44.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.194+0000 7f6f66ffd640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6f5c0a2b80 0x7f6f5c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:44.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.194+0000 7f6f753fc640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6f5c0a2b80 0x7f6f5c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:44.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.194+0000 7f6f66ffd640 1 -- 172.21.15.70:0/2902456403 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4237+0+0 (secure 0 0 0) 0x7f6f6c0cd950 con 0x7f6f70101c20 2024-09-12T01:46:44.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.195+0000 7f6f753fc640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6f5c0a2b80 0x7f6f5c0a5040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f70075d10 tx=0x7f6f6000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:44.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.199+0000 7f6f66ffd640 1 -- 172.21.15.70:0/2902456403 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f6c01f020 con 0x7f6f70101c20 2024-09-12T01:46:44.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:46:44.382+0000 7f6f77e61640 1 -- 172.21.15.70:0/2902456403 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6f54000bc0 con 0x7f6f5c0a2b80 2024-09-12T01:46:44.687 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:46:44.376+0000 7fece5a8c640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T01:46:44.688 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:46:44.383+0000 7fece20c6640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:46:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:46:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T01:46:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='osd.5 [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:46:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:46:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:46:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:46:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:46:44.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T01:46:44.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:44.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='osd.5 [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:44.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.764 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:46:44.764 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T01:46:44.764 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:44.764 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='osd.5 [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:46:44.764 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:46:44.764 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T01:46:44.764 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.764 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.764 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:46:44.764 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:46:44.765 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.765 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:44.765 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:44.765 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:44.765 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:44.765 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:44.765 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:44.765 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:46:45.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: Detected new or changed devices on smithi191 2024-09-12T01:46:45.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: Adjusting osd_memory_target on smithi191 to 8544M 2024-09-12T01:46:45.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-12T01:46:45.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T01:46:45.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:45.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:45.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:45.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:46:45.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:46:45.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:45.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: osd.5 [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422] boot 2024-09-12T01:46:45.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T01:46:45.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:45 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:45.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: Detected new or changed devices on smithi191 2024-09-12T01:46:45.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: Adjusting osd_memory_target on smithi191 to 8544M 2024-09-12T01:46:45.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-12T01:46:45.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T01:46:45.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:45.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:45.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:45.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:46:45.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:46:45.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:45.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: osd.5 [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422] boot 2024-09-12T01:46:45.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T01:46:45.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:45 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:45.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: Detected new or changed devices on smithi191 2024-09-12T01:46:45.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: Adjusting osd_memory_target on smithi191 to 8544M 2024-09-12T01:46:45.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-12T01:46:45.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T01:46:45.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:46:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:46:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: osd.5 [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422] boot 2024-09-12T01:46:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T01:46:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:45 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:46:46.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:46 smithi152 ceph-mon[35055]: purged_snaps scrub starts 2024-09-12T01:46:46.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:46 smithi152 ceph-mon[35055]: purged_snaps scrub ok 2024-09-12T01:46:46.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:46 smithi152 ceph-mon[35055]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:46:46.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:46 smithi152 ceph-mon[35055]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T01:46:46.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:46 smithi070 ceph-mon[31177]: purged_snaps scrub starts 2024-09-12T01:46:46.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:46 smithi070 ceph-mon[31177]: purged_snaps scrub ok 2024-09-12T01:46:46.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:46 smithi070 ceph-mon[31177]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:46:46.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:46 smithi070 ceph-mon[31177]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T01:46:46.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:46 smithi191 ceph-mon[35770]: purged_snaps scrub starts 2024-09-12T01:46:46.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:46 smithi191 ceph-mon[35770]: purged_snaps scrub ok 2024-09-12T01:46:46.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:46 smithi191 ceph-mon[35770]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:46:46.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:46 smithi191 ceph-mon[35770]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T01:46:47.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:47 smithi070 ceph-mon[31177]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T01:46:47.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:47 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2593322593' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54b45119-c39b-4fc3-a1a5-3ed1d28646ca"}]: dispatch 2024-09-12T01:46:47.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:47 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2593322593' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54b45119-c39b-4fc3-a1a5-3ed1d28646ca"}]': finished 2024-09-12T01:46:47.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:47 smithi070 ceph-mon[31177]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T01:46:47.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:47 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:46:47.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:47 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2890815548' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:46:47.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:47 smithi152 ceph-mon[35055]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T01:46:47.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:47 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2593322593' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54b45119-c39b-4fc3-a1a5-3ed1d28646ca"}]: dispatch 2024-09-12T01:46:47.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:47 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2593322593' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54b45119-c39b-4fc3-a1a5-3ed1d28646ca"}]': finished 2024-09-12T01:46:47.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:47 smithi152 ceph-mon[35055]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T01:46:47.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:47 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:46:47.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:47 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2890815548' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:46:47.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:47 smithi191 ceph-mon[35770]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T01:46:47.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:47 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2593322593' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54b45119-c39b-4fc3-a1a5-3ed1d28646ca"}]: dispatch 2024-09-12T01:46:47.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:47 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2593322593' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54b45119-c39b-4fc3-a1a5-3ed1d28646ca"}]': finished 2024-09-12T01:46:47.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:47 smithi191 ceph-mon[35770]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T01:46:47.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:47 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:46:47.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:47 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2890815548' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:46:48.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:48 smithi152 ceph-mon[35055]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:46:48.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:48 smithi152 ceph-mon[35055]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T01:46:48.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:48 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:46:48.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:48 smithi070 ceph-mon[31177]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:46:48.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:48 smithi070 ceph-mon[31177]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T01:46:48.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:48 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:46:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:48 smithi191 ceph-mon[35770]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:46:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:48 smithi191 ceph-mon[35770]: osdmap e41: 7 total, 6 up, 7 in 2024-09-12T01:46:48.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:48 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:46:50.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:49 smithi152 ceph-mon[35055]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T01:46:50.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:49 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:46:50.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:49 smithi152 ceph-mon[35055]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:46:50.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:49 smithi070 ceph-mon[31177]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T01:46:50.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:46:50.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:49 smithi070 ceph-mon[31177]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:46:50.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:49 smithi191 ceph-mon[35770]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T01:46:50.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:49 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:46:50.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:49 smithi191 ceph-mon[35770]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T01:46:52.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:52 smithi152 ceph-mon[35055]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-12T01:46:52.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:52 smithi070 ceph-mon[31177]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-12T01:46:52.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:52 smithi191 ceph-mon[35770]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-12T01:46:54.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:54 smithi152 ceph-mon[35055]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-12T01:46:54.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:54 smithi070 ceph-mon[31177]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-12T01:46:54.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:54 smithi191 ceph-mon[35770]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-12T01:46:55.683 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T01:46:55.683 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:55.755 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T01:46:55.755 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:55.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T01:46:55.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:56.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:56 smithi070 ceph-mon[31177]: Deploying daemon osd.6 on smithi070 2024-09-12T01:46:56.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:56 smithi070 ceph-mon[31177]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:46:56.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:56 smithi152 ceph-mon[35055]: Deploying daemon osd.6 on smithi070 2024-09-12T01:46:56.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:56 smithi152 ceph-mon[35055]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:46:56.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:56 smithi191 ceph-mon[35770]: Deploying daemon osd.6 on smithi070 2024-09-12T01:46:56.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:56 smithi191 ceph-mon[35770]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:46:58.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:46:58 smithi152 ceph-mon[35055]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T01:46:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:46:58 smithi070 ceph-mon[31177]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T01:46:58.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:46:58 smithi191 ceph-mon[35770]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T01:47:00.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:00 smithi152 ceph-mon[35055]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:00.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:00 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:00.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:00 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:00.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:00 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:00.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:00 smithi070 ceph-mon[31177]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:00.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:00 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:00.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:00 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:00.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:00 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:00.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:00 smithi191 ceph-mon[35770]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:00.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:00 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:00.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:00 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:00.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:00 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:02.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:02 smithi191 ceph-mon[35770]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:02.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:02 smithi152 ceph-mon[35055]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:02 smithi070 ceph-mon[31177]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:04.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.022+0000 7f6f66ffd640 1 -- 172.21.15.70:0/2902456403 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6f54000bc0 con 0x7f6f5c0a2b80 2024-09-12T01:47:04.024 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 6 on host 'smithi070' 2024-09-12T01:47:04.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.025+0000 7f6f77e61640 1 -- 172.21.15.70:0/2902456403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6f5c0a2b80 msgr2=0x7f6f5c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:04.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.025+0000 7f6f77e61640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6f5c0a2b80 0x7f6f5c0a5040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f70075d10 tx=0x7f6f6000b390 comp rx=0 tx=0).stop 2024-09-12T01:47:04.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.025+0000 7f6f77e61640 1 -- 172.21.15.70:0/2902456403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f70101c20 msgr2=0x7f6f70075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:04.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.025+0000 7f6f77e61640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f70101c20 0x7f6f70075f90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00b450 tx=0x7f6f6c00b910 comp rx=0 tx=0).stop 2024-09-12T01:47:04.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.025+0000 7f6f77e61640 1 -- 172.21.15.70:0/2902456403 shutdown_connections 2024-09-12T01:47:04.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.025+0000 7f6f77e61640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6f5c0a2b80 0x7f6f5c0a5040 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:04.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.025+0000 7f6f77e61640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f701037e0 0x7f6f70074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:04.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.025+0000 7f6f77e61640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f70102e20 0x7f6f700745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:04.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.025+0000 7f6f77e61640 1 --2- 172.21.15.70:0/2902456403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f70101c20 0x7f6f70075f90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:04.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.025+0000 7f6f77e61640 1 -- 172.21.15.70:0/2902456403 >> 172.21.15.70:0/2902456403 conn(0x7f6f700fd3b0 msgr2=0x7f6f70106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:04.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.025+0000 7f6f77e61640 1 -- 172.21.15.70:0/2902456403 shutdown_connections 2024-09-12T01:47:04.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:04.025+0000 7f6f77e61640 1 -- 172.21.15.70:0/2902456403 wait complete. 2024-09-12T01:47:04.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:04.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:04.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:04.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:04.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:04.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:04 smithi070 ceph-mon[31177]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:04.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:04.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:04.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:04.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:04.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:04.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:04.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:04.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:04 smithi191 ceph-mon[35770]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:04.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:04.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:04.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:04.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:04.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:04.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:04.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:04.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:04 smithi152 ceph-mon[35055]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:04.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:04.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:04.626 DEBUG:teuthology.orchestra.run.smithi070:osd.6> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T01:47:04.628 INFO:tasks.cephadm:Deploying osd.7 on smithi152 with /dev/vg_nvme/lv_2... 2024-09-12T01:47:04.628 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:47:04.888 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:47:05.135 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:05 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:05.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:05 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:05.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:05 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:06.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:06 smithi152 ceph-mon[35055]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:06.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:06 smithi070 ceph-mon[31177]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:06.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:06 smithi191 ceph-mon[35770]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:06.996 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:47:06 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:47:06.789+0000 7f90769fc640 -1 osd.6 0 log_to_monitors true 2024-09-12T01:47:07.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:07 smithi070 ceph-mon[31177]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:47:07.383 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:07 smithi152 ceph-mon[35055]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:47:07.387 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:47:07.416 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_2 2024-09-12T01:47:07.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:07 smithi191 ceph-mon[35770]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T01:47:07.661 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:47:08.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.105+0000 7f76867f0640 1 -- 172.21.15.152:0/3851580732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7680102690 msgr2=0x7f7680108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:08.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.105+0000 7f76867f0640 1 --2- 172.21.15.152:0/3851580732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7680102690 0x7f7680108f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7678009ca0 tx=0x7f767802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:47:08.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.105+0000 7f76867f0640 1 -- 172.21.15.152:0/3851580732 shutdown_connections 2024-09-12T01:47:08.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.105+0000 7f76867f0640 1 --2- 172.21.15.152:0/3851580732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7680102690 0x7f7680108f20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:08.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.105+0000 7f76867f0640 1 --2- 172.21.15.152:0/3851580732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7680101cd0 0x7f7680102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:08.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.105+0000 7f76867f0640 1 --2- 172.21.15.152:0/3851580732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7680100ad0 0x7f7680100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:08.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.105+0000 7f76867f0640 1 -- 172.21.15.152:0/3851580732 >> 172.21.15.152:0/3851580732 conn(0x7f76800fc280 msgr2=0x7f76800fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:08.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.105+0000 7f76867f0640 1 -- 172.21.15.152:0/3851580732 shutdown_connections 2024-09-12T01:47:08.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.105+0000 7f76867f0640 1 -- 172.21.15.152:0/3851580732 wait complete. 2024-09-12T01:47:08.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.105+0000 7f76867f0640 1 Processor -- start 2024-09-12T01:47:08.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.105+0000 7f76867f0640 1 -- start start 2024-09-12T01:47:08.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f76867f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7680100ad0 0x7f768006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:08.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f76867f0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7680101cd0 0x7f768019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:08.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f76867f0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7680102690 0x7f768019f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:08.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f76867f0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f768010c940 con 0x7f7680100ad0 2024-09-12T01:47:08.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f76867f0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f768010c7c0 con 0x7f7680101cd0 2024-09-12T01:47:08.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f76867f0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f768010cac0 con 0x7f7680102690 2024-09-12T01:47:08.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f767f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7680101cd0 0x7f768019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:08.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f767f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7680101cd0 0x7f768019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50224/0 (socket says 172.21.15.152:50224) 2024-09-12T01:47:08.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f767f7fe640 1 -- 172.21.15.152:0/2019967434 learned_addr learned my addr 172.21.15.152:0/2019967434 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-12T01:47:08.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f767ffff640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7680100ad0 0x7f768006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:08.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f7684d8d640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7680102690 0x7f768019f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:08.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f767f7fe640 1 -- 172.21.15.152:0/2019967434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7680102690 msgr2=0x7f768019f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:08.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f767f7fe640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7680102690 0x7f768019f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:08.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f767f7fe640 1 -- 172.21.15.152:0/2019967434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7680100ad0 msgr2=0x7f768006aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:08.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f767f7fe640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7680100ad0 0x7f768006aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:08.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f767f7fe640 1 -- 172.21.15.152:0/2019967434 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768019fc40 con 0x7f7680101cd0 2024-09-12T01:47:08.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f7684d8d640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7680102690 0x7f768019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:47:08.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f767f7fe640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7680101cd0 0x7f768019cd10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f767400b4a0 tx=0x7f767400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:08.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f767d7fa640 1 -- 172.21.15.152:0/2019967434 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674014070 con 0x7f7680101cd0 2024-09-12T01:47:08.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f767d7fa640 1 -- 172.21.15.152:0/2019967434 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7674010b10 con 0x7f7680101cd0 2024-09-12T01:47:08.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.106+0000 7f76867f0640 1 -- 172.21.15.152:0/2019967434 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768019fed0 con 0x7f7680101cd0 2024-09-12T01:47:08.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.107+0000 7f767d7fa640 1 -- 172.21.15.152:0/2019967434 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674017d60 con 0x7f7680101cd0 2024-09-12T01:47:08.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.107+0000 7f76867f0640 1 -- 172.21.15.152:0/2019967434 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76801a0380 con 0x7f7680101cd0 2024-09-12T01:47:08.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.107+0000 7f76867f0640 1 -- 172.21.15.152:0/2019967434 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7680107e00 con 0x7f7680101cd0 2024-09-12T01:47:08.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.109+0000 7f767d7fa640 1 -- 172.21.15.152:0/2019967434 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7674017070 con 0x7f7680101cd0 2024-09-12T01:47:08.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.109+0000 7f767d7fa640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f76680a2b80 0x7f76680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:08.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.109+0000 7f767d7fa640 1 -- 172.21.15.152:0/2019967434 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4685+0+0 (secure 0 0 0) 0x7f76740cd970 con 0x7f7680101cd0 2024-09-12T01:47:08.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.110+0000 7f767ffff640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f76680a2b80 0x7f76680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:08.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.110+0000 7f767ffff640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f76680a2b80 0x7f76680a5040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7670005fd0 tx=0x7f767000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:08.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.113+0000 7f767d7fa640 1 -- 172.21.15.152:0/2019967434 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f767409b700 con 0x7f7680101cd0 2024-09-12T01:47:08.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:08.289+0000 7f76867f0640 1 -- 172.21.15.152:0/2019967434 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7680062630 con 0x7f76680a2b80 2024-09-12T01:47:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T01:47:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T01:47:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-12T01:47:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: Detected new or changed devices on smithi070 2024-09-12T01:47:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: Adjusting osd_memory_target on smithi070 to 5696M 2024-09-12T01:47:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:08.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:08.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:08.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:08.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:08 smithi191 ceph-mon[35770]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:08.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T01:47:08.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T01:47:08.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-12T01:47:08.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:08.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: Detected new or changed devices on smithi070 2024-09-12T01:47:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: Adjusting osd_memory_target on smithi070 to 5696M 2024-09-12T01:47:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:08 smithi152 ceph-mon[35055]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:08.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T01:47:08.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T01:47:08.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-12T01:47:08.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:08.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: Detected new or changed devices on smithi070 2024-09-12T01:47:08.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:08.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:08.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:08.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:08.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:08.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: Adjusting osd_memory_target on smithi070 to 5696M 2024-09-12T01:47:08.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:08.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:08.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:08.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:08.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-mon[31177]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:09.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:47:08.676+0000 7f907215c640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T01:47:09.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:47:08 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:47:08.685+0000 7f906a78e640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:47:09.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:09 smithi152 ceph-mon[35055]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-12T01:47:09.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:09 smithi152 ceph-mon[35055]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T01:47:09.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:09.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:09.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:09 smithi152 ceph-mon[35055]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:09.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:47:09.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:47:09.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:09.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:09 smithi152 ceph-mon[35055]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' 2024-09-12T01:47:09.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:09.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:09 smithi191 ceph-mon[35770]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-12T01:47:09.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:09 smithi191 ceph-mon[35770]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T01:47:09.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:09.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:09.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:09 smithi191 ceph-mon[35770]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:09.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:47:09.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:47:09.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:09.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:09 smithi191 ceph-mon[35770]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' 2024-09-12T01:47:09.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:09.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:09 smithi070 ceph-mon[31177]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-12T01:47:09.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:09 smithi070 ceph-mon[31177]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T01:47:09.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:09.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:09.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:09 smithi070 ceph-mon[31177]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:09.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:47:09.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:47:09.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:09.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:09 smithi070 ceph-mon[31177]: from='osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283]' entity='osd.6' 2024-09-12T01:47:09.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:10.244 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:10 smithi152 ceph-mon[35055]: purged_snaps scrub starts 2024-09-12T01:47:10.244 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:10 smithi152 ceph-mon[35055]: purged_snaps scrub ok 2024-09-12T01:47:10.244 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:10 smithi152 ceph-mon[35055]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:10.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:10 smithi152 ceph-mon[35055]: osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283] boot 2024-09-12T01:47:10.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:10 smithi152 ceph-mon[35055]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T01:47:10.245 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:10 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:10.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:10 smithi191 ceph-mon[35770]: purged_snaps scrub starts 2024-09-12T01:47:10.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:10 smithi191 ceph-mon[35770]: purged_snaps scrub ok 2024-09-12T01:47:10.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:10 smithi191 ceph-mon[35770]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:10.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:10 smithi191 ceph-mon[35770]: osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283] boot 2024-09-12T01:47:10.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:10 smithi191 ceph-mon[35770]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T01:47:10.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:10 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:10.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:10 smithi070 ceph-mon[31177]: purged_snaps scrub starts 2024-09-12T01:47:10.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:10 smithi070 ceph-mon[31177]: purged_snaps scrub ok 2024-09-12T01:47:10.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:10 smithi070 ceph-mon[31177]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:47:10.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:10 smithi070 ceph-mon[31177]: osd.6 [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283] boot 2024-09-12T01:47:10.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:10 smithi070 ceph-mon[31177]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T01:47:10.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:10 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T01:47:11.142 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:11 smithi152 ceph-mon[35055]: from='client.? 172.21.15.152:0/3660181805' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0267631-52ff-4beb-80d8-70eb3fd0d237"}]: dispatch 2024-09-12T01:47:11.142 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:11 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0267631-52ff-4beb-80d8-70eb3fd0d237"}]: dispatch 2024-09-12T01:47:11.142 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:11 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0267631-52ff-4beb-80d8-70eb3fd0d237"}]': finished 2024-09-12T01:47:11.142 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:11 smithi152 ceph-mon[35055]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T01:47:11.142 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:11 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:11.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:11 smithi191 ceph-mon[35770]: from='client.? 172.21.15.152:0/3660181805' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0267631-52ff-4beb-80d8-70eb3fd0d237"}]: dispatch 2024-09-12T01:47:11.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:11 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0267631-52ff-4beb-80d8-70eb3fd0d237"}]: dispatch 2024-09-12T01:47:11.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:11 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0267631-52ff-4beb-80d8-70eb3fd0d237"}]': finished 2024-09-12T01:47:11.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:11 smithi191 ceph-mon[35770]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T01:47:11.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:11 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:11.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:11 smithi070 ceph-mon[31177]: from='client.? 172.21.15.152:0/3660181805' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0267631-52ff-4beb-80d8-70eb3fd0d237"}]: dispatch 2024-09-12T01:47:11.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:11 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b0267631-52ff-4beb-80d8-70eb3fd0d237"}]: dispatch 2024-09-12T01:47:11.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:11 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0267631-52ff-4beb-80d8-70eb3fd0d237"}]': finished 2024-09-12T01:47:11.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:11 smithi070 ceph-mon[31177]: osdmap e46: 8 total, 7 up, 8 in 2024-09-12T01:47:11.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:11 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:12.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:12 smithi191 ceph-mon[35770]: from='client.? 172.21.15.152:0/1357298336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:47:12.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:12 smithi191 ceph-mon[35770]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:12.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:12 smithi152 ceph-mon[35055]: from='client.? 172.21.15.152:0/1357298336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:47:12.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:12 smithi152 ceph-mon[35055]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:12.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:12 smithi070 ceph-mon[31177]: from='client.? 172.21.15.152:0/1357298336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:47:12.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:12 smithi070 ceph-mon[31177]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:14.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:14 smithi152 ceph-mon[35055]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:14.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:14 smithi070 ceph-mon[31177]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:14.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:14 smithi191 ceph-mon[35770]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:16.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:16 smithi152 ceph-mon[35055]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:16.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:16 smithi070 ceph-mon[31177]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:16.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:16 smithi191 ceph-mon[35770]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:18.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:18 smithi152 ceph-mon[35055]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:18.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:18 smithi070 ceph-mon[31177]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:18.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:18 smithi191 ceph-mon[35770]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:19.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:19 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T01:47:19.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:19 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:19.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:19 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T01:47:19.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:19 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:19.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:19 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T01:47:19.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:19 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:20.505 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:20 smithi152 ceph-mon[35055]: Deploying daemon osd.7 on smithi152 2024-09-12T01:47:20.505 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:20 smithi152 ceph-mon[35055]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:20 smithi070 ceph-mon[31177]: Deploying daemon osd.7 on smithi152 2024-09-12T01:47:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:20 smithi070 ceph-mon[31177]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:20.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:20 smithi191 ceph-mon[35770]: Deploying daemon osd.7 on smithi152 2024-09-12T01:47:20.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:20 smithi191 ceph-mon[35770]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:22.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:22 smithi152 ceph-mon[35055]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:22.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:22 smithi070 ceph-mon[31177]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:22.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:22 smithi191 ceph-mon[35770]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:24.681 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:24 smithi152 ceph-mon[35055]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:24.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:24 smithi070 ceph-mon[31177]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:24.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:24 smithi191 ceph-mon[35770]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:25.690 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:25 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:25.690 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:25 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:25.690 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:25 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:25.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:25 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:25.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:25 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:25.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:25 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:25.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:25 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:25.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:25 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:25.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:25 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:26.683 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:26 smithi152 ceph-mon[35055]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:26.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:26 smithi070 ceph-mon[31177]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:26.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:26 smithi191 ceph-mon[35770]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:28.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.647+0000 7f767d7fa640 1 -- 172.21.15.152:0/2019967434 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7680062630 con 0x7f76680a2b80 2024-09-12T01:47:28.649 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 7 on host 'smithi152' 2024-09-12T01:47:28.650 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:28 smithi152 ceph-mon[35055]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:28.650 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:28 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:28.650 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:28 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:28.650 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:28 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:28.650 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:28 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:28.650 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:28 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:28.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.649+0000 7f76867f0640 1 -- 172.21.15.152:0/2019967434 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f76680a2b80 msgr2=0x7f76680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:28.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.649+0000 7f76867f0640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f76680a2b80 0x7f76680a5040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7670005fd0 tx=0x7f767000b410 comp rx=0 tx=0).stop 2024-09-12T01:47:28.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.649+0000 7f76867f0640 1 -- 172.21.15.152:0/2019967434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7680101cd0 msgr2=0x7f768019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:28.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.649+0000 7f76867f0640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7680101cd0 0x7f768019cd10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f767400b4a0 tx=0x7f767400b960 comp rx=0 tx=0).stop 2024-09-12T01:47:28.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.649+0000 7f76867f0640 1 -- 172.21.15.152:0/2019967434 shutdown_connections 2024-09-12T01:47:28.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.649+0000 7f76867f0640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f76680a2b80 0x7f76680a5040 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:28.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.649+0000 7f76867f0640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7680102690 0x7f768019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:28.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.649+0000 7f76867f0640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7680101cd0 0x7f768019cd10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:28.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.649+0000 7f76867f0640 1 --2- 172.21.15.152:0/2019967434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7680100ad0 0x7f768006aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:28.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.649+0000 7f76867f0640 1 -- 172.21.15.152:0/2019967434 >> 172.21.15.152:0/2019967434 conn(0x7f76800fc280 msgr2=0x7f7680104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:28.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.649+0000 7f76867f0640 1 -- 172.21.15.152:0/2019967434 shutdown_connections 2024-09-12T01:47:28.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:47:28.649+0000 7f76867f0640 1 -- 172.21.15.152:0/2019967434 wait complete. 2024-09-12T01:47:28.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:28 smithi070 ceph-mon[31177]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:28.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:28 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:28.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:28 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:28.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:28 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:28.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:28 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:28.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:28 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:28.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:28 smithi191 ceph-mon[35770]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:28.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:28 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:28.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:28 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:28.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:28 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:28.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:28 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:28.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:28 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:29.281 DEBUG:teuthology.orchestra.run.smithi152:osd.7> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T01:47:29.283 INFO:tasks.cephadm:Deploying osd.8 on smithi191 with /dev/vg_nvme/lv_2... 2024-09-12T01:47:29.284 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:47:29.539 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:47:29.660 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:29 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:29.660 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:29 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:29.660 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:29 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:29.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:29 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:29.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:29 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:29.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:29 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:29.806 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:29 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:29.806 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:29 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:29.806 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:29 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:30.755 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:30 smithi152 ceph-mon[35055]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:30.821 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:30 smithi191 ceph-mon[35770]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:31.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:30 smithi070 ceph-mon[31177]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:31.509 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:47:31 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:47:31.247+0000 7ffb6bfa1640 -1 osd.7 0 log_to_monitors true 2024-09-12T01:47:31.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:31 smithi191 ceph-mon[35770]: from='osd.7 [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:47:31.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:31 smithi191 ceph-mon[35770]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:47:31.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:31 smithi152 ceph-mon[35055]: from='osd.7 [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:47:31.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:31 smithi152 ceph-mon[35055]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:47:32.008 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:47:32.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:31 smithi070 ceph-mon[31177]: from='osd.7 [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:47:32.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:31 smithi070 ceph-mon[31177]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T01:47:32.035 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi191:vg_nvme/lv_2 2024-09-12T01:47:32.303 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:47:32.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:32.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T01:47:32.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T01:47:32.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:32.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='osd.7 [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:47:32.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:47:32.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:32.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:32.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:32.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:32.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:32.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:32.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:32.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:32.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:32.745 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.741+0000 7f8bd2728640 1 -- 172.21.15.191:0/3173832809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bcc1037c0 msgr2=0x7f8bcc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:32.745 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.741+0000 7f8bd2728640 1 --2- 172.21.15.191:0/3173832809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc10a050 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009ca0 tx=0x7f8bc402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.745 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.742+0000 7f8bd2728640 1 -- 172.21.15.191:0/3173832809 shutdown_connections 2024-09-12T01:47:32.745 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.742+0000 7f8bd2728640 1 --2- 172.21.15.191:0/3173832809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc10a050 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.742+0000 7f8bd2728640 1 --2- 172.21.15.191:0/3173832809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bcc102e00 0x7f8bcc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.742+0000 7f8bd2728640 1 --2- 172.21.15.191:0/3173832809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bcc101c00 0x7f8bcc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.742+0000 7f8bd2728640 1 -- 172.21.15.191:0/3173832809 >> 172.21.15.191:0/3173832809 conn(0x7f8bcc0fd390 msgr2=0x7f8bcc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:32.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.742+0000 7f8bd2728640 1 -- 172.21.15.191:0/3173832809 shutdown_connections 2024-09-12T01:47:32.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.742+0000 7f8bd2728640 1 -- 172.21.15.191:0/3173832809 wait complete. 2024-09-12T01:47:32.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.742+0000 7f8bd2728640 1 Processor -- start 2024-09-12T01:47:32.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.742+0000 7f8bd2728640 1 -- start start 2024-09-12T01:47:32.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.742+0000 7f8bd2728640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bcc101c00 0x7f8bcc075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:32.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.742+0000 7f8bd2728640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bcc102e00 0x7f8bcc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:32.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bd2728640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:32.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bd2728640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc10d9c0 con 0x7f8bcc102e00 2024-09-12T01:47:32.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bd2728640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc10d840 con 0x7f8bcc101c00 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bd2728640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc10db40 con 0x7f8bcc1037c0 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bcbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bcc101c00 0x7f8bcc075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bd0cc5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bcbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bcc101c00 0x7f8bcc075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.191:39922/0 (socket says 172.21.15.191:39922) 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bcbfff640 1 -- 172.21.15.191:0/1415487749 learned_addr learned my addr 172.21.15.191:0/1415487749 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bcb7fe640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bcc102e00 0x7f8bcc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bcbfff640 1 -- 172.21.15.191:0/1415487749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bcc1037c0 msgr2=0x7f8bcc074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bcbfff640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bcbfff640 1 -- 172.21.15.191:0/1415487749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bcc102e00 msgr2=0x7f8bcc0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bcbfff640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bcc102e00 0x7f8bcc0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bcbfff640 1 -- 172.21.15.191:0/1415487749 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc0753e0 con 0x7f8bcc101c00 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bd0cc5640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:47:32.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bcbfff640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bcc101c00 0x7f8bcc075f90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00d770 tx=0x7f8bbc00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:32.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bc97fa640 1 -- 172.21.15.191:0/1415487749 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc017070 con 0x7f8bcc101c00 2024-09-12T01:47:32.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bc97fa640 1 -- 172.21.15.191:0/1415487749 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bbc009c30 con 0x7f8bcc101c00 2024-09-12T01:47:32.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bd2728640 1 -- 172.21.15.191:0/1415487749 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bcc1a20c0 con 0x7f8bcc101c00 2024-09-12T01:47:32.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bc97fa640 1 -- 172.21.15.191:0/1415487749 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc003e40 con 0x7f8bcc101c00 2024-09-12T01:47:32.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.743+0000 7f8bd2728640 1 -- 172.21.15.191:0/1415487749 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc1a25d0 con 0x7f8bcc101c00 2024-09-12T01:47:32.748 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.744+0000 7f8bd2728640 1 -- 172.21.15.191:0/1415487749 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc108f30 con 0x7f8bcc101c00 2024-09-12T01:47:32.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.745+0000 7f8bc97fa640 1 -- 172.21.15.191:0/1415487749 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8bbc004000 con 0x7f8bcc101c00 2024-09-12T01:47:32.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.746+0000 7f8bc97fa640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8bb40a2b80 0x7f8bb40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:32.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.746+0000 7f8bc97fa640 1 -- 172.21.15.191:0/1415487749 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5117+0+0 (secure 0 0 0) 0x7f8bbc0cdd00 con 0x7f8bcc101c00 2024-09-12T01:47:32.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.746+0000 7f8bcb7fe640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8bb40a2b80 0x7f8bb40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:32.749 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.747+0000 7f8bcb7fe640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8bb40a2b80 0x7f8bb40a5040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc075d10 tx=0x7f8bc0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:32.750 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.750+0000 7f8bc97fa640 1 -- 172.21.15.191:0/1415487749 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8bbc009de0 con 0x7f8bcc101c00 2024-09-12T01:47:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T01:47:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T01:47:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='osd.7 [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:47:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:47:32.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:32.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:32.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:32.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:32.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:32.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:32.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:32.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:32.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:32.925 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:32.924+0000 7f8bd2728640 1 -- 172.21.15.191:0/1415487749 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8bcc062630 con 0x7f8bb40a2b80 2024-09-12T01:47:33.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:47:32.535+0000 7ffb67701640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T01:47:33.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:47:32.545+0000 7ffb63d3b640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:47:33.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='osd.7 [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:33.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:33.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:33.645 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:33 smithi191 ceph-mon[35770]: Detected new or changed devices on smithi152 2024-09-12T01:47:33.645 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:33 smithi191 ceph-mon[35770]: Adjusting osd_memory_target on smithi152 to 5696M 2024-09-12T01:47:33.645 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:33 smithi191 ceph-mon[35770]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-12T01:47:33.646 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:33 smithi191 ceph-mon[35770]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T01:47:33.646 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:33 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:33.646 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:33 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:33.646 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:33 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:47:33.646 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:33 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:47:33.646 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:33 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:33 smithi152 ceph-mon[35055]: Detected new or changed devices on smithi152 2024-09-12T01:47:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:33 smithi152 ceph-mon[35055]: Adjusting osd_memory_target on smithi152 to 5696M 2024-09-12T01:47:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:33 smithi152 ceph-mon[35055]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-12T01:47:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:33 smithi152 ceph-mon[35055]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T01:47:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:33 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:33 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:34.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:33 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:47:34.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:33 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:47:34.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:33 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:33 smithi070 ceph-mon[31177]: Detected new or changed devices on smithi152 2024-09-12T01:47:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:33 smithi070 ceph-mon[31177]: Adjusting osd_memory_target on smithi152 to 5696M 2024-09-12T01:47:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:33 smithi070 ceph-mon[31177]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-12T01:47:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:33 smithi070 ceph-mon[31177]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T01:47:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:33 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:33 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:33 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:47:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:33 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:47:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:33 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:34.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:34 smithi191 ceph-mon[35770]: purged_snaps scrub starts 2024-09-12T01:47:34.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:34 smithi191 ceph-mon[35770]: purged_snaps scrub ok 2024-09-12T01:47:34.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:34 smithi191 ceph-mon[35770]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:34.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:34 smithi191 ceph-mon[35770]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:34.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:34 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:34.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:34 smithi191 ceph-mon[35770]: osd.7 [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312] boot 2024-09-12T01:47:34.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:34 smithi191 ceph-mon[35770]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T01:47:34.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:34 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:34.881 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:34 smithi191 ceph-mon[35770]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T01:47:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:34 smithi152 ceph-mon[35055]: purged_snaps scrub starts 2024-09-12T01:47:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:34 smithi152 ceph-mon[35055]: purged_snaps scrub ok 2024-09-12T01:47:35.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:34 smithi152 ceph-mon[35055]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:35.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:34 smithi152 ceph-mon[35055]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:35.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:34 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:35.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:34 smithi152 ceph-mon[35055]: osd.7 [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312] boot 2024-09-12T01:47:35.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:34 smithi152 ceph-mon[35055]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T01:47:35.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:34 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:35.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:34 smithi152 ceph-mon[35055]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T01:47:35.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:34 smithi070 ceph-mon[31177]: purged_snaps scrub starts 2024-09-12T01:47:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:34 smithi070 ceph-mon[31177]: purged_snaps scrub ok 2024-09-12T01:47:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:34 smithi070 ceph-mon[31177]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:34 smithi070 ceph-mon[31177]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T01:47:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:34 smithi070 ceph-mon[31177]: osd.7 [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312] boot 2024-09-12T01:47:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:34 smithi070 ceph-mon[31177]: osdmap e49: 8 total, 8 up, 8 in 2024-09-12T01:47:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T01:47:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:34 smithi070 ceph-mon[31177]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T01:47:35.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:35 smithi191 ceph-mon[35770]: from='client.? 172.21.15.191:0/3127183026' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70"}]: dispatch 2024-09-12T01:47:35.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:35 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70"}]: dispatch 2024-09-12T01:47:35.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:35 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70"}]': finished 2024-09-12T01:47:35.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:35 smithi191 ceph-mon[35770]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T01:47:35.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:35 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:36.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:35 smithi152 ceph-mon[35055]: from='client.? 172.21.15.191:0/3127183026' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70"}]: dispatch 2024-09-12T01:47:36.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:35 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70"}]: dispatch 2024-09-12T01:47:36.015 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:35 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70"}]': finished 2024-09-12T01:47:36.015 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:35 smithi152 ceph-mon[35055]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T01:47:36.015 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:35 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:36.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:35 smithi070 ceph-mon[31177]: from='client.? 172.21.15.191:0/3127183026' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70"}]: dispatch 2024-09-12T01:47:36.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:35 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70"}]: dispatch 2024-09-12T01:47:36.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:35 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70"}]': finished 2024-09-12T01:47:36.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:35 smithi070 ceph-mon[31177]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T01:47:36.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:35 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:36.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:36 smithi191 ceph-mon[35770]: pgmap v168: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:36.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:36 smithi191 ceph-mon[35770]: from='client.? 172.21.15.191:0/496043730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:47:36.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:36 smithi191 ceph-mon[35770]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T01:47:36.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:36 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:37.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:36 smithi152 ceph-mon[35055]: pgmap v168: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:37.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:36 smithi152 ceph-mon[35055]: from='client.? 172.21.15.191:0/496043730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:47:37.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:36 smithi152 ceph-mon[35055]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T01:47:37.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:36 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:37.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:36 smithi070 ceph-mon[31177]: pgmap v168: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:37.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:36 smithi070 ceph-mon[31177]: from='client.? 172.21.15.191:0/496043730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:47:37.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:36 smithi070 ceph-mon[31177]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T01:47:37.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:36 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:38.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:38 smithi191 ceph-mon[35770]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T01:47:38.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:38 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:38.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:38 smithi191 ceph-mon[35770]: pgmap v171: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:38.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:38 smithi152 ceph-mon[35055]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T01:47:38.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:38 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:38.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:38 smithi152 ceph-mon[35055]: pgmap v171: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:38.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:38 smithi070 ceph-mon[31177]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T01:47:38.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:38 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:38.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:38 smithi070 ceph-mon[31177]: pgmap v171: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:40.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:40 smithi152 ceph-mon[35055]: pgmap v172: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:40.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:40 smithi070 ceph-mon[31177]: pgmap v172: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:40.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:40 smithi191 ceph-mon[35770]: pgmap v172: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:42.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:42 smithi152 ceph-mon[35055]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:42.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:42 smithi070 ceph-mon[31177]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:42.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:42 smithi191 ceph-mon[35770]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:44.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:44 smithi191 ceph-mon[35770]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:44.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T01:47:44.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:44.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:44 smithi152 ceph-mon[35055]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:44.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T01:47:44.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:44.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:44 smithi070 ceph-mon[31177]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:44.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T01:47:44.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:45.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:45 smithi191 ceph-mon[35770]: Deploying daemon osd.8 on smithi191 2024-09-12T01:47:45.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:45 smithi152 ceph-mon[35055]: Deploying daemon osd.8 on smithi191 2024-09-12T01:47:45.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:45 smithi070 ceph-mon[31177]: Deploying daemon osd.8 on smithi191 2024-09-12T01:47:46.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:46 smithi191 ceph-mon[35770]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:46.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:46 smithi152 ceph-mon[35055]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:46.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:46 smithi070 ceph-mon[31177]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:48.728 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:48 smithi191 ceph-mon[35770]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:48.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:48 smithi070 ceph-mon[31177]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:49.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:48 smithi152 ceph-mon[35055]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:49.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:49.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:49.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:49.832 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:49 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:49.832 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:49 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:49.832 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:49 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:50.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:49 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:50.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:49 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:50.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:49 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:50.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:50 smithi070 ceph-mon[31177]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:50.860 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:50 smithi191 ceph-mon[35770]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:51.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:50 smithi152 ceph-mon[35055]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:52.624 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:52 smithi191 ceph-mon[35770]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:52.624 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:52.624 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:52.624 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:52.625 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:52.625 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:52.666 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 8 on host 'smithi191' 2024-09-12T01:47:52.666 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.666+0000 7f8bc97fa640 1 -- 172.21.15.191:0/1415487749 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8bcc062630 con 0x7f8bb40a2b80 2024-09-12T01:47:52.669 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.669+0000 7f8bd2728640 1 -- 172.21.15.191:0/1415487749 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8bb40a2b80 msgr2=0x7f8bb40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:52.669 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.669+0000 7f8bd2728640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8bb40a2b80 0x7f8bb40a5040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc075d10 tx=0x7f8bc0005f90 comp rx=0 tx=0).stop 2024-09-12T01:47:52.669 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.669+0000 7f8bd2728640 1 -- 172.21.15.191:0/1415487749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bcc101c00 msgr2=0x7f8bcc075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:52.669 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.669+0000 7f8bd2728640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bcc101c00 0x7f8bcc075f90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00d770 tx=0x7f8bbc00dc30 comp rx=0 tx=0).stop 2024-09-12T01:47:52.669 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.669+0000 7f8bd2728640 1 -- 172.21.15.191:0/1415487749 shutdown_connections 2024-09-12T01:47:52.669 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.669+0000 7f8bd2728640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8bb40a2b80 0x7f8bb40a5040 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:52.669 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.669+0000 7f8bd2728640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:52.669 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.669+0000 7f8bd2728640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bcc102e00 0x7f8bcc0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:52.669 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.669+0000 7f8bd2728640 1 --2- 172.21.15.191:0/1415487749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bcc101c00 0x7f8bcc075f90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:52.669 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.669+0000 7f8bd2728640 1 -- 172.21.15.191:0/1415487749 >> 172.21.15.191:0/1415487749 conn(0x7f8bcc0fd390 msgr2=0x7f8bcc106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:52.670 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.669+0000 7f8bd2728640 1 -- 172.21.15.191:0/1415487749 shutdown_connections 2024-09-12T01:47:52.670 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:47:52.669+0000 7f8bd2728640 1 -- 172.21.15.191:0/1415487749 wait complete. 2024-09-12T01:47:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:52 smithi070 ceph-mon[31177]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:52 smithi152 ceph-mon[35055]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:53.220 DEBUG:teuthology.orchestra.run.smithi191:osd.8> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T01:47:53.223 INFO:tasks.cephadm:Deploying osd.9 on smithi070 with /dev/vg_nvme/lv_1... 2024-09-12T01:47:53.223 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T01:47:53.481 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:47:53.818 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:53 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:53.818 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:53 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:53.818 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:53 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:53.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:53 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:53.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:53 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:53 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:54.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:53 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:54.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:53 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:54.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:53 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:54.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:54 smithi191 ceph-mon[35770]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:54.755 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:54 smithi070 ceph-mon[31177]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:55.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:54 smithi152 ceph-mon[35055]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:47:55.926 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:47:55 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:47:55.589+0000 7fa6da1b1640 -1 osd.8 0 log_to_monitors true 2024-09-12T01:47:55.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_1 2024-09-12T01:47:56.195 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:47:56.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:56 smithi070 ceph-mon[31177]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:56.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:56 smithi070 ceph-mon[31177]: from='osd.8 [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:47:56.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:56 smithi070 ceph-mon[31177]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:47:56.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:56.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:56.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:56.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:56.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:56.568 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:56.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:56.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:56.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:56 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.651+0000 7f62fc134640 1 -- 172.21.15.70:0/308448365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62f41026d0 msgr2=0x7f62f4108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.651+0000 7f62fc134640 1 --2- 172.21.15.70:0/308448365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62f41026d0 0x7f62f4108f60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009ca0 tx=0x7f62ec02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:47:56.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.651+0000 7f62fc134640 1 -- 172.21.15.70:0/308448365 shutdown_connections 2024-09-12T01:47:56.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.651+0000 7f62fc134640 1 --2- 172.21.15.70:0/308448365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62f41026d0 0x7f62f4108f60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:56.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.651+0000 7f62fc134640 1 --2- 172.21.15.70:0/308448365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62f4101d10 0x7f62f4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:56.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.651+0000 7f62fc134640 1 --2- 172.21.15.70:0/308448365 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f4100b10 0x7f62f4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:56.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.651+0000 7f62fc134640 1 -- 172.21.15.70:0/308448365 >> 172.21.15.70:0/308448365 conn(0x7f62f40fc2a0 msgr2=0x7f62f40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:56.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.651+0000 7f62fc134640 1 -- 172.21.15.70:0/308448365 shutdown_connections 2024-09-12T01:47:56.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.651+0000 7f62fc134640 1 -- 172.21.15.70:0/308448365 wait complete. 2024-09-12T01:47:56.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62fc134640 1 Processor -- start 2024-09-12T01:47:56.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62fc134640 1 -- start start 2024-09-12T01:47:56.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62fc134640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62f4100b10 0x7f62f4196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:56.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62fc134640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62f4101d10 0x7f62f4197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:56.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62fc134640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f41026d0 0x7f62f419e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62fc134640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f62f410ca20 con 0x7f62f4100b10 2024-09-12T01:47:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62fc134640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f62f410c8a0 con 0x7f62f4101d10 2024-09-12T01:47:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62fc134640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f62f410cba0 con 0x7f62f41026d0 2024-09-12T01:47:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62f9ed0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62f4100b10 0x7f62f4196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62f9ed0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62f4100b10 0x7f62f4196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52670/0 (socket says 172.21.15.70:52670) 2024-09-12T01:47:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62f9ed0640 1 -- 172.21.15.70:0/233532412 learned_addr learned my addr 172.21.15.70:0/233532412 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:47:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62f96cf640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62f4101d10 0x7f62f4197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62fa6d1640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f41026d0 0x7f62f419e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62f9ed0640 1 -- 172.21.15.70:0/233532412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f41026d0 msgr2=0x7f62f419e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62f9ed0640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f41026d0 0x7f62f419e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62f9ed0640 1 -- 172.21.15.70:0/233532412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62f4101d10 msgr2=0x7f62f4197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:56.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62f9ed0640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62f4101d10 0x7f62f4197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62f9ed0640 1 -- 172.21.15.70:0/233532412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f419ec20 con 0x7f62f4100b10 2024-09-12T01:47:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62fa6d1640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f41026d0 0x7f62f419e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:47:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.652+0000 7f62f96cf640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62f4101d10 0x7f62f4197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:47:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.653+0000 7f62f9ed0640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62f4100b10 0x7f62f4196ff0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62f000b450 tx=0x7f62f000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.653+0000 7f62eaffd640 1 -- 172.21.15.70:0/233532412 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0015020 con 0x7f62f4100b10 2024-09-12T01:47:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.653+0000 7f62eaffd640 1 -- 172.21.15.70:0/233532412 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62f0011d90 con 0x7f62f4100b10 2024-09-12T01:47:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.653+0000 7f62fc134640 1 -- 172.21.15.70:0/233532412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f419ef10 con 0x7f62f4100b10 2024-09-12T01:47:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.653+0000 7f62eaffd640 1 -- 172.21.15.70:0/233532412 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f000f340 con 0x7f62f4100b10 2024-09-12T01:47:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.653+0000 7f62fc134640 1 -- 172.21.15.70:0/233532412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f419f440 con 0x7f62f4100b10 2024-09-12T01:47:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.654+0000 7f62fc134640 1 -- 172.21.15.70:0/233532412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f4107f10 con 0x7f62f4100b10 2024-09-12T01:47:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.655+0000 7f62eaffd640 1 -- 172.21.15.70:0/233532412 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f62f0018020 con 0x7f62f4100b10 2024-09-12T01:47:56.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.656+0000 7f62eaffd640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62e00a2c30 0x7f62e00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:56.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.656+0000 7f62f96cf640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62e00a2c30 0x7f62e00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:56.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.656+0000 7f62eaffd640 1 -- 172.21.15.70:0/233532412 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5533+0+0 (secure 0 0 0) 0x7f62f00ce000 con 0x7f62f4100b10 2024-09-12T01:47:56.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.656+0000 7f62f96cf640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62e00a2c30 0x7f62e00a50f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f62f4198510 tx=0x7f62e4008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:56.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.660+0000 7f62eaffd640 1 -- 172.21.15.70:0/233532412 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62f001f020 con 0x7f62f4100b10 2024-09-12T01:47:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:47:56.835+0000 7f62fc134640 1 -- 172.21.15.70:0/233532412 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f62f4062630 con 0x7f62e00a2c30 2024-09-12T01:47:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:56 smithi191 ceph-mon[35770]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:56 smithi191 ceph-mon[35770]: from='osd.8 [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:47:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:56 smithi191 ceph-mon[35770]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:47:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:56.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:56.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:56.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:56.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:56 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:56 smithi152 ceph-mon[35055]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:56 smithi152 ceph-mon[35055]: from='osd.8 [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:47:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:56 smithi152 ceph-mon[35055]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T01:47:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:57.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:57.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:47:57.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:57.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:57.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:57.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:56 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:47:57.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:57 smithi070 ceph-mon[31177]: Detected new or changed devices on smithi191 2024-09-12T01:47:57.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:57 smithi070 ceph-mon[31177]: Adjusting osd_memory_target on smithi191 to 5696M 2024-09-12T01:47:57.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:57 smithi070 ceph-mon[31177]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T01:47:57.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:57 smithi070 ceph-mon[31177]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T01:47:57.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:57 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:57.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:57 smithi070 ceph-mon[31177]: from='osd.8 [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:47:57.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:57 smithi070 ceph-mon[31177]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:47:57.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:57 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:47:57.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:57 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:47:57.933 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:57 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:57.937 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:47:57 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:47:57.539+0000 7fa6d5911640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T01:47:57.938 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:47:57 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:47:57.551+0000 7fa6d1f4b640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:47:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:57 smithi191 ceph-mon[35770]: Detected new or changed devices on smithi191 2024-09-12T01:47:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:57 smithi191 ceph-mon[35770]: Adjusting osd_memory_target on smithi191 to 5696M 2024-09-12T01:47:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:57 smithi191 ceph-mon[35770]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T01:47:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:57 smithi191 ceph-mon[35770]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T01:47:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:57 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:57 smithi191 ceph-mon[35770]: from='osd.8 [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:47:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:57 smithi191 ceph-mon[35770]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:47:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:57 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:47:57.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:57 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:47:57.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:57 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:58.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:57 smithi152 ceph-mon[35055]: Detected new or changed devices on smithi191 2024-09-12T01:47:58.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:57 smithi152 ceph-mon[35055]: Adjusting osd_memory_target on smithi191 to 5696M 2024-09-12T01:47:58.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:57 smithi152 ceph-mon[35055]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T01:47:58.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:57 smithi152 ceph-mon[35055]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T01:47:58.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:57 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:58.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:57 smithi152 ceph-mon[35055]: from='osd.8 [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:47:58.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:57 smithi152 ceph-mon[35055]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:47:58.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:57 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:47:58.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:57 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:47:58.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:57 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:58 smithi070 ceph-mon[31177]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:58 smithi070 ceph-mon[31177]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:58 smithi070 ceph-mon[31177]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-12T01:47:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:58 smithi070 ceph-mon[31177]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T01:47:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:58 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:58.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:58 smithi191 ceph-mon[35770]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:58.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:58 smithi191 ceph-mon[35770]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:58 smithi191 ceph-mon[35770]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-12T01:47:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:58 smithi191 ceph-mon[35770]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T01:47:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:58 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:58 smithi152 ceph-mon[35055]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:58 smithi152 ceph-mon[35055]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T01:47:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:58 smithi152 ceph-mon[35055]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-12T01:47:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:58 smithi152 ceph-mon[35055]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T01:47:59.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:58 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:59.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:58 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:59.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:59 smithi070 ceph-mon[31177]: purged_snaps scrub starts 2024-09-12T01:47:59.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:59 smithi070 ceph-mon[31177]: purged_snaps scrub ok 2024-09-12T01:47:59.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:59 smithi070 ceph-mon[31177]: osd.8 [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072] boot 2024-09-12T01:47:59.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:59 smithi070 ceph-mon[31177]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T01:47:59.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:59 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:59.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:59 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2066015571' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51b65e44-5204-4ce9-8626-3161eee23a6c"}]: dispatch 2024-09-12T01:47:59.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:59 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2066015571' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51b65e44-5204-4ce9-8626-3161eee23a6c"}]': finished 2024-09-12T01:47:59.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:59 smithi070 ceph-mon[31177]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T01:47:59.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:47:59 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:47:59.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:59 smithi191 ceph-mon[35770]: purged_snaps scrub starts 2024-09-12T01:47:59.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:59 smithi191 ceph-mon[35770]: purged_snaps scrub ok 2024-09-12T01:47:59.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:59 smithi191 ceph-mon[35770]: osd.8 [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072] boot 2024-09-12T01:47:59.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:59 smithi191 ceph-mon[35770]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T01:47:59.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:59 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:47:59.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:59 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2066015571' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51b65e44-5204-4ce9-8626-3161eee23a6c"}]: dispatch 2024-09-12T01:47:59.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:59 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2066015571' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51b65e44-5204-4ce9-8626-3161eee23a6c"}]': finished 2024-09-12T01:47:59.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:59 smithi191 ceph-mon[35770]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T01:47:59.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:47:59 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:00.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:59 smithi152 ceph-mon[35055]: purged_snaps scrub starts 2024-09-12T01:48:00.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:59 smithi152 ceph-mon[35055]: purged_snaps scrub ok 2024-09-12T01:48:00.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:59 smithi152 ceph-mon[35055]: osd.8 [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072] boot 2024-09-12T01:48:00.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:59 smithi152 ceph-mon[35055]: osdmap e56: 9 total, 9 up, 9 in 2024-09-12T01:48:00.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:59 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T01:48:00.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:59 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2066015571' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51b65e44-5204-4ce9-8626-3161eee23a6c"}]: dispatch 2024-09-12T01:48:00.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:59 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2066015571' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51b65e44-5204-4ce9-8626-3161eee23a6c"}]': finished 2024-09-12T01:48:00.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:59 smithi152 ceph-mon[35055]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T01:48:00.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:47:59 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:00.913 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:00 smithi152 ceph-mon[35055]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:00.914 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:00 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/689844262' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:48:00.914 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:00 smithi152 ceph-mon[35055]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T01:48:00.914 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:00 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:00.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:00 smithi191 ceph-mon[35770]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:00.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:00 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/689844262' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:48:00.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:00 smithi191 ceph-mon[35770]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T01:48:00.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:00 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:01.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:00 smithi070 ceph-mon[31177]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:01.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:00 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/689844262' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:48:01.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:00 smithi070 ceph-mon[31177]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T01:48:01.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:00 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:02.192 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:02 smithi152 ceph-mon[35055]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T01:48:02.192 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:02 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:02.192 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:02 smithi152 ceph-mon[35055]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:02.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:02 smithi191 ceph-mon[35770]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T01:48:02.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:02 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:02.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:02 smithi191 ceph-mon[35770]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:02.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:02 smithi070 ceph-mon[31177]: osdmap e59: 10 total, 9 up, 10 in 2024-09-12T01:48:02.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:02 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:02.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:02 smithi070 ceph-mon[31177]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:03.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:03 smithi191 ceph-mon[35770]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T01:48:03.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:03 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:03.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:03 smithi152 ceph-mon[35055]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T01:48:03.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:03 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:03.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:03 smithi070 ceph-mon[31177]: osdmap e60: 10 total, 9 up, 10 in 2024-09-12T01:48:03.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:03 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:04.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:04 smithi191 ceph-mon[35770]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:04.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:04 smithi152 ceph-mon[35055]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:04.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:04 smithi070 ceph-mon[31177]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:06.576 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:06 smithi070 ceph-mon[31177]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T01:48:06.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:06 smithi152 ceph-mon[35055]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T01:48:06.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:06 smithi191 ceph-mon[35770]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T01:48:07.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T01:48:07.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:07.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T01:48:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:07.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T01:48:07.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:08.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:08 smithi152 ceph-mon[35055]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-12T01:48:08.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:08 smithi152 ceph-mon[35055]: Deploying daemon osd.9 on smithi070 2024-09-12T01:48:08.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:08 smithi070 ceph-mon[31177]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-12T01:48:08.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:08 smithi070 ceph-mon[31177]: Deploying daemon osd.9 on smithi070 2024-09-12T01:48:08.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:08 smithi191 ceph-mon[35770]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-12T01:48:08.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:08 smithi191 ceph-mon[35770]: Deploying daemon osd.9 on smithi070 2024-09-12T01:48:10.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:10 smithi070 ceph-mon[31177]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-12T01:48:10.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:10 smithi152 ceph-mon[35055]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-12T01:48:10.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:10 smithi191 ceph-mon[35770]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-12T01:48:12.752 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:12 smithi070 ceph-mon[31177]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:48:12.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:12 smithi191 ceph-mon[35770]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:48:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:12 smithi152 ceph-mon[35055]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:48:13.715 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:13 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:13.715 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:13 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:13.715 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:13 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:13.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:13 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:13.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:13 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:13.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:13 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:14.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:13 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:14.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:13 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:14.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:13 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:14.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:14 smithi070 ceph-mon[31177]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-12T01:48:14.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:14 smithi191 ceph-mon[35770]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-12T01:48:15.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:14 smithi152 ceph-mon[35055]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-12T01:48:15.789 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 9 on host 'smithi070' 2024-09-12T01:48:15.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.788+0000 7f62eaffd640 1 -- 172.21.15.70:0/233532412 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f62f4062630 con 0x7f62e00a2c30 2024-09-12T01:48:15.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.790+0000 7f62fc134640 1 -- 172.21.15.70:0/233532412 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62e00a2c30 msgr2=0x7f62e00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:15.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.790+0000 7f62fc134640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62e00a2c30 0x7f62e00a50f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f62f4198510 tx=0x7f62e4008040 comp rx=0 tx=0).stop 2024-09-12T01:48:15.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.790+0000 7f62fc134640 1 -- 172.21.15.70:0/233532412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62f4100b10 msgr2=0x7f62f4196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:15.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.790+0000 7f62fc134640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62f4100b10 0x7f62f4196ff0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62f000b450 tx=0x7f62f000b910 comp rx=0 tx=0).stop 2024-09-12T01:48:15.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.790+0000 7f62fc134640 1 -- 172.21.15.70:0/233532412 shutdown_connections 2024-09-12T01:48:15.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.790+0000 7f62fc134640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62e00a2c30 0x7f62e00a50f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:15.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.790+0000 7f62fc134640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f41026d0 0x7f62f419e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:15.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.790+0000 7f62fc134640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62f4101d10 0x7f62f4197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:15.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.790+0000 7f62fc134640 1 --2- 172.21.15.70:0/233532412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62f4100b10 0x7f62f4196ff0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:15.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.790+0000 7f62fc134640 1 -- 172.21.15.70:0/233532412 >> 172.21.15.70:0/233532412 conn(0x7f62f40fc2a0 msgr2=0x7f62f41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:15.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.790+0000 7f62fc134640 1 -- 172.21.15.70:0/233532412 shutdown_connections 2024-09-12T01:48:15.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:48:15.790+0000 7f62fc134640 1 -- 172.21.15.70:0/233532412 wait complete. 2024-09-12T01:48:16.492 DEBUG:teuthology.orchestra.run.smithi070:osd.9> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T01:48:16.494 INFO:tasks.cephadm:Deploying osd.10 on smithi152 with /dev/vg_nvme/lv_1... 2024-09-12T01:48:16.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T01:48:16.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:16 smithi070 ceph-mon[31177]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:48:16.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:16.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:16.753 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:48:16.875 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:16 smithi152 ceph-mon[35055]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:48:16.875 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:16.875 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:16.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:16 smithi191 ceph-mon[35770]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T01:48:16.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:16.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:18.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:18 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:18.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:18 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:18.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:18 smithi191 ceph-mon[35770]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:18.508 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:18 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:18.508 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:18 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:18.508 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:18 smithi152 ceph-mon[35055]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:18 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:18 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:18 smithi070 ceph-mon[31177]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:19.275 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-12T01:48:19.302 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi152:vg_nvme/lv_1 2024-09-12T01:48:19.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:19 smithi070 ceph-mon[31177]: from='osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:48:19.519 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:48:19 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:48:19.310+0000 7f1b17444640 -1 osd.9 0 log_to_monitors true 2024-09-12T01:48:19.562 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:48:19.582 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:19 smithi152 ceph-mon[35055]: from='osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:48:19.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:19 smithi191 ceph-mon[35770]: from='osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T01:48:20.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.012+0000 7f2e1ac48640 1 -- 172.21.15.152:0/2709335777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e141037c0 msgr2=0x7f2e1410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:20.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.012+0000 7f2e1ac48640 1 --2- 172.21.15.152:0/2709335777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e141037c0 0x7f2e1410a050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009ca0 tx=0x7f2e0c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:48:20.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.012+0000 7f2e1ac48640 1 -- 172.21.15.152:0/2709335777 shutdown_connections 2024-09-12T01:48:20.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.012+0000 7f2e1ac48640 1 --2- 172.21.15.152:0/2709335777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e141037c0 0x7f2e1410a050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.012+0000 7f2e1ac48640 1 --2- 172.21.15.152:0/2709335777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e14102e00 0x7f2e14103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.012+0000 7f2e1ac48640 1 --2- 172.21.15.152:0/2709335777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e14101c00 0x7f2e14102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.012+0000 7f2e1ac48640 1 -- 172.21.15.152:0/2709335777 >> 172.21.15.152:0/2709335777 conn(0x7f2e140fd3b0 msgr2=0x7f2e140ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.012+0000 7f2e1ac48640 1 -- 172.21.15.152:0/2709335777 shutdown_connections 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.012+0000 7f2e1ac48640 1 -- 172.21.15.152:0/2709335777 wait complete. 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.012+0000 7f2e1ac48640 1 Processor -- start 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.012+0000 7f2e1ac48640 1 -- start start 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e1ac48640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e14101c00 0x7f2e14197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e1ac48640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e14102e00 0x7f2e14198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e1ac48640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e141037c0 0x7f2e1419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e1ac48640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1410d9c0 con 0x7f2e14101c00 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e1ac48640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1410d840 con 0x7f2e14102e00 2024-09-12T01:48:20.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e1ac48640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1410db40 con 0x7f2e141037c0 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e189e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e14101c00 0x7f2e14197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e189e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e14101c00 0x7f2e14197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.152:43796/0 (socket says 172.21.15.152:43796) 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e189e4640 1 -- 172.21.15.152:0/3060976899 learned_addr learned my addr 172.21.15.152:0/3060976899 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e13fff640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e14102e00 0x7f2e14198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e191e5640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e141037c0 0x7f2e1419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e189e4640 1 -- 172.21.15.152:0/3060976899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e141037c0 msgr2=0x7f2e1419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e189e4640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e141037c0 0x7f2e1419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e189e4640 1 -- 172.21.15.152:0/3060976899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e14102e00 msgr2=0x7f2e14198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e189e4640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e14102e00 0x7f2e14198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e189e4640 1 -- 172.21.15.152:0/3060976899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1419fb60 con 0x7f2e14101c00 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e13fff640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e14102e00 0x7f2e14198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.013+0000 7f2e189e4640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e14101c00 0x7f2e14197f30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800e9c0 tx=0x7f2e0800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:20.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.014+0000 7f2e11ffb640 1 -- 172.21.15.152:0/3060976899 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0800cd80 con 0x7f2e14101c00 2024-09-12T01:48:20.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.014+0000 7f2e11ffb640 1 -- 172.21.15.152:0/3060976899 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e080035f0 con 0x7f2e14101c00 2024-09-12T01:48:20.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.014+0000 7f2e1ac48640 1 -- 172.21.15.152:0/3060976899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1419fe50 con 0x7f2e14101c00 2024-09-12T01:48:20.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.014+0000 7f2e11ffb640 1 -- 172.21.15.152:0/3060976899 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08010690 con 0x7f2e14101c00 2024-09-12T01:48:20.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.014+0000 7f2e1ac48640 1 -- 172.21.15.152:0/3060976899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e141a02a0 con 0x7f2e14101c00 2024-09-12T01:48:20.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.015+0000 7f2e1ac48640 1 -- 172.21.15.152:0/3060976899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e14108f30 con 0x7f2e14101c00 2024-09-12T01:48:20.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.016+0000 7f2e11ffb640 1 -- 172.21.15.152:0/3060976899 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2e080037a0 con 0x7f2e14101c00 2024-09-12T01:48:20.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.016+0000 7f2e11ffb640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2e040a2bb0 0x7f2e040a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:20.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.017+0000 7f2e11ffb640 1 -- 172.21.15.152:0/3060976899 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5965+0+0 (secure 0 0 0) 0x7f2e080ceb80 con 0x7f2e14101c00 2024-09-12T01:48:20.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.017+0000 7f2e13fff640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2e040a2bb0 0x7f2e040a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:20.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.017+0000 7f2e13fff640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2e040a2bb0 0x7f2e040a5070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2e14199450 tx=0x7f2e0000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:20.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.021+0000 7f2e11ffb640 1 -- 172.21.15.152:0/3060976899 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e0809c370 con 0x7f2e14101c00 2024-09-12T01:48:20.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:20.206+0000 7f2e1ac48640 1 -- 172.21.15.152:0/3060976899 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2e14062630 con 0x7f2e040a2bb0 2024-09-12T01:48:20.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:20 smithi152 ceph-mon[35055]: from='osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T01:48:20.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:20 smithi152 ceph-mon[35055]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T01:48:20.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:20 smithi152 ceph-mon[35055]: from='osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-12T01:48:20.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:20.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:20 smithi152 ceph-mon[35055]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:20.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:48:20.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:48:20.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:20.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:20 smithi152 ceph-mon[35055]: from='osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-12T01:48:20.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:20 smithi152 ceph-mon[35055]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T01:48:20.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:20 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:20.515 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:48:20.372+0000 7f1b12ba4640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T01:48:20.515 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:48:20.385+0000 7f1b0f1de640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:48:20.515 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-mon[31177]: from='osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T01:48:20.515 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-mon[31177]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T01:48:20.515 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-mon[31177]: from='osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-12T01:48:20.515 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:20.515 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-mon[31177]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:20.516 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:48:20.516 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:48:20.516 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:20.516 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-mon[31177]: from='osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-12T01:48:20.516 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-mon[31177]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T01:48:20.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:20 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:20 smithi191 ceph-mon[35770]: from='osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T01:48:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:20 smithi191 ceph-mon[35770]: osdmap e61: 10 total, 9 up, 10 in 2024-09-12T01:48:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:20 smithi191 ceph-mon[35770]: from='osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-12T01:48:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:20 smithi191 ceph-mon[35770]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:48:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:48:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:20 smithi191 ceph-mon[35770]: from='osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-12T01:48:20.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:20 smithi191 ceph-mon[35770]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T01:48:20.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:20 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:21.643 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:21.643 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:21.643 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: Detected new or changed devices on smithi070 2024-09-12T01:48:21.643 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.643 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.643 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:21.644 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:21.644 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:21.644 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:21.644 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: Adjusting osd_memory_target on smithi070 to 4272M 2024-09-12T01:48:21.644 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.644 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:21.644 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:21.644 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.644 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:21.644 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:21.644 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:21.644 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.645 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:21.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:21.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:21.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: Detected new or changed devices on smithi070 2024-09-12T01:48:21.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:21.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:21.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:21.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:21.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: Adjusting osd_memory_target on smithi070 to 4272M 2024-09-12T01:48:21.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:21.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:21.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:21.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:21.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:21.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:21.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:21.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:21.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: Detected new or changed devices on smithi070 2024-09-12T01:48:21.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: Adjusting osd_memory_target on smithi070 to 4272M 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:21.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:22.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:22 smithi070 ceph-mon[31177]: purged_snaps scrub starts 2024-09-12T01:48:22.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:22 smithi070 ceph-mon[31177]: purged_snaps scrub ok 2024-09-12T01:48:22.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:22 smithi070 ceph-mon[31177]: osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043] boot 2024-09-12T01:48:22.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:22 smithi070 ceph-mon[31177]: osdmap e63: 10 total, 10 up, 10 in 2024-09-12T01:48:22.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:22 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:22.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:22 smithi070 ceph-mon[31177]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:22.683 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:22 smithi152 ceph-mon[35055]: purged_snaps scrub starts 2024-09-12T01:48:22.684 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:22 smithi152 ceph-mon[35055]: purged_snaps scrub ok 2024-09-12T01:48:22.684 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:22 smithi152 ceph-mon[35055]: osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043] boot 2024-09-12T01:48:22.684 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:22 smithi152 ceph-mon[35055]: osdmap e63: 10 total, 10 up, 10 in 2024-09-12T01:48:22.684 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:22 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:22.684 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:22 smithi152 ceph-mon[35055]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:22.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:22 smithi191 ceph-mon[35770]: purged_snaps scrub starts 2024-09-12T01:48:22.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:22 smithi191 ceph-mon[35770]: purged_snaps scrub ok 2024-09-12T01:48:22.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:22 smithi191 ceph-mon[35770]: osd.9 [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043] boot 2024-09-12T01:48:22.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:22 smithi191 ceph-mon[35770]: osdmap e63: 10 total, 10 up, 10 in 2024-09-12T01:48:22.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:22 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T01:48:22.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:22 smithi191 ceph-mon[35770]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T01:48:23.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:23 smithi191 ceph-mon[35770]: osdmap e64: 10 total, 10 up, 10 in 2024-09-12T01:48:23.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:23 smithi191 ceph-mon[35770]: from='client.? 172.21.15.152:0/3805481910' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69fd537a-46d7-418a-9952-57c3e716456b"}]: dispatch 2024-09-12T01:48:23.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:23 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69fd537a-46d7-418a-9952-57c3e716456b"}]: dispatch 2024-09-12T01:48:23.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:23 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69fd537a-46d7-418a-9952-57c3e716456b"}]': finished 2024-09-12T01:48:23.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:23 smithi191 ceph-mon[35770]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T01:48:23.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:23 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:23.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:23 smithi191 ceph-mon[35770]: from='client.? 172.21.15.152:0/1278384887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:48:23.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:23 smithi152 ceph-mon[35055]: osdmap e64: 10 total, 10 up, 10 in 2024-09-12T01:48:23.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:23 smithi152 ceph-mon[35055]: from='client.? 172.21.15.152:0/3805481910' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69fd537a-46d7-418a-9952-57c3e716456b"}]: dispatch 2024-09-12T01:48:23.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:23 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69fd537a-46d7-418a-9952-57c3e716456b"}]: dispatch 2024-09-12T01:48:23.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:23 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69fd537a-46d7-418a-9952-57c3e716456b"}]': finished 2024-09-12T01:48:23.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:23 smithi152 ceph-mon[35055]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T01:48:23.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:23 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:23.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:23 smithi152 ceph-mon[35055]: from='client.? 172.21.15.152:0/1278384887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:48:23.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:23 smithi070 ceph-mon[31177]: osdmap e64: 10 total, 10 up, 10 in 2024-09-12T01:48:23.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:23 smithi070 ceph-mon[31177]: from='client.? 172.21.15.152:0/3805481910' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69fd537a-46d7-418a-9952-57c3e716456b"}]: dispatch 2024-09-12T01:48:23.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:23 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69fd537a-46d7-418a-9952-57c3e716456b"}]: dispatch 2024-09-12T01:48:23.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:23 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69fd537a-46d7-418a-9952-57c3e716456b"}]': finished 2024-09-12T01:48:23.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:23 smithi070 ceph-mon[31177]: osdmap e65: 11 total, 10 up, 11 in 2024-09-12T01:48:23.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:23 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:23.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:23 smithi070 ceph-mon[31177]: from='client.? 172.21.15.152:0/1278384887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:48:24.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:24 smithi191 ceph-mon[35770]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:24.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:24 smithi152 ceph-mon[35055]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:24.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:24 smithi070 ceph-mon[31177]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:26.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:26 smithi152 ceph-mon[35055]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:26.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:26 smithi070 ceph-mon[31177]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:26.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:26 smithi191 ceph-mon[35770]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:28.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:28 smithi152 ceph-mon[35055]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:28.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:28 smithi070 ceph-mon[31177]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:28.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:28 smithi191 ceph-mon[35770]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:30.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:30 smithi152 ceph-mon[35055]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:30 smithi070 ceph-mon[31177]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:30.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:30 smithi191 ceph-mon[35770]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:31.628 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:31 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T01:48:31.628 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:31 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:31.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:31 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T01:48:31.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:31 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:31.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:31 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T01:48:31.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:31 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:32.585 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:32 smithi152 ceph-mon[35055]: Deploying daemon osd.10 on smithi152 2024-09-12T01:48:32.585 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:32 smithi152 ceph-mon[35055]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:32 smithi070 ceph-mon[31177]: Deploying daemon osd.10 on smithi152 2024-09-12T01:48:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:32 smithi070 ceph-mon[31177]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:32.839 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:32 smithi191 ceph-mon[35770]: Deploying daemon osd.10 on smithi152 2024-09-12T01:48:32.839 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:32 smithi191 ceph-mon[35770]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:34.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:34 smithi152 ceph-mon[35055]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:34.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:34 smithi191 ceph-mon[35770]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:35.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:34 smithi070 ceph-mon[31177]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:36.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:36 smithi152 ceph-mon[35055]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:36.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:36 smithi191 ceph-mon[35770]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:37.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:36 smithi070 ceph-mon[31177]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:37.779 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:37.779 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:37.779 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:37.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:37.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:37.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:38.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:38.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:38.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:38.783 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:38 smithi152 ceph-mon[35055]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:38.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:38 smithi191 ceph-mon[35770]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:39.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:38 smithi070 ceph-mon[31177]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:39.898 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 10 on host 'smithi152' 2024-09-12T01:48:39.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.897+0000 7f2e11ffb640 1 -- 172.21.15.152:0/3060976899 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f2e14062630 con 0x7f2e040a2bb0 2024-09-12T01:48:39.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.900+0000 7f2e1ac48640 1 -- 172.21.15.152:0/3060976899 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2e040a2bb0 msgr2=0x7f2e040a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:39.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.900+0000 7f2e1ac48640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2e040a2bb0 0x7f2e040a5070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2e14199450 tx=0x7f2e0000b390 comp rx=0 tx=0).stop 2024-09-12T01:48:39.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.900+0000 7f2e1ac48640 1 -- 172.21.15.152:0/3060976899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e14101c00 msgr2=0x7f2e14197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:39.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.900+0000 7f2e1ac48640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e14101c00 0x7f2e14197f30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800e9c0 tx=0x7f2e0800ee80 comp rx=0 tx=0).stop 2024-09-12T01:48:39.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.900+0000 7f2e1ac48640 1 -- 172.21.15.152:0/3060976899 shutdown_connections 2024-09-12T01:48:39.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.900+0000 7f2e1ac48640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2e040a2bb0 0x7f2e040a5070 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:39.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.900+0000 7f2e1ac48640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e141037c0 0x7f2e1419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:39.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.900+0000 7f2e1ac48640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e14102e00 0x7f2e14198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:39.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.900+0000 7f2e1ac48640 1 --2- 172.21.15.152:0/3060976899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e14101c00 0x7f2e14197f30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:39.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.900+0000 7f2e1ac48640 1 -- 172.21.15.152:0/3060976899 >> 172.21.15.152:0/3060976899 conn(0x7f2e140fd3b0 msgr2=0x7f2e14106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:39.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.900+0000 7f2e1ac48640 1 -- 172.21.15.152:0/3060976899 shutdown_connections 2024-09-12T01:48:39.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-12T01:48:39.900+0000 7f2e1ac48640 1 -- 172.21.15.152:0/3060976899 wait complete. 2024-09-12T01:48:40.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:40 smithi191 ceph-mon[35770]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.490 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.490 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.490 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:40 smithi152 ceph-mon[35055]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:40.490 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:40.490 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:40.490 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.490 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:40.490 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.490 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:40 smithi070 ceph-mon[31177]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:40.646 DEBUG:teuthology.orchestra.run.smithi152:osd.10> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T01:48:40.649 INFO:tasks.cephadm:Deploying osd.11 on smithi191 with /dev/vg_nvme/lv_1... 2024-09-12T01:48:40.650 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T01:48:40.903 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:48:42.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:42 smithi191 ceph-mon[35770]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:42.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:42 smithi152 ceph-mon[35055]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:42.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:42 smithi070 ceph-mon[31177]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:43.158 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:48:42 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:48:42.855+0000 7f058a822640 -1 osd.10 0 log_to_monitors true 2024-09-12T01:48:43.391 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-09-12T01:48:43.416 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi191:vg_nvme/lv_1 2024-09-12T01:48:43.672 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:48:43.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:43 smithi191 ceph-mon[35770]: from='osd.10 [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:48:43.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:43 smithi191 ceph-mon[35770]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:48:43.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:43 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:43.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:43 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:43.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:43 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:43.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:43 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:43.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:43 smithi152 ceph-mon[35055]: from='osd.10 [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:48:43.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:43 smithi152 ceph-mon[35055]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:48:43.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:43 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:43.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:43 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:43.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:43 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:43.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:43 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:43.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:43 smithi070 ceph-mon[31177]: from='osd.10 [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:48:43.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:43 smithi070 ceph-mon[31177]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T01:48:43.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:43 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:43.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:43 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:43.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:43 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:43.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:43 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:44.110 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.107+0000 7f22559ac640 1 -- 172.21.15.191:0/3756685320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2250102e00 msgr2=0x7f2250103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:44.111 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.107+0000 7f22559ac640 1 --2- 172.21.15.191:0/3756685320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2250102e00 0x7f2250103280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2240009900 tx=0x7f224002a410 comp rx=0 tx=0).stop 2024-09-12T01:48:44.111 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.107+0000 7f22559ac640 1 -- 172.21.15.191:0/3756685320 shutdown_connections 2024-09-12T01:48:44.111 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.107+0000 7f22559ac640 1 --2- 172.21.15.191:0/3756685320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22501037c0 0x7f225010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:44.111 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.107+0000 7f22559ac640 1 --2- 172.21.15.191:0/3756685320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2250102e00 0x7f2250103280 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:44.111 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.107+0000 7f22559ac640 1 --2- 172.21.15.191:0/3756685320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2250101c00 0x7f2250102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:44.111 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.107+0000 7f22559ac640 1 -- 172.21.15.191:0/3756685320 >> 172.21.15.191:0/3756685320 conn(0x7f22500fd390 msgr2=0x7f22500ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:44.111 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.107+0000 7f22559ac640 1 -- 172.21.15.191:0/3756685320 shutdown_connections 2024-09-12T01:48:44.111 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.107+0000 7f22559ac640 1 -- 172.21.15.191:0/3756685320 wait complete. 2024-09-12T01:48:44.111 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.108+0000 7f22559ac640 1 Processor -- start 2024-09-12T01:48:44.112 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.108+0000 7f22559ac640 1 -- start start 2024-09-12T01:48:44.112 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.108+0000 7f22559ac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2250101c00 0x7f2250197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:44.112 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.108+0000 7f22559ac640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2250102e00 0x7f2250198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:44.112 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.108+0000 7f22559ac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22501037c0 0x7f225019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:44.112 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.108+0000 7f22559ac640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f225010da10 con 0x7f2250101c00 2024-09-12T01:48:44.112 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.108+0000 7f22559ac640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f225010d890 con 0x7f22501037c0 2024-09-12T01:48:44.112 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.108+0000 7f22559ac640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f225010db90 con 0x7f2250102e00 2024-09-12T01:48:44.112 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f224e7fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2250102e00 0x7f2250198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:44.112 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f224e7fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2250102e00 0x7f2250198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:39178/0 (socket says 172.21.15.191:39178) 2024-09-12T01:48:44.112 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f224e7fc640 1 -- 172.21.15.191:0/1200677276 learned_addr learned my addr 172.21.15.191:0/1200677276 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-12T01:48:44.112 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f224effd640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2250101c00 0x7f2250197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:44.112 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f224f7fe640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22501037c0 0x7f225019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:44.113 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f224e7fc640 1 -- 172.21.15.191:0/1200677276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22501037c0 msgr2=0x7f225019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:44.113 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f224e7fc640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22501037c0 0x7f225019f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:44.113 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f224e7fc640 1 -- 172.21.15.191:0/1200677276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2250101c00 msgr2=0x7f2250197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:44.113 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f224e7fc640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2250101c00 0x7f2250197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:44.113 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f224e7fc640 1 -- 172.21.15.191:0/1200677276 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225019fb70 con 0x7f2250102e00 2024-09-12T01:48:44.113 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f224f7fe640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22501037c0 0x7f225019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:48:44.113 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f224e7fc640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2250102e00 0x7f2250198480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f22400316a0 tx=0x7f2240032d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:44.113 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f22549aa640 1 -- 172.21.15.191:0/1200677276 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224003f030 con 0x7f2250102e00 2024-09-12T01:48:44.113 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f22549aa640 1 -- 172.21.15.191:0/1200677276 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2240003d00 con 0x7f2250102e00 2024-09-12T01:48:44.113 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f22559ac640 1 -- 172.21.15.191:0/1200677276 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225019fe00 con 0x7f2250102e00 2024-09-12T01:48:44.113 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f22549aa640 1 -- 172.21.15.191:0/1200677276 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240035070 con 0x7f2250102e00 2024-09-12T01:48:44.113 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.109+0000 7f22559ac640 1 -- 172.21.15.191:0/1200677276 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22501a0260 con 0x7f2250102e00 2024-09-12T01:48:44.114 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.111+0000 7f22559ac640 1 -- 172.21.15.191:0/1200677276 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2250108ed0 con 0x7f2250102e00 2024-09-12T01:48:44.114 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.111+0000 7f22549aa640 1 -- 172.21.15.191:0/1200677276 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2240042030 con 0x7f2250102e00 2024-09-12T01:48:44.114 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.112+0000 7f22549aa640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f22380a2c30 0x7f22380a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:44.115 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.112+0000 7f22549aa640 1 -- 172.21.15.191:0/1200677276 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6398+0+0 (secure 0 0 0) 0x7f22400eeec0 con 0x7f2250102e00 2024-09-12T01:48:44.115 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.112+0000 7f224effd640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f22380a2c30 0x7f22380a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:44.115 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.113+0000 7f224effd640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f22380a2c30 0x7f22380a50f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2250102c60 tx=0x7f2244005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:44.117 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.116+0000 7f22549aa640 1 -- 172.21.15.191:0/1200677276 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f22400bc5a0 con 0x7f2250102e00 2024-09-12T01:48:44.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:48:44.298+0000 7f22559ac640 1 -- 172.21.15.191:0/1200677276 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2250062630 con 0x7f22380a2c30 2024-09-12T01:48:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: Detected new or changed devices on smithi152 2024-09-12T01:48:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: Adjusting osd_memory_target on smithi152 to 4272M 2024-09-12T01:48:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T01:48:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T01:48:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='osd.10 [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:48:44.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:48:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:48:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:48:44.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:44 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:45.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:45.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: Detected new or changed devices on smithi152 2024-09-12T01:48:45.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:45.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:45.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: Adjusting osd_memory_target on smithi152 to 4272M 2024-09-12T01:48:45.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T01:48:45.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T01:48:45.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='osd.10 [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:48:45.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:45.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:48:45.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:45.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:45.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:45.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:45.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:48:45.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:48:45.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:44 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:45.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:45.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: Detected new or changed devices on smithi152 2024-09-12T01:48:45.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:45.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:48:45.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: Adjusting osd_memory_target on smithi152 to 4272M 2024-09-12T01:48:45.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T01:48:45.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: osdmap e66: 11 total, 10 up, 11 in 2024-09-12T01:48:45.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='osd.10 [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:48:45.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:45.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2024-09-12T01:48:45.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:45.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:45.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:45.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:48:45.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:48:45.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:48:45.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:44 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:45.762 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:48:45 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:48:45.328+0000 7f0585f82640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T01:48:45.762 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:48:45 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:48:45.347+0000 7f057e5b4640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:48:45.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:45 smithi152 ceph-mon[35055]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:45 smithi152 ceph-mon[35055]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-12T01:48:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:45 smithi152 ceph-mon[35055]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T01:48:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:45 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:45 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:45.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:45 smithi152 ceph-mon[35055]: from='osd.10 ' entity='osd.10' 2024-09-12T01:48:45.800 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:45 smithi191 ceph-mon[35770]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:45.800 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:45 smithi191 ceph-mon[35770]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-12T01:48:45.800 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:45 smithi191 ceph-mon[35770]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T01:48:45.800 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:45 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:45.800 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:45 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:45.800 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:45 smithi191 ceph-mon[35770]: from='osd.10 ' entity='osd.10' 2024-09-12T01:48:46.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:45 smithi070 ceph-mon[31177]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:46.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:45 smithi070 ceph-mon[31177]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2024-09-12T01:48:46.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:45 smithi070 ceph-mon[31177]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T01:48:46.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:45 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:46.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:45 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:46.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:45 smithi070 ceph-mon[31177]: from='osd.10 ' entity='osd.10' 2024-09-12T01:48:46.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:46 smithi191 ceph-mon[35770]: purged_snaps scrub starts 2024-09-12T01:48:46.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:46 smithi191 ceph-mon[35770]: purged_snaps scrub ok 2024-09-12T01:48:46.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:46 smithi191 ceph-mon[35770]: pgmap v219: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:46.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:46 smithi191 ceph-mon[35770]: osd.10 [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437] boot 2024-09-12T01:48:46.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:46 smithi191 ceph-mon[35770]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T01:48:46.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:46 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:46.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:46 smithi191 ceph-mon[35770]: from='client.? 172.21.15.191:0/1447994769' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4d88a79-ce4f-45f6-aa34-8b9c66a953d5"}]: dispatch 2024-09-12T01:48:46.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:46 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4d88a79-ce4f-45f6-aa34-8b9c66a953d5"}]: dispatch 2024-09-12T01:48:46.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:46 smithi191 ceph-mon[35770]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4d88a79-ce4f-45f6-aa34-8b9c66a953d5"}]': finished 2024-09-12T01:48:46.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:46 smithi191 ceph-mon[35770]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T01:48:46.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:46 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:48:47.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:46 smithi152 ceph-mon[35055]: purged_snaps scrub starts 2024-09-12T01:48:47.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:46 smithi152 ceph-mon[35055]: purged_snaps scrub ok 2024-09-12T01:48:47.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:46 smithi152 ceph-mon[35055]: pgmap v219: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:47.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:46 smithi152 ceph-mon[35055]: osd.10 [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437] boot 2024-09-12T01:48:47.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:46 smithi152 ceph-mon[35055]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T01:48:47.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:46 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:47.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:46 smithi152 ceph-mon[35055]: from='client.? 172.21.15.191:0/1447994769' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4d88a79-ce4f-45f6-aa34-8b9c66a953d5"}]: dispatch 2024-09-12T01:48:47.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:46 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4d88a79-ce4f-45f6-aa34-8b9c66a953d5"}]: dispatch 2024-09-12T01:48:47.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:46 smithi152 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4d88a79-ce4f-45f6-aa34-8b9c66a953d5"}]': finished 2024-09-12T01:48:47.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:46 smithi152 ceph-mon[35055]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T01:48:47.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:46 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:48:47.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:46 smithi070 ceph-mon[31177]: purged_snaps scrub starts 2024-09-12T01:48:47.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:46 smithi070 ceph-mon[31177]: purged_snaps scrub ok 2024-09-12T01:48:47.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:46 smithi070 ceph-mon[31177]: pgmap v219: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T01:48:47.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:46 smithi070 ceph-mon[31177]: osd.10 [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437] boot 2024-09-12T01:48:47.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:46 smithi070 ceph-mon[31177]: osdmap e68: 11 total, 11 up, 11 in 2024-09-12T01:48:47.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:46 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T01:48:47.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:46 smithi070 ceph-mon[31177]: from='client.? 172.21.15.191:0/1447994769' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4d88a79-ce4f-45f6-aa34-8b9c66a953d5"}]: dispatch 2024-09-12T01:48:47.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:46 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c4d88a79-ce4f-45f6-aa34-8b9c66a953d5"}]: dispatch 2024-09-12T01:48:47.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:46 smithi070 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c4d88a79-ce4f-45f6-aa34-8b9c66a953d5"}]': finished 2024-09-12T01:48:47.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:46 smithi070 ceph-mon[31177]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T01:48:47.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:46 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:48:47.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:47 smithi191 ceph-mon[35770]: from='client.? 172.21.15.191:0/2319319141' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:48:47.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:47 smithi191 ceph-mon[35770]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T01:48:47.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:47 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:48:48.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:47 smithi152 ceph-mon[35055]: from='client.? 172.21.15.191:0/2319319141' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:48:48.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:47 smithi152 ceph-mon[35055]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T01:48:48.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:47 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:48:48.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:47 smithi070 ceph-mon[31177]: from='client.? 172.21.15.191:0/2319319141' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:48:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:47 smithi070 ceph-mon[31177]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T01:48:48.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:47 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:48:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:48 smithi191 ceph-mon[35770]: pgmap v222: 1 pgs: 1 peering; 577 KiB data, 723 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:48:49.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:48 smithi152 ceph-mon[35055]: pgmap v222: 1 pgs: 1 peering; 577 KiB data, 723 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:48:49.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:48 smithi070 ceph-mon[31177]: pgmap v222: 1 pgs: 1 peering; 577 KiB data, 723 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:48:49.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:49 smithi191 ceph-mon[35770]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T01:48:49.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:49 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:48:50.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:49 smithi152 ceph-mon[35055]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T01:48:50.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:49 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:48:50.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:49 smithi070 ceph-mon[31177]: osdmap e71: 12 total, 11 up, 12 in 2024-09-12T01:48:50.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:48:50.920 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:50 smithi070 ceph-mon[31177]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 723 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:48:50.920 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:50 smithi070 ceph-mon[31177]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T01:48:50.920 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:50 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:48:50.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:50 smithi191 ceph-mon[35770]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 723 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:48:50.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:50 smithi191 ceph-mon[35770]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T01:48:50.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:50 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:48:51.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:50 smithi152 ceph-mon[35055]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 723 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:48:51.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:50 smithi152 ceph-mon[35055]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T01:48:51.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:50 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:48:52.857 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:52 smithi191 ceph-mon[35770]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-12T01:48:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:52 smithi152 ceph-mon[35055]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-12T01:48:53.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:52 smithi070 ceph-mon[31177]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-12T01:48:54.845 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:54 smithi191 ceph-mon[35770]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T01:48:55.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:54 smithi152 ceph-mon[35055]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T01:48:55.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:54 smithi070 ceph-mon[31177]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T01:48:55.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T01:48:55.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:55 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:55.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:55 smithi191 ceph-mon[35770]: Deploying daemon osd.11 on smithi191 2024-09-12T01:48:55.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:55 smithi191 ceph-mon[35770]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:48:56.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T01:48:56.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:55 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:56.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:55 smithi152 ceph-mon[35055]: Deploying daemon osd.11 on smithi191 2024-09-12T01:48:56.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:55 smithi152 ceph-mon[35055]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:48:56.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T01:48:56.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:55 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:56.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:55 smithi070 ceph-mon[31177]: Deploying daemon osd.11 on smithi191 2024-09-12T01:48:56.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:55 smithi070 ceph-mon[31177]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T01:48:58.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:48:58 smithi191 ceph-mon[35770]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-12T01:48:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:48:58 smithi070 ceph-mon[31177]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-12T01:48:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:48:58 smithi152 ceph-mon[35055]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-12T01:49:00.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:00 smithi070 ceph-mon[31177]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:49:00.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:00 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:00.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:00 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:00.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:00 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:00.814 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:00 smithi152 ceph-mon[35055]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:49:00.815 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:00 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:00.815 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:00 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:00.815 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:00 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:00.857 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:00 smithi191 ceph-mon[35770]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:49:00.857 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:00 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:00.857 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:00 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:00.857 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:00 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:02.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:02 smithi191 ceph-mon[35770]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:03.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:02 smithi152 ceph-mon[35055]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:03.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:02 smithi070 ceph-mon[31177]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:03.947 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.947+0000 7f22549aa640 1 -- 172.21.15.191:0/1200677276 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f2250062630 con 0x7f22380a2c30 2024-09-12T01:49:03.947 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 11 on host 'smithi191' 2024-09-12T01:49:03.949 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.949+0000 7f22559ac640 1 -- 172.21.15.191:0/1200677276 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f22380a2c30 msgr2=0x7f22380a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:03.949 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.949+0000 7f22559ac640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f22380a2c30 0x7f22380a50f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2250102c60 tx=0x7f2244005f90 comp rx=0 tx=0).stop 2024-09-12T01:49:03.949 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.949+0000 7f22559ac640 1 -- 172.21.15.191:0/1200677276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2250102e00 msgr2=0x7f2250198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:03.949 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.949+0000 7f22559ac640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2250102e00 0x7f2250198480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f22400316a0 tx=0x7f2240032d90 comp rx=0 tx=0).stop 2024-09-12T01:49:03.949 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.949+0000 7f22559ac640 1 -- 172.21.15.191:0/1200677276 shutdown_connections 2024-09-12T01:49:03.949 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.949+0000 7f22559ac640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f22380a2c30 0x7f22380a50f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:03.949 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.949+0000 7f22559ac640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22501037c0 0x7f225019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:03.949 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.949+0000 7f22559ac640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2250102e00 0x7f2250198480 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:03.949 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.949+0000 7f22559ac640 1 --2- 172.21.15.191:0/1200677276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2250101c00 0x7f2250197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:03.950 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.949+0000 7f22559ac640 1 -- 172.21.15.191:0/1200677276 >> 172.21.15.191:0/1200677276 conn(0x7f22500fd390 msgr2=0x7f22501060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:03.950 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.949+0000 7f22559ac640 1 -- 172.21.15.191:0/1200677276 shutdown_connections 2024-09-12T01:49:03.950 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:03.949+0000 7f22559ac640 1 -- 172.21.15.191:0/1200677276 wait complete. 2024-09-12T01:49:04.578 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:04.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:04.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:04 smithi191 ceph-mon[35770]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:04.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:04.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:04 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.605 DEBUG:teuthology.orchestra.run.smithi191:osd.11> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T01:49:04.607 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T01:49:04.608 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:49:04.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.636 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:04.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:04.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:04 smithi070 ceph-mon[31177]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:04.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:04.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:04 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:04.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:04.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:04 smithi152 ceph-mon[35055]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:04.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:04.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:04 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:04.865 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:05.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.254+0000 7fae86054640 1 -- 172.21.15.70:0/4262588374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae801026d0 msgr2=0x7fae80104ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:05.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.254+0000 7fae86054640 1 --2- 172.21.15.70:0/4262588374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae801026d0 0x7fae80104ac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fae70009900 tx=0x7fae7002a410 comp rx=0 tx=0).stop 2024-09-12T01:49:05.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.254+0000 7fae86054640 1 -- 172.21.15.70:0/4262588374 shutdown_connections 2024-09-12T01:49:05.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.254+0000 7fae86054640 1 --2- 172.21.15.70:0/4262588374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae80107930 0x7fae80109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:05.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.254+0000 7fae86054640 1 --2- 172.21.15.70:0/4262588374 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae80105000 0x7fae801073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:05.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.254+0000 7fae86054640 1 --2- 172.21.15.70:0/4262588374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae801026d0 0x7fae80104ac0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:05.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.254+0000 7fae86054640 1 -- 172.21.15.70:0/4262588374 >> 172.21.15.70:0/4262588374 conn(0x7fae800fc290 msgr2=0x7fae800fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:05.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.254+0000 7fae86054640 1 -- 172.21.15.70:0/4262588374 shutdown_connections 2024-09-12T01:49:05.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.254+0000 7fae86054640 1 -- 172.21.15.70:0/4262588374 wait complete. 2024-09-12T01:49:05.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.254+0000 7fae86054640 1 Processor -- start 2024-09-12T01:49:05.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae86054640 1 -- start start 2024-09-12T01:49:05.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae86054640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae801026d0 0x7fae80102030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:05.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae86054640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae80105000 0x7fae80100680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:05.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae86054640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae80107930 0x7fae80100bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:05.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae86054640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fae8010d9c0 con 0x7fae80105000 2024-09-12T01:49:05.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae86054640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fae8010d840 con 0x7fae801026d0 2024-09-12T01:49:05.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae86054640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fae8010db40 con 0x7fae80107930 2024-09-12T01:49:05.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae7effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae80105000 0x7fae80100680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:05.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae7effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae80105000 0x7fae80100680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45176/0 (socket says 172.21.15.70:45176) 2024-09-12T01:49:05.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae7effd640 1 -- 172.21.15.70:0/3026694057 learned_addr learned my addr 172.21.15.70:0/3026694057 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:05.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae7f7fe640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae801026d0 0x7fae80102030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae7ffff640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae80107930 0x7fae80100bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae7effd640 1 -- 172.21.15.70:0/3026694057 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae80107930 msgr2=0x7fae80100bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae7effd640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae80107930 0x7fae80100bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae7effd640 1 -- 172.21.15.70:0/3026694057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae801026d0 msgr2=0x7fae80102030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae7effd640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae801026d0 0x7fae80102030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae7effd640 1 -- 172.21.15.70:0/3026694057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae80101480 con 0x7fae80105000 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.255+0000 7fae7ffff640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae80107930 0x7fae80100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.256+0000 7fae7effd640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae80105000 0x7fae80100680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c970 tx=0x7fae7400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.256+0000 7fae7cff9640 1 -- 172.21.15.70:0/3026694057 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74007bb0 con 0x7fae80105000 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.256+0000 7fae86054640 1 -- 172.21.15.70:0/3026694057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae801a2170 con 0x7fae80105000 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.256+0000 7fae7cff9640 1 -- 172.21.15.70:0/3026694057 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae74007d50 con 0x7fae80105000 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.256+0000 7fae7cff9640 1 -- 172.21.15.70:0/3026694057 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7400f6b0 con 0x7fae80105000 2024-09-12T01:49:05.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.256+0000 7fae86054640 1 -- 172.21.15.70:0/3026694057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae801a2680 con 0x7fae80105000 2024-09-12T01:49:05.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.257+0000 7fae86054640 1 -- 172.21.15.70:0/3026694057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae800fdd80 con 0x7fae80105000 2024-09-12T01:49:05.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.258+0000 7fae7cff9640 1 -- 172.21.15.70:0/3026694057 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fae740046c0 con 0x7fae80105000 2024-09-12T01:49:05.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.259+0000 7fae7cff9640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fae680a2b80 0x7fae680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:05.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.259+0000 7fae7cff9640 1 -- 172.21.15.70:0/3026694057 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7fae740cea70 con 0x7fae80105000 2024-09-12T01:49:05.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.259+0000 7fae7f7fe640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fae680a2b80 0x7fae680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:05.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.259+0000 7fae7f7fe640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fae680a2b80 0x7fae680a5040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fae70006010 tx=0x7fae70031640 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:05.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.263+0000 7fae7cff9640 1 -- 172.21.15.70:0/3026694057 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae74014030 con 0x7fae80105000 2024-09-12T01:49:05.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.432+0000 7fae86054640 1 -- 172.21.15.70:0/3026694057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fae8002da10 con 0x7fae80105000 2024-09-12T01:49:05.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.433+0000 7fae7cff9640 1 -- 172.21.15.70:0/3026694057 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fae7409bfb0 con 0x7fae80105000 2024-09-12T01:49:05.433 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:05.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.434+0000 7fae86054640 1 -- 172.21.15.70:0/3026694057 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fae680a2b80 msgr2=0x7fae680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:05.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.434+0000 7fae86054640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fae680a2b80 0x7fae680a5040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fae70006010 tx=0x7fae70031640 comp rx=0 tx=0).stop 2024-09-12T01:49:05.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.435+0000 7fae86054640 1 -- 172.21.15.70:0/3026694057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae80105000 msgr2=0x7fae80100680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:05.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.435+0000 7fae86054640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae80105000 0x7fae80100680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c970 tx=0x7fae7400ce30 comp rx=0 tx=0).stop 2024-09-12T01:49:05.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.435+0000 7fae86054640 1 -- 172.21.15.70:0/3026694057 shutdown_connections 2024-09-12T01:49:05.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.435+0000 7fae86054640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fae680a2b80 0x7fae680a5040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:05.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.435+0000 7fae86054640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae80107930 0x7fae80100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:05.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.435+0000 7fae86054640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae80105000 0x7fae80100680 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:05.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.435+0000 7fae86054640 1 --2- 172.21.15.70:0/3026694057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae801026d0 0x7fae80102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:05.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.435+0000 7fae86054640 1 -- 172.21.15.70:0/3026694057 >> 172.21.15.70:0/3026694057 conn(0x7fae800fc290 msgr2=0x7fae80103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:05.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.435+0000 7fae86054640 1 -- 172.21.15.70:0/3026694057 shutdown_connections 2024-09-12T01:49:05.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:05.435+0000 7fae86054640 1 -- 172.21.15.70:0/3026694057 wait complete. 2024-09-12T01:49:05.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:05 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3026694057' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:49:05.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:05 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3026694057' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:49:05.794 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:05 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3026694057' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:49:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726105725,"num_in_osds":12,"osd_in_since":1726105726,"num_remapped_pgs":0} 2024-09-12T01:49:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:06 smithi070 ceph-mon[31177]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:06.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:06 smithi191 ceph-mon[35770]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:06.773 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:49:06 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:49:06.537+0000 7f9698d11640 -1 osd.11 0 log_to_monitors true 2024-09-12T01:49:07.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:06 smithi152 ceph-mon[35055]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:07.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:49:07.424 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:07.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:07 smithi191 ceph-mon[35770]: from='osd.11 [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:49:07.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:07 smithi191 ceph-mon[35770]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:49:07.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:07.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:07.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:07.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:07.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:07.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:07.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:07.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:07.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:07.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:07.772 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:07 smithi070 ceph-mon[31177]: from='osd.11 [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:49:07.772 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:07 smithi070 ceph-mon[31177]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:49:07.772 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:07.772 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:07.772 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:07.773 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:07.773 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:07.773 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:07.773 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:07.773 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:07.773 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:07.773 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:07.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.932+0000 7f8167e52640 1 -- 172.21.15.70:0/2801841877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8160102690 msgr2=0x7f8160108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.932+0000 7f8167e52640 1 --2- 172.21.15.70:0/2801841877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8160102690 0x7f8160108f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8158009ca0 tx=0x7f815802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.932+0000 7f8167e52640 1 -- 172.21.15.70:0/2801841877 shutdown_connections 2024-09-12T01:49:07.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.932+0000 7f8167e52640 1 --2- 172.21.15.70:0/2801841877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8160102690 0x7f8160108f20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.932+0000 7f8167e52640 1 --2- 172.21.15.70:0/2801841877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8160101cd0 0x7f8160102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.932+0000 7f8167e52640 1 --2- 172.21.15.70:0/2801841877 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8160100ad0 0x7f8160100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.932+0000 7f8167e52640 1 -- 172.21.15.70:0/2801841877 >> 172.21.15.70:0/2801841877 conn(0x7f81600fc280 msgr2=0x7f81600fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.932+0000 7f8167e52640 1 -- 172.21.15.70:0/2801841877 shutdown_connections 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.932+0000 7f8167e52640 1 -- 172.21.15.70:0/2801841877 wait complete. 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8167e52640 1 Processor -- start 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8167e52640 1 -- start start 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8167e52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8160100ad0 0x7f8160197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8167e52640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8160101cd0 0x7f81601983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8167e52640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8160102690 0x7f816019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8167e52640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f816010d9a0 con 0x7f8160100ad0 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8167e52640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f816010d820 con 0x7f8160101cd0 2024-09-12T01:49:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8167e52640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f816010db20 con 0x7f8160102690 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8165bee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8160100ad0 0x7f8160197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8165bee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8160100ad0 0x7f8160197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45190/0 (socket says 172.21.15.70:45190) 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8165bee640 1 -- 172.21.15.70:0/4125067852 learned_addr learned my addr 172.21.15.70:0/4125067852 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f81653ed640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8160101cd0 0x7f81601983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f81663ef640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8160102690 0x7f816019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8165bee640 1 -- 172.21.15.70:0/4125067852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8160102690 msgr2=0x7f816019f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8165bee640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8160102690 0x7f816019f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8165bee640 1 -- 172.21.15.70:0/4125067852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8160101cd0 msgr2=0x7f81601983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8165bee640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8160101cd0 0x7f81601983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f8165bee640 1 -- 172.21.15.70:0/4125067852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816019fae0 con 0x7f8160100ad0 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.933+0000 7f81653ed640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8160101cd0 0x7f81601983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.934+0000 7f8165bee640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8160100ad0 0x7f8160197eb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f815c00c970 tx=0x7f815c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:07.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.934+0000 7f8156ffd640 1 -- 172.21.15.70:0/4125067852 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c004220 con 0x7f8160100ad0 2024-09-12T01:49:07.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.934+0000 7f8167e52640 1 -- 172.21.15.70:0/4125067852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816019fdd0 con 0x7f8160100ad0 2024-09-12T01:49:07.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.934+0000 7f8156ffd640 1 -- 172.21.15.70:0/4125067852 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f815c0043c0 con 0x7f8160100ad0 2024-09-12T01:49:07.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.934+0000 7f8156ffd640 1 -- 172.21.15.70:0/4125067852 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c004a00 con 0x7f8160100ad0 2024-09-12T01:49:07.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.934+0000 7f8167e52640 1 -- 172.21.15.70:0/4125067852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81601a0220 con 0x7f8160100ad0 2024-09-12T01:49:07.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.935+0000 7f8167e52640 1 -- 172.21.15.70:0/4125067852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8160107da0 con 0x7f8160100ad0 2024-09-12T01:49:07.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.936+0000 7f8156ffd640 1 -- 172.21.15.70:0/4125067852 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f815c0079b0 con 0x7f8160100ad0 2024-09-12T01:49:07.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.937+0000 7f8156ffd640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f814c0a2bb0 0x7f814c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.937+0000 7f8156ffd640 1 -- 172.21.15.70:0/4125067852 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6831+0+0 (secure 0 0 0) 0x7f815c0cebc0 con 0x7f8160100ad0 2024-09-12T01:49:07.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.937+0000 7f81653ed640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f814c0a2bb0 0x7f814c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.937+0000 7f81653ed640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f814c0a2bb0 0x7f814c0a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f81601993d0 tx=0x7f8150005d90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:07.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:07.940+0000 7f8156ffd640 1 -- 172.21.15.70:0/4125067852 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f815c014030 con 0x7f8160100ad0 2024-09-12T01:49:08.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:07 smithi152 ceph-mon[35055]: from='osd.11 [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:49:08.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:07 smithi152 ceph-mon[35055]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T01:49:08.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:08.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:08.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:08.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:08.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:08.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:49:08.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:08.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:08.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:08.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.107+0000 7f8167e52640 1 -- 172.21.15.70:0/4125067852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f816002d940 con 0x7f8160100ad0 2024-09-12T01:49:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.108+0000 7f8156ffd640 1 -- 172.21.15.70:0/4125067852 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f815c09c0f0 con 0x7f8160100ad0 2024-09-12T01:49:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.110+0000 7f8167e52640 1 -- 172.21.15.70:0/4125067852 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f814c0a2bb0 msgr2=0x7f814c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.110+0000 7f8167e52640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f814c0a2bb0 0x7f814c0a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f81601993d0 tx=0x7f8150005d90 comp rx=0 tx=0).stop 2024-09-12T01:49:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.110+0000 7f8167e52640 1 -- 172.21.15.70:0/4125067852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8160100ad0 msgr2=0x7f8160197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.110+0000 7f8167e52640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8160100ad0 0x7f8160197eb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f815c00c970 tx=0x7f815c00ce30 comp rx=0 tx=0).stop 2024-09-12T01:49:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.110+0000 7f8167e52640 1 -- 172.21.15.70:0/4125067852 shutdown_connections 2024-09-12T01:49:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.110+0000 7f8167e52640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f814c0a2bb0 0x7f814c0a5070 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.110+0000 7f8167e52640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8160102690 0x7f816019f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.110+0000 7f8167e52640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8160101cd0 0x7f81601983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.110+0000 7f8167e52640 1 --2- 172.21.15.70:0/4125067852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8160100ad0 0x7f8160197eb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.110+0000 7f8167e52640 1 -- 172.21.15.70:0/4125067852 >> 172.21.15.70:0/4125067852 conn(0x7f81600fc280 msgr2=0x7f8160104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.110+0000 7f8167e52640 1 -- 172.21.15.70:0/4125067852 shutdown_connections 2024-09-12T01:49:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:08.110+0000 7f8167e52640 1 -- 172.21.15.70:0/4125067852 wait complete. 2024-09-12T01:49:08.777 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726105725,"num_in_osds":12,"osd_in_since":1726105726,"num_remapped_pgs":0} 2024-09-12T01:49:08.937 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:49:08 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:49:08.531+0000 7f9694471640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T01:49:08.937 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:49:08 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:49:08.546+0000 7f9690aab640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:49:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:08 smithi191 ceph-mon[35770]: Detected new or changed devices on smithi191 2024-09-12T01:49:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:08 smithi191 ceph-mon[35770]: Adjusting osd_memory_target on smithi191 to 4272M 2024-09-12T01:49:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:08 smithi191 ceph-mon[35770]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:08 smithi191 ceph-mon[35770]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T01:49:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:08 smithi191 ceph-mon[35770]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T01:49:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:08 smithi191 ceph-mon[35770]: from='osd.11 [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:49:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:08 smithi191 ceph-mon[35770]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:49:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:08 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/4125067852' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:49:09.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:08 smithi152 ceph-mon[35055]: Detected new or changed devices on smithi191 2024-09-12T01:49:09.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:08 smithi152 ceph-mon[35055]: Adjusting osd_memory_target on smithi191 to 4272M 2024-09-12T01:49:09.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:08 smithi152 ceph-mon[35055]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:09.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:08 smithi152 ceph-mon[35055]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T01:49:09.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:08 smithi152 ceph-mon[35055]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T01:49:09.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:09.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:08 smithi152 ceph-mon[35055]: from='osd.11 [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:49:09.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:08 smithi152 ceph-mon[35055]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:49:09.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:08 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/4125067852' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:49:09.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:08 smithi070 ceph-mon[31177]: Detected new or changed devices on smithi191 2024-09-12T01:49:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:08 smithi070 ceph-mon[31177]: Adjusting osd_memory_target on smithi191 to 4272M 2024-09-12T01:49:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:08 smithi070 ceph-mon[31177]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:08 smithi070 ceph-mon[31177]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T01:49:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:08 smithi070 ceph-mon[31177]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T01:49:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:08 smithi070 ceph-mon[31177]: from='osd.11 [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:49:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:08 smithi070 ceph-mon[31177]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-09-12T01:49:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:08 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/4125067852' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:49:09.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:49:09.806 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:09 smithi070 ceph-mon[31177]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-12T01:49:09.807 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:09 smithi070 ceph-mon[31177]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T01:49:09.807 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:09.807 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:09.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:09 smithi191 ceph-mon[35770]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-12T01:49:09.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:09 smithi191 ceph-mon[35770]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T01:49:09.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:09.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:10.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:09 smithi152 ceph-mon[35055]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-09-12T01:49:10.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:09 smithi152 ceph-mon[35055]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T01:49:10.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:10.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:10.035 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:10.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.502+0000 7f0ab20f1640 1 -- 172.21.15.70:0/224657148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aac101d10 msgr2=0x7f0aac102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:10.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.502+0000 7f0ab20f1640 1 --2- 172.21.15.70:0/224657148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aac101d10 0x7f0aac102190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009900 tx=0x7f0a9402a410 comp rx=0 tx=0).stop 2024-09-12T01:49:10.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.502+0000 7f0ab20f1640 1 -- 172.21.15.70:0/224657148 shutdown_connections 2024-09-12T01:49:10.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.502+0000 7f0ab20f1640 1 --2- 172.21.15.70:0/224657148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0aac1026d0 0x7f0aac108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.502+0000 7f0ab20f1640 1 --2- 172.21.15.70:0/224657148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aac101d10 0x7f0aac102190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.502+0000 7f0ab20f1640 1 --2- 172.21.15.70:0/224657148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0aac100b10 0x7f0aac100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.502+0000 7f0ab20f1640 1 -- 172.21.15.70:0/224657148 >> 172.21.15.70:0/224657148 conn(0x7f0aac0fc2a0 msgr2=0x7f0aac0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:10.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.502+0000 7f0ab20f1640 1 -- 172.21.15.70:0/224657148 shutdown_connections 2024-09-12T01:49:10.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.502+0000 7f0ab20f1640 1 -- 172.21.15.70:0/224657148 wait complete. 2024-09-12T01:49:10.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.502+0000 7f0ab20f1640 1 Processor -- start 2024-09-12T01:49:10.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.502+0000 7f0ab20f1640 1 -- start start 2024-09-12T01:49:10.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0ab20f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0aac100b10 0x7f0aac104bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:10.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0ab20f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aac101d10 0x7f0aac103240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:10.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0ab20f1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0aac1026d0 0x7f0aac103780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:10.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0ab20f1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac10c8d0 con 0x7f0aac101d10 2024-09-12T01:49:10.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0ab20f1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac10c750 con 0x7f0aac100b10 2024-09-12T01:49:10.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0ab20f1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac10ca50 con 0x7f0aac1026d0 2024-09-12T01:49:10.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0aa2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aac101d10 0x7f0aac103240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:10.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0aa2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aac101d10 0x7f0aac103240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41480/0 (socket says 172.21.15.70:41480) 2024-09-12T01:49:10.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0aa2ffd640 1 -- 172.21.15.70:0/2452220269 learned_addr learned my addr 172.21.15.70:0/2452220269 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:10.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0aabfff640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0aac1026d0 0x7f0aac103780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:10.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0aab7fe640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0aac100b10 0x7f0aac104bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:10.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0aa2ffd640 1 -- 172.21.15.70:0/2452220269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0aac1026d0 msgr2=0x7f0aac103780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:10.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0aa2ffd640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0aac1026d0 0x7f0aac103780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0aa2ffd640 1 -- 172.21.15.70:0/2452220269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0aac100b10 msgr2=0x7f0aac104bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:10.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0aa2ffd640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0aac100b10 0x7f0aac104bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0aa2ffd640 1 -- 172.21.15.70:0/2452220269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac104040 con 0x7f0aac101d10 2024-09-12T01:49:10.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0aab7fe640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0aac100b10 0x7f0aac104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:49:10.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.503+0000 7f0aa2ffd640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aac101d10 0x7f0aac103240 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009a20 tx=0x7f0a94004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:10.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.504+0000 7f0aa97fa640 1 -- 172.21.15.70:0/2452220269 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9403f030 con 0x7f0aac101d10 2024-09-12T01:49:10.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.504+0000 7f0aa97fa640 1 -- 172.21.15.70:0/2452220269 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0a94003d00 con 0x7f0aac101d10 2024-09-12T01:49:10.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.504+0000 7f0ab20f1640 1 -- 172.21.15.70:0/2452220269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac1a2110 con 0x7f0aac101d10 2024-09-12T01:49:10.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.504+0000 7f0aa97fa640 1 -- 172.21.15.70:0/2452220269 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94035070 con 0x7f0aac101d10 2024-09-12T01:49:10.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.504+0000 7f0ab20f1640 1 -- 172.21.15.70:0/2452220269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac1a25c0 con 0x7f0aac101d10 2024-09-12T01:49:10.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.505+0000 7f0ab20f1640 1 -- 172.21.15.70:0/2452220269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aac1a27f0 con 0x7f0aac101d10 2024-09-12T01:49:10.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.507+0000 7f0aa97fa640 1 -- 172.21.15.70:0/2452220269 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0a94042030 con 0x7f0aac101d10 2024-09-12T01:49:10.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.507+0000 7f0aa97fa640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0a980a2b80 0x7f0a980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:10.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.507+0000 7f0aab7fe640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0a980a2b80 0x7f0a980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:10.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.507+0000 7f0aa97fa640 1 -- 172.21.15.70:0/2452220269 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f0a940ef5e0 con 0x7f0aac101d10 2024-09-12T01:49:10.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.508+0000 7f0aab7fe640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0a980a2b80 0x7f0a980a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0aac101b70 tx=0x7f0a9c005e70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:10.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.510+0000 7f0aa97fa640 1 -- 172.21.15.70:0/2452220269 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a940bc9e0 con 0x7f0aac101d10 2024-09-12T01:49:10.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.678+0000 7f0ab20f1640 1 -- 172.21.15.70:0/2452220269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f0aac1a29c0 con 0x7f0aac101d10 2024-09-12T01:49:10.679 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:10 smithi070 ceph-mon[31177]: purged_snaps scrub starts 2024-09-12T01:49:10.679 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:10 smithi070 ceph-mon[31177]: purged_snaps scrub ok 2024-09-12T01:49:10.679 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:10 smithi070 ceph-mon[31177]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:10.679 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:10 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:10.679 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:10 smithi070 ceph-mon[31177]: osd.11 [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530] boot 2024-09-12T01:49:10.679 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:10 smithi070 ceph-mon[31177]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T01:49:10.679 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:10 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:10.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.679+0000 7f0aa97fa640 1 -- 172.21.15.70:0/2452220269 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f0a940bc2e0 con 0x7f0aac101d10 2024-09-12T01:49:10.680 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:10.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.681+0000 7f0ab20f1640 1 -- 172.21.15.70:0/2452220269 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0a980a2b80 msgr2=0x7f0a980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:10.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.681+0000 7f0ab20f1640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0a980a2b80 0x7f0a980a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0aac101b70 tx=0x7f0a9c005e70 comp rx=0 tx=0).stop 2024-09-12T01:49:10.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.681+0000 7f0ab20f1640 1 -- 172.21.15.70:0/2452220269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aac101d10 msgr2=0x7f0aac103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:10.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.681+0000 7f0ab20f1640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aac101d10 0x7f0aac103240 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009a20 tx=0x7f0a94004430 comp rx=0 tx=0).stop 2024-09-12T01:49:10.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.681+0000 7f0ab20f1640 1 -- 172.21.15.70:0/2452220269 shutdown_connections 2024-09-12T01:49:10.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.681+0000 7f0ab20f1640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0a980a2b80 0x7f0a980a5040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.681+0000 7f0ab20f1640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0aac1026d0 0x7f0aac103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.681+0000 7f0ab20f1640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0aac101d10 0x7f0aac103240 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.681+0000 7f0ab20f1640 1 --2- 172.21.15.70:0/2452220269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0aac100b10 0x7f0aac104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:10.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.681+0000 7f0ab20f1640 1 -- 172.21.15.70:0/2452220269 >> 172.21.15.70:0/2452220269 conn(0x7f0aac0fc2a0 msgr2=0x7f0aac06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:10.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.681+0000 7f0ab20f1640 1 -- 172.21.15.70:0/2452220269 shutdown_connections 2024-09-12T01:49:10.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:10.681+0000 7f0ab20f1640 1 -- 172.21.15.70:0/2452220269 wait complete. 2024-09-12T01:49:10.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:10 smithi191 ceph-mon[35770]: purged_snaps scrub starts 2024-09-12T01:49:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:10 smithi191 ceph-mon[35770]: purged_snaps scrub ok 2024-09-12T01:49:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:10 smithi191 ceph-mon[35770]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:10 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:10 smithi191 ceph-mon[35770]: osd.11 [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530] boot 2024-09-12T01:49:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:10 smithi191 ceph-mon[35770]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T01:49:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:10 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:11.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:10 smithi152 ceph-mon[35055]: purged_snaps scrub starts 2024-09-12T01:49:11.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:10 smithi152 ceph-mon[35055]: purged_snaps scrub ok 2024-09-12T01:49:11.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:10 smithi152 ceph-mon[35055]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-12T01:49:11.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:10 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:11.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:10 smithi152 ceph-mon[35055]: osd.11 [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530] boot 2024-09-12T01:49:11.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:10 smithi152 ceph-mon[35055]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T01:49:11.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:10 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T01:49:11.387 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1726105749,"num_in_osds":12,"osd_in_since":1726105726,"num_remapped_pgs":0} 2024-09-12T01:49:11.388 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:49:11.675 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:11.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:11 smithi070 ceph-mon[31177]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T01:49:11.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:11 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2452220269' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:49:11.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:11 smithi191 ceph-mon[35770]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T01:49:11.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:11 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2452220269' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:49:12.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:11 smithi152 ceph-mon[35055]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T01:49:12.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:11 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2452220269' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:49:12.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.089+0000 7fb9686ad640 1 -- 172.21.15.70:0/1213114968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb960106a80 msgr2=0x7fb960106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:12.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.089+0000 7fb9686ad640 1 --2- 172.21.15.70:0/1213114968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb960106a80 0x7fb960106e60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb958009930 tx=0x7fb95802a420 comp rx=0 tx=0).stop 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.089+0000 7fb9686ad640 1 -- 172.21.15.70:0/1213114968 shutdown_connections 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.089+0000 7fb9686ad640 1 --2- 172.21.15.70:0/1213114968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb960101420 0x7fb96010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.089+0000 7fb9686ad640 1 --2- 172.21.15.70:0/1213114968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb960100a80 0x7fb960100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.089+0000 7fb9686ad640 1 --2- 172.21.15.70:0/1213114968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb960106a80 0x7fb960106e60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.089+0000 7fb9686ad640 1 -- 172.21.15.70:0/1213114968 >> 172.21.15.70:0/1213114968 conn(0x7fb9600fc7a0 msgr2=0x7fb9600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.089+0000 7fb9686ad640 1 -- 172.21.15.70:0/1213114968 shutdown_connections 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.089+0000 7fb9686ad640 1 -- 172.21.15.70:0/1213114968 wait complete. 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb9686ad640 1 Processor -- start 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb9686ad640 1 -- start start 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb9686ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb960100a80 0x7fb960196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb9686ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb960101420 0x7fb9601969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb9686ad640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb960106a80 0x7fb96019ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb9686ad640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb96010ff50 con 0x7fb960101420 2024-09-12T01:49:12.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb9686ad640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb96010fdd0 con 0x7fb960100a80 2024-09-12T01:49:12.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb9686ad640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb9601100d0 con 0x7fb960106a80 2024-09-12T01:49:12.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb965c48640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb960101420 0x7fb9601969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:12.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb965c48640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb960101420 0x7fb9601969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41510/0 (socket says 172.21.15.70:41510) 2024-09-12T01:49:12.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb965c48640 1 -- 172.21.15.70:0/4270145522 learned_addr learned my addr 172.21.15.70:0/4270145522 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:12.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb966449640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb960100a80 0x7fb960196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:12.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb965c48640 1 -- 172.21.15.70:0/4270145522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb960106a80 msgr2=0x7fb96019ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:12.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb966c4a640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb960106a80 0x7fb96019ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:12.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb965c48640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb960106a80 0x7fb96019ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb965c48640 1 -- 172.21.15.70:0/4270145522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb960100a80 msgr2=0x7fb960196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:12.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb965c48640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb960100a80 0x7fb960196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb965c48640 1 -- 172.21.15.70:0/4270145522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96019b420 con 0x7fb960101420 2024-09-12T01:49:12.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.090+0000 7fb966449640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb960100a80 0x7fb960196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.091+0000 7fb965c48640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb960101420 0x7fb9601969b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb95400ba50 tx=0x7fb95400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.091+0000 7fb95f7fe640 1 -- 172.21.15.70:0/4270145522 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954019070 con 0x7fb960101420 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.091+0000 7fb95f7fe640 1 -- 172.21.15.70:0/4270145522 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb95400cbe0 con 0x7fb960101420 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.091+0000 7fb95f7fe640 1 -- 172.21.15.70:0/4270145522 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954007770 con 0x7fb960101420 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.091+0000 7fb9686ad640 1 -- 172.21.15.70:0/4270145522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96019b710 con 0x7fb960101420 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.091+0000 7fb9686ad640 1 -- 172.21.15.70:0/4270145522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9601a2ff0 con 0x7fb960101420 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.092+0000 7fb9686ad640 1 -- 172.21.15.70:0/4270145522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb960100f60 con 0x7fb960101420 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.093+0000 7fb95f7fe640 1 -- 172.21.15.70:0/4270145522 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb95401c070 con 0x7fb960101420 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.093+0000 7fb95f7fe640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb9480a4e10 0x7fb9480a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.094+0000 7fb966449640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb9480a4e10 0x7fb9480a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.094+0000 7fb95f7fe640 1 -- 172.21.15.70:0/4270145522 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fb9540ce1c0 con 0x7fb960101420 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.094+0000 7fb966449640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb9480a4e10 0x7fb9480a72d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb958000c00 tx=0x7fb958005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:12.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.098+0000 7fb95f7fe640 1 -- 172.21.15.70:0/4270145522 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb95409b5c0 con 0x7fb960101420 2024-09-12T01:49:12.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.268+0000 7fb9686ad640 1 -- 172.21.15.70:0/4270145522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb96002d7c0 con 0x7fb960101420 2024-09-12T01:49:12.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.269+0000 7fb95f7fe640 1 -- 172.21.15.70:0/4270145522 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18478 (secure 0 0 0) 0x7fb95409aec0 con 0x7fb960101420 2024-09-12T01:49:12.270 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:12.270 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":76,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:49:10.538063+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:49:12.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.271+0000 7fb9686ad640 1 -- 172.21.15.70:0/4270145522 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb9480a4e10 msgr2=0x7fb9480a72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:12.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.271+0000 7fb9686ad640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb9480a4e10 0x7fb9480a72d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb958000c00 tx=0x7fb958005a20 comp rx=0 tx=0).stop 2024-09-12T01:49:12.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.271+0000 7fb9686ad640 1 -- 172.21.15.70:0/4270145522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb960101420 msgr2=0x7fb9601969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:12.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.271+0000 7fb9686ad640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb960101420 0x7fb9601969b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb95400ba50 tx=0x7fb95400bf10 comp rx=0 tx=0).stop 2024-09-12T01:49:12.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.271+0000 7fb9686ad640 1 -- 172.21.15.70:0/4270145522 shutdown_connections 2024-09-12T01:49:12.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.271+0000 7fb9686ad640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb9480a4e10 0x7fb9480a72d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.271+0000 7fb9686ad640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb960106a80 0x7fb96019ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.271+0000 7fb9686ad640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb960101420 0x7fb9601969b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.271+0000 7fb9686ad640 1 --2- 172.21.15.70:0/4270145522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb960100a80 0x7fb960196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:12.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.271+0000 7fb9686ad640 1 -- 172.21.15.70:0/4270145522 >> 172.21.15.70:0/4270145522 conn(0x7fb9600fc7a0 msgr2=0x7fb9600fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:12.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.271+0000 7fb9686ad640 1 -- 172.21.15.70:0/4270145522 shutdown_connections 2024-09-12T01:49:12.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:12.272+0000 7fb9686ad640 1 -- 172.21.15.70:0/4270145522 wait complete. 2024-09-12T01:49:12.788 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:12 smithi070 ceph-mon[31177]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:12.789 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:12 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/4270145522' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:49:12.790 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:45:33.697735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:49:12.790 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T01:49:12.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:12 smithi191 ceph-mon[35770]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:12 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/4270145522' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:49:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:12 smithi152 ceph-mon[35055]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:12 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/4270145522' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:49:13.029 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:13.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.431+0000 7f0921fec640 1 -- 172.21.15.70:0/2180866413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f091c102ef0 msgr2=0x7f091c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:13.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.431+0000 7f0921fec640 1 --2- 172.21.15.70:0/2180866413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f091c102ef0 0x7f091c10da40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0914009ca0 tx=0x7f091402a950 comp rx=0 tx=0).stop 2024-09-12T01:49:13.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.431+0000 7f0921fec640 1 -- 172.21.15.70:0/2180866413 shutdown_connections 2024-09-12T01:49:13.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.431+0000 7f0921fec640 1 --2- 172.21.15.70:0/2180866413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f091c102ef0 0x7f091c10da40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:13.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.431+0000 7f0921fec640 1 --2- 172.21.15.70:0/2180866413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f091c102570 0x7f091c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:13.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.431+0000 7f0921fec640 1 --2- 172.21.15.70:0/2180866413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f091c100e20 0x7f091c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:13.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.431+0000 7f0921fec640 1 -- 172.21.15.70:0/2180866413 >> 172.21.15.70:0/2180866413 conn(0x7f091c0fc7d0 msgr2=0x7f091c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:13.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.432+0000 7f0921fec640 1 -- 172.21.15.70:0/2180866413 shutdown_connections 2024-09-12T01:49:13.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.432+0000 7f0921fec640 1 -- 172.21.15.70:0/2180866413 wait complete. 2024-09-12T01:49:13.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.432+0000 7f0921fec640 1 Processor -- start 2024-09-12T01:49:13.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.432+0000 7f0921fec640 1 -- start start 2024-09-12T01:49:13.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f0921fec640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f091c100e20 0x7f091c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:13.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f0921fec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f091c102570 0x7f091c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:13.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f0921fec640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f091c102ef0 0x7f091c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:13.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f0921fec640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f091c1121e0 con 0x7f091c102570 2024-09-12T01:49:13.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f0921fec640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f091c112060 con 0x7f091c102ef0 2024-09-12T01:49:13.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f0921fec640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f091c112360 con 0x7f091c100e20 2024-09-12T01:49:13.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f091affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f091c102570 0x7f091c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:13.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f091affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f091c102570 0x7f091c198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41530/0 (socket says 172.21.15.70:41530) 2024-09-12T01:49:13.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f091affd640 1 -- 172.21.15.70:0/221487562 learned_addr learned my addr 172.21.15.70:0/221487562 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:13.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f091bfff640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f091c102ef0 0x7f091c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:13.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f091b7fe640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f091c100e20 0x7f091c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:13.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f091affd640 1 -- 172.21.15.70:0/221487562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f091c100e20 msgr2=0x7f091c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:13.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f091affd640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f091c100e20 0x7f091c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:13.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f091affd640 1 -- 172.21.15.70:0/221487562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f091c102ef0 msgr2=0x7f091c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:13.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f091affd640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f091c102ef0 0x7f091c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:13.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f091affd640 1 -- 172.21.15.70:0/221487562 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f091c19d550 con 0x7f091c102570 2024-09-12T01:49:13.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f091bfff640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f091c102ef0 0x7f091c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:49:13.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f091affd640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f091c102570 0x7f091c198ae0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f091000b4a0 tx=0x7f091000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:13.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f0918ff9640 1 -- 172.21.15.70:0/221487562 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910014070 con 0x7f091c102570 2024-09-12T01:49:13.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f0918ff9640 1 -- 172.21.15.70:0/221487562 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0910010b10 con 0x7f091c102570 2024-09-12T01:49:13.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.433+0000 7f0921fec640 1 -- 172.21.15.70:0/221487562 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f091c19d840 con 0x7f091c102570 2024-09-12T01:49:13.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.434+0000 7f0918ff9640 1 -- 172.21.15.70:0/221487562 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910017d60 con 0x7f091c102570 2024-09-12T01:49:13.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.434+0000 7f0921fec640 1 -- 172.21.15.70:0/221487562 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f091c1a5120 con 0x7f091c102570 2024-09-12T01:49:13.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.435+0000 7f0921fec640 1 -- 172.21.15.70:0/221487562 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f091c101200 con 0x7f091c102570 2024-09-12T01:49:13.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.436+0000 7f0918ff9640 1 -- 172.21.15.70:0/221487562 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0910017070 con 0x7f091c102570 2024-09-12T01:49:13.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.436+0000 7f0918ff9640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f09040a2b80 0x7f09040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:13.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.437+0000 7f091b7fe640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f09040a2b80 0x7f09040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:13.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.437+0000 7f0918ff9640 1 -- 172.21.15.70:0/221487562 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f09100ce390 con 0x7f091c102570 2024-09-12T01:49:13.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.437+0000 7f091b7fe640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f09040a2b80 0x7f09040a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f090c0058c0 tx=0x7f090c00a4c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:13.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.440+0000 7f0918ff9640 1 -- 172.21.15.70:0/221487562 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f091009b790 con 0x7f091c102570 2024-09-12T01:49:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.609+0000 7f0921fec640 1 -- 172.21.15.70:0/221487562 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f091c1a5320 con 0x7f091c102570 2024-09-12T01:49:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.609+0000 7f0918ff9640 1 -- 172.21.15.70:0/221487562 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f091009b090 con 0x7f091c102570 2024-09-12T01:49:13.609 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-12T01:49:13.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.611+0000 7f0921fec640 1 -- 172.21.15.70:0/221487562 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f09040a2b80 msgr2=0x7f09040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:13.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.611+0000 7f0921fec640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f09040a2b80 0x7f09040a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f090c0058c0 tx=0x7f090c00a4c0 comp rx=0 tx=0).stop 2024-09-12T01:49:13.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.611+0000 7f0921fec640 1 -- 172.21.15.70:0/221487562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f091c102570 msgr2=0x7f091c198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:13.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.611+0000 7f0921fec640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f091c102570 0x7f091c198ae0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f091000b4a0 tx=0x7f091000b960 comp rx=0 tx=0).stop 2024-09-12T01:49:13.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.611+0000 7f0921fec640 1 -- 172.21.15.70:0/221487562 shutdown_connections 2024-09-12T01:49:13.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.611+0000 7f0921fec640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f09040a2b80 0x7f09040a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:13.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.611+0000 7f0921fec640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f091c102ef0 0x7f091c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:13.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.611+0000 7f0921fec640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f091c102570 0x7f091c198ae0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:13.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.611+0000 7f0921fec640 1 --2- 172.21.15.70:0/221487562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f091c100e20 0x7f091c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:13.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.611+0000 7f0921fec640 1 -- 172.21.15.70:0/221487562 >> 172.21.15.70:0/221487562 conn(0x7f091c0fc7d0 msgr2=0x7f091c1067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:13.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.612+0000 7f0921fec640 1 -- 172.21.15.70:0/221487562 shutdown_connections 2024-09-12T01:49:13.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:13.612+0000 7f0921fec640 1 -- 172.21.15.70:0/221487562 wait complete. 2024-09-12T01:49:14.283 INFO:tasks.cephadm:Adding mds.a on smithi070 2024-09-12T01:49:14.283 INFO:tasks.cephadm:Adding mds.d on smithi070 2024-09-12T01:49:14.283 INFO:tasks.cephadm:Adding mds.g on smithi070 2024-09-12T01:49:14.283 INFO:tasks.cephadm:Adding mds.j on smithi070 2024-09-12T01:49:14.283 INFO:tasks.cephadm:Adding mds.b on smithi152 2024-09-12T01:49:14.283 INFO:tasks.cephadm:Adding mds.e on smithi152 2024-09-12T01:49:14.283 INFO:tasks.cephadm:Adding mds.h on smithi152 2024-09-12T01:49:14.284 INFO:tasks.cephadm:Adding mds.k on smithi152 2024-09-12T01:49:14.284 INFO:tasks.cephadm:Adding mds.c on smithi191 2024-09-12T01:49:14.284 INFO:tasks.cephadm:Adding mds.f on smithi191 2024-09-12T01:49:14.284 INFO:tasks.cephadm:Adding mds.i on smithi191 2024-09-12T01:49:14.284 INFO:tasks.cephadm:Adding mds.l on smithi191 2024-09-12T01:49:14.284 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l' 2024-09-12T01:49:14.538 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:49:14.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:14 smithi191 ceph-mon[35770]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:14.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:14 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/221487562' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:49:14.979 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.965+0000 7f0d4c46c640 1 -- 172.21.15.191:0/4269391341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d441037c0 msgr2=0x7f0d4410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:14.979 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.965+0000 7f0d4c46c640 1 --2- 172.21.15.191:0/4269391341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d441037c0 0x7f0d4410a050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009ca0 tx=0x7f0d3c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:49:14.980 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 -- 172.21.15.191:0/4269391341 shutdown_connections 2024-09-12T01:49:14.980 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 --2- 172.21.15.191:0/4269391341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d441037c0 0x7f0d4410a050 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:14.980 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 --2- 172.21.15.191:0/4269391341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d44102e00 0x7f0d44103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:14.980 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 --2- 172.21.15.191:0/4269391341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d44101c00 0x7f0d44102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:14.980 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 -- 172.21.15.191:0/4269391341 >> 172.21.15.191:0/4269391341 conn(0x7f0d440fd3b0 msgr2=0x7f0d440ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:14.980 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 -- 172.21.15.191:0/4269391341 shutdown_connections 2024-09-12T01:49:14.980 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 -- 172.21.15.191:0/4269391341 wait complete. 2024-09-12T01:49:14.980 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 Processor -- start 2024-09-12T01:49:14.980 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 -- start start 2024-09-12T01:49:14.980 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d44101c00 0x7f0d44075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:14.980 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d44102e00 0x7f0d440745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:14.980 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d441037c0 0x7f0d44074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:14.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4410d9c0 con 0x7f0d44102e00 2024-09-12T01:49:14.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4410d840 con 0x7f0d44101c00 2024-09-12T01:49:14.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4c46c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4410db40 con 0x7f0d441037c0 2024-09-12T01:49:14.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4aa09640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d441037c0 0x7f0d44074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:14.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4aa09640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d441037c0 0x7f0d44074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:58822/0 (socket says 172.21.15.191:58822) 2024-09-12T01:49:14.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.966+0000 7f0d4aa09640 1 -- 172.21.15.191:0/1129950089 learned_addr learned my addr 172.21.15.191:0/1129950089 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-09-12T01:49:14.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d49a07640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d44102e00 0x7f0d440745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:14.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d4a208640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d44101c00 0x7f0d44075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:14.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d4aa09640 1 -- 172.21.15.191:0/1129950089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d44101c00 msgr2=0x7f0d44075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:14.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d4aa09640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d44101c00 0x7f0d44075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:14.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d4aa09640 1 -- 172.21.15.191:0/1129950089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d44102e00 msgr2=0x7f0d440745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:14.981 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d4aa09640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d44102e00 0x7f0d440745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d4aa09640 1 -- 172.21.15.191:0/1129950089 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d440753e0 con 0x7f0d441037c0 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d49a07640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d44102e00 0x7f0d440745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d4aa09640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d441037c0 0x7f0d44074b20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c02f540 tx=0x7f0d3c009890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d3b7fe640 1 -- 172.21.15.191:0/1129950089 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c02fae0 con 0x7f0d441037c0 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d4c46c640 1 -- 172.21.15.191:0/1129950089 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d441a2050 con 0x7f0d441037c0 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d3b7fe640 1 -- 172.21.15.191:0/1129950089 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0d3c02fc80 con 0x7f0d441037c0 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d3b7fe640 1 -- 172.21.15.191:0/1129950089 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0468c0 con 0x7f0d441037c0 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.967+0000 7f0d4c46c640 1 -- 172.21.15.191:0/1129950089 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d441a25b0 con 0x7f0d441037c0 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.969+0000 7f0d4c46c640 1 -- 172.21.15.191:0/1129950089 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d44108ed0 con 0x7f0d441037c0 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.970+0000 7f0d3b7fe640 1 -- 172.21.15.191:0/1129950089 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0d3c030bc0 con 0x7f0d441037c0 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.971+0000 7f0d3b7fe640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0d300a2b80 0x7f0d300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.971+0000 7f0d3b7fe640 1 -- 172.21.15.191:0/1129950089 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f0d3c0f0310 con 0x7f0d441037c0 2024-09-12T01:49:14.982 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.971+0000 7f0d4a208640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0d300a2b80 0x7f0d300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:14.983 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.972+0000 7f0d4a208640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0d300a2b80 0x7f0d300a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0d400058c0 tx=0x7f0d4000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:14.983 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:14.974+0000 7f0d3b7fe640 1 -- 172.21.15.191:0/1129950089 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d3c0821b0 con 0x7f0d441037c0 2024-09-12T01:49:15.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:14 smithi152 ceph-mon[35055]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:15.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:14 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/221487562' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:49:15.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:14 smithi070 ceph-mon[31177]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:15.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:14 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/221487562' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:49:15.153 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.153+0000 7f0d4c46c640 1 -- 172.21.15.191:0/1129950089 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}) -- 0x7f0d44062730 con 0x7f0d300a2b80 2024-09-12T01:49:15.160 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.160+0000 7f0d3b7fe640 1 -- 172.21.15.191:0/1129950089 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f0d44062730 con 0x7f0d300a2b80 2024-09-12T01:49:15.160 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mds.all update... 2024-09-12T01:49:15.163 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.163+0000 7f0d4c46c640 1 -- 172.21.15.191:0/1129950089 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0d300a2b80 msgr2=0x7f0d300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:15.163 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.163+0000 7f0d4c46c640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0d300a2b80 0x7f0d300a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0d400058c0 tx=0x7f0d4000a2d0 comp rx=0 tx=0).stop 2024-09-12T01:49:15.163 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.163+0000 7f0d4c46c640 1 -- 172.21.15.191:0/1129950089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d441037c0 msgr2=0x7f0d44074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:15.163 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.163+0000 7f0d4c46c640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d441037c0 0x7f0d44074b20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c02f540 tx=0x7f0d3c009890 comp rx=0 tx=0).stop 2024-09-12T01:49:15.163 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.163+0000 7f0d4c46c640 1 -- 172.21.15.191:0/1129950089 shutdown_connections 2024-09-12T01:49:15.163 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.163+0000 7f0d4c46c640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0d300a2b80 0x7f0d300a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:15.163 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.163+0000 7f0d4c46c640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d441037c0 0x7f0d44074b20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:15.163 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.163+0000 7f0d4c46c640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d44102e00 0x7f0d440745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:15.163 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.163+0000 7f0d4c46c640 1 --2- 172.21.15.191:0/1129950089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d44101c00 0x7f0d44075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:15.164 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.163+0000 7f0d4c46c640 1 -- 172.21.15.191:0/1129950089 >> 172.21.15.191:0/1129950089 conn(0x7f0d440fd3b0 msgr2=0x7f0d441060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:15.164 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.163+0000 7f0d4c46c640 1 -- 172.21.15.191:0/1129950089 shutdown_connections 2024-09-12T01:49:15.164 INFO:teuthology.orchestra.run.smithi191.stderr:2024-09-12T01:49:15.163+0000 7f0d4c46c640 1 -- 172.21.15.191:0/1129950089 wait complete. 2024-09-12T01:49:15.895 DEBUG:teuthology.orchestra.run.smithi070:mds.a> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T01:49:15.898 DEBUG:teuthology.orchestra.run.smithi070:mds.d> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T01:49:15.942 DEBUG:teuthology.orchestra.run.smithi070:mds.g> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T01:49:15.985 DEBUG:teuthology.orchestra.run.smithi070:mds.j> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T01:49:16.027 DEBUG:teuthology.orchestra.run.smithi152:mds.b> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T01:49:16.030 DEBUG:teuthology.orchestra.run.smithi152:mds.e> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T01:49:16.075 DEBUG:teuthology.orchestra.run.smithi152:mds.h> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T01:49:16.119 DEBUG:teuthology.orchestra.run.smithi152:mds.k> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T01:49:16.165 DEBUG:teuthology.orchestra.run.smithi191:mds.c> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T01:49:16.168 DEBUG:teuthology.orchestra.run.smithi191:mds.f> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T01:49:16.210 DEBUG:teuthology.orchestra.run.smithi191:mds.i> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T01:49:16.253 DEBUG:teuthology.orchestra.run.smithi191:mds.l> sudo journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T01:49:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:16 smithi070 ceph-mon[31177]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:16 smithi070 ceph-mon[31177]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-09-12T01:49:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:16.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:16.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:16 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:16.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:16 smithi070 ceph-mon[31177]: Deploying daemon mds.l on smithi191 2024-09-12T01:49:16.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:16 smithi070 ceph-mon[31177]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:16.296 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T01:49:16.297 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:49:16.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:16 smithi191 ceph-mon[35770]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:16.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:16 smithi191 ceph-mon[35770]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-09-12T01:49:16.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:16.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:16.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:16.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:16.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:16.396 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:16.397 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:16.397 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:16 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:16.397 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:16 smithi191 ceph-mon[35770]: Deploying daemon mds.l on smithi191 2024-09-12T01:49:16.397 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:16 smithi191 ceph-mon[35770]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:16.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:16 smithi152 ceph-mon[35055]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:16.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:16 smithi152 ceph-mon[35055]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-09-12T01:49:16.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:16.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:16.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:16.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:16.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:16.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:16.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:16.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:16 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:16.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:16 smithi152 ceph-mon[35055]: Deploying daemon mds.l on smithi191 2024-09-12T01:49:16.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:16 smithi152 ceph-mon[35055]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:16.542 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:16.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.975+0000 7f644effd640 1 -- 172.21.15.70:0/2804064865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6448101400 msgr2=0x7f644810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:16.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.975+0000 7f644effd640 1 --2- 172.21.15.70:0/2804064865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6448101400 0x7f644810d930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6440009cd0 tx=0x7f644002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:49:16.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.976+0000 7f644effd640 1 -- 172.21.15.70:0/2804064865 shutdown_connections 2024-09-12T01:49:16.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.976+0000 7f644effd640 1 --2- 172.21.15.70:0/2804064865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6448101400 0x7f644810d930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:16.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.976+0000 7f644effd640 1 --2- 172.21.15.70:0/2804064865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6448100a60 0x7f6448100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:16.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.976+0000 7f644effd640 1 --2- 172.21.15.70:0/2804064865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6448106a60 0x7f6448106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:16.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.976+0000 7f644effd640 1 -- 172.21.15.70:0/2804064865 >> 172.21.15.70:0/2804064865 conn(0x7f64480fc780 msgr2=0x7f64480feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:16.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.976+0000 7f644effd640 1 -- 172.21.15.70:0/2804064865 shutdown_connections 2024-09-12T01:49:16.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.976+0000 7f644effd640 1 -- 172.21.15.70:0/2804064865 wait complete. 2024-09-12T01:49:16.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.976+0000 7f644effd640 1 Processor -- start 2024-09-12T01:49:16.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.976+0000 7f644effd640 1 -- start start 2024-09-12T01:49:16.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6448100a60 0x7f6448198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:16.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6448101400 0x7f6448198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:16.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644effd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6448106a60 0x7f644819cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:16.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644effd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6448111040 con 0x7f6448100a60 2024-09-12T01:49:16.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644effd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6448110ec0 con 0x7f6448101400 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644effd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f64481111c0 con 0x7f6448106a60 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644cd99640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6448100a60 0x7f6448198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644cd99640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6448100a60 0x7f6448198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41548/0 (socket says 172.21.15.70:41548) 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644cd99640 1 -- 172.21.15.70:0/516395552 learned_addr learned my addr 172.21.15.70:0/516395552 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644d59a640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6448106a60 0x7f644819cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f6447fff640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6448101400 0x7f6448198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644cd99640 1 -- 172.21.15.70:0/516395552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6448106a60 msgr2=0x7f644819cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644cd99640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6448106a60 0x7f644819cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644cd99640 1 -- 172.21.15.70:0/516395552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6448101400 msgr2=0x7f6448198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644cd99640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6448101400 0x7f6448198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644cd99640 1 -- 172.21.15.70:0/516395552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644819d5e0 con 0x7f6448100a60 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644cd99640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6448100a60 0x7f6448198630 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f643c00b4a0 tx=0x7f643c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:16.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f6445ffb640 1 -- 172.21.15.70:0/516395552 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c014070 con 0x7f6448100a60 2024-09-12T01:49:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f6445ffb640 1 -- 172.21.15.70:0/516395552 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f643c010b10 con 0x7f6448100a60 2024-09-12T01:49:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f644effd640 1 -- 172.21.15.70:0/516395552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644819d8d0 con 0x7f6448100a60 2024-09-12T01:49:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.977+0000 7f6445ffb640 1 -- 172.21.15.70:0/516395552 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c017d60 con 0x7f6448100a60 2024-09-12T01:49:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.978+0000 7f644effd640 1 -- 172.21.15.70:0/516395552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64481a51b0 con 0x7f6448100a60 2024-09-12T01:49:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.979+0000 7f644effd640 1 -- 172.21.15.70:0/516395552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6448100f40 con 0x7f6448100a60 2024-09-12T01:49:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.980+0000 7f6445ffb640 1 -- 172.21.15.70:0/516395552 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f643c017070 con 0x7f6448100a60 2024-09-12T01:49:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.980+0000 7f6445ffb640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64380a2b80 0x7f64380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.980+0000 7f6447fff640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64380a2b80 0x7f64380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.980+0000 7f6445ffb640 1 -- 172.21.15.70:0/516395552 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f643c0ce100 con 0x7f6448100a60 2024-09-12T01:49:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.981+0000 7f6447fff640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64380a2b80 0x7f64380a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f644806b7e0 tx=0x7f6434008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:16.985+0000 7f6445ffb640 1 -- 172.21.15.70:0/516395552 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f643c09b460 con 0x7f6448100a60 2024-09-12T01:49:17.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.185+0000 7f644effd640 1 -- 172.21.15.70:0/516395552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64481a5380 con 0x7f6448100a60 2024-09-12T01:49:17.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.185+0000 7f6445ffb640 1 -- 172.21.15.70:0/516395552 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f643c09ad60 con 0x7f6448100a60 2024-09-12T01:49:17.187 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:17.187 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":1,"btime":"2024-09-12T01:42:34:901597+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T01:49:17.187 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 1 2024-09-12T01:49:17.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.187+0000 7f644effd640 1 -- 172.21.15.70:0/516395552 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64380a2b80 msgr2=0x7f64380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:17.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.187+0000 7f644effd640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64380a2b80 0x7f64380a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f644806b7e0 tx=0x7f6434008040 comp rx=0 tx=0).stop 2024-09-12T01:49:17.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.188+0000 7f644effd640 1 -- 172.21.15.70:0/516395552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6448100a60 msgr2=0x7f6448198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:17.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.188+0000 7f644effd640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6448100a60 0x7f6448198630 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f643c00b4a0 tx=0x7f643c00b960 comp rx=0 tx=0).stop 2024-09-12T01:49:17.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.188+0000 7f644effd640 1 -- 172.21.15.70:0/516395552 shutdown_connections 2024-09-12T01:49:17.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.188+0000 7f644effd640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64380a2b80 0x7f64380a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:17.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.188+0000 7f644effd640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6448106a60 0x7f644819cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:17.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.188+0000 7f644effd640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6448101400 0x7f6448198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:17.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.188+0000 7f644effd640 1 --2- 172.21.15.70:0/516395552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6448100a60 0x7f6448198630 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:17.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.188+0000 7f644effd640 1 -- 172.21.15.70:0/516395552 >> 172.21.15.70:0/516395552 conn(0x7f64480fc780 msgr2=0x7f6448104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:17.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.188+0000 7f644effd640 1 -- 172.21.15.70:0/516395552 shutdown_connections 2024-09-12T01:49:17.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:17.188+0000 7f644effd640 1 -- 172.21.15.70:0/516395552 wait complete. 2024-09-12T01:49:17.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:17 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/516395552' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:17.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:17 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/516395552' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:17.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:17 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/516395552' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:17.672 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:49:17 smithi191 systemd[1]: Starting Ceph mds.l for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:49:17.937 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:49:17 smithi191 podman[66170]: 2024-09-12 01:49:17.574963726 +0000 UTC m=+0.015465729 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:17.938 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:49:17 smithi191 podman[66170]: 2024-09-12 01:49:17.685871518 +0000 UTC m=+0.126373502 container create cadebaaa594d814696ec9bf8288e6d4852c36efeebacd1b7a4a24473fe16d0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-l, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:49:17.938 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:49:17 smithi191 podman[66170]: 2024-09-12 01:49:17.888564832 +0000 UTC m=+0.329066820 container init cadebaaa594d814696ec9bf8288e6d4852c36efeebacd1b7a4a24473fe16d0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T01:49:17.938 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:49:17 smithi191 podman[66170]: 2024-09-12 01:49:17.891514289 +0000 UTC m=+0.332016273 container start cadebaaa594d814696ec9bf8288e6d4852c36efeebacd1b7a4a24473fe16d0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-l, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T01:49:17.938 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:49:17 smithi191 ceph-mds[66189]: -- 172.21.15.191:0/3452687034 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bfac9eb860 con 0x55bfac9c9400 2024-09-12T01:49:17.938 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:49:17 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-l[66185]: starting mds.l at 2024-09-12T01:49:18.246 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:49:17 smithi191 bash[66170]: cadebaaa594d814696ec9bf8288e6d4852c36efeebacd1b7a4a24473fe16d0ae 2024-09-12T01:49:18.246 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:49:17 smithi191 systemd[1]: Started Ceph mds.l for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:18.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:18 smithi152 ceph-mon[35055]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:18.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:18 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.191:6832/1019939610,v1:172.21.15.191:6833/1019939610] up:boot 2024-09-12T01:49:18.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:18 smithi152 ceph-mon[35055]: fsmap 1 up:standby 2024-09-12T01:49:18.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:18 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:49:18.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:18 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:18.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:18 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:18.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:18 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:18.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:18 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:18.500 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:18 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:18.501 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:18 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:18 smithi070 ceph-mon[31177]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:18 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.191:6832/1019939610,v1:172.21.15.191:6833/1019939610] up:boot 2024-09-12T01:49:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:18 smithi070 ceph-mon[31177]: fsmap 1 up:standby 2024-09-12T01:49:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:18 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:49:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:18 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:18 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:18 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:18 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:18 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:18.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:18 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:18.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:18 smithi191 ceph-mon[35770]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:18.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:18 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.191:6832/1019939610,v1:172.21.15.191:6833/1019939610] up:boot 2024-09-12T01:49:18.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:18 smithi191 ceph-mon[35770]: fsmap 1 up:standby 2024-09-12T01:49:18.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:18 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:49:18.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:18 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:18.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:18 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:18.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:18 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:18.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:18 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:18.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:18 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:18.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:18 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:19.503 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:19 smithi152 ceph-mon[35055]: Deploying daemon mds.k on smithi152 2024-09-12T01:49:19.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:19 smithi070 ceph-mon[31177]: Deploying daemon mds.k on smithi152 2024-09-12T01:49:19.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:19 smithi191 ceph-mon[35770]: Deploying daemon mds.k on smithi152 2024-09-12T01:49:19.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:49:20.117 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:20.222 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:49:20 smithi152 systemd[1]: Starting Ceph mds.k for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:49:20.472 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:20 smithi152 ceph-mon[35055]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:20.473 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:49:20 smithi152 podman[64111]: 2024-09-12 01:49:20.125164468 +0000 UTC m=+0.016474651 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:20.473 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:49:20 smithi152 podman[64111]: 2024-09-12 01:49:20.225989139 +0000 UTC m=+0.117299304 container create 56d78402e3e0ef7b3cc3c5ca14811c896c72bdcc92bc798d11f5304fd6e5a938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-k, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:49:20.473 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:49:20 smithi152 podman[64111]: 2024-09-12 01:49:20.445533088 +0000 UTC m=+0.336843256 container init 56d78402e3e0ef7b3cc3c5ca14811c896c72bdcc92bc798d11f5304fd6e5a938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-k, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T01:49:20.473 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:49:20 smithi152 podman[64111]: 2024-09-12 01:49:20.448437465 +0000 UTC m=+0.339747632 container start 56d78402e3e0ef7b3cc3c5ca14811c896c72bdcc92bc798d11f5304fd6e5a938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T01:49:20.473 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:49:20 smithi152 ceph-mds[64130]: -- 172.21.15.152:0/3731671176 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559f37f15c20 con 0x559f37ef3400 2024-09-12T01:49:20.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:20 smithi070 ceph-mon[31177]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:20.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.539+0000 7f16accd6640 1 -- 172.21.15.70:0/1204052793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a8102570 msgr2=0x7f16a81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:20.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.539+0000 7f16accd6640 1 --2- 172.21.15.70:0/1204052793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a8102570 0x7f16a81029b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f169c009900 tx=0x7f169c02a480 comp rx=0 tx=0).stop 2024-09-12T01:49:20.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.539+0000 7f16accd6640 1 -- 172.21.15.70:0/1204052793 shutdown_connections 2024-09-12T01:49:20.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.539+0000 7f16accd6640 1 --2- 172.21.15.70:0/1204052793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16a8102ef0 0x7f16a810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:20.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.539+0000 7f16accd6640 1 --2- 172.21.15.70:0/1204052793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a8102570 0x7f16a81029b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:20.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.539+0000 7f16accd6640 1 --2- 172.21.15.70:0/1204052793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a8100e20 0x7f16a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:20.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.539+0000 7f16accd6640 1 -- 172.21.15.70:0/1204052793 >> 172.21.15.70:0/1204052793 conn(0x7f16a80fc7d0 msgr2=0x7f16a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:20.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.539+0000 7f16accd6640 1 -- 172.21.15.70:0/1204052793 shutdown_connections 2024-09-12T01:49:20.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.539+0000 7f16accd6640 1 -- 172.21.15.70:0/1204052793 wait complete. 2024-09-12T01:49:20.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.540+0000 7f16accd6640 1 Processor -- start 2024-09-12T01:49:20.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.540+0000 7f16accd6640 1 -- start start 2024-09-12T01:49:20.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.540+0000 7f16accd6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a8100e20 0x7f16a81974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.540+0000 7f16accd6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a8102570 0x7f16a8197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.540+0000 7f16accd6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16a8102ef0 0x7f16a819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.540+0000 7f16accd6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f16a81110a0 con 0x7f16a8102570 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.540+0000 7f16accd6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f16a8110f20 con 0x7f16a8102ef0 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.540+0000 7f16accd6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f16a8111220 con 0x7f16a8100e20 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.540+0000 7f16a5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a8102570 0x7f16a8197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.540+0000 7f16a5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a8102570 0x7f16a8197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56080/0 (socket says 172.21.15.70:56080) 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.540+0000 7f16a5d9b640 1 -- 172.21.15.70:0/2326549433 learned_addr learned my addr 172.21.15.70:0/2326549433 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.540+0000 7f16a659c640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a8100e20 0x7f16a81974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.541+0000 7f16a6d9d640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16a8102ef0 0x7f16a819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.541+0000 7f16a5d9b640 1 -- 172.21.15.70:0/2326549433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a8100e20 msgr2=0x7f16a81974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.541+0000 7f16a5d9b640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a8100e20 0x7f16a81974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.541+0000 7f16a5d9b640 1 -- 172.21.15.70:0/2326549433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16a8102ef0 msgr2=0x7f16a819bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.541+0000 7f16a5d9b640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16a8102ef0 0x7f16a819bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.541+0000 7f16a5d9b640 1 -- 172.21.15.70:0/2326549433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a819c470 con 0x7f16a8102570 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.541+0000 7f16a5d9b640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a8102570 0x7f16a8197a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f169c006010 tx=0x7f169c004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.541+0000 7f16977fe640 1 -- 172.21.15.70:0/2326549433 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c03f030 con 0x7f16a8102570 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.541+0000 7f16accd6640 1 -- 172.21.15.70:0/2326549433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a819c700 con 0x7f16a8102570 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.541+0000 7f16977fe640 1 -- 172.21.15.70:0/2326549433 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f169c005500 con 0x7f16a8102570 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.541+0000 7f16977fe640 1 -- 172.21.15.70:0/2326549433 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c035070 con 0x7f16a8102570 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.541+0000 7f16accd6640 1 -- 172.21.15.70:0/2326549433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a81a4040 con 0x7f16a8102570 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.542+0000 7f16accd6640 1 -- 172.21.15.70:0/2326549433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a8101200 con 0x7f16a8102570 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.543+0000 7f16977fe640 1 -- 172.21.15.70:0/2326549433 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f169c042030 con 0x7f16a8102570 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.544+0000 7f16977fe640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f16900a2b80 0x7f16900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.544+0000 7f16a659c640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f16900a2b80 0x7f16900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.544+0000 7f16977fe640 1 -- 172.21.15.70:0/2326549433 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f169c0ef660 con 0x7f16a8102570 2024-09-12T01:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.545+0000 7f16a659c640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f16900a2b80 0x7f16900a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f16980058c0 tx=0x7f169800a250 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:20.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.547+0000 7f16977fe640 1 -- 172.21.15.70:0/2326549433 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f169c0bc9c0 con 0x7f16a8102570 2024-09-12T01:49:20.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:20 smithi191 ceph-mon[35770]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.761+0000 7f16accd6640 1 -- 172.21.15.70:0/2326549433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16a8198820 con 0x7f16a8102570 2024-09-12T01:49:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.761+0000 7f16977fe640 1 -- 172.21.15.70:0/2326549433 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f16a8198820 con 0x7f16a8102570 2024-09-12T01:49:20.762 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:20.763 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":2,"btime":"2024-09-12T01:49:17:919930+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T01:49:20.763 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 2 2024-09-12T01:49:20.763 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:49:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-k[64126]: starting mds.k at 2024-09-12T01:49:20.763 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:49:20 smithi152 bash[64111]: 56d78402e3e0ef7b3cc3c5ca14811c896c72bdcc92bc798d11f5304fd6e5a938 2024-09-12T01:49:20.763 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:49:20 smithi152 systemd[1]: Started Ceph mds.k for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:20.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.763+0000 7f16accd6640 1 -- 172.21.15.70:0/2326549433 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f16900a2b80 msgr2=0x7f16900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:20.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.763+0000 7f16accd6640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f16900a2b80 0x7f16900a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f16980058c0 tx=0x7f169800a250 comp rx=0 tx=0).stop 2024-09-12T01:49:20.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.763+0000 7f16accd6640 1 -- 172.21.15.70:0/2326549433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a8102570 msgr2=0x7f16a8197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:20.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.763+0000 7f16accd6640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a8102570 0x7f16a8197a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f169c006010 tx=0x7f169c004c00 comp rx=0 tx=0).stop 2024-09-12T01:49:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.763+0000 7f16accd6640 1 -- 172.21.15.70:0/2326549433 shutdown_connections 2024-09-12T01:49:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.763+0000 7f16accd6640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f16900a2b80 0x7f16900a5040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.763+0000 7f16accd6640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16a8102ef0 0x7f16a819bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.763+0000 7f16accd6640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16a8102570 0x7f16a8197a00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.763+0000 7f16accd6640 1 --2- 172.21.15.70:0/2326549433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16a8100e20 0x7f16a81974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.763+0000 7f16accd6640 1 -- 172.21.15.70:0/2326549433 >> 172.21.15.70:0/2326549433 conn(0x7f16a80fc7d0 msgr2=0x7f16a8105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.763+0000 7f16accd6640 1 -- 172.21.15.70:0/2326549433 shutdown_connections 2024-09-12T01:49:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:20.763+0000 7f16accd6640 1 -- 172.21.15.70:0/2326549433 wait complete. 2024-09-12T01:49:21.876 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:21.877 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:21.877 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:21.877 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:21.877 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:21.877 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:21.877 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:21 smithi152 ceph-mon[35055]: Deploying daemon mds.j on smithi070 2024-09-12T01:49:21.878 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:21 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2326549433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:21.878 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:21 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.152:6832/2100585386,v1:172.21.15.152:6833/2100585386] up:boot 2024-09-12T01:49:21.878 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:21 smithi152 ceph-mon[35055]: fsmap 2 up:standby 2024-09-12T01:49:21.878 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:49:21.878 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:21 smithi152 ceph-mon[35055]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:21.930 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:21.930 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:21.930 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:21.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:21.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:21.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:21.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:21 smithi070 ceph-mon[31177]: Deploying daemon mds.j on smithi070 2024-09-12T01:49:21.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:21 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2326549433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:21.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:21 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.152:6832/2100585386,v1:172.21.15.152:6833/2100585386] up:boot 2024-09-12T01:49:21.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:21 smithi070 ceph-mon[31177]: fsmap 2 up:standby 2024-09-12T01:49:21.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:49:21.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:21 smithi070 ceph-mon[31177]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:21.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:21 smithi191 ceph-mon[35770]: Deploying daemon mds.j on smithi070 2024-09-12T01:49:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:21 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2326549433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:21 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.152:6832/2100585386,v1:172.21.15.152:6833/2100585386] up:boot 2024-09-12T01:49:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:21 smithi191 ceph-mon[35770]: fsmap 2 up:standby 2024-09-12T01:49:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:49:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:21 smithi191 ceph-mon[35770]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:23.421 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:49:23.685 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:23.769 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 12 01:49:23 smithi070 systemd[1]: Started Ceph mds.j for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:24.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.138+0000 7f87f818b640 1 -- 172.21.15.70:0/1021572455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f010c170 msgr2=0x7f87f010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:24.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.138+0000 7f87f818b640 1 --2- 172.21.15.70:0/1021572455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f010c170 0x7f87f010e610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009ca0 tx=0x7f87e002a950 comp rx=0 tx=0).stop 2024-09-12T01:49:24.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.138+0000 7f87f818b640 1 -- 172.21.15.70:0/1021572455 shutdown_connections 2024-09-12T01:49:24.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.138+0000 7f87f818b640 1 --2- 172.21.15.70:0/1021572455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f010c170 0x7f87f010e610 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.138+0000 7f87f818b640 1 --2- 172.21.15.70:0/1021572455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f0103660 0x7f87f010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.138+0000 7f87f818b640 1 --2- 172.21.15.70:0/1021572455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87f0102d40 0x7f87f0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.138+0000 7f87f818b640 1 -- 172.21.15.70:0/1021572455 >> 172.21.15.70:0/1021572455 conn(0x7f87f00fc7a0 msgr2=0x7f87f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.138+0000 7f87f818b640 1 -- 172.21.15.70:0/1021572455 shutdown_connections 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.138+0000 7f87f818b640 1 -- 172.21.15.70:0/1021572455 wait complete. 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.139+0000 7f87f818b640 1 Processor -- start 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.139+0000 7f87f818b640 1 -- start start 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.139+0000 7f87f818b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f0102d40 0x7f87f01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.139+0000 7f87f818b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87f0103660 0x7f87f0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.139+0000 7f87f818b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f010c170 0x7f87f0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.139+0000 7f87f818b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f87f0112070 con 0x7f87f0102d40 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.139+0000 7f87f818b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f87f0111ef0 con 0x7f87f010c170 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.139+0000 7f87f818b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01121f0 con 0x7f87f0103660 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.139+0000 7f87f5f27640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f0102d40 0x7f87f01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.139+0000 7f87f5f27640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f0102d40 0x7f87f01009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56124/0 (socket says 172.21.15.70:56124) 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.139+0000 7f87f5f27640 1 -- 172.21.15.70:0/1062221521 learned_addr learned my addr 172.21.15.70:0/1062221521 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.140+0000 7f87f5726640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87f0103660 0x7f87f0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.140+0000 7f87f5f27640 1 -- 172.21.15.70:0/1062221521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87f0103660 msgr2=0x7f87f0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.140+0000 7f87f5f27640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87f0103660 0x7f87f0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.140+0000 7f87f5f27640 1 -- 172.21.15.70:0/1062221521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f010c170 msgr2=0x7f87f0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.140+0000 7f87f5f27640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f010c170 0x7f87f0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.140+0000 7f87f5f27640 1 -- 172.21.15.70:0/1062221521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f01a6950 con 0x7f87f0102d40 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.140+0000 7f87f5f27640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f0102d40 0x7f87f01009a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f87e800d950 tx=0x7f87e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.140+0000 7f87eeffd640 1 -- 172.21.15.70:0/1062221521 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8017030 con 0x7f87f0102d40 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.140+0000 7f87f818b640 1 -- 172.21.15.70:0/1062221521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f01a6c40 con 0x7f87f0102d40 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.140+0000 7f87eeffd640 1 -- 172.21.15.70:0/1062221521 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f87e8004020 con 0x7f87f0102d40 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.140+0000 7f87eeffd640 1 -- 172.21.15.70:0/1062221521 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8004a00 con 0x7f87f0102d40 2024-09-12T01:49:24.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.140+0000 7f87f818b640 1 -- 172.21.15.70:0/1062221521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f01a7180 con 0x7f87f0102d40 2024-09-12T01:49:24.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.141+0000 7f87f818b640 1 -- 172.21.15.70:0/1062221521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f0103120 con 0x7f87f0102d40 2024-09-12T01:49:24.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.142+0000 7f87eeffd640 1 -- 172.21.15.70:0/1062221521 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f87e80041d0 con 0x7f87f0102d40 2024-09-12T01:49:24.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.143+0000 7f87eeffd640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f87d80a2b80 0x7f87d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:24.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.143+0000 7f87f5726640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f87d80a2b80 0x7f87d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:24.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.143+0000 7f87eeffd640 1 -- 172.21.15.70:0/1062221521 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f87e80ce620 con 0x7f87f0102d40 2024-09-12T01:49:24.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.143+0000 7f87f5726640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f87d80a2b80 0x7f87d80a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f87e40058c0 tx=0x7f87e4005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:24.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.147+0000 7f87eeffd640 1 -- 172.21.15.70:0/1062221521 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87e809ba20 con 0x7f87f0102d40 2024-09-12T01:49:24.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.371+0000 7f87f818b640 1 -- 172.21.15.70:0/1062221521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87f0101ed0 con 0x7f87f0102d40 2024-09-12T01:49:24.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.372+0000 7f87eeffd640 1 -- 172.21.15.70:0/1062221521 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f87e809b320 con 0x7f87f0102d40 2024-09-12T01:49:24.373 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:24.373 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":4,"btime":"2024-09-12T01:49:23:436621+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T01:49:24.373 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 4 2024-09-12T01:49:24.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.373+0000 7f87f818b640 1 -- 172.21.15.70:0/1062221521 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f87d80a2b80 msgr2=0x7f87d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:24.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.373+0000 7f87f818b640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f87d80a2b80 0x7f87d80a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f87e40058c0 tx=0x7f87e4005850 comp rx=0 tx=0).stop 2024-09-12T01:49:24.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.373+0000 7f87f818b640 1 -- 172.21.15.70:0/1062221521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f0102d40 msgr2=0x7f87f01009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:24.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.373+0000 7f87f818b640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f0102d40 0x7f87f01009a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f87e800d950 tx=0x7f87e800de10 comp rx=0 tx=0).stop 2024-09-12T01:49:24.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.374+0000 7f87f818b640 1 -- 172.21.15.70:0/1062221521 shutdown_connections 2024-09-12T01:49:24.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.374+0000 7f87f818b640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f87d80a2b80 0x7f87d80a5040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:24.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.374+0000 7f87f818b640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87f010c170 0x7f87f0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:24.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.374+0000 7f87f818b640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87f0103660 0x7f87f0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:24.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.374+0000 7f87f818b640 1 --2- 172.21.15.70:0/1062221521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f0102d40 0x7f87f01009a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:24.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.374+0000 7f87f818b640 1 -- 172.21.15.70:0/1062221521 >> 172.21.15.70:0/1062221521 conn(0x7f87f00fc7a0 msgr2=0x7f87f00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:24.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.374+0000 7f87f818b640 1 -- 172.21.15.70:0/1062221521 shutdown_connections 2024-09-12T01:49:24.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:24.374+0000 7f87f818b640 1 -- 172.21.15.70:0/1062221521 wait complete. 2024-09-12T01:49:24.722 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:24 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.70:6834/158611905,v1:172.21.15.70:6835/158611905] up:boot 2024-09-12T01:49:24.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:24 smithi070 ceph-mon[31177]: fsmap 3 up:standby 2024-09-12T01:49:24.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:24 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:49:24.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:24 smithi070 ceph-mon[31177]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:24.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:24 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:24.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:24 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:24.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:24 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:24.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:24 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:24.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:24 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:24.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:24 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:24.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:24 smithi070 ceph-mon[31177]: Deploying daemon mds.d on smithi070 2024-09-12T01:49:24.723 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:24 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1062221521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:24.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:24 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.70:6834/158611905,v1:172.21.15.70:6835/158611905] up:boot 2024-09-12T01:49:24.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:24 smithi152 ceph-mon[35055]: fsmap 3 up:standby 2024-09-12T01:49:24.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:24 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:49:24.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:24 smithi152 ceph-mon[35055]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:24.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:24 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:24.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:24 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:24.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:24 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:24.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:24 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:24.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:24 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:24.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:24 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:24.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:24 smithi152 ceph-mon[35055]: Deploying daemon mds.d on smithi070 2024-09-12T01:49:24.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:24 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1062221521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:24.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:24 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.70:6834/158611905,v1:172.21.15.70:6835/158611905] up:boot 2024-09-12T01:49:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:24 smithi191 ceph-mon[35770]: fsmap 3 up:standby 2024-09-12T01:49:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:24 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T01:49:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:24 smithi191 ceph-mon[35770]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:24 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:24 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:24 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:24 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:24 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:24 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:24 smithi191 ceph-mon[35770]: Deploying daemon mds.d on smithi070 2024-09-12T01:49:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:24 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1062221521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:26.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:26 smithi070 ceph-mon[31177]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:26.769 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:49:26 smithi070 systemd[1]: Starting Ceph mds.d for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:49:26.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:26 smithi191 ceph-mon[35770]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:27.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:26 smithi152 ceph-mon[35055]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:27.042 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:49:26 smithi070 podman[70986]: 2024-09-12 01:49:26.683241484 +0000 UTC m=+0.015164166 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:27.042 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:49:26 smithi070 podman[70986]: 2024-09-12 01:49:26.780663805 +0000 UTC m=+0.112586532 container create 88ed23c9454f413befdb20b227e86bf9fc7d79781341c739e3716cc9f91044bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T01:49:27.042 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:49:27 smithi070 podman[70986]: 2024-09-12 01:49:27.016656432 +0000 UTC m=+0.348579114 container init 88ed23c9454f413befdb20b227e86bf9fc7d79781341c739e3716cc9f91044bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T01:49:27.042 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:49:27 smithi070 podman[70986]: 2024-09-12 01:49:27.019542672 +0000 UTC m=+0.351465362 container start 88ed23c9454f413befdb20b227e86bf9fc7d79781341c739e3716cc9f91044bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T01:49:27.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:49:27.384 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:27.506 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:49:27 smithi070 ceph-mds[71005]: -- 172.21.15.70:0/1949409977 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c80a927860 con 0x55c80a905400 2024-09-12T01:49:27.506 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:49:27 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-d[71001]: starting mds.d at 2024-09-12T01:49:27.506 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:49:27 smithi070 bash[70986]: 88ed23c9454f413befdb20b227e86bf9fc7d79781341c739e3716cc9f91044bb 2024-09-12T01:49:27.506 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:49:27 smithi070 systemd[1]: Started Ceph mds.d for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.841+0000 7f932ee2c640 1 -- 172.21.15.70:0/2984687804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9328100e20 msgr2=0x7f9328101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.841+0000 7f932ee2c640 1 --2- 172.21.15.70:0/2984687804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9328100e20 0x7f9328101200 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9318009ca0 tx=0x7f931802a950 comp rx=0 tx=0).stop 2024-09-12T01:49:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.841+0000 7f932ee2c640 1 -- 172.21.15.70:0/2984687804 shutdown_connections 2024-09-12T01:49:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.841+0000 7f932ee2c640 1 --2- 172.21.15.70:0/2984687804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9328102ef0 0x7f932810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.841+0000 7f932ee2c640 1 --2- 172.21.15.70:0/2984687804 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9328102570 0x7f93281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.841+0000 7f932ee2c640 1 --2- 172.21.15.70:0/2984687804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9328100e20 0x7f9328101200 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.841+0000 7f932ee2c640 1 -- 172.21.15.70:0/2984687804 >> 172.21.15.70:0/2984687804 conn(0x7f93280fc7d0 msgr2=0x7f93280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.841+0000 7f932ee2c640 1 -- 172.21.15.70:0/2984687804 shutdown_connections 2024-09-12T01:49:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.841+0000 7f932ee2c640 1 -- 172.21.15.70:0/2984687804 wait complete. 2024-09-12T01:49:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.841+0000 7f932ee2c640 1 Processor -- start 2024-09-12T01:49:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.841+0000 7f932ee2c640 1 -- start start 2024-09-12T01:49:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.841+0000 7f932ee2c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9328100e20 0x7f9328198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932ee2c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9328102570 0x7f9328198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932ee2c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9328102ef0 0x7f932819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932ee2c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f93281121e0 con 0x7f9328102ef0 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932ee2c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9328112060 con 0x7f9328100e20 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932ee2c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9328112360 con 0x7f9328102570 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932d3c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9328102ef0 0x7f932819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932d3c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9328102ef0 0x7f932819cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56152/0 (socket says 172.21.15.70:56152) 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932d3c9640 1 -- 172.21.15.70:0/2656336266 learned_addr learned my addr 172.21.15.70:0/2656336266 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932cbc8640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9328100e20 0x7f9328198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932d3c9640 1 -- 172.21.15.70:0/2656336266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9328102570 msgr2=0x7f9328198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932d3c9640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9328102570 0x7f9328198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932d3c9640 1 -- 172.21.15.70:0/2656336266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9328100e20 msgr2=0x7f9328198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932d3c9640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9328100e20 0x7f9328198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932d3c9640 1 -- 172.21.15.70:0/2656336266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932819d5f0 con 0x7f9328102ef0 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932cbc8640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9328100e20 0x7f9328198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:49:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932d3c9640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9328102ef0 0x7f932819cf10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f932000e970 tx=0x7f932000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:27.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f9325ffb640 1 -- 172.21.15.70:0/2656336266 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932000ccc0 con 0x7f9328102ef0 2024-09-12T01:49:27.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f9325ffb640 1 -- 172.21.15.70:0/2656336266 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f932000ce60 con 0x7f9328102ef0 2024-09-12T01:49:27.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932ee2c640 1 -- 172.21.15.70:0/2656336266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932819d8e0 con 0x7f9328102ef0 2024-09-12T01:49:27.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f9325ffb640 1 -- 172.21.15.70:0/2656336266 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9320010690 con 0x7f9328102ef0 2024-09-12T01:49:27.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.842+0000 7f932ee2c640 1 -- 172.21.15.70:0/2656336266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93281a51c0 con 0x7f9328102ef0 2024-09-12T01:49:27.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.844+0000 7f932ee2c640 1 -- 172.21.15.70:0/2656336266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9328101200 con 0x7f9328102ef0 2024-09-12T01:49:27.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.845+0000 7f9325ffb640 1 -- 172.21.15.70:0/2656336266 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f93200046c0 con 0x7f9328102ef0 2024-09-12T01:49:27.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.845+0000 7f9325ffb640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93140a2c00 0x7f93140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:27.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.846+0000 7f932cbc8640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93140a2c00 0x7f93140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:27.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.846+0000 7f9325ffb640 1 -- 172.21.15.70:0/2656336266 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f93200cf0c0 con 0x7f9328102ef0 2024-09-12T01:49:27.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.846+0000 7f932cbc8640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93140a2c00 0x7f93140a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9318030040 tx=0x7f9318005f80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:27.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:27.850+0000 7f9325ffb640 1 -- 172.21.15.70:0/2656336266 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f932009c4a0 con 0x7f9328102ef0 2024-09-12T01:49:28.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.051+0000 7f932ee2c640 1 -- 172.21.15.70:0/2656336266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93281a5480 con 0x7f9328102ef0 2024-09-12T01:49:28.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.051+0000 7f9325ffb640 1 -- 172.21.15.70:0/2656336266 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f932009bda0 con 0x7f9328102ef0 2024-09-12T01:49:28.052 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:28.052 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"btime":"2024-09-12T01:49:27:518823+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T01:49:28.053 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 5 2024-09-12T01:49:28.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.054+0000 7f932ee2c640 1 -- 172.21.15.70:0/2656336266 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93140a2c00 msgr2=0x7f93140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:28.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.054+0000 7f932ee2c640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93140a2c00 0x7f93140a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9318030040 tx=0x7f9318005f80 comp rx=0 tx=0).stop 2024-09-12T01:49:28.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.054+0000 7f932ee2c640 1 -- 172.21.15.70:0/2656336266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9328102ef0 msgr2=0x7f932819cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:28.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.054+0000 7f932ee2c640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9328102ef0 0x7f932819cf10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f932000e970 tx=0x7f932000ed70 comp rx=0 tx=0).stop 2024-09-12T01:49:28.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.054+0000 7f932ee2c640 1 -- 172.21.15.70:0/2656336266 shutdown_connections 2024-09-12T01:49:28.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.054+0000 7f932ee2c640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93140a2c00 0x7f93140a50c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:28.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.054+0000 7f932ee2c640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9328102ef0 0x7f932819cf10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:28.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.054+0000 7f932ee2c640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9328102570 0x7f9328198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:28.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.054+0000 7f932ee2c640 1 --2- 172.21.15.70:0/2656336266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9328100e20 0x7f9328198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:28.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.054+0000 7f932ee2c640 1 -- 172.21.15.70:0/2656336266 >> 172.21.15.70:0/2656336266 conn(0x7f93280fc7d0 msgr2=0x7f93280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:28.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.054+0000 7f932ee2c640 1 -- 172.21.15.70:0/2656336266 shutdown_connections 2024-09-12T01:49:28.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:28.054+0000 7f932ee2c640 1 -- 172.21.15.70:0/2656336266 wait complete. 2024-09-12T01:49:28.365 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:28 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:28.365 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:28 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:28.365 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:28 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:28.365 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:28 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:28.365 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:28 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:28.365 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:28 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:28.366 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:28 smithi070 ceph-mon[31177]: Deploying daemon mds.e on smithi152 2024-09-12T01:49:28.366 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:28 smithi070 ceph-mon[31177]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:28.366 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:28 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.70:6836/2540092631,v1:172.21.15.70:6837/2540092631] up:boot 2024-09-12T01:49:28.366 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:28 smithi070 ceph-mon[31177]: fsmap 4 up:standby 2024-09-12T01:49:28.366 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:28 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:49:28.366 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:28 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2656336266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:28 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:28 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:28 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:28 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:28 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:28 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:28 smithi191 ceph-mon[35770]: Deploying daemon mds.e on smithi152 2024-09-12T01:49:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:28 smithi191 ceph-mon[35770]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:28 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.70:6836/2540092631,v1:172.21.15.70:6837/2540092631] up:boot 2024-09-12T01:49:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:28 smithi191 ceph-mon[35770]: fsmap 4 up:standby 2024-09-12T01:49:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:28 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:49:28.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:28 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2656336266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:28.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:28 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:28.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:28 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:28.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:28 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:28.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:28 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:28.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:28 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:28.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:28 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:28.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:28 smithi152 ceph-mon[35055]: Deploying daemon mds.e on smithi152 2024-09-12T01:49:28.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:28 smithi152 ceph-mon[35055]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:28.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:28 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.70:6836/2540092631,v1:172.21.15.70:6837/2540092631] up:boot 2024-09-12T01:49:28.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:28 smithi152 ceph-mon[35055]: fsmap 4 up:standby 2024-09-12T01:49:28.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:28 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T01:49:28.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:28 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2656336266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:29.213 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:49:29 smithi152 systemd[1]: Starting Ceph mds.e for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:49:29.513 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:49:29 smithi152 podman[64423]: 2024-09-12 01:49:29.116467511 +0000 UTC m=+0.016607135 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:29.513 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:49:29 smithi152 podman[64423]: 2024-09-12 01:49:29.230552554 +0000 UTC m=+0.130692168 container create a9649aa599899b1d634ed38c1a802b70dc02a1a9c48265e868abeeb3341ffb0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T01:49:29.513 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:49:29 smithi152 podman[64423]: 2024-09-12 01:49:29.424493606 +0000 UTC m=+0.324633230 container init a9649aa599899b1d634ed38c1a802b70dc02a1a9c48265e868abeeb3341ffb0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T01:49:29.513 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:49:29 smithi152 podman[64423]: 2024-09-12 01:49:29.427477219 +0000 UTC m=+0.327616833 container start a9649aa599899b1d634ed38c1a802b70dc02a1a9c48265e868abeeb3341ffb0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-e, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T01:49:29.513 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:49:29 smithi152 ceph-mds[64443]: -- 172.21.15.152:0/1826854551 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d9b2fc7860 con 0x55d9b2fa4800 2024-09-12T01:49:29.513 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:49:29 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-e[64439]: starting mds.e at 2024-09-12T01:49:30.012 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:49:29 smithi152 bash[64423]: a9649aa599899b1d634ed38c1a802b70dc02a1a9c48265e868abeeb3341ffb0a 2024-09-12T01:49:30.012 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:49:29 smithi152 systemd[1]: Started Ceph mds.e for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:30 smithi191 ceph-mon[35770]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:30 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.152:6834/2743921312,v1:172.21.15.152:6835/2743921312] up:boot 2024-09-12T01:49:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:30 smithi191 ceph-mon[35770]: fsmap 5 up:standby 2024-09-12T01:49:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:49:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:30.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:30 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:30.690 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:30 smithi191 ceph-mon[35770]: Deploying daemon mds.f on smithi191 2024-09-12T01:49:30.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:30 smithi152 ceph-mon[35055]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:30.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:30 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.152:6834/2743921312,v1:172.21.15.152:6835/2743921312] up:boot 2024-09-12T01:49:30.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:30 smithi152 ceph-mon[35055]: fsmap 5 up:standby 2024-09-12T01:49:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:49:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:30 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:30.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:30 smithi152 ceph-mon[35055]: Deploying daemon mds.f on smithi191 2024-09-12T01:49:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:30 smithi070 ceph-mon[31177]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:30 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.152:6834/2743921312,v1:172.21.15.152:6835/2743921312] up:boot 2024-09-12T01:49:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:30 smithi070 ceph-mon[31177]: fsmap 5 up:standby 2024-09-12T01:49:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:49:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:30 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:30 smithi070 ceph-mon[31177]: Deploying daemon mds.f on smithi191 2024-09-12T01:49:30.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:49:31.033 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:31.437 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:49:31 smithi191 systemd[1]: Starting Ceph mds.f for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:49:31.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.545+0000 7f8423d93640 1 -- 172.21.15.70:0/225333262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f841c102790 msgr2=0x7f841c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:31.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.545+0000 7f8423d93640 1 --2- 172.21.15.70:0/225333262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f841c102790 0x7f841c1067e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f840c009900 tx=0x7f840c02a410 comp rx=0 tx=0).stop 2024-09-12T01:49:31.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.545+0000 7f8423d93640 1 -- 172.21.15.70:0/225333262 shutdown_connections 2024-09-12T01:49:31.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.545+0000 7f8423d93640 1 --2- 172.21.15.70:0/225333262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f841c106f10 0x7f841c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.545+0000 7f8423d93640 1 --2- 172.21.15.70:0/225333262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f841c102790 0x7f841c1067e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.545+0000 7f8423d93640 1 --2- 172.21.15.70:0/225333262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f841c101de0 0x7f841c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.545+0000 7f8423d93640 1 -- 172.21.15.70:0/225333262 >> 172.21.15.70:0/225333262 conn(0x7f841c0fd8c0 msgr2=0x7f841c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.545+0000 7f8423d93640 1 -- 172.21.15.70:0/225333262 shutdown_connections 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.545+0000 7f8423d93640 1 -- 172.21.15.70:0/225333262 wait complete. 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8423d93640 1 Processor -- start 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8423d93640 1 -- start start 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8423d93640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f841c101de0 0x7f841c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8423d93640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f841c102790 0x7f841c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8423d93640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f841c106f10 0x7f841c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8423d93640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f841c1120d0 con 0x7f841c106f10 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8423d93640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f841c111f50 con 0x7f841c101de0 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8423d93640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f841c112250 con 0x7f841c102790 2024-09-12T01:49:31.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8422330640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f841c106f10 0x7f841c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8422330640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f841c106f10 0x7f841c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36230/0 (socket says 172.21.15.70:36230) 2024-09-12T01:49:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8422330640 1 -- 172.21.15.70:0/599496942 learned_addr learned my addr 172.21.15.70:0/599496942 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f842132e640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f841c102790 0x7f841c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8421b2f640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f841c101de0 0x7f841c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8422330640 1 -- 172.21.15.70:0/599496942 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f841c102790 msgr2=0x7f841c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8422330640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f841c102790 0x7f841c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8422330640 1 -- 172.21.15.70:0/599496942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f841c101de0 msgr2=0x7f841c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8422330640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f841c101de0 0x7f841c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8422330640 1 -- 172.21.15.70:0/599496942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c1a6a90 con 0x7f841c106f10 2024-09-12T01:49:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8421b2f640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f841c101de0 0x7f841c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:49:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.546+0000 7f8422330640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f841c106f10 0x7f841c074f70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f841400b970 tx=0x7f841400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:31.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.547+0000 7f8412ffd640 1 -- 172.21.15.70:0/599496942 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414019070 con 0x7f841c106f10 2024-09-12T01:49:31.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.547+0000 7f8412ffd640 1 -- 172.21.15.70:0/599496942 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f841400cb40 con 0x7f841c106f10 2024-09-12T01:49:31.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.547+0000 7f8423d93640 1 -- 172.21.15.70:0/599496942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c1a6d80 con 0x7f841c106f10 2024-09-12T01:49:31.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.547+0000 7f8412ffd640 1 -- 172.21.15.70:0/599496942 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414007700 con 0x7f841c106f10 2024-09-12T01:49:31.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.547+0000 7f8423d93640 1 -- 172.21.15.70:0/599496942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c1a72c0 con 0x7f841c106f10 2024-09-12T01:49:31.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.548+0000 7f8423d93640 1 -- 172.21.15.70:0/599496942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c1021c0 con 0x7f841c106f10 2024-09-12T01:49:31.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.549+0000 7f8412ffd640 1 -- 172.21.15.70:0/599496942 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f841401c070 con 0x7f841c106f10 2024-09-12T01:49:31.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.549+0000 7f8412ffd640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84080a2b80 0x7f84080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:31.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.549+0000 7f8421b2f640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84080a2b80 0x7f84080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:31.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.549+0000 7f8412ffd640 1 -- 172.21.15.70:0/599496942 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f84140ce640 con 0x7f841c106f10 2024-09-12T01:49:31.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.550+0000 7f8421b2f640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84080a2b80 0x7f84080a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8418009b40 tx=0x7f8418005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:31.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.553+0000 7f8412ffd640 1 -- 172.21.15.70:0/599496942 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f841409ba40 con 0x7f841c106f10 2024-09-12T01:49:31.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.755+0000 7f8423d93640 1 -- 172.21.15.70:0/599496942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f841c1a7550 con 0x7f841c106f10 2024-09-12T01:49:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.756+0000 7f8412ffd640 1 -- 172.21.15.70:0/599496942 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7f841409b340 con 0x7f841c106f10 2024-09-12T01:49:31.757 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:31.757 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":6,"btime":"2024-09-12T01:49:29:506456+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-12T01:49:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 6 2024-09-12T01:49:31.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.758+0000 7f8423d93640 1 -- 172.21.15.70:0/599496942 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84080a2b80 msgr2=0x7f84080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:31.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.758+0000 7f8423d93640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84080a2b80 0x7f84080a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8418009b40 tx=0x7f8418005e50 comp rx=0 tx=0).stop 2024-09-12T01:49:31.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.758+0000 7f8423d93640 1 -- 172.21.15.70:0/599496942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f841c106f10 msgr2=0x7f841c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:31.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.758+0000 7f8423d93640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f841c106f10 0x7f841c074f70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f841400b970 tx=0x7f841400be30 comp rx=0 tx=0).stop 2024-09-12T01:49:31.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.758+0000 7f8423d93640 1 -- 172.21.15.70:0/599496942 shutdown_connections 2024-09-12T01:49:31.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.758+0000 7f8423d93640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84080a2b80 0x7f84080a5040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.758+0000 7f8423d93640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f841c106f10 0x7f841c074f70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.758+0000 7f8423d93640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f841c102790 0x7f841c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.758+0000 7f8423d93640 1 --2- 172.21.15.70:0/599496942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f841c101de0 0x7f841c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.758+0000 7f8423d93640 1 -- 172.21.15.70:0/599496942 >> 172.21.15.70:0/599496942 conn(0x7f841c0fd8c0 msgr2=0x7f841c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.758+0000 7f8423d93640 1 -- 172.21.15.70:0/599496942 shutdown_connections 2024-09-12T01:49:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:31.758+0000 7f8423d93640 1 -- 172.21.15.70:0/599496942 wait complete. 2024-09-12T01:49:31.845 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:49:31 smithi191 podman[66472]: 2024-09-12 01:49:31.524357229 +0000 UTC m=+0.107255072 container create afaa17d49462e67667dc38d05cf6098afed61f0ca332c72860b2ac1e9be00cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T01:49:31.846 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:49:31 smithi191 podman[66472]: 2024-09-12 01:49:31.432684508 +0000 UTC m=+0.015582361 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:31.846 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:49:31 smithi191 podman[66472]: 2024-09-12 01:49:31.727388439 +0000 UTC m=+0.310286282 container init afaa17d49462e67667dc38d05cf6098afed61f0ca332c72860b2ac1e9be00cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T01:49:31.846 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:49:31 smithi191 podman[66472]: 2024-09-12 01:49:31.730136376 +0000 UTC m=+0.313034220 container start afaa17d49462e67667dc38d05cf6098afed61f0ca332c72860b2ac1e9be00cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T01:49:31.846 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:49:31 smithi191 ceph-mds[66491]: -- 172.21.15.191:0/3658474261 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a441943c20 con 0x55a441921000 2024-09-12T01:49:31.846 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:49:31 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-f[66487]: starting mds.f at 2024-09-12T01:49:31.846 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:49:31 smithi191 bash[66472]: afaa17d49462e67667dc38d05cf6098afed61f0ca332c72860b2ac1e9be00cf4 2024-09-12T01:49:32.187 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:49:31 smithi191 systemd[1]: Started Ceph mds.f for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:32.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:32 smithi152 ceph-mon[35055]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:32.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:32 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/599496942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:32.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:32.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:32.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:32.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:32.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:32.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:32 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:32.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:32 smithi070 ceph-mon[31177]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:32 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/599496942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:32 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:32.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:32 smithi191 ceph-mon[35770]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:32.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:32 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/599496942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:32.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:32.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:32.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:32.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:32.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:32.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:32 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:33.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:33 smithi191 ceph-mon[35770]: Deploying daemon mds.c on smithi191 2024-09-12T01:49:33.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:33 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] up:boot 2024-09-12T01:49:33.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:33 smithi191 ceph-mon[35770]: fsmap 6 up:standby 2024-09-12T01:49:33.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:33 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:49:33.768 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:49:33 smithi191 systemd[1]: Starting Ceph mds.c for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:49:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:33 smithi152 ceph-mon[35055]: Deploying daemon mds.c on smithi191 2024-09-12T01:49:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:33 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] up:boot 2024-09-12T01:49:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:33 smithi152 ceph-mon[35055]: fsmap 6 up:standby 2024-09-12T01:49:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:33 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:49:34.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:33 smithi070 ceph-mon[31177]: Deploying daemon mds.c on smithi191 2024-09-12T01:49:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:33 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] up:boot 2024-09-12T01:49:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:33 smithi070 ceph-mon[31177]: fsmap 6 up:standby 2024-09-12T01:49:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:33 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:49:34.050 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:49:33 smithi191 podman[66772]: 2024-09-12 01:49:33.83535068 +0000 UTC m=+0.017078071 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:34.050 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:49:33 smithi191 podman[66772]: 2024-09-12 01:49:33.940114953 +0000 UTC m=+0.121842336 container create 67d5c27f25c655bd1584f387d0b8556b49a53ba6f230d7933d04eb2ba8b79ac8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T01:49:34.436 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:49:34.437 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:49:34 smithi191 podman[66772]: 2024-09-12 01:49:34.143563036 +0000 UTC m=+0.325290418 container init 67d5c27f25c655bd1584f387d0b8556b49a53ba6f230d7933d04eb2ba8b79ac8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T01:49:34.437 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:49:34 smithi191 podman[66772]: 2024-09-12 01:49:34.14671605 +0000 UTC m=+0.328443440 container start 67d5c27f25c655bd1584f387d0b8556b49a53ba6f230d7933d04eb2ba8b79ac8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T01:49:34.438 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:49:34 smithi191 ceph-mds[66799]: -- 172.21.15.191:0/2198927255 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f7255d1c20 con 0x55f7255ae800 2024-09-12T01:49:34.438 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:49:34 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-c[66795]: starting mds.c at 2024-09-12T01:49:34.438 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:49:34 smithi191 bash[66772]: 67d5c27f25c655bd1584f387d0b8556b49a53ba6f230d7933d04eb2ba8b79ac8 2024-09-12T01:49:34.438 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:49:34 smithi191 systemd[1]: Started Ceph mds.c for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:34.693 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:34.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:34 smithi070 ceph-mon[31177]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:34.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:34.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:34.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:34.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:34.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:34.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:34 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:34.848 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:34 smithi152 ceph-mon[35055]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:34.848 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:34 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:34.848 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:34 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:34.848 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:34 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:34.848 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:34 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:34.849 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:34 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:34.849 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:34 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:34.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:34 smithi191 ceph-mon[35770]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:34.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:34 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:34.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:34 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:34.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:34 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:34.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:34 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:34.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:34 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:34.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:34 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.088+0000 7f6304ed6640 1 -- 172.21.15.70:0/2005802373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63001036e0 msgr2=0x7f6300107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.088+0000 7f6304ed6640 1 --2- 172.21.15.70:0/2005802373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63001036e0 0x7f6300107b90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009930 tx=0x7f62e802a420 comp rx=0 tx=0).stop 2024-09-12T01:49:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.088+0000 7f6304ed6640 1 -- 172.21.15.70:0/2005802373 shutdown_connections 2024-09-12T01:49:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.088+0000 7f6304ed6640 1 --2- 172.21.15.70:0/2005802373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63001082a0 0x7f630010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.088+0000 7f6304ed6640 1 --2- 172.21.15.70:0/2005802373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63001036e0 0x7f6300107b90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.088+0000 7f6304ed6640 1 --2- 172.21.15.70:0/2005802373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6300102d30 0x7f6300103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.088+0000 7f6304ed6640 1 -- 172.21.15.70:0/2005802373 >> 172.21.15.70:0/2005802373 conn(0x7f63000fc7d0 msgr2=0x7f63000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.089+0000 7f6304ed6640 1 -- 172.21.15.70:0/2005802373 shutdown_connections 2024-09-12T01:49:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.089+0000 7f6304ed6640 1 -- 172.21.15.70:0/2005802373 wait complete. 2024-09-12T01:49:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.089+0000 7f6304ed6640 1 Processor -- start 2024-09-12T01:49:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.089+0000 7f6304ed6640 1 -- start start 2024-09-12T01:49:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f6304ed6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6300102d30 0x7f63001986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f6304ed6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63001036e0 0x7f6300198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f6304ed6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63001082a0 0x7f630019cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f6304ed6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f63001121c0 con 0x7f6300102d30 2024-09-12T01:49:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f6304ed6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6300112040 con 0x7f63001082a0 2024-09-12T01:49:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f6304ed6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6300112340 con 0x7f63001036e0 2024-09-12T01:49:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6300102d30 0x7f63001986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6300102d30 0x7f63001986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36246/0 (socket says 172.21.15.70:36246) 2024-09-12T01:49:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62fe59c640 1 -- 172.21.15.70:0/4291893548 learned_addr learned my addr 172.21.15.70:0/4291893548 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62fed9d640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63001082a0 0x7f630019cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62fdd9b640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63001036e0 0x7f6300198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62fe59c640 1 -- 172.21.15.70:0/4291893548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63001036e0 msgr2=0x7f6300198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62fe59c640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63001036e0 0x7f6300198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62fe59c640 1 -- 172.21.15.70:0/4291893548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63001082a0 msgr2=0x7f630019cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62fe59c640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63001082a0 0x7f630019cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62fe59c640 1 -- 172.21.15.70:0/4291893548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630019d650 con 0x7f6300102d30 2024-09-12T01:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62fed9d640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63001082a0 0x7f630019cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62fe59c640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6300102d30 0x7f63001986a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f62f000eab0 tx=0x7f62f000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62f77fe640 1 -- 172.21.15.70:0/4291893548 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f000ce40 con 0x7f6300102d30 2024-09-12T01:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62f77fe640 1 -- 172.21.15.70:0/4291893548 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62f0011970 con 0x7f6300102d30 2024-09-12T01:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f6304ed6640 1 -- 172.21.15.70:0/4291893548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630019d940 con 0x7f6300102d30 2024-09-12T01:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.090+0000 7f62f77fe640 1 -- 172.21.15.70:0/4291893548 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0010bb0 con 0x7f6300102d30 2024-09-12T01:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.091+0000 7f6304ed6640 1 -- 172.21.15.70:0/4291893548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63001a5220 con 0x7f6300102d30 2024-09-12T01:49:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.091+0000 7f6304ed6640 1 -- 172.21.15.70:0/4291893548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6300103110 con 0x7f6300102d30 2024-09-12T01:49:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.093+0000 7f62f77fe640 1 -- 172.21.15.70:0/4291893548 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f62f0010d50 con 0x7f6300102d30 2024-09-12T01:49:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.094+0000 7f62f77fe640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62ec0a2c00 0x7f62ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.094+0000 7f62fdd9b640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62ec0a2c00 0x7f62ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.094+0000 7f62f77fe640 1 -- 172.21.15.70:0/4291893548 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f62f00cf190 con 0x7f6300102d30 2024-09-12T01:49:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.094+0000 7f62fdd9b640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62ec0a2c00 0x7f62ec0a50c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62e8005940 tx=0x7f62e80058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:35.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.098+0000 7f62f77fe640 1 -- 172.21.15.70:0/4291893548 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62f0016030 con 0x7f6300102d30 2024-09-12T01:49:35.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.299+0000 7f6304ed6640 1 -- 172.21.15.70:0/4291893548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f630010a2b0 con 0x7f6300102d30 2024-09-12T01:49:35.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.300+0000 7f62f77fe640 1 -- 172.21.15.70:0/4291893548 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7f62f009c590 con 0x7f6300102d30 2024-09-12T01:49:35.301 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:35.301 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"btime":"2024-09-12T01:49:34:523941+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T01:49:35.301 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-09-12T01:49:35.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.302+0000 7f6304ed6640 1 -- 172.21.15.70:0/4291893548 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62ec0a2c00 msgr2=0x7f62ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:35.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.302+0000 7f6304ed6640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62ec0a2c00 0x7f62ec0a50c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62e8005940 tx=0x7f62e80058d0 comp rx=0 tx=0).stop 2024-09-12T01:49:35.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.302+0000 7f6304ed6640 1 -- 172.21.15.70:0/4291893548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6300102d30 msgr2=0x7f63001986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:35.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.302+0000 7f6304ed6640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6300102d30 0x7f63001986a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f62f000eab0 tx=0x7f62f000ef70 comp rx=0 tx=0).stop 2024-09-12T01:49:35.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.302+0000 7f6304ed6640 1 -- 172.21.15.70:0/4291893548 shutdown_connections 2024-09-12T01:49:35.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.302+0000 7f6304ed6640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62ec0a2c00 0x7f62ec0a50c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:35.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.302+0000 7f6304ed6640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63001082a0 0x7f630019cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:35.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.302+0000 7f6304ed6640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63001036e0 0x7f6300198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:35.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.302+0000 7f6304ed6640 1 --2- 172.21.15.70:0/4291893548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6300102d30 0x7f63001986a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:35.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.302+0000 7f6304ed6640 1 -- 172.21.15.70:0/4291893548 >> 172.21.15.70:0/4291893548 conn(0x7f63000fc7d0 msgr2=0x7f6300106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:35.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.302+0000 7f6304ed6640 1 -- 172.21.15.70:0/4291893548 shutdown_connections 2024-09-12T01:49:35.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:35.302+0000 7f6304ed6640 1 -- 172.21.15.70:0/4291893548 wait complete. 2024-09-12T01:49:35.793 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:35 smithi070 ceph-mon[31177]: Deploying daemon mds.h on smithi152 2024-09-12T01:49:35.793 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:35 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] up:boot 2024-09-12T01:49:35.793 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:35 smithi070 ceph-mon[31177]: fsmap 7 up:standby 2024-09-12T01:49:35.793 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:35 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:49:35.793 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:35 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/4291893548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:35.913 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:35 smithi152 ceph-mon[35055]: Deploying daemon mds.h on smithi152 2024-09-12T01:49:35.913 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:35 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] up:boot 2024-09-12T01:49:35.913 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:35 smithi152 ceph-mon[35055]: fsmap 7 up:standby 2024-09-12T01:49:35.913 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:35 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:49:35.913 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:35 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/4291893548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:35.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:35 smithi191 ceph-mon[35770]: Deploying daemon mds.h on smithi152 2024-09-12T01:49:35.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:35 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] up:boot 2024-09-12T01:49:35.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:35 smithi191 ceph-mon[35770]: fsmap 7 up:standby 2024-09-12T01:49:35.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:35 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:49:35.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:35 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/4291893548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:36.263 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:49:36 smithi152 systemd[1]: Starting Ceph mds.h for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:49:36.621 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:36 smithi152 ceph-mon[35055]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:36.621 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:49:36 smithi152 podman[64726]: 2024-09-12 01:49:36.259744965 +0000 UTC m=+0.016436032 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:36.621 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:49:36 smithi152 podman[64726]: 2024-09-12 01:49:36.384485795 +0000 UTC m=+0.141176866 container create 7ac0545caa724a41f7b4cd8a87268c00c550a985cbbbba9fb91dbae9c7d07428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:49:36.622 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:49:36 smithi152 podman[64726]: 2024-09-12 01:49:36.595311886 +0000 UTC m=+0.352002945 container init 7ac0545caa724a41f7b4cd8a87268c00c550a985cbbbba9fb91dbae9c7d07428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:49:36.622 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:49:36 smithi152 podman[64726]: 2024-09-12 01:49:36.598276513 +0000 UTC m=+0.354967575 container start 7ac0545caa724a41f7b4cd8a87268c00c550a985cbbbba9fb91dbae9c7d07428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T01:49:36.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:36 smithi191 ceph-mon[35770]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:37.012 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:49:36 smithi152 ceph-mds[64747]: -- 172.21.15.152:0/2722282518 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc3e1e1860 con 0x55fc3e1bf400 2024-09-12T01:49:37.012 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:49:36 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h[64743]: starting mds.h at 2024-09-12T01:49:37.012 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:49:36 smithi152 bash[64726]: 7ac0545caa724a41f7b4cd8a87268c00c550a985cbbbba9fb91dbae9c7d07428 2024-09-12T01:49:37.012 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:49:36 smithi152 systemd[1]: Started Ceph mds.h for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:37.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:36 smithi070 ceph-mon[31177]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:37.985 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:49:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:37 smithi152 ceph-mon[35055]: Deploying daemon mds.i on smithi191 2024-09-12T01:49:38.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:37 smithi152 ceph-mon[35055]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:38.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:37 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] up:boot 2024-09-12T01:49:38.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:37 smithi152 ceph-mon[35055]: fsmap 8 up:standby 2024-09-12T01:49:38.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:37 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:49:38.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:38.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:38.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:38.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:38.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:38.014 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:38.014 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:37 smithi070 ceph-mon[31177]: Deploying daemon mds.i on smithi191 2024-09-12T01:49:38.014 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:37 smithi070 ceph-mon[31177]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:38.014 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:37 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] up:boot 2024-09-12T01:49:38.014 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:37 smithi070 ceph-mon[31177]: fsmap 8 up:standby 2024-09-12T01:49:38.014 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:37 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:49:38.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:38.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:38.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:38.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:38.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:38.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:38.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:37 smithi191 ceph-mon[35770]: Deploying daemon mds.i on smithi191 2024-09-12T01:49:38.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:37 smithi191 ceph-mon[35770]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:38.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:37 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] up:boot 2024-09-12T01:49:38.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:37 smithi191 ceph-mon[35770]: fsmap 8 up:standby 2024-09-12T01:49:38.103 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:37 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:49:38.236 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:38.688 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:49:38 smithi191 systemd[1]: Starting Ceph mds.i for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:49:38.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.729+0000 7ffbdebb9640 1 -- 172.21.15.70:0/4253366619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbd8102d40 msgr2=0x7ffbd8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:38.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.729+0000 7ffbdebb9640 1 --2- 172.21.15.70:0/4253366619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbd8102d40 0x7ffbd8103120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009900 tx=0x7ffbcc02a4d0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.729+0000 7ffbdebb9640 1 -- 172.21.15.70:0/4253366619 shutdown_connections 2024-09-12T01:49:38.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.729+0000 7ffbdebb9640 1 --2- 172.21.15.70:0/4253366619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbd810c170 0x7ffbd810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.729+0000 7ffbdebb9640 1 --2- 172.21.15.70:0/4253366619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbd8103660 0x7ffbd810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.729+0000 7ffbdebb9640 1 --2- 172.21.15.70:0/4253366619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbd8102d40 0x7ffbd8103120 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.729+0000 7ffbdebb9640 1 -- 172.21.15.70:0/4253366619 >> 172.21.15.70:0/4253366619 conn(0x7ffbd80fc7a0 msgr2=0x7ffbd80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:38.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.729+0000 7ffbdebb9640 1 -- 172.21.15.70:0/4253366619 shutdown_connections 2024-09-12T01:49:38.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.729+0000 7ffbdebb9640 1 -- 172.21.15.70:0/4253366619 wait complete. 2024-09-12T01:49:38.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.730+0000 7ffbdebb9640 1 Processor -- start 2024-09-12T01:49:38.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.730+0000 7ffbdebb9640 1 -- start start 2024-09-12T01:49:38.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.730+0000 7ffbdebb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbd8102d40 0x7ffbd81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:38.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.730+0000 7ffbdebb9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbd8103660 0x7ffbd8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:38.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.730+0000 7ffbdebb9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbd810c170 0x7ffbd8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:38.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.730+0000 7ffbdebb9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd81121b0 con 0x7ffbd8102d40 2024-09-12T01:49:38.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.730+0000 7ffbdebb9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd8112030 con 0x7ffbd810c170 2024-09-12T01:49:38.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.730+0000 7ffbdebb9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd8112330 con 0x7ffbd8103660 2024-09-12T01:49:38.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.730+0000 7ffbdc955640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbd8102d40 0x7ffbd81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:38.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.730+0000 7ffbdc955640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbd8102d40 0x7ffbd81009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36256/0 (socket says 172.21.15.70:36256) 2024-09-12T01:49:38.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.730+0000 7ffbdc955640 1 -- 172.21.15.70:0/3260420404 learned_addr learned my addr 172.21.15.70:0/3260420404 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:38.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbdd156640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbd810c170 0x7ffbd8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:38.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbdc955640 1 -- 172.21.15.70:0/3260420404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbd8103660 msgr2=0x7ffbd8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:38.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbd7fff640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbd8103660 0x7ffbd8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:38.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbdc955640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbd8103660 0x7ffbd8100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbdc955640 1 -- 172.21.15.70:0/3260420404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbd810c170 msgr2=0x7ffbd8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:38.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbdc955640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbd810c170 0x7ffbd8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbdc955640 1 -- 172.21.15.70:0/3260420404 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd81a6c30 con 0x7ffbd8102d40 2024-09-12T01:49:38.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbdc955640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbd8102d40 0x7ffbd81009a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0315e0 tx=0x7ffbcc004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:38.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbd5ffb640 1 -- 172.21.15.70:0/3260420404 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc03f030 con 0x7ffbd8102d40 2024-09-12T01:49:38.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbd5ffb640 1 -- 172.21.15.70:0/3260420404 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffbcc003d00 con 0x7ffbd8102d40 2024-09-12T01:49:38.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbdebb9640 1 -- 172.21.15.70:0/3260420404 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd81a6ec0 con 0x7ffbd8102d40 2024-09-12T01:49:38.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbd5ffb640 1 -- 172.21.15.70:0/3260420404 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc035070 con 0x7ffbd8102d40 2024-09-12T01:49:38.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.731+0000 7ffbdebb9640 1 -- 172.21.15.70:0/3260420404 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd81a7310 con 0x7ffbd8102d40 2024-09-12T01:49:38.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.732+0000 7ffbdebb9640 1 -- 172.21.15.70:0/3260420404 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd81031a0 con 0x7ffbd8102d40 2024-09-12T01:49:38.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.734+0000 7ffbd5ffb640 1 -- 172.21.15.70:0/3260420404 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ffbcc042030 con 0x7ffbd8102d40 2024-09-12T01:49:38.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.735+0000 7ffbd5ffb640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffbc80a2b80 0x7ffbc80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:38.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.735+0000 7ffbd7fff640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffbc80a2b80 0x7ffbc80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:38.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.735+0000 7ffbd5ffb640 1 -- 172.21.15.70:0/3260420404 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ffbcc0ef4c0 con 0x7ffbd8102d40 2024-09-12T01:49:38.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.735+0000 7ffbd7fff640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffbc80a2b80 0x7ffbc80a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80fee00 tx=0x7ffbc4008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:38.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.738+0000 7ffbd5ffb640 1 -- 172.21.15.70:0/3260420404 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffbcc0bc8c0 con 0x7ffbd8102d40 2024-09-12T01:49:38.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.939+0000 7ffbdebb9640 1 -- 172.21.15.70:0/3260420404 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbd8101ed0 con 0x7ffbd8102d40 2024-09-12T01:49:38.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.940+0000 7ffbd5ffb640 1 -- 172.21.15.70:0/3260420404 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7219 (secure 0 0 0) 0x7ffbcc0bc1c0 con 0x7ffbd8102d40 2024-09-12T01:49:38.941 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:38.941 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":9,"btime":"2024-09-12T01:49:37:534526+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-12T01:49:38.941 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 9 2024-09-12T01:49:38.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.942+0000 7ffbdebb9640 1 -- 172.21.15.70:0/3260420404 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffbc80a2b80 msgr2=0x7ffbc80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:38.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.942+0000 7ffbdebb9640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffbc80a2b80 0x7ffbc80a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80fee00 tx=0x7ffbc4008040 comp rx=0 tx=0).stop 2024-09-12T01:49:38.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.942+0000 7ffbdebb9640 1 -- 172.21.15.70:0/3260420404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbd8102d40 msgr2=0x7ffbd81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:38.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.942+0000 7ffbdebb9640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbd8102d40 0x7ffbd81009a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0315e0 tx=0x7ffbcc004380 comp rx=0 tx=0).stop 2024-09-12T01:49:38.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.942+0000 7ffbdebb9640 1 -- 172.21.15.70:0/3260420404 shutdown_connections 2024-09-12T01:49:38.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.942+0000 7ffbdebb9640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffbc80a2b80 0x7ffbc80a5040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.942+0000 7ffbdebb9640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbd810c170 0x7ffbd8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.942+0000 7ffbdebb9640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbd8103660 0x7ffbd8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.942+0000 7ffbdebb9640 1 --2- 172.21.15.70:0/3260420404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffbd8102d40 0x7ffbd81009a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.942+0000 7ffbdebb9640 1 -- 172.21.15.70:0/3260420404 >> 172.21.15.70:0/3260420404 conn(0x7ffbd80fc7a0 msgr2=0x7ffbd80fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:38.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.942+0000 7ffbdebb9640 1 -- 172.21.15.70:0/3260420404 shutdown_connections 2024-09-12T01:49:38.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:38.942+0000 7ffbdebb9640 1 -- 172.21.15.70:0/3260420404 wait complete. 2024-09-12T01:49:39.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:38 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3260420404' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:39.036 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:49:38 smithi191 podman[67083]: 2024-09-12 01:49:38.67147666 +0000 UTC m=+0.015627498 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:39.036 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:49:38 smithi191 podman[67083]: 2024-09-12 01:49:38.789533739 +0000 UTC m=+0.133684576 container create 1c863ba550a443560c1c389f0325fbdae9d79eac6025f3d9721477c0ab386bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-i, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T01:49:39.036 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:49:39 smithi191 podman[67083]: 2024-09-12 01:49:39.009744618 +0000 UTC m=+0.353895446 container init 1c863ba550a443560c1c389f0325fbdae9d79eac6025f3d9721477c0ab386bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:49:39.036 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:49:39 smithi191 podman[67083]: 2024-09-12 01:49:39.013435764 +0000 UTC m=+0.357586592 container start 1c863ba550a443560c1c389f0325fbdae9d79eac6025f3d9721477c0ab386bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-i, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T01:49:39.036 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:49:39 smithi191 ceph-mds[67103]: -- 172.21.15.191:0/1977538574 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558737123860 con 0x558737101000 2024-09-12T01:49:39.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:38 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3260420404' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:39.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:38 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3260420404' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:39.437 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:49:39 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-i[67099]: starting mds.i at 2024-09-12T01:49:39.437 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:49:39 smithi191 bash[67083]: 1c863ba550a443560c1c389f0325fbdae9d79eac6025f3d9721477c0ab386bef 2024-09-12T01:49:39.438 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:49:39 smithi191 systemd[1]: Started Ceph mds.i for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:40 smithi191 ceph-mon[35770]: Deploying daemon mds.g on smithi070 2024-09-12T01:49:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:40 smithi191 ceph-mon[35770]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:40 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] up:boot 2024-09-12T01:49:40.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:40 smithi191 ceph-mon[35770]: fsmap 9 up:standby 2024-09-12T01:49:40.439 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:40 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:49:40.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:40.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:40.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:40.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:40.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:40.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:40.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:40 smithi152 ceph-mon[35055]: Deploying daemon mds.g on smithi070 2024-09-12T01:49:40.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:40 smithi152 ceph-mon[35055]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:40.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:40 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] up:boot 2024-09-12T01:49:40.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:40 smithi152 ceph-mon[35055]: fsmap 9 up:standby 2024-09-12T01:49:40.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:40 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:49:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:40 smithi070 ceph-mon[31177]: Deploying daemon mds.g on smithi070 2024-09-12T01:49:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:40 smithi070 ceph-mon[31177]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:40 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] up:boot 2024-09-12T01:49:40.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:40 smithi070 ceph-mon[31177]: fsmap 9 up:standby 2024-09-12T01:49:40.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:40 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:49:41.519 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:49:41 smithi070 systemd[1]: Starting Ceph mds.g for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:49:41.674 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:49:41.808 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:49:41 smithi070 podman[71755]: 2024-09-12 01:49:41.43969525 +0000 UTC m=+0.015819555 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:41.808 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:49:41 smithi070 podman[71755]: 2024-09-12 01:49:41.57304971 +0000 UTC m=+0.149174009 container create a64769e3ebcbc917869c5b2ba49879b9e643ea9e8ba56d828ef962a036ec7d68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T01:49:41.808 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:49:41 smithi070 podman[71755]: 2024-09-12 01:49:41.808846049 +0000 UTC m=+0.384970361 container init a64769e3ebcbc917869c5b2ba49879b9e643ea9e8ba56d828ef962a036ec7d68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-12T01:49:41.990 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:42.113 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:49:41 smithi070 podman[71755]: 2024-09-12 01:49:41.811906164 +0000 UTC m=+0.388030464 container start a64769e3ebcbc917869c5b2ba49879b9e643ea9e8ba56d828ef962a036ec7d68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T01:49:42.114 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:49:41 smithi070 ceph-mds[71793]: -- 172.21.15.70:0/1713169034 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ffc7467860 con 0x55ffc7445000 2024-09-12T01:49:42.114 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:49:41 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-g[71784]: starting mds.g at 2024-09-12T01:49:42.114 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:49:41 smithi070 bash[71755]: a64769e3ebcbc917869c5b2ba49879b9e643ea9e8ba56d828ef962a036ec7d68 2024-09-12T01:49:42.114 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:49:41 smithi070 systemd[1]: Started Ceph mds.g for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:42.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.448+0000 7f1e13763640 1 -- 172.21.15.70:0/3407508360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0c1036e0 msgr2=0x7f1e0c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:42.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.448+0000 7f1e13763640 1 --2- 172.21.15.70:0/3407508360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0c1036e0 0x7f1e0c107b90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009930 tx=0x7f1dfc02a480 comp rx=0 tx=0).stop 2024-09-12T01:49:42.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.448+0000 7f1e13763640 1 -- 172.21.15.70:0/3407508360 shutdown_connections 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.448+0000 7f1e13763640 1 --2- 172.21.15.70:0/3407508360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e0c1082a0 0x7f1e0c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.448+0000 7f1e13763640 1 --2- 172.21.15.70:0/3407508360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0c1036e0 0x7f1e0c107b90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.448+0000 7f1e13763640 1 --2- 172.21.15.70:0/3407508360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e0c102d30 0x7f1e0c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.448+0000 7f1e13763640 1 -- 172.21.15.70:0/3407508360 >> 172.21.15.70:0/3407508360 conn(0x7f1e0c0fc7d0 msgr2=0x7f1e0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.448+0000 7f1e13763640 1 -- 172.21.15.70:0/3407508360 shutdown_connections 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.448+0000 7f1e13763640 1 -- 172.21.15.70:0/3407508360 wait complete. 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.448+0000 7f1e13763640 1 Processor -- start 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.448+0000 7f1e13763640 1 -- start start 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e13763640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e0c102d30 0x7f1e0c19e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e13763640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e0c1036e0 0x7f1e0c19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e13763640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0c1082a0 0x7f1e0c198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e13763640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c1122c0 con 0x7f1e0c1082a0 2024-09-12T01:49:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e13763640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c112140 con 0x7f1e0c102d30 2024-09-12T01:49:42.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e13763640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c112440 con 0x7f1e0c1036e0 2024-09-12T01:49:42.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e11d00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0c1082a0 0x7f1e0c198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:42.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e11d00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0c1082a0 0x7f1e0c198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53978/0 (socket says 172.21.15.70:53978) 2024-09-12T01:49:42.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e11d00640 1 -- 172.21.15.70:0/4141230511 learned_addr learned my addr 172.21.15.70:0/4141230511 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:42.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e10cfe640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e0c1036e0 0x7f1e0c19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:42.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e114ff640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e0c102d30 0x7f1e0c19e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:42.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e11d00640 1 -- 172.21.15.70:0/4141230511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e0c1036e0 msgr2=0x7f1e0c19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:42.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e11d00640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e0c1036e0 0x7f1e0c19eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e11d00640 1 -- 172.21.15.70:0/4141230511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e0c102d30 msgr2=0x7f1e0c19e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:42.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e11d00640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e0c102d30 0x7f1e0c19e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e11d00640 1 -- 172.21.15.70:0/4141230511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0c198f00 con 0x7f1e0c1082a0 2024-09-12T01:49:42.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e10cfe640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e0c1036e0 0x7f1e0c19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:49:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e11d00640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0c1082a0 0x7f1e0c198690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400b990 tx=0x7f1e0400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e027fc640 1 -- 172.21.15.70:0/4141230511 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04019070 con 0x7f1e0c1082a0 2024-09-12T01:49:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e027fc640 1 -- 172.21.15.70:0/4141230511 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1e0400cba0 con 0x7f1e0c1082a0 2024-09-12T01:49:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e13763640 1 -- 172.21.15.70:0/4141230511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0c1991f0 con 0x7f1e0c1082a0 2024-09-12T01:49:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e027fc640 1 -- 172.21.15.70:0/4141230511 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04007770 con 0x7f1e0c1082a0 2024-09-12T01:49:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.449+0000 7f1e13763640 1 -- 172.21.15.70:0/4141230511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0c1a5370 con 0x7f1e0c1082a0 2024-09-12T01:49:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.450+0000 7f1e13763640 1 -- 172.21.15.70:0/4141230511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0c06a850 con 0x7f1e0c1082a0 2024-09-12T01:49:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.452+0000 7f1e027fc640 1 -- 172.21.15.70:0/4141230511 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1e0401c070 con 0x7f1e0c1082a0 2024-09-12T01:49:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.453+0000 7f1e027fc640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1df80a2b80 0x7f1df80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.453+0000 7f1e027fc640 1 -- 172.21.15.70:0/4141230511 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f1e040ce710 con 0x7f1e0c1082a0 2024-09-12T01:49:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.453+0000 7f1e114ff640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1df80a2b80 0x7f1df80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.453+0000 7f1e114ff640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1df80a2b80 0x7f1df80a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e08006fd0 tx=0x7f1e08008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:42.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.456+0000 7f1e027fc640 1 -- 172.21.15.70:0/4141230511 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e0409bb10 con 0x7f1e0c1082a0 2024-09-12T01:49:42.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.666+0000 7f1e13763640 1 -- 172.21.15.70:0/4141230511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e0c10a2b0 con 0x7f1e0c1082a0 2024-09-12T01:49:42.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:42 smithi070 ceph-mon[31177]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:42.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:42.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:42.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:42.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:42.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:42.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:42 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:42.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.667+0000 7f1e027fc640 1 -- 172.21.15.70:0/4141230511 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7f1e0409b410 con 0x7f1e0c1082a0 2024-09-12T01:49:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:42.668 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":11,"btime":"2024-09-12T01:49:42:520724+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T01:49:42.668 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 11 2024-09-12T01:49:42.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.669+0000 7f1e13763640 1 -- 172.21.15.70:0/4141230511 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1df80a2b80 msgr2=0x7f1df80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.670+0000 7f1e13763640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1df80a2b80 0x7f1df80a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e08006fd0 tx=0x7f1e08008040 comp rx=0 tx=0).stop 2024-09-12T01:49:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.670+0000 7f1e13763640 1 -- 172.21.15.70:0/4141230511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0c1082a0 msgr2=0x7f1e0c198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.670+0000 7f1e13763640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0c1082a0 0x7f1e0c198690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400b990 tx=0x7f1e0400be50 comp rx=0 tx=0).stop 2024-09-12T01:49:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.670+0000 7f1e13763640 1 -- 172.21.15.70:0/4141230511 shutdown_connections 2024-09-12T01:49:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.670+0000 7f1e13763640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1df80a2b80 0x7f1df80a5040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.670+0000 7f1e13763640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0c1082a0 0x7f1e0c198690 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.670+0000 7f1e13763640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e0c1036e0 0x7f1e0c19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.670+0000 7f1e13763640 1 --2- 172.21.15.70:0/4141230511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e0c102d30 0x7f1e0c19e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.670+0000 7f1e13763640 1 -- 172.21.15.70:0/4141230511 >> 172.21.15.70:0/4141230511 conn(0x7f1e0c0fc7d0 msgr2=0x7f1e0c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.670+0000 7f1e13763640 1 -- 172.21.15.70:0/4141230511 shutdown_connections 2024-09-12T01:49:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:42.670+0000 7f1e13763640 1 -- 172.21.15.70:0/4141230511 wait complete. 2024-09-12T01:49:42.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:42 smithi191 ceph-mon[35770]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:42.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:42.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:42.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:42.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:42.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:42.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:42 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:43.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:42 smithi152 ceph-mon[35055]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:43.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:43.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:43.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:43.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:43.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:43.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:42 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:43.788 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:43 smithi070 ceph-mon[31177]: Deploying daemon mds.a on smithi070 2024-09-12T01:49:43.788 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:43 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.70:6838/3076923681,v1:172.21.15.70:6839/3076923681] up:boot 2024-09-12T01:49:43.788 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:43 smithi070 ceph-mon[31177]: fsmap 10 up:standby 2024-09-12T01:49:43.788 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:43 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:49:43.789 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:43 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/4141230511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:43.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:43 smithi191 ceph-mon[35770]: Deploying daemon mds.a on smithi070 2024-09-12T01:49:43.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:43 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.70:6838/3076923681,v1:172.21.15.70:6839/3076923681] up:boot 2024-09-12T01:49:43.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:43 smithi191 ceph-mon[35770]: fsmap 10 up:standby 2024-09-12T01:49:43.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:43 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:49:43.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:43 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/4141230511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:44.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:43 smithi152 ceph-mon[35055]: Deploying daemon mds.a on smithi070 2024-09-12T01:49:44.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:43 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.70:6838/3076923681,v1:172.21.15.70:6839/3076923681] up:boot 2024-09-12T01:49:44.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:43 smithi152 ceph-mon[35055]: fsmap 10 up:standby 2024-09-12T01:49:44.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:43 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:49:44.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:43 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/4141230511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:44.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:44 smithi070 ceph-mon[31177]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:44.769 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:49:44 smithi070 systemd[1]: Starting Ceph mds.a for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:49:44.825 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:44 smithi191 ceph-mon[35770]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:45.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:44 smithi152 ceph-mon[35055]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:45.046 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:49:44 smithi070 podman[72174]: 2024-09-12 01:49:44.68824634 +0000 UTC m=+0.015851921 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:45.046 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:49:44 smithi070 podman[72174]: 2024-09-12 01:49:44.835746955 +0000 UTC m=+0.163352534 container create 40ba78fa839cf61f2de9ca719bdc6824c836719f02ad28dc11074ee51859860a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T01:49:45.046 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:49:45 smithi070 podman[72174]: 2024-09-12 01:49:45.04654309 +0000 UTC m=+0.374148669 container init 40ba78fa839cf61f2de9ca719bdc6824c836719f02ad28dc11074ee51859860a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:49:45.519 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:49:45 smithi070 podman[72174]: 2024-09-12 01:49:45.049632929 +0000 UTC m=+0.377238511 container start 40ba78fa839cf61f2de9ca719bdc6824c836719f02ad28dc11074ee51859860a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T01:49:45.519 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:49:45 smithi070 ceph-mds[72193]: -- 172.21.15.70:0/1313187844 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f69b319860 con 0x55f69b2f7400 2024-09-12T01:49:45.519 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:49:45 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a[72189]: starting mds.a at 2024-09-12T01:49:45.520 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:49:45 smithi070 bash[72174]: 40ba78fa839cf61f2de9ca719bdc6824c836719f02ad28dc11074ee51859860a 2024-09-12T01:49:45.520 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:49:45 smithi070 systemd[1]: Started Ceph mds.a for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:45.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:49:45.950 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:46.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:46 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:46.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:46 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:46.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:46 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:46.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:46 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:46.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:46 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:46.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:46 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:46.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:46 smithi152 ceph-mon[35055]: Deploying daemon mds.b on smithi152 2024-09-12T01:49:46.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:46 smithi152 ceph-mon[35055]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:46.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:46 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.70:6840/3509291516,v1:172.21.15.70:6841/3509291516] up:boot 2024-09-12T01:49:46.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:46 smithi152 ceph-mon[35055]: fsmap 11 up:standby 2024-09-12T01:49:46.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:46 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:49:46.342 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:46 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:46.342 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:46 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:46.342 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:46 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:46.342 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:46 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:46.342 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:46 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:46.342 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:46 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:46.342 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:46 smithi070 ceph-mon[31177]: Deploying daemon mds.b on smithi152 2024-09-12T01:49:46.342 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:46 smithi070 ceph-mon[31177]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:46.342 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:46 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.70:6840/3509291516,v1:172.21.15.70:6841/3509291516] up:boot 2024-09-12T01:49:46.342 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:46 smithi070 ceph-mon[31177]: fsmap 11 up:standby 2024-09-12T01:49:46.342 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:46 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:49:46.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.423+0000 7fc77802d640 1 -- 172.21.15.70:0/1949579564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7701082a0 msgr2=0x7fc77010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:46.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.423+0000 7fc77802d640 1 --2- 172.21.15.70:0/1949579564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7701082a0 0x7fc77010ec40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc768009930 tx=0x7fc76802a440 comp rx=0 tx=0).stop 2024-09-12T01:49:46.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.423+0000 7fc77802d640 1 -- 172.21.15.70:0/1949579564 shutdown_connections 2024-09-12T01:49:46.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.423+0000 7fc77802d640 1 --2- 172.21.15.70:0/1949579564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7701082a0 0x7fc77010ec40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:46.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.423+0000 7fc77802d640 1 --2- 172.21.15.70:0/1949579564 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7701036e0 0x7fc770107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:46.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.423+0000 7fc77802d640 1 --2- 172.21.15.70:0/1949579564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc770102d30 0x7fc770103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:46.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.423+0000 7fc77802d640 1 -- 172.21.15.70:0/1949579564 >> 172.21.15.70:0/1949579564 conn(0x7fc7700fc7d0 msgr2=0x7fc7700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:46.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.423+0000 7fc77802d640 1 -- 172.21.15.70:0/1949579564 shutdown_connections 2024-09-12T01:49:46.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.423+0000 7fc77802d640 1 -- 172.21.15.70:0/1949579564 wait complete. 2024-09-12T01:49:46.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc77802d640 1 Processor -- start 2024-09-12T01:49:46.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc77802d640 1 -- start start 2024-09-12T01:49:46.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc77802d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770102d30 0x7fc770198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc77802d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7701036e0 0x7fc770198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc77802d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7701082a0 0x7fc77019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc77802d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc770112220 con 0x7fc770102d30 2024-09-12T01:49:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc77802d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc7701120a0 con 0x7fc7701036e0 2024-09-12T01:49:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc77802d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc7701123a0 con 0x7fc7701082a0 2024-09-12T01:49:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc775dc9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770102d30 0x7fc770198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc775dc9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770102d30 0x7fc770198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54000/0 (socket says 172.21.15.70:54000) 2024-09-12T01:49:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc775dc9640 1 -- 172.21.15.70:0/573362177 learned_addr learned my addr 172.21.15.70:0/573362177 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc775dc9640 1 -- 172.21.15.70:0/573362177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7701082a0 msgr2=0x7fc77019cf50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:49:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc775dc9640 1 --2- 172.21.15.70:0/573362177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7701082a0 0x7fc77019cf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc775dc9640 1 -- 172.21.15.70:0/573362177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7701036e0 msgr2=0x7fc770198bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:49:46.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc775dc9640 1 --2- 172.21.15.70:0/573362177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7701036e0 0x7fc770198bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:46.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc775dc9640 1 -- 172.21.15.70:0/573362177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77019d630 con 0x7fc770102d30 2024-09-12T01:49:46.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.424+0000 7fc775dc9640 1 --2- 172.21.15.70:0/573362177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770102d30 0x7fc770198680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc76000cce0 tx=0x7fc76000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:46.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.425+0000 7fc76effd640 1 -- 172.21.15.70:0/573362177 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760004b20 con 0x7fc770102d30 2024-09-12T01:49:46.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.425+0000 7fc76effd640 1 -- 172.21.15.70:0/573362177 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc760004cc0 con 0x7fc770102d30 2024-09-12T01:49:46.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.425+0000 7fc77802d640 1 -- 172.21.15.70:0/573362177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77019d920 con 0x7fc770102d30 2024-09-12T01:49:46.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.425+0000 7fc76effd640 1 -- 172.21.15.70:0/573362177 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76000f870 con 0x7fc770102d30 2024-09-12T01:49:46.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.425+0000 7fc77802d640 1 -- 172.21.15.70:0/573362177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7701a5200 con 0x7fc770102d30 2024-09-12T01:49:46.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.425+0000 7fc77802d640 1 -- 172.21.15.70:0/573362177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc770103110 con 0x7fc770102d30 2024-09-12T01:49:46.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.427+0000 7fc76effd640 1 -- 172.21.15.70:0/573362177 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc76000fa10 con 0x7fc770102d30 2024-09-12T01:49:46.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.427+0000 7fc76effd640 1 --2- 172.21.15.70:0/573362177 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc7580a2c00 0x7fc7580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:46.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.427+0000 7fc76effd640 1 -- 172.21.15.70:0/573362177 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fc7600cf020 con 0x7fc770102d30 2024-09-12T01:49:46.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.427+0000 7fc7755c8640 1 --2- 172.21.15.70:0/573362177 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc7580a2c00 0x7fc7580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:46.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.428+0000 7fc7755c8640 1 --2- 172.21.15.70:0/573362177 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc7580a2c00 0x7fc7580a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc770103e20 tx=0x7fc764006c20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:46.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.430+0000 7fc76effd640 1 -- 172.21.15.70:0/573362177 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc760014030 con 0x7fc770102d30 2024-09-12T01:49:46.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:46 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:46.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:46 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:46.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:46 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:46.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:46 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:49:46.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:46 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:49:46.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:46 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:46.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:46 smithi191 ceph-mon[35770]: Deploying daemon mds.b on smithi152 2024-09-12T01:49:46.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:46 smithi191 ceph-mon[35770]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:46.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:46 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.70:6840/3509291516,v1:172.21.15.70:6841/3509291516] up:boot 2024-09-12T01:49:46.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:46 smithi191 ceph-mon[35770]: fsmap 11 up:standby 2024-09-12T01:49:46.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:46 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:49:46.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.632+0000 7fc77802d640 1 -- 172.21.15.70:0/573362177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7701999e0 con 0x7fc770102d30 2024-09-12T01:49:46.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.633+0000 7fc76effd640 1 -- 172.21.15.70:0/573362177 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9701 (secure 0 0 0) 0x7fc76009c4a0 con 0x7fc770102d30 2024-09-12T01:49:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:46.634 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":12,"btime":"2024-09-12T01:49:45:531708+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T01:49:46.634 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 12 2024-09-12T01:49:46.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.635+0000 7fc77802d640 1 -- 172.21.15.70:0/573362177 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc7580a2c00 msgr2=0x7fc7580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:46.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.635+0000 7fc77802d640 1 --2- 172.21.15.70:0/573362177 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc7580a2c00 0x7fc7580a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc770103e20 tx=0x7fc764006c20 comp rx=0 tx=0).stop 2024-09-12T01:49:46.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.635+0000 7fc77802d640 1 -- 172.21.15.70:0/573362177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770102d30 msgr2=0x7fc770198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:46.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.635+0000 7fc77802d640 1 --2- 172.21.15.70:0/573362177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770102d30 0x7fc770198680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc76000cce0 tx=0x7fc76000a620 comp rx=0 tx=0).stop 2024-09-12T01:49:46.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.635+0000 7fc77802d640 1 -- 172.21.15.70:0/573362177 shutdown_connections 2024-09-12T01:49:46.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.635+0000 7fc77802d640 1 --2- 172.21.15.70:0/573362177 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc7580a2c00 0x7fc7580a50c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:46.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.635+0000 7fc77802d640 1 --2- 172.21.15.70:0/573362177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7701082a0 0x7fc77019cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:46.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.635+0000 7fc77802d640 1 --2- 172.21.15.70:0/573362177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7701036e0 0x7fc770198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:46.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.635+0000 7fc77802d640 1 --2- 172.21.15.70:0/573362177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770102d30 0x7fc770198680 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:46.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.635+0000 7fc77802d640 1 -- 172.21.15.70:0/573362177 >> 172.21.15.70:0/573362177 conn(0x7fc7700fc7d0 msgr2=0x7fc7700fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:46.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.635+0000 7fc77802d640 1 -- 172.21.15.70:0/573362177 shutdown_connections 2024-09-12T01:49:46.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:46.635+0000 7fc77802d640 1 -- 172.21.15.70:0/573362177 wait complete. 2024-09-12T01:49:47.197 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:49:47 smithi152 systemd[1]: Starting Ceph mds.b for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:49:47.279 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:47 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/573362177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:47.461 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:47 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/573362177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:47.461 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:49:47 smithi152 podman[65029]: 2024-09-12 01:49:47.364459115 +0000 UTC m=+0.105965449 container create fe19a7587df021f421f5d67434f3d17e72511ee401884141816b48bc3f8726f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T01:49:47.462 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:49:47 smithi152 podman[65029]: 2024-09-12 01:49:47.274400411 +0000 UTC m=+0.015906717 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:47.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:47 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/573362177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:48.012 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:49:47 smithi152 podman[65029]: 2024-09-12 01:49:47.567158255 +0000 UTC m=+0.308664547 container init fe19a7587df021f421f5d67434f3d17e72511ee401884141816b48bc3f8726f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-12T01:49:48.012 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:49:47 smithi152 podman[65029]: 2024-09-12 01:49:47.570028761 +0000 UTC m=+0.311535056 container start fe19a7587df021f421f5d67434f3d17e72511ee401884141816b48bc3f8726f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:49:48.012 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:49:47 smithi152 ceph-mds[65049]: -- 172.21.15.152:0/1833233916 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5605e14d1860 con 0x5605e14af000 2024-09-12T01:49:48.012 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:49:47 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b[65045]: starting mds.b at 2024-09-12T01:49:48.013 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:49:47 smithi152 bash[65029]: fe19a7587df021f421f5d67434f3d17e72511ee401884141816b48bc3f8726f0 2024-09-12T01:49:48.013 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:49:47 smithi152 systemd[1]: Started Ceph mds.b for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:49:48.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:48 smithi152 ceph-mon[35055]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:48.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:48 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:48 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:48 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:48 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:48 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:48 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:48.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:48 smithi070 ceph-mon[31177]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:48.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:48 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:48 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:48 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:48 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:48 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:48 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:48.533 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:48 smithi191 ceph-mon[35770]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:48.533 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:48 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.533 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:48 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.533 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:48 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:48 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:48 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:48.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:48 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:49.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:49:49.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:49 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] up:boot 2024-09-12T01:49:49.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:49 smithi152 ceph-mon[35055]: fsmap 12 up:standby 2024-09-12T01:49:49.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:49 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:49:49.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:49 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:49.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:49 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:49.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:49 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] up:boot 2024-09-12T01:49:49.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:49 smithi070 ceph-mon[31177]: fsmap 12 up:standby 2024-09-12T01:49:49.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:49:49.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:49.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:49 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:49.562 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:49.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:49 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] up:boot 2024-09-12T01:49:49.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:49 smithi191 ceph-mon[35770]: fsmap 12 up:standby 2024-09-12T01:49:49.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:49 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:49:49.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:49 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:49.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:49 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.029+0000 7fb617911640 1 -- 172.21.15.70:0/608939392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb610100b20 msgr2=0x7fb610100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:50.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.029+0000 7fb617911640 1 --2- 172.21.15.70:0/608939392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb610100b20 0x7fb610100f00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb600009900 tx=0x7fb60002a410 comp rx=0 tx=0).stop 2024-09-12T01:49:50.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 -- 172.21.15.70:0/608939392 shutdown_connections 2024-09-12T01:49:50.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 --2- 172.21.15.70:0/608939392 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb61010e500 0x7fb610110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 --2- 172.21.15.70:0/608939392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb610101440 0x7fb61010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 --2- 172.21.15.70:0/608939392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb610100b20 0x7fb610100f00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 -- 172.21.15.70:0/608939392 >> 172.21.15.70:0/608939392 conn(0x7fb6100fc7d0 msgr2=0x7fb6100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 -- 172.21.15.70:0/608939392 shutdown_connections 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 -- 172.21.15.70:0/608939392 wait complete. 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 Processor -- start 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 -- start start 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb610100b20 0x7fb6101a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb610101440 0x7fb6101a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb61010e500 0x7fb61019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb6101143b0 con 0x7fb610101440 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb610114230 con 0x7fb610100b20 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.030+0000 7fb617911640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb610114530 con 0x7fb61010e500 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb614eac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb610101440 0x7fb6101a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb614eac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb610101440 0x7fb6101a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54014/0 (socket says 172.21.15.70:54014) 2024-09-12T01:49:50.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb614eac640 1 -- 172.21.15.70:0/1479529788 learned_addr learned my addr 172.21.15.70:0/1479529788 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb615eae640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb61010e500 0x7fb61019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb6156ad640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb610100b20 0x7fb6101a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb614eac640 1 -- 172.21.15.70:0/1479529788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb61010e500 msgr2=0x7fb61019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb614eac640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb61010e500 0x7fb61019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb614eac640 1 -- 172.21.15.70:0/1479529788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb610100b20 msgr2=0x7fb6101a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb614eac640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb610100b20 0x7fb6101a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb614eac640 1 -- 172.21.15.70:0/1479529788 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61019aed0 con 0x7fb610101440 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb614eac640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb610101440 0x7fb6101a0ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00d770 tx=0x7fb60c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb6067fc640 1 -- 172.21.15.70:0/1479529788 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c017070 con 0x7fb610101440 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb6067fc640 1 -- 172.21.15.70:0/1479529788 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb60c009c30 con 0x7fb610101440 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb6067fc640 1 -- 172.21.15.70:0/1479529788 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c003e40 con 0x7fb610101440 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb617911640 1 -- 172.21.15.70:0/1479529788 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61019b1c0 con 0x7fb610101440 2024-09-12T01:49:50.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.031+0000 7fb617911640 1 -- 172.21.15.70:0/1479529788 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6101a7510 con 0x7fb610101440 2024-09-12T01:49:50.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.032+0000 7fb617911640 1 -- 172.21.15.70:0/1479529788 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb61019b530 con 0x7fb610101440 2024-09-12T01:49:50.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.033+0000 7fb6067fc640 1 -- 172.21.15.70:0/1479529788 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb60c004000 con 0x7fb610101440 2024-09-12T01:49:50.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.034+0000 7fb6067fc640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb5fc0a2b80 0x7fb5fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:50.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.034+0000 7fb6156ad640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb5fc0a2b80 0x7fb5fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:50.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.034+0000 7fb6067fc640 1 -- 172.21.15.70:0/1479529788 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fb60c0ce880 con 0x7fb610101440 2024-09-12T01:49:50.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.034+0000 7fb6156ad640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb5fc0a2b80 0x7fb5fc0a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb600009230 tx=0x7fb6000058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:50.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.037+0000 7fb6067fc640 1 -- 172.21.15.70:0/1479529788 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb60c009de0 con 0x7fb610101440 2024-09-12T01:49:50.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.254+0000 7fb617911640 1 -- 172.21.15.70:0/1479529788 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb61019bb90 con 0x7fb610101440 2024-09-12T01:49:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.257+0000 7fb6067fc640 1 -- 172.21.15.70:0/1479529788 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10530 (secure 0 0 0) 0x7fb60c09b630 con 0x7fb610101440 2024-09-12T01:49:50.257 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:50.257 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":13,"btime":"2024-09-12T01:49:48:197599+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24392,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24427,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T01:49:50.258 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 13 2024-09-12T01:49:50.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.259+0000 7fb617911640 1 -- 172.21.15.70:0/1479529788 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb5fc0a2b80 msgr2=0x7fb5fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:50.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.259+0000 7fb617911640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb5fc0a2b80 0x7fb5fc0a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb600009230 tx=0x7fb6000058d0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.259+0000 7fb617911640 1 -- 172.21.15.70:0/1479529788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb610101440 msgr2=0x7fb6101a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:50.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.259+0000 7fb617911640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb610101440 0x7fb6101a0ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00d770 tx=0x7fb60c00dc30 comp rx=0 tx=0).stop 2024-09-12T01:49:50.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.259+0000 7fb617911640 1 -- 172.21.15.70:0/1479529788 shutdown_connections 2024-09-12T01:49:50.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.259+0000 7fb617911640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb5fc0a2b80 0x7fb5fc0a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.259+0000 7fb617911640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb61010e500 0x7fb61019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.259+0000 7fb617911640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb610101440 0x7fb6101a0ad0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.259+0000 7fb617911640 1 --2- 172.21.15.70:0/1479529788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb610100b20 0x7fb6101a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:50.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.259+0000 7fb617911640 1 -- 172.21.15.70:0/1479529788 >> 172.21.15.70:0/1479529788 conn(0x7fb6100fc7d0 msgr2=0x7fb6100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:50.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.259+0000 7fb617911640 1 -- 172.21.15.70:0/1479529788 shutdown_connections 2024-09-12T01:49:50.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:50.259+0000 7fb617911640 1 -- 172.21.15.70:0/1479529788 wait complete. 2024-09-12T01:49:50.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:50 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:50 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:50 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:50 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:50 smithi152 ceph-mon[35055]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:50.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:50 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:50.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:50 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:50.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:50 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:50 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:50.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:50 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:50 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:50 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:50 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:50 smithi070 ceph-mon[31177]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:50.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:50 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:50.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:50 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:50.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:50 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:50 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:50.552 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:50 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.552 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:50 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.552 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:50 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.552 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:50 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.552 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:50 smithi191 ceph-mon[35770]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:50.553 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:50 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:50.553 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:50 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:50.553 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:50 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:50.553 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:50 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:51.412 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:51 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1479529788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:51.412 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:51 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:51.412 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:51 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:51.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T01:49:51.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:51 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1479529788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:51.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:51 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:51.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:51 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:51.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:51 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1479529788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:49:51.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:51 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:51.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:51 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:51.718 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:52.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.238+0000 7f8064c12640 1 -- 172.21.15.70:0/1160264013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8060106f00 msgr2=0x7f806010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:52.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.238+0000 7f8064c12640 1 --2- 172.21.15.70:0/1160264013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8060106f00 0x7f806010ea80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8058009ca0 tx=0x7f805802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.238+0000 7f8064c12640 1 -- 172.21.15.70:0/1160264013 shutdown_connections 2024-09-12T01:49:52.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.238+0000 7f8064c12640 1 --2- 172.21.15.70:0/1160264013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8060106f00 0x7f806010ea80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.238+0000 7f8064c12640 1 --2- 172.21.15.70:0/1160264013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8060102780 0x7f80601067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.238+0000 7f8064c12640 1 --2- 172.21.15.70:0/1160264013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8060101dd0 0x7f80601021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.238+0000 7f8064c12640 1 -- 172.21.15.70:0/1160264013 >> 172.21.15.70:0/1160264013 conn(0x7f80600fd8b0 msgr2=0x7f80600ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:52.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.238+0000 7f8064c12640 1 -- 172.21.15.70:0/1160264013 shutdown_connections 2024-09-12T01:49:52.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.238+0000 7f8064c12640 1 -- 172.21.15.70:0/1160264013 wait complete. 2024-09-12T01:49:52.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.239+0000 7f8064c12640 1 Processor -- start 2024-09-12T01:49:52.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.239+0000 7f8064c12640 1 -- start start 2024-09-12T01:49:52.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.239+0000 7f8064c12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8060101dd0 0x7f8060198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.239+0000 7f8064c12640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8060102780 0x7f8060198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.239+0000 7f8064c12640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8060106f00 0x7f806019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.239+0000 7f8064c12640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8060112140 con 0x7f8060101dd0 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.239+0000 7f8064c12640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8060111fc0 con 0x7f8060102780 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.239+0000 7f8064c12640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f80601122c0 con 0x7f8060106f00 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.239+0000 7f805e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8060101dd0 0x7f8060198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.239+0000 7f805e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8060101dd0 0x7f8060198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59706/0 (socket says 172.21.15.70:59706) 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.239+0000 7f805e59c640 1 -- 172.21.15.70:0/3040892417 learned_addr learned my addr 172.21.15.70:0/3040892417 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.239+0000 7f805dd9b640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8060102780 0x7f8060198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.240+0000 7f805e59c640 1 -- 172.21.15.70:0/3040892417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8060106f00 msgr2=0x7f806019cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.240+0000 7f805e59c640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8060106f00 0x7f806019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.240+0000 7f805e59c640 1 -- 172.21.15.70:0/3040892417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8060102780 msgr2=0x7f8060198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:52.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.240+0000 7f805e59c640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8060102780 0x7f8060198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.240+0000 7f805e59c640 1 -- 172.21.15.70:0/3040892417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806019d5d0 con 0x7f8060101dd0 2024-09-12T01:49:52.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.240+0000 7f805dd9b640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8060102780 0x7f8060198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:49:52.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.240+0000 7f805e59c640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8060101dd0 0x7f8060198620 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f805000b4a0 tx=0x7f805000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:52.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.240+0000 7f804f7fe640 1 -- 172.21.15.70:0/3040892417 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8050014070 con 0x7f8060101dd0 2024-09-12T01:49:52.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.240+0000 7f8064c12640 1 -- 172.21.15.70:0/3040892417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806019d8c0 con 0x7f8060101dd0 2024-09-12T01:49:52.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.240+0000 7f804f7fe640 1 -- 172.21.15.70:0/3040892417 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8050010b10 con 0x7f8060101dd0 2024-09-12T01:49:52.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.240+0000 7f804f7fe640 1 -- 172.21.15.70:0/3040892417 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8050017d60 con 0x7f8060101dd0 2024-09-12T01:49:52.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.240+0000 7f8064c12640 1 -- 172.21.15.70:0/3040892417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80601a51a0 con 0x7f8060101dd0 2024-09-12T01:49:52.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.241+0000 7f8064c12640 1 -- 172.21.15.70:0/3040892417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8060102230 con 0x7f8060101dd0 2024-09-12T01:49:52.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.242+0000 7f804f7fe640 1 -- 172.21.15.70:0/3040892417 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8050017070 con 0x7f8060101dd0 2024-09-12T01:49:52.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.243+0000 7f804f7fe640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f80480a2c00 0x7f80480a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:52.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.243+0000 7f805dd9b640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f80480a2c00 0x7f80480a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:52.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.243+0000 7f804f7fe640 1 -- 172.21.15.70:0/3040892417 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f80500cdf70 con 0x7f8060101dd0 2024-09-12T01:49:52.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.243+0000 7f805dd9b640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f80480a2c00 0x7f80480a50c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8054006fd0 tx=0x7f8054008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:52.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.247+0000 7f804f7fe640 1 -- 172.21.15.70:0/3040892417 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f805009b370 con 0x7f8060101dd0 2024-09-12T01:49:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.416+0000 7f8064c12640 1 -- 172.21.15.70:0/3040892417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8060109b50 con 0x7f8060101dd0 2024-09-12T01:49:52.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.416+0000 7f804f7fe640 1 -- 172.21.15.70:0/3040892417 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7f805009ac70 con 0x7f8060101dd0 2024-09-12T01:49:52.416 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.416 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.416 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:52 smithi070 ceph-mon[31177]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:52.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:52.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:52.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:52.417 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2024-09-12T01:49:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:49:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2024-09-12T01:49:52.417 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2024-09-12T01:49:52.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:49:52.418 INFO:teuthology.orchestra.run.smithi070.stdout:] 2024-09-12T01:49:52.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.418+0000 7f8064c12640 1 -- 172.21.15.70:0/3040892417 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f80480a2c00 msgr2=0x7f80480a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:52.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.418+0000 7f8064c12640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f80480a2c00 0x7f80480a50c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8054006fd0 tx=0x7f8054008040 comp rx=0 tx=0).stop 2024-09-12T01:49:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.418+0000 7f8064c12640 1 -- 172.21.15.70:0/3040892417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8060101dd0 msgr2=0x7f8060198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.418+0000 7f8064c12640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8060101dd0 0x7f8060198620 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f805000b4a0 tx=0x7f805000b960 comp rx=0 tx=0).stop 2024-09-12T01:49:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.418+0000 7f8064c12640 1 -- 172.21.15.70:0/3040892417 shutdown_connections 2024-09-12T01:49:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.418+0000 7f8064c12640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f80480a2c00 0x7f80480a50c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.418+0000 7f8064c12640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8060106f00 0x7f806019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.418+0000 7f8064c12640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8060102780 0x7f8060198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.418+0000 7f8064c12640 1 --2- 172.21.15.70:0/3040892417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8060101dd0 0x7f8060198620 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.418+0000 7f8064c12640 1 -- 172.21.15.70:0/3040892417 >> 172.21.15.70:0/3040892417 conn(0x7f80600fd8b0 msgr2=0x7f80600fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.418+0000 7f8064c12640 1 -- 172.21.15.70:0/3040892417 shutdown_connections 2024-09-12T01:49:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:52.418+0000 7f8064c12640 1 -- 172.21.15.70:0/3040892417 wait complete. 2024-09-12T01:49:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:52 smithi191 ceph-mon[35770]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:52.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:52 smithi152 ceph-mon[35055]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:52.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:52.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:52.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:52.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:49:53.063 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:49:53.063 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:49:53.306 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:53.426 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:53 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3040892417' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T01:49:53.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:53 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3040892417' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T01:49:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.731+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/1670905438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb4101290 msgr2=0x7f1eb4107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.731+0000 7f1ebbe4f640 1 --2- 172.21.15.70:0/1670905438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb4101290 0x7f1eb4107a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009930 tx=0x7f1eb002a420 comp rx=0 tx=0).stop 2024-09-12T01:49:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.731+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/1670905438 shutdown_connections 2024-09-12T01:49:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.731+0000 7f1ebbe4f640 1 --2- 172.21.15.70:0/1670905438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1eb4108160 0x7f1eb410eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.731+0000 7f1ebbe4f640 1 --2- 172.21.15.70:0/1670905438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb4101290 0x7f1eb4107a50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.731+0000 7f1ebbe4f640 1 --2- 172.21.15.70:0/1670905438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb41008e0 0x7f1eb4100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.731+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/1670905438 >> 172.21.15.70:0/1670905438 conn(0x7f1eb4077210 msgr2=0x7f1eb4077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.731+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/1670905438 shutdown_connections 2024-09-12T01:49:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.732+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/1670905438 wait complete. 2024-09-12T01:49:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.732+0000 7f1ebbe4f640 1 Processor -- start 2024-09-12T01:49:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.732+0000 7f1ebbe4f640 1 -- start start 2024-09-12T01:49:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.732+0000 7f1ebbe4f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb41008e0 0x7f1eb41a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.732+0000 7f1ebbe4f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb4101290 0x7f1eb41a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.732+0000 7f1ebbe4f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1eb4108160 0x7f1eb419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.732+0000 7f1ebbe4f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4112180 con 0x7f1eb41008e0 2024-09-12T01:49:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.732+0000 7f1ebbe4f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4112000 con 0x7f1eb4108160 2024-09-12T01:49:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1ebbe4f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4112300 con 0x7f1eb4101290 2024-09-12T01:49:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1eb9beb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb41008e0 0x7f1eb41a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1eb9beb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb41008e0 0x7f1eb41a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59736/0 (socket says 172.21.15.70:59736) 2024-09-12T01:49:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1eb9beb640 1 -- 172.21.15.70:0/79403673 learned_addr learned my addr 172.21.15.70:0/79403673 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1eb9beb640 1 -- 172.21.15.70:0/79403673 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb4101290 msgr2=0x7f1eb41a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1eb9beb640 1 --2- 172.21.15.70:0/79403673 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb4101290 0x7f1eb41a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1eb9beb640 1 -- 172.21.15.70:0/79403673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1eb4108160 msgr2=0x7f1eb419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1eb9beb640 1 --2- 172.21.15.70:0/79403673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1eb4108160 0x7f1eb419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1eb9beb640 1 -- 172.21.15.70:0/79403673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb419acf0 con 0x7f1eb41008e0 2024-09-12T01:49:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1eb9beb640 1 --2- 172.21.15.70:0/79403673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb41008e0 0x7f1eb41a0400 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800c920 tx=0x7f1ea800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1ea6ffd640 1 -- 172.21.15.70:0/79403673 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8007c70 con 0x7f1eb41008e0 2024-09-12T01:49:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/79403673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb419afe0 con 0x7f1eb41008e0 2024-09-12T01:49:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1ea6ffd640 1 -- 172.21.15.70:0/79403673 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1ea8007e10 con 0x7f1eb41008e0 2024-09-12T01:49:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1ea6ffd640 1 -- 172.21.15.70:0/79403673 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8018940 con 0x7f1eb41008e0 2024-09-12T01:49:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.733+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/79403673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb41a72d0 con 0x7f1eb41008e0 2024-09-12T01:49:53.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.734+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/79403673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb4100cc0 con 0x7f1eb41008e0 2024-09-12T01:49:53.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.735+0000 7f1ea6ffd640 1 -- 172.21.15.70:0/79403673 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1ea8018b20 con 0x7f1eb41008e0 2024-09-12T01:49:53.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.736+0000 7f1ea6ffd640 1 --2- 172.21.15.70:0/79403673 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1ea00a2b80 0x7f1ea00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:53.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.736+0000 7f1eb93ea640 1 --2- 172.21.15.70:0/79403673 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1ea00a2b80 0x7f1ea00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:53.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.736+0000 7f1ea6ffd640 1 -- 172.21.15.70:0/79403673 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f1ea80cedf0 con 0x7f1eb41008e0 2024-09-12T01:49:53.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.736+0000 7f1eb93ea640 1 --2- 172.21.15.70:0/79403673 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1ea00a2b80 0x7f1ea00a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40ff120 tx=0x7f1eb0000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:53.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.740+0000 7f1ea6ffd640 1 -- 172.21.15.70:0/79403673 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ea8014030 con 0x7f1eb41008e0 2024-09-12T01:49:53.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:53 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3040892417' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T01:49:53.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:53.907+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/79403673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1eb402d7c0 con 0x7f1eb41008e0 2024-09-12T01:49:54.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.282+0000 7f1ea6ffd640 1 -- 172.21.15.70:0/79403673 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7f1ea800de20 con 0x7f1eb41008e0 2024-09-12T01:49:54.282 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2024-09-12T01:49:54.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.284+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/79403673 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1ea00a2b80 msgr2=0x7f1ea00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:54.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.284+0000 7f1ebbe4f640 1 --2- 172.21.15.70:0/79403673 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1ea00a2b80 0x7f1ea00a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40ff120 tx=0x7f1eb0000bc0 comp rx=0 tx=0).stop 2024-09-12T01:49:54.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.284+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/79403673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb41008e0 msgr2=0x7f1eb41a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:54.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.284+0000 7f1ebbe4f640 1 --2- 172.21.15.70:0/79403673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb41008e0 0x7f1eb41a0400 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800c920 tx=0x7f1ea800cde0 comp rx=0 tx=0).stop 2024-09-12T01:49:54.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.284+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/79403673 shutdown_connections 2024-09-12T01:49:54.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.284+0000 7f1ebbe4f640 1 --2- 172.21.15.70:0/79403673 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1ea00a2b80 0x7f1ea00a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:54.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.284+0000 7f1ebbe4f640 1 --2- 172.21.15.70:0/79403673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1eb4108160 0x7f1eb419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:54.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.284+0000 7f1ebbe4f640 1 --2- 172.21.15.70:0/79403673 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb4101290 0x7f1eb41a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:54.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.284+0000 7f1ebbe4f640 1 --2- 172.21.15.70:0/79403673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb41008e0 0x7f1eb41a0400 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:54.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.284+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/79403673 >> 172.21.15.70:0/79403673 conn(0x7f1eb4077210 msgr2=0x7f1eb40ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:54.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.285+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/79403673 shutdown_connections 2024-09-12T01:49:54.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:54.285+0000 7f1ebbe4f640 1 -- 172.21.15.70:0/79403673 wait complete. 2024-09-12T01:49:54.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:54 smithi070 ceph-mon[31177]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:54.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:54 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/79403673' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:49:54.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:54 smithi191 ceph-mon[35770]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:54.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:54 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/79403673' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:49:54.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:54 smithi152 ceph-mon[35055]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:54.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:54 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/79403673' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T01:49:54.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:49:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:55.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:55 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/79403673' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T01:49:55.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:55 smithi070 ceph-mon[31177]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T01:49:55.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.592+0000 7f47c50eb640 1 -- 172.21.15.70:0/300986813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c0106a80 msgr2=0x7f47c0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:55.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.592+0000 7f47c50eb640 1 --2- 172.21.15.70:0/300986813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c0106a80 0x7f47c0106e60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009cd0 tx=0x7f47b802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:49:55.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.592+0000 7f47c50eb640 1 -- 172.21.15.70:0/300986813 shutdown_connections 2024-09-12T01:49:55.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.592+0000 7f47c50eb640 1 --2- 172.21.15.70:0/300986813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47c0101420 0x7f47c010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.592+0000 7f47c50eb640 1 --2- 172.21.15.70:0/300986813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47c0100a80 0x7f47c0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.592+0000 7f47c50eb640 1 --2- 172.21.15.70:0/300986813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c0106a80 0x7f47c0106e60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.592+0000 7f47c50eb640 1 -- 172.21.15.70:0/300986813 >> 172.21.15.70:0/300986813 conn(0x7f47c00fc7a0 msgr2=0x7f47c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.592+0000 7f47c50eb640 1 -- 172.21.15.70:0/300986813 shutdown_connections 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.592+0000 7f47c50eb640 1 -- 172.21.15.70:0/300986813 wait complete. 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.592+0000 7f47c50eb640 1 Processor -- start 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47c50eb640 1 -- start start 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47c50eb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47c0100a80 0x7f47c0198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47c50eb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47c0101420 0x7f47c0198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47c50eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c0106a80 0x7f47c019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47c50eb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47c0111060 con 0x7f47c0106a80 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47c50eb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f47c0110ee0 con 0x7f47c0101420 2024-09-12T01:49:55.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47c50eb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f47c01111e0 con 0x7f47c0100a80 2024-09-12T01:49:55.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47bf59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c0106a80 0x7f47c019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:55.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47bf59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c0106a80 0x7f47c019cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59760/0 (socket says 172.21.15.70:59760) 2024-09-12T01:49:55.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47bf59e640 1 -- 172.21.15.70:0/2175128893 learned_addr learned my addr 172.21.15.70:0/2175128893 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:55.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47be59c640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47c0101420 0x7f47c0198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:55.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47bed9d640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47c0100a80 0x7f47c0198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:55.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47bf59e640 1 -- 172.21.15.70:0/2175128893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47c0100a80 msgr2=0x7f47c0198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:55.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47bf59e640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47c0100a80 0x7f47c0198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:55.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47bf59e640 1 -- 172.21.15.70:0/2175128893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47c0101420 msgr2=0x7f47c0198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:55.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47bf59e640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47c0101420 0x7f47c0198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:55.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47bf59e640 1 -- 172.21.15.70:0/2175128893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c019d610 con 0x7f47c0106a80 2024-09-12T01:49:55.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.593+0000 7f47bed9d640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47c0100a80 0x7f47c0198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:49:55.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.594+0000 7f47bf59e640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c0106a80 0x7f47c019cf30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009fd0 tx=0x7f47b000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.594+0000 7f47b7fff640 1 -- 172.21.15.70:0/2175128893 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0015020 con 0x7f47c0106a80 2024-09-12T01:49:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.594+0000 7f47c50eb640 1 -- 172.21.15.70:0/2175128893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c019d900 con 0x7f47c0106a80 2024-09-12T01:49:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.594+0000 7f47b7fff640 1 -- 172.21.15.70:0/2175128893 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47b0011d30 con 0x7f47c0106a80 2024-09-12T01:49:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.594+0000 7f47b7fff640 1 -- 172.21.15.70:0/2175128893 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b000f2e0 con 0x7f47c0106a80 2024-09-12T01:49:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.594+0000 7f47c50eb640 1 -- 172.21.15.70:0/2175128893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c01a51e0 con 0x7f47c0106a80 2024-09-12T01:49:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.595+0000 7f47c50eb640 1 -- 172.21.15.70:0/2175128893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c0100f60 con 0x7f47c0106a80 2024-09-12T01:49:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.597+0000 7f47b7fff640 1 -- 172.21.15.70:0/2175128893 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f47b0018020 con 0x7f47c0106a80 2024-09-12T01:49:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.597+0000 7f47b7fff640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f47a00a2b80 0x7f47a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.597+0000 7f47bed9d640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f47a00a2b80 0x7f47a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.597+0000 7f47b7fff640 1 -- 172.21.15.70:0/2175128893 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7f47b00ceba0 con 0x7f47c0106a80 2024-09-12T01:49:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.598+0000 7f47bed9d640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f47a00a2b80 0x7f47a00a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009a60 tx=0x7f47b8000f40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.601+0000 7f47b7fff640 1 -- 172.21.15.70:0/2175128893 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47b001f020 con 0x7f47c0106a80 2024-09-12T01:49:55.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:55 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/79403673' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T01:49:55.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:55 smithi191 ceph-mon[35770]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T01:49:55.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:55 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/79403673' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T01:49:55.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:55 smithi152 ceph-mon[35055]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T01:49:55.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:55.773+0000 7f47c50eb640 1 -- 172.21.15.70:0/2175128893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f47c002d7c0 con 0x7f47c0106a80 2024-09-12T01:49:56.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.296+0000 7f47b7fff640 1 -- 172.21.15.70:0/2175128893 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7f47b009be30 con 0x7f47c0106a80 2024-09-12T01:49:56.297 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2024-09-12T01:49:56.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.299+0000 7f47c50eb640 1 -- 172.21.15.70:0/2175128893 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f47a00a2b80 msgr2=0x7f47a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:56.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.299+0000 7f47c50eb640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f47a00a2b80 0x7f47a00a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009a60 tx=0x7f47b8000f40 comp rx=0 tx=0).stop 2024-09-12T01:49:56.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.299+0000 7f47c50eb640 1 -- 172.21.15.70:0/2175128893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c0106a80 msgr2=0x7f47c019cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:56.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.299+0000 7f47c50eb640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c0106a80 0x7f47c019cf30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009fd0 tx=0x7f47b000b820 comp rx=0 tx=0).stop 2024-09-12T01:49:56.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.299+0000 7f47c50eb640 1 -- 172.21.15.70:0/2175128893 shutdown_connections 2024-09-12T01:49:56.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.299+0000 7f47c50eb640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f47a00a2b80 0x7f47a00a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:56.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.299+0000 7f47c50eb640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c0106a80 0x7f47c019cf30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:56.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.299+0000 7f47c50eb640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47c0101420 0x7f47c0198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:56.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.299+0000 7f47c50eb640 1 --2- 172.21.15.70:0/2175128893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47c0100a80 0x7f47c0198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:56.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.299+0000 7f47c50eb640 1 -- 172.21.15.70:0/2175128893 >> 172.21.15.70:0/2175128893 conn(0x7f47c00fc7a0 msgr2=0x7f47c006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:56.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.299+0000 7f47c50eb640 1 -- 172.21.15.70:0/2175128893 shutdown_connections 2024-09-12T01:49:56.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:56.300+0000 7f47c50eb640 1 -- 172.21.15.70:0/2175128893 wait complete. 2024-09-12T01:49:56.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:56 smithi070 ceph-mon[31177]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T01:49:56.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:56 smithi070 ceph-mon[31177]: pgmap v265: 33 pgs: 1 creating+activating, 6 creating+peering, 5 active+clean, 21 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:56.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:56 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2175128893' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:49:56.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:56 smithi191 ceph-mon[35770]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T01:49:56.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:56 smithi191 ceph-mon[35770]: pgmap v265: 33 pgs: 1 creating+activating, 6 creating+peering, 5 active+clean, 21 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:56.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:56 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2175128893' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:49:56.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:56 smithi152 ceph-mon[35055]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T01:49:56.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:56 smithi152 ceph-mon[35055]: pgmap v265: 33 pgs: 1 creating+activating, 6 creating+peering, 5 active+clean, 21 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:56.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:56 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2175128893' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T01:49:56.879 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:49:57.122 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:57.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:57 smithi070 ceph-mon[31177]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:49:57.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:57 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2175128893' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T01:49:57.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:57 smithi070 ceph-mon[31177]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T01:49:57.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.654+0000 7f1de03a0640 1 -- 172.21.15.70:0/3620947725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dd8102790 msgr2=0x7f1dd81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:57.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.654+0000 7f1de03a0640 1 --2- 172.21.15.70:0/3620947725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dd8102790 0x7f1dd81067e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009900 tx=0x7f1dc802a410 comp rx=0 tx=0).stop 2024-09-12T01:49:57.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.654+0000 7f1de03a0640 1 -- 172.21.15.70:0/3620947725 shutdown_connections 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.654+0000 7f1de03a0640 1 --2- 172.21.15.70:0/3620947725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dd8106f10 0x7f1dd810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.654+0000 7f1de03a0640 1 --2- 172.21.15.70:0/3620947725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dd8102790 0x7f1dd81067e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.654+0000 7f1de03a0640 1 --2- 172.21.15.70:0/3620947725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dd8101de0 0x7f1dd81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.654+0000 7f1de03a0640 1 -- 172.21.15.70:0/3620947725 >> 172.21.15.70:0/3620947725 conn(0x7f1dd80fd8c0 msgr2=0x7f1dd80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.654+0000 7f1de03a0640 1 -- 172.21.15.70:0/3620947725 shutdown_connections 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.654+0000 7f1de03a0640 1 -- 172.21.15.70:0/3620947725 wait complete. 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1de03a0640 1 Processor -- start 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1de03a0640 1 -- start start 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1de03a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dd8101de0 0x7f1dd8198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1de03a0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dd8102790 0x7f1dd8198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1de03a0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dd8106f10 0x7f1dd819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1de03a0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd8112150 con 0x7f1dd8101de0 2024-09-12T01:49:57.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1de03a0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd8111fd0 con 0x7f1dd8106f10 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1de03a0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81122d0 con 0x7f1dd8102790 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1dde13c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dd8101de0 0x7f1dd8198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1dde13c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dd8101de0 0x7f1dd8198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59786/0 (socket says 172.21.15.70:59786) 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1dde13c640 1 -- 172.21.15.70:0/237855978 learned_addr learned my addr 172.21.15.70:0/237855978 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1dde93d640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dd8106f10 0x7f1dd819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1dde13c640 1 -- 172.21.15.70:0/237855978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dd8102790 msgr2=0x7f1dd8198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1dde13c640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dd8102790 0x7f1dd8198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1dde13c640 1 -- 172.21.15.70:0/237855978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dd8106f10 msgr2=0x7f1dd819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1dde13c640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dd8106f10 0x7f1dd819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1dde13c640 1 -- 172.21.15.70:0/237855978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd819d620 con 0x7f1dd8101de0 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.655+0000 7f1dde93d640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dd8106f10 0x7f1dd819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.656+0000 7f1dde13c640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dd8101de0 0x7f1dd8198670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400b4a0 tx=0x7f1dd400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:57.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.656+0000 7f1dcf7fe640 1 -- 172.21.15.70:0/237855978 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4014070 con 0x7f1dd8101de0 2024-09-12T01:49:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.656+0000 7f1dcf7fe640 1 -- 172.21.15.70:0/237855978 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1dd4010b10 con 0x7f1dd8101de0 2024-09-12T01:49:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.656+0000 7f1de03a0640 1 -- 172.21.15.70:0/237855978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd819d910 con 0x7f1dd8101de0 2024-09-12T01:49:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.656+0000 7f1dcf7fe640 1 -- 172.21.15.70:0/237855978 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4017d60 con 0x7f1dd8101de0 2024-09-12T01:49:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.656+0000 7f1de03a0640 1 -- 172.21.15.70:0/237855978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd81a51f0 con 0x7f1dd8101de0 2024-09-12T01:49:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.657+0000 7f1de03a0640 1 -- 172.21.15.70:0/237855978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dd8102240 con 0x7f1dd8101de0 2024-09-12T01:49:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.658+0000 7f1dcf7fe640 1 -- 172.21.15.70:0/237855978 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1dd4017070 con 0x7f1dd8101de0 2024-09-12T01:49:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.659+0000 7f1dcf7fe640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1dc40a2c00 0x7f1dc40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.659+0000 7f1ddd93b640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1dc40a2c00 0x7f1dc40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.659+0000 7f1dcf7fe640 1 -- 172.21.15.70:0/237855978 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f1dd40ce6a0 con 0x7f1dd8101de0 2024-09-12T01:49:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.659+0000 7f1ddd93b640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1dc40a2c00 0x7f1dc40a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80096c0 tx=0x7f1dc8000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:57.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.662+0000 7f1dcf7fe640 1 -- 172.21.15.70:0/237855978 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1dd409b790 con 0x7f1dd8101de0 2024-09-12T01:49:57.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:57 smithi191 ceph-mon[35770]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:49:57.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:57 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2175128893' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T01:49:57.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:57 smithi191 ceph-mon[35770]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T01:49:57.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:57 smithi152 ceph-mon[35055]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:49:57.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:57 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2175128893' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T01:49:57.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:57 smithi152 ceph-mon[35055]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T01:49:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:57.863+0000 7f1de03a0640 1 -- 172.21.15.70:0/237855978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1dd81999d0 con 0x7f1dd8101de0 2024-09-12T01:49:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.310+0000 7f1dcf7fe640 1 -- 172.21.15.70:0/237855978 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f1dd409b090 con 0x7f1dd8101de0 2024-09-12T01:49:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T01:49:58.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.313+0000 7f1de03a0640 1 -- 172.21.15.70:0/237855978 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1dc40a2c00 msgr2=0x7f1dc40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:58.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.313+0000 7f1de03a0640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1dc40a2c00 0x7f1dc40a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80096c0 tx=0x7f1dc8000bc0 comp rx=0 tx=0).stop 2024-09-12T01:49:58.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.313+0000 7f1de03a0640 1 -- 172.21.15.70:0/237855978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dd8101de0 msgr2=0x7f1dd8198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:58.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.313+0000 7f1de03a0640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dd8101de0 0x7f1dd8198670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400b4a0 tx=0x7f1dd400b960 comp rx=0 tx=0).stop 2024-09-12T01:49:58.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.313+0000 7f1de03a0640 1 -- 172.21.15.70:0/237855978 shutdown_connections 2024-09-12T01:49:58.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.313+0000 7f1de03a0640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1dc40a2c00 0x7f1dc40a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.313+0000 7f1de03a0640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dd8106f10 0x7f1dd819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.313+0000 7f1de03a0640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dd8102790 0x7f1dd8198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.313+0000 7f1de03a0640 1 --2- 172.21.15.70:0/237855978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dd8101de0 0x7f1dd8198670 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.313+0000 7f1de03a0640 1 -- 172.21.15.70:0/237855978 >> 172.21.15.70:0/237855978 conn(0x7f1dd80fd8c0 msgr2=0x7f1dd80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.313+0000 7f1de03a0640 1 -- 172.21.15.70:0/237855978 shutdown_connections 2024-09-12T01:49:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:58.313+0000 7f1de03a0640 1 -- 172.21.15.70:0/237855978 wait complete. 2024-09-12T01:49:58.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:58 smithi070 ceph-mon[31177]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T01:49:58.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:58 smithi070 ceph-mon[31177]: pgmap v268: 97 pgs: 1 creating+activating, 8 creating+peering, 24 active+clean, 64 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:58.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:58 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/237855978' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T01:49:58.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:58 smithi070 ceph-mon[31177]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T01:49:58.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:58 smithi191 ceph-mon[35770]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T01:49:58.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:58 smithi191 ceph-mon[35770]: pgmap v268: 97 pgs: 1 creating+activating, 8 creating+peering, 24 active+clean, 64 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:58.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:58 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/237855978' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T01:49:58.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:58 smithi191 ceph-mon[35770]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T01:49:58.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:58 smithi152 ceph-mon[35055]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T01:49:58.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:58 smithi152 ceph-mon[35055]: pgmap v268: 97 pgs: 1 creating+activating, 8 creating+peering, 24 active+clean, 64 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:49:58.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:58 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/237855978' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T01:49:58.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:58 smithi152 ceph-mon[35055]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T01:49:58.890 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:49:59.134 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:49:59.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:59 smithi070 ceph-mon[31177]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T01:49:59.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:59 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/237855978' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T01:49:59.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:59 smithi070 ceph-mon[31177]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T01:49:59.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:49:59 smithi070 ceph-mon[31177]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T01:49:59.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:59 smithi191 ceph-mon[35770]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T01:49:59.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:59 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/237855978' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T01:49:59.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:59 smithi191 ceph-mon[35770]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T01:49:59.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:49:59 smithi191 ceph-mon[35770]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T01:49:59.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.659+0000 7f058e963640 1 -- 172.21.15.70:0/1103658897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0588101de0 msgr2=0x7f05881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:59.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.659+0000 7f058e963640 1 --2- 172.21.15.70:0/1103658897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0588101de0 0x7f05881021c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0578009900 tx=0x7f057802a410 comp rx=0 tx=0).stop 2024-09-12T01:49:59.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.659+0000 7f058e963640 1 -- 172.21.15.70:0/1103658897 shutdown_connections 2024-09-12T01:49:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.659+0000 7f058e963640 1 --2- 172.21.15.70:0/1103658897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0588106f10 0x7f058810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.659+0000 7f058e963640 1 --2- 172.21.15.70:0/1103658897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0588102790 0x7f05881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.659+0000 7f058e963640 1 --2- 172.21.15.70:0/1103658897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0588101de0 0x7f05881021c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.659+0000 7f058e963640 1 -- 172.21.15.70:0/1103658897 >> 172.21.15.70:0/1103658897 conn(0x7f05880fd8c0 msgr2=0x7f05880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.659+0000 7f058e963640 1 -- 172.21.15.70:0/1103658897 shutdown_connections 2024-09-12T01:49:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.659+0000 7f058e963640 1 -- 172.21.15.70:0/1103658897 wait complete. 2024-09-12T01:49:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.660+0000 7f058e963640 1 Processor -- start 2024-09-12T01:49:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.660+0000 7f058e963640 1 -- start start 2024-09-12T01:49:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.660+0000 7f058e963640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0588101de0 0x7f05880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.660+0000 7f058e963640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0588102790 0x7f0588074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.660+0000 7f058e963640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0588106f10 0x7f0588074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.660+0000 7f058e963640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0588112150 con 0x7f0588102790 2024-09-12T01:49:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.660+0000 7f058e963640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0588111fd0 con 0x7f0588101de0 2024-09-12T01:49:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.660+0000 7f058e963640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f05881122d0 con 0x7f0588106f10 2024-09-12T01:49:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.660+0000 7f05877fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0588102790 0x7f0588074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.660+0000 7f05877fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0588102790 0x7f0588074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59808/0 (socket says 172.21.15.70:59808) 2024-09-12T01:49:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.660+0000 7f05877fe640 1 -- 172.21.15.70:0/303461981 learned_addr learned my addr 172.21.15.70:0/303461981 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:49:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f0587fff640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0588101de0 0x7f05880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f058cf00640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0588106f10 0x7f0588074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f05877fe640 1 -- 172.21.15.70:0/303461981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0588106f10 msgr2=0x7f0588074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f05877fe640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0588106f10 0x7f0588074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f05877fe640 1 -- 172.21.15.70:0/303461981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0588101de0 msgr2=0x7f05880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f05877fe640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0588101de0 0x7f05880744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f05877fe640 1 -- 172.21.15.70:0/303461981 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05881a6b30 con 0x7f0588102790 2024-09-12T01:49:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f05877fe640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0588102790 0x7f0588074a30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f057c00b4a0 tx=0x7f057c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f05857fa640 1 -- 172.21.15.70:0/303461981 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c014070 con 0x7f0588102790 2024-09-12T01:49:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f05857fa640 1 -- 172.21.15.70:0/303461981 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f057c010b10 con 0x7f0588102790 2024-09-12T01:49:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f058e963640 1 -- 172.21.15.70:0/303461981 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05881a6e20 con 0x7f0588102790 2024-09-12T01:49:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f05857fa640 1 -- 172.21.15.70:0/303461981 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c017d60 con 0x7f0588102790 2024-09-12T01:49:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.661+0000 7f058e963640 1 -- 172.21.15.70:0/303461981 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05881a72d0 con 0x7f0588102790 2024-09-12T01:49:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.662+0000 7f058e963640 1 -- 172.21.15.70:0/303461981 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0588102240 con 0x7f0588102790 2024-09-12T01:49:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.663+0000 7f05857fa640 1 -- 172.21.15.70:0/303461981 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f057c017070 con 0x7f0588102790 2024-09-12T01:49:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.664+0000 7f05857fa640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f05700a2c00 0x7f05700a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.664+0000 7f0587fff640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f05700a2c00 0x7f05700a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.664+0000 7f05857fa640 1 -- 172.21.15.70:0/303461981 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f057c0ce2e0 con 0x7f0588102790 2024-09-12T01:49:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.664+0000 7f0587fff640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f05700a2c00 0x7f05700a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0578000c00 tx=0x7f05780095f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:59.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.668+0000 7f05857fa640 1 -- 172.21.15.70:0/303461981 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f057c09b390 con 0x7f0588102790 2024-09-12T01:49:59.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:59 smithi152 ceph-mon[35055]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T01:49:59.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:59 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/237855978' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T01:49:59.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:59 smithi152 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T01:49:59.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:49:59 smithi152 ceph-mon[35055]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T01:49:59.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.835+0000 7f058e963640 1 -- 172.21.15.70:0/303461981 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f058810a120 con 0x7f0588102790 2024-09-12T01:49:59.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.836+0000 7f05857fa640 1 -- 172.21.15.70:0/303461981 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22289 (secure 0 0 0) 0x7f057c09ac90 con 0x7f0588102790 2024-09-12T01:49:59.837 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:49:59.837 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":81,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:49:57.864065+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:49:54.140097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:49:56.005187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:49:59.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.839+0000 7f058e963640 1 -- 172.21.15.70:0/303461981 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f05700a2c00 msgr2=0x7f05700a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:59.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.839+0000 7f058e963640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f05700a2c00 0x7f05700a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0578000c00 tx=0x7f05780095f0 comp rx=0 tx=0).stop 2024-09-12T01:49:59.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.839+0000 7f058e963640 1 -- 172.21.15.70:0/303461981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0588102790 msgr2=0x7f0588074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:59.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.839+0000 7f058e963640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0588102790 0x7f0588074a30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f057c00b4a0 tx=0x7f057c00b960 comp rx=0 tx=0).stop 2024-09-12T01:49:59.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.839+0000 7f058e963640 1 -- 172.21.15.70:0/303461981 shutdown_connections 2024-09-12T01:49:59.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.839+0000 7f058e963640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f05700a2c00 0x7f05700a50c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:59.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.839+0000 7f058e963640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0588106f10 0x7f0588074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:59.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.839+0000 7f058e963640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0588102790 0x7f0588074a30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:59.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.839+0000 7f058e963640 1 --2- 172.21.15.70:0/303461981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0588101de0 0x7f05880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:59.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.839+0000 7f058e963640 1 -- 172.21.15.70:0/303461981 >> 172.21.15.70:0/303461981 conn(0x7f05880fd8c0 msgr2=0x7f05880fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:59.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.839+0000 7f058e963640 1 -- 172.21.15.70:0/303461981 shutdown_connections 2024-09-12T01:49:59.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:49:59.839+0000 7f058e963640 1 -- 172.21.15.70:0/303461981 wait complete. 2024-09-12T01:50:00.494 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:00 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] up:active 2024-09-12T01:50:00.494 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:00 smithi070 ceph-mon[31177]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:50:00.494 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:00 smithi070 ceph-mon[31177]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:50:00.494 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:00 smithi070 ceph-mon[31177]: pgmap v270: 97 pgs: 1 creating+activating, 8 creating+peering, 58 active+clean, 30 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 5 op/s 2024-09-12T01:50:00.494 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:00 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/303461981' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:00.494 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:00 smithi070 ceph-mon[31177]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-09-12T01:50:00.494 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:00 smithi070 ceph-mon[31177]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-09-12T01:50:00.494 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:00 smithi070 ceph-mon[31177]: application not enabled on pool 'cephfs_metadata' 2024-09-12T01:50:00.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:00 smithi070 ceph-mon[31177]: application not enabled on pool 'cephfs_data' 2024-09-12T01:50:00.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:00 smithi070 ceph-mon[31177]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-12T01:50:00.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:50:00.663 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:00 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] up:active 2024-09-12T01:50:00.664 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:00 smithi152 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:50:00.664 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:00 smithi152 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:50:00.664 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:00 smithi152 ceph-mon[35055]: pgmap v270: 97 pgs: 1 creating+activating, 8 creating+peering, 58 active+clean, 30 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 5 op/s 2024-09-12T01:50:00.664 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:00 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/303461981' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:00.664 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:00 smithi152 ceph-mon[35055]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-09-12T01:50:00.664 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:00 smithi152 ceph-mon[35055]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-09-12T01:50:00.664 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:00 smithi152 ceph-mon[35055]: application not enabled on pool 'cephfs_metadata' 2024-09-12T01:50:00.664 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:00 smithi152 ceph-mon[35055]: application not enabled on pool 'cephfs_data' 2024-09-12T01:50:00.664 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:00 smithi152 ceph-mon[35055]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-12T01:50:00.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:00 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] up:active 2024-09-12T01:50:00.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:00 smithi191 ceph-mon[35770]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:50:00.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:00 smithi191 ceph-mon[35770]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:50:00.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:00 smithi191 ceph-mon[35770]: pgmap v270: 97 pgs: 1 creating+activating, 8 creating+peering, 58 active+clean, 30 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 5 op/s 2024-09-12T01:50:00.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:00 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/303461981' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:00.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:00 smithi191 ceph-mon[35770]: Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-09-12T01:50:00.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:00 smithi191 ceph-mon[35770]: [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-09-12T01:50:00.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:00 smithi191 ceph-mon[35770]: application not enabled on pool 'cephfs_metadata' 2024-09-12T01:50:00.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:00 smithi191 ceph-mon[35770]: application not enabled on pool 'cephfs_data' 2024-09-12T01:50:00.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:00 smithi191 ceph-mon[35770]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-09-12T01:50:00.768 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:01.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.202+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1677368880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3cc101420 msgr2=0x7fa3cc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:01.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.202+0000 7fa3d10ef640 1 --2- 172.21.15.70:0/1677368880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3cc101420 0x7fa3cc10d950 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009cd0 tx=0x7fa3c402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:50:01.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.202+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1677368880 shutdown_connections 2024-09-12T01:50:01.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.202+0000 7fa3d10ef640 1 --2- 172.21.15.70:0/1677368880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3cc101420 0x7fa3cc10d950 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:01.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.202+0000 7fa3d10ef640 1 --2- 172.21.15.70:0/1677368880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3cc100a80 0x7fa3cc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.202+0000 7fa3d10ef640 1 --2- 172.21.15.70:0/1677368880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3cc106a80 0x7fa3cc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.202+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1677368880 >> 172.21.15.70:0/1677368880 conn(0x7fa3cc0fc7a0 msgr2=0x7fa3cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.202+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1677368880 shutdown_connections 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.202+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1677368880 wait complete. 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.203+0000 7fa3d10ef640 1 Processor -- start 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.203+0000 7fa3d10ef640 1 -- start start 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3d10ef640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3cc100a80 0x7fa3cc1a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3d10ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3cc101420 0x7fa3cc1a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3d10ef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3cc106a80 0x7fa3cc19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3d10ef640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc111060 con 0x7fa3cc101420 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3d10ef640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc110ee0 con 0x7fa3cc106a80 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3d10ef640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc1111e0 con 0x7fa3cc100a80 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3c3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3cc101420 0x7fa3cc1a4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:01.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3c3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3cc101420 0x7fa3cc1a4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48690/0 (socket says 172.21.15.70:48690) 2024-09-12T01:50:01.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3c3fff640 1 -- 172.21.15.70:0/1456514025 learned_addr learned my addr 172.21.15.70:0/1456514025 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:01.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3cad9d640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3cc100a80 0x7fa3cc1a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:01.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3cb59e640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3cc106a80 0x7fa3cc19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:01.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3c3fff640 1 -- 172.21.15.70:0/1456514025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3cc100a80 msgr2=0x7fa3cc1a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:01.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3c3fff640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3cc100a80 0x7fa3cc1a4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:01.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3c3fff640 1 -- 172.21.15.70:0/1456514025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3cc106a80 msgr2=0x7fa3cc19ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:01.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3c3fff640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3cc106a80 0x7fa3cc19ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:01.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3c3fff640 1 -- 172.21.15.70:0/1456514025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3cc19f550 con 0x7fa3cc101420 2024-09-12T01:50:01.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3cb59e640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3cc106a80 0x7fa3cc19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:01.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3c3fff640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3cc101420 0x7fa3cc1a4f60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400b4a0 tx=0x7fa3b400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:01.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3c8d99640 1 -- 172.21.15.70:0/1456514025 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4015020 con 0x7fa3cc101420 2024-09-12T01:50:01.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1456514025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3cc19f840 con 0x7fa3cc101420 2024-09-12T01:50:01.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3c8d99640 1 -- 172.21.15.70:0/1456514025 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa3b4011d30 con 0x7fa3cc101420 2024-09-12T01:50:01.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3c8d99640 1 -- 172.21.15.70:0/1456514025 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400f2e0 con 0x7fa3cc101420 2024-09-12T01:50:01.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.204+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1456514025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3cc1ab7d0 con 0x7fa3cc101420 2024-09-12T01:50:01.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.205+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1456514025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3cc1021c0 con 0x7fa3cc101420 2024-09-12T01:50:01.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.206+0000 7fa3c8d99640 1 -- 172.21.15.70:0/1456514025 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa3b4018020 con 0x7fa3cc101420 2024-09-12T01:50:01.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.207+0000 7fa3c8d99640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa3b80a2b80 0x7fa3b80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:01.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.207+0000 7fa3cad9d640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa3b80a2b80 0x7fa3b80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:01.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.207+0000 7fa3c8d99640 1 -- 172.21.15.70:0/1456514025 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fa3b40ce7f0 con 0x7fa3cc101420 2024-09-12T01:50:01.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.207+0000 7fa3cad9d640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa3b80a2b80 0x7fa3b80a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc10dd60 tx=0x7fa3bc009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:01.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.211+0000 7fa3c8d99640 1 -- 172.21.15.70:0/1456514025 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3b401f020 con 0x7fa3cc101420 2024-09-12T01:50:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.380+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1456514025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3cc1aba60 con 0x7fa3cc101420 2024-09-12T01:50:01.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.382+0000 7fa3c8d99640 1 -- 172.21.15.70:0/1456514025 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22289 (secure 0 0 0) 0x7fa3b409b8a0 con 0x7fa3cc101420 2024-09-12T01:50:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:50:01.382 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":81,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:49:57.864065+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:49:54.140097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:49:56.005187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:50:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.384+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1456514025 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa3b80a2b80 msgr2=0x7fa3b80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.384+0000 7fa3d10ef640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa3b80a2b80 0x7fa3b80a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc10dd60 tx=0x7fa3bc009110 comp rx=0 tx=0).stop 2024-09-12T01:50:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.384+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1456514025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3cc101420 msgr2=0x7fa3cc1a4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.384+0000 7fa3d10ef640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3cc101420 0x7fa3cc1a4f60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400b4a0 tx=0x7fa3b400b8a0 comp rx=0 tx=0).stop 2024-09-12T01:50:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.384+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1456514025 shutdown_connections 2024-09-12T01:50:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.384+0000 7fa3d10ef640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa3b80a2b80 0x7fa3b80a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.384+0000 7fa3d10ef640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3cc106a80 0x7fa3cc19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.384+0000 7fa3d10ef640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3cc101420 0x7fa3cc1a4f60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.384+0000 7fa3d10ef640 1 --2- 172.21.15.70:0/1456514025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3cc100a80 0x7fa3cc1a4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.384+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1456514025 >> 172.21.15.70:0/1456514025 conn(0x7fa3cc0fc7a0 msgr2=0x7fa3cc06a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.384+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1456514025 shutdown_connections 2024-09-12T01:50:01.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:01.384+0000 7fa3d10ef640 1 -- 172.21.15.70:0/1456514025 wait complete. 2024-09-12T01:50:01.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:01 smithi070 ceph-mon[31177]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T01:50:01.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:01 smithi070 ceph-mon[31177]: Cluster is now healthy 2024-09-12T01:50:01.675 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:01 smithi152 ceph-mon[35055]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T01:50:01.676 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:01 smithi152 ceph-mon[35055]: Cluster is now healthy 2024-09-12T01:50:01.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:01 smithi191 ceph-mon[35770]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T01:50:01.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:01 smithi191 ceph-mon[35770]: Cluster is now healthy 2024-09-12T01:50:02.037 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:50:02.284 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:02.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:02 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1456514025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:02.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:02 smithi191 ceph-mon[35770]: pgmap v271: 97 pgs: 2 creating+peering, 95 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-12T01:50:02.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:02 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1456514025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:02.673 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:02 smithi070 ceph-mon[31177]: pgmap v271: 97 pgs: 2 creating+peering, 95 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-12T01:50:02.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:02 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1456514025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:02.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:02 smithi152 ceph-mon[35055]: pgmap v271: 97 pgs: 2 creating+peering, 95 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-12T01:50:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.755+0000 7f0fc01d3640 1 -- 172.21.15.70:0/286851560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb8106f10 msgr2=0x7f0fb810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.755+0000 7f0fc01d3640 1 --2- 172.21.15.70:0/286851560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb8106f10 0x7f0fb810ea90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009ca0 tx=0x7f0fb002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:50:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.755+0000 7f0fc01d3640 1 -- 172.21.15.70:0/286851560 shutdown_connections 2024-09-12T01:50:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.755+0000 7f0fc01d3640 1 --2- 172.21.15.70:0/286851560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb8106f10 0x7f0fb810ea90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.756+0000 7f0fc01d3640 1 --2- 172.21.15.70:0/286851560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fb8102790 0x7f0fb81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.756+0000 7f0fc01d3640 1 --2- 172.21.15.70:0/286851560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fb8101de0 0x7f0fb81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.756+0000 7f0fc01d3640 1 -- 172.21.15.70:0/286851560 >> 172.21.15.70:0/286851560 conn(0x7f0fb80fd8c0 msgr2=0x7f0fb80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.756+0000 7f0fc01d3640 1 -- 172.21.15.70:0/286851560 shutdown_connections 2024-09-12T01:50:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.756+0000 7f0fc01d3640 1 -- 172.21.15.70:0/286851560 wait complete. 2024-09-12T01:50:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.756+0000 7f0fc01d3640 1 Processor -- start 2024-09-12T01:50:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.756+0000 7f0fc01d3640 1 -- start start 2024-09-12T01:50:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.756+0000 7f0fc01d3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb8101de0 0x7f0fb8198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.756+0000 7f0fc01d3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fb8102790 0x7f0fb8198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.756+0000 7f0fc01d3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fb8106f10 0x7f0fb819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.756+0000 7f0fc01d3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb81120d0 con 0x7f0fb8101de0 2024-09-12T01:50:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.756+0000 7f0fc01d3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8111f50 con 0x7f0fb8102790 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fc01d3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8112250 con 0x7f0fb8106f10 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fbdf6f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb8101de0 0x7f0fb8198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fbdf6f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb8101de0 0x7f0fb8198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48708/0 (socket says 172.21.15.70:48708) 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fbdf6f640 1 -- 172.21.15.70:0/1321776210 learned_addr learned my addr 172.21.15.70:0/1321776210 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fbd76e640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fb8102790 0x7f0fb8198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fbe770640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fb8106f10 0x7f0fb819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fbdf6f640 1 -- 172.21.15.70:0/1321776210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fb8106f10 msgr2=0x7f0fb819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fbdf6f640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fb8106f10 0x7f0fb819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fbdf6f640 1 -- 172.21.15.70:0/1321776210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fb8102790 msgr2=0x7f0fb8198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fbdf6f640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fb8102790 0x7f0fb8198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fbdf6f640 1 -- 172.21.15.70:0/1321776210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb819d500 con 0x7f0fb8101de0 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fbd76e640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fb8102790 0x7f0fb8198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fbdf6f640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb8101de0 0x7f0fb8198550 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400d950 tx=0x7f0fb400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0faeffd640 1 -- 172.21.15.70:0/1321776210 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4017030 con 0x7f0fb8101de0 2024-09-12T01:50:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0faeffd640 1 -- 172.21.15.70:0/1321776210 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0fb4004020 con 0x7f0fb8101de0 2024-09-12T01:50:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fc01d3640 1 -- 172.21.15.70:0/1321776210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb819d7f0 con 0x7f0fb8101de0 2024-09-12T01:50:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0faeffd640 1 -- 172.21.15.70:0/1321776210 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4004a00 con 0x7f0fb8101de0 2024-09-12T01:50:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.757+0000 7f0fc01d3640 1 -- 172.21.15.70:0/1321776210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb81a50d0 con 0x7f0fb8101de0 2024-09-12T01:50:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.758+0000 7f0fc01d3640 1 -- 172.21.15.70:0/1321776210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb81021c0 con 0x7f0fb8101de0 2024-09-12T01:50:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.759+0000 7f0faeffd640 1 -- 172.21.15.70:0/1321776210 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0fb40041d0 con 0x7f0fb8101de0 2024-09-12T01:50:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.760+0000 7f0faeffd640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0fa40a2c00 0x7f0fa40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.760+0000 7f0fbd76e640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0fa40a2c00 0x7f0fa40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.760+0000 7f0faeffd640 1 -- 172.21.15.70:0/1321776210 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f0fb40cef40 con 0x7f0fb8101de0 2024-09-12T01:50:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.760+0000 7f0fbd76e640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0fa40a2c00 0x7f0fa40a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80ff770 tx=0x7f0fa8008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.763+0000 7f0faeffd640 1 -- 172.21.15.70:0/1321776210 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0fb409c070 con 0x7f0fb8101de0 2024-09-12T01:50:02.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:02.966+0000 7f0fc01d3640 1 -- 172.21.15.70:0/1321776210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0fb810a0f0 con 0x7f0fb8101de0 2024-09-12T01:50:03.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.333+0000 7f0faeffd640 1 -- 172.21.15.70:0/1321776210 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f0fb409b970 con 0x7f0fb8101de0 2024-09-12T01:50:03.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.335+0000 7f0fc01d3640 1 -- 172.21.15.70:0/1321776210 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0fa40a2c00 msgr2=0x7f0fa40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:03.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.335+0000 7f0fc01d3640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0fa40a2c00 0x7f0fa40a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80ff770 tx=0x7f0fa8008040 comp rx=0 tx=0).stop 2024-09-12T01:50:03.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.335+0000 7f0fc01d3640 1 -- 172.21.15.70:0/1321776210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb8101de0 msgr2=0x7f0fb8198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:03.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.335+0000 7f0fc01d3640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb8101de0 0x7f0fb8198550 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400d950 tx=0x7f0fb400de10 comp rx=0 tx=0).stop 2024-09-12T01:50:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.335+0000 7f0fc01d3640 1 -- 172.21.15.70:0/1321776210 shutdown_connections 2024-09-12T01:50:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.335+0000 7f0fc01d3640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0fa40a2c00 0x7f0fa40a50c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.335+0000 7f0fc01d3640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fb8106f10 0x7f0fb819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.335+0000 7f0fc01d3640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fb8102790 0x7f0fb8198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.335+0000 7f0fc01d3640 1 --2- 172.21.15.70:0/1321776210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb8101de0 0x7f0fb8198550 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.335+0000 7f0fc01d3640 1 -- 172.21.15.70:0/1321776210 >> 172.21.15.70:0/1321776210 conn(0x7f0fb80fd8c0 msgr2=0x7f0fb80fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.335+0000 7f0fc01d3640 1 -- 172.21.15.70:0/1321776210 shutdown_connections 2024-09-12T01:50:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:03.335+0000 7f0fc01d3640 1 -- 172.21.15.70:0/1321776210 wait complete. 2024-09-12T01:50:03.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:03 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1321776210' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:50:03.512 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:50:03 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b[65045]: 2024-09-12T01:50:03.209+0000 7f9c6f4b1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:50:03.604 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:03 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1321776210' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:50:03.633 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:03 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1321776210' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T01:50:03.895 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T01:50:03.895 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-12T01:50:04.140 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:04.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:04 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1321776210' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T01:50:04.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:04 smithi070 ceph-mon[31177]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:50:04.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:04 smithi070 ceph-mon[31177]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-12T01:50:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.653+0000 7f8fb6afd640 1 -- 172.21.15.70:0/4121791284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101de0 msgr2=0x7f8fb01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.653+0000 7f8fb6afd640 1 --2- 172.21.15.70:0/4121791284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101de0 0x7f8fb01021c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009900 tx=0x7f8fa402a410 comp rx=0 tx=0).stop 2024-09-12T01:50:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.653+0000 7f8fb6afd640 1 -- 172.21.15.70:0/4121791284 shutdown_connections 2024-09-12T01:50:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.653+0000 7f8fb6afd640 1 --2- 172.21.15.70:0/4121791284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0106f10 0x7f8fb010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.653+0000 7f8fb6afd640 1 --2- 172.21.15.70:0/4121791284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fb0102790 0x7f8fb01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.653+0000 7f8fb6afd640 1 --2- 172.21.15.70:0/4121791284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101de0 0x7f8fb01021c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.653+0000 7f8fb6afd640 1 -- 172.21.15.70:0/4121791284 >> 172.21.15.70:0/4121791284 conn(0x7f8fb00fd8c0 msgr2=0x7f8fb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.653+0000 7f8fb6afd640 1 -- 172.21.15.70:0/4121791284 shutdown_connections 2024-09-12T01:50:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.653+0000 7f8fb6afd640 1 -- 172.21.15.70:0/4121791284 wait complete. 2024-09-12T01:50:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.653+0000 7f8fb6afd640 1 Processor -- start 2024-09-12T01:50:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.653+0000 7f8fb6afd640 1 -- start start 2024-09-12T01:50:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb6afd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101de0 0x7f8fb01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb6afd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0102790 0x7f8fb0198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb6afd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fb0106f10 0x7f8fb019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb6afd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb0112090 con 0x7f8fb0101de0 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb6afd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb0111f10 con 0x7f8fb0106f10 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb6afd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb0112210 con 0x7f8fb0102790 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb4899640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101de0 0x7f8fb01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb4899640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101de0 0x7f8fb01984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48718/0 (socket says 172.21.15.70:48718) 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb4899640 1 -- 172.21.15.70:0/311553530 learned_addr learned my addr 172.21.15.70:0/311553530 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8faffff640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0102790 0x7f8fb0198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb509a640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fb0106f10 0x7f8fb019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb4899640 1 -- 172.21.15.70:0/311553530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0102790 msgr2=0x7f8fb0198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb4899640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0102790 0x7f8fb0198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb4899640 1 -- 172.21.15.70:0/311553530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fb0106f10 msgr2=0x7f8fb019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb4899640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fb0106f10 0x7f8fb019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb4899640 1 -- 172.21.15.70:0/311553530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb019d4a0 con 0x7f8fb0101de0 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8faffff640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0102790 0x7f8fb0198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb4899640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101de0 0x7f8fb01984f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4006010 tx=0x7f8fa40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fadffb640 1 -- 172.21.15.70:0/311553530 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa403f030 con 0x7f8fb0101de0 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fb6afd640 1 -- 172.21.15.70:0/311553530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb019d730 con 0x7f8fb0101de0 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fadffb640 1 -- 172.21.15.70:0/311553530 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fa4003d00 con 0x7f8fb0101de0 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.654+0000 7f8fadffb640 1 -- 172.21.15.70:0/311553530 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4035070 con 0x7f8fb0101de0 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.655+0000 7f8fb6afd640 1 -- 172.21.15.70:0/311553530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb01a5070 con 0x7f8fb0101de0 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.656+0000 7f8fb6afd640 1 -- 172.21.15.70:0/311553530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb01032c0 con 0x7f8fb0101de0 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.657+0000 7f8fadffb640 1 -- 172.21.15.70:0/311553530 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8fa4042030 con 0x7f8fb0101de0 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.657+0000 7f8fadffb640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8fa00a2b80 0x7f8fa00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.658+0000 7f8fadffb640 1 -- 172.21.15.70:0/311553530 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f8fa40ef380 con 0x7f8fb0101de0 2024-09-12T01:50:04.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.658+0000 7f8faffff640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8fa00a2b80 0x7f8fa00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:04.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.658+0000 7f8faffff640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8fa00a2b80 0x7f8fa00a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8fb01088e0 tx=0x7f8f9c005ec0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:04.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.662+0000 7f8fadffb640 1 -- 172.21.15.70:0/311553530 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fa40bc430 con 0x7f8fb0101de0 2024-09-12T01:50:04.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:04 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1321776210' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T01:50:04.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:04 smithi191 ceph-mon[35770]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:50:04.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:04 smithi191 ceph-mon[35770]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-12T01:50:04.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:04 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1321776210' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T01:50:04.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:04 smithi152 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:50:04.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:04 smithi152 ceph-mon[35055]: pgmap v272: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-12T01:50:04.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:04.864+0000 7f8fb6afd640 1 -- 172.21.15.70:0/311553530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f8fb010a0f0 con 0x7f8fb0101de0 2024-09-12T01:50:05.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.343+0000 7f8fadffb640 1 -- 172.21.15.70:0/311553530 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f8fa40bbd30 con 0x7f8fb0101de0 2024-09-12T01:50:05.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.346+0000 7f8fb6afd640 1 -- 172.21.15.70:0/311553530 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8fa00a2b80 msgr2=0x7f8fa00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.346+0000 7f8fb6afd640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8fa00a2b80 0x7f8fa00a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8fb01088e0 tx=0x7f8f9c005ec0 comp rx=0 tx=0).stop 2024-09-12T01:50:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.346+0000 7f8fb6afd640 1 -- 172.21.15.70:0/311553530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101de0 msgr2=0x7f8fb01984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.346+0000 7f8fb6afd640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101de0 0x7f8fb01984f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4006010 tx=0x7f8fa40042f0 comp rx=0 tx=0).stop 2024-09-12T01:50:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.346+0000 7f8fb6afd640 1 -- 172.21.15.70:0/311553530 shutdown_connections 2024-09-12T01:50:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.346+0000 7f8fb6afd640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8fa00a2b80 0x7f8fa00a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.346+0000 7f8fb6afd640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fb0106f10 0x7f8fb019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.346+0000 7f8fb6afd640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fb0102790 0x7f8fb0198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.346+0000 7f8fb6afd640 1 --2- 172.21.15.70:0/311553530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fb0101de0 0x7f8fb01984f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.346+0000 7f8fb6afd640 1 -- 172.21.15.70:0/311553530 >> 172.21.15.70:0/311553530 conn(0x7f8fb00fd8c0 msgr2=0x7f8fb00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.346+0000 7f8fb6afd640 1 -- 172.21.15.70:0/311553530 shutdown_connections 2024-09-12T01:50:05.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:05.346+0000 7f8fb6afd640 1 -- 172.21.15.70:0/311553530 wait complete. 2024-09-12T01:50:05.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:05 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/311553530' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T01:50:05.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:05 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/311553530' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T01:50:05.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:05 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/311553530' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T01:50:05.945 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T01:50:06.189 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:06.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:06 smithi070 ceph-mon[31177]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T01:50:06.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:06 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/311553530' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T01:50:06.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:06 smithi070 ceph-mon[31177]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T01:50:06.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:06 smithi070 ceph-mon[31177]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:50:06.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:06 smithi070 ceph-mon[31177]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T01:50:06.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:06 smithi070 ceph-mon[31177]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T01:50:06.564 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:06 smithi070 ceph-mon[31177]: pgmap v273: 97 pgs: 97 active+clean; 580 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-12T01:50:06.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.645+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2838799063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac1082a0 msgr2=0x7f7bac10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:06.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.645+0000 7f7bb20cd640 1 --2- 172.21.15.70:0/2838799063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac1082a0 0x7f7bac10ec40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4009cd0 tx=0x7f7ba402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:50:06.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.645+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2838799063 shutdown_connections 2024-09-12T01:50:06.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.645+0000 7f7bb20cd640 1 --2- 172.21.15.70:0/2838799063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac1082a0 0x7f7bac10ec40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:06.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.645+0000 7f7bb20cd640 1 --2- 172.21.15.70:0/2838799063 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bac1036e0 0x7f7bac107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:06.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.645+0000 7f7bb20cd640 1 --2- 172.21.15.70:0/2838799063 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac102d30 0x7f7bac103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:06.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.645+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2838799063 >> 172.21.15.70:0/2838799063 conn(0x7f7bac0fc7d0 msgr2=0x7f7bac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:06.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.646+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2838799063 shutdown_connections 2024-09-12T01:50:06.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.646+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2838799063 wait complete. 2024-09-12T01:50:06.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.646+0000 7f7bb20cd640 1 Processor -- start 2024-09-12T01:50:06.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.646+0000 7f7bb20cd640 1 -- start start 2024-09-12T01:50:06.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.646+0000 7f7bb20cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bac102d30 0x7f7bac100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:06.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7bb20cd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac1036e0 0x7f7bac100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:06.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7bb20cd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac1082a0 0x7f7bac101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:06.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7bb20cd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac112240 con 0x7f7bac1082a0 2024-09-12T01:50:06.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7bb20cd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1120c0 con 0x7f7bac102d30 2024-09-12T01:50:06.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7bb20cd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1123c0 con 0x7f7bac1036e0 2024-09-12T01:50:06.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7babfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac1082a0 0x7f7bac101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:06.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7babfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac1082a0 0x7f7bac101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48728/0 (socket says 172.21.15.70:48728) 2024-09-12T01:50:06.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7babfff640 1 -- 172.21.15.70:0/2815337314 learned_addr learned my addr 172.21.15.70:0/2815337314 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:06.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7bab7fe640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bac102d30 0x7f7bac100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:06.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7ba2ffd640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac1036e0 0x7f7bac100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:06.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7babfff640 1 -- 172.21.15.70:0/2815337314 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac1036e0 msgr2=0x7f7bac100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:06.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7babfff640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac1036e0 0x7f7bac100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:06.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7babfff640 1 -- 172.21.15.70:0/2815337314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bac102d30 msgr2=0x7f7bac100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:06.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7babfff640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bac102d30 0x7f7bac100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:06.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7babfff640 1 -- 172.21.15.70:0/2815337314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bac1a6b40 con 0x7f7bac1082a0 2024-09-12T01:50:06.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7bab7fe640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bac102d30 0x7f7bac100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:06.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7babfff640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac1082a0 0x7f7bac101410 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4006010 tx=0x7f7ba4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:06.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7ba97fa640 1 -- 172.21.15.70:0/2815337314 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4004040 con 0x7f7bac1082a0 2024-09-12T01:50:06.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7ba97fa640 1 -- 172.21.15.70:0/2815337314 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ba40046e0 con 0x7f7bac1082a0 2024-09-12T01:50:06.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2815337314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bac1a6dd0 con 0x7f7bac1082a0 2024-09-12T01:50:06.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7ba97fa640 1 -- 172.21.15.70:0/2815337314 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4046480 con 0x7f7bac1082a0 2024-09-12T01:50:06.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.647+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2815337314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bac1a72d0 con 0x7f7bac1082a0 2024-09-12T01:50:06.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.648+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2815337314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bac103110 con 0x7f7bac1082a0 2024-09-12T01:50:06.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.649+0000 7f7ba97fa640 1 -- 172.21.15.70:0/2815337314 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7ba4030630 con 0x7f7bac1082a0 2024-09-12T01:50:06.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.651+0000 7f7ba97fa640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7b980a2b80 0x7f7b980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:06.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.651+0000 7f7bab7fe640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7b980a2b80 0x7f7b980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:06.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.651+0000 7f7ba97fa640 1 -- 172.21.15.70:0/2815337314 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f7ba402e030 con 0x7f7bac1082a0 2024-09-12T01:50:06.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.651+0000 7f7bab7fe640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7b980a2b80 0x7f7b980a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009930 tx=0x7f7b9c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:06.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.655+0000 7f7ba97fa640 1 -- 172.21.15.70:0/2815337314 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ba404b060 con 0x7f7bac1082a0 2024-09-12T01:50:06.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:06 smithi191 ceph-mon[35770]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T01:50:06.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:06 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/311553530' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T01:50:06.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:06 smithi191 ceph-mon[35770]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T01:50:06.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:06 smithi191 ceph-mon[35770]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:50:06.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:06 smithi191 ceph-mon[35770]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T01:50:06.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:06 smithi191 ceph-mon[35770]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T01:50:06.689 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:06 smithi191 ceph-mon[35770]: pgmap v273: 97 pgs: 97 active+clean; 580 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-12T01:50:06.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:06 smithi152 ceph-mon[35055]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T01:50:06.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:06 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/311553530' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T01:50:06.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:06 smithi152 ceph-mon[35055]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T01:50:06.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:06 smithi152 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T01:50:06.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:06 smithi152 ceph-mon[35055]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T01:50:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:06 smithi152 ceph-mon[35055]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T01:50:06.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:06 smithi152 ceph-mon[35055]: pgmap v273: 97 pgs: 97 active+clean; 580 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-12T01:50:06.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:06.857+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2815337314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f7bac1a7560 con 0x7f7bac1082a0 2024-09-12T01:50:07.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.355+0000 7f7ba97fa640 1 -- 172.21.15.70:0/2815337314 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f7ba40bd6e0 con 0x7f7bac1082a0 2024-09-12T01:50:07.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.357+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2815337314 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7b980a2b80 msgr2=0x7f7b980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:07.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.357+0000 7f7bb20cd640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7b980a2b80 0x7f7b980a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009930 tx=0x7f7b9c008040 comp rx=0 tx=0).stop 2024-09-12T01:50:07.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.357+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2815337314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac1082a0 msgr2=0x7f7bac101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:07.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.357+0000 7f7bb20cd640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac1082a0 0x7f7bac101410 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4006010 tx=0x7f7ba4003f10 comp rx=0 tx=0).stop 2024-09-12T01:50:07.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.357+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2815337314 shutdown_connections 2024-09-12T01:50:07.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.357+0000 7f7bb20cd640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7b980a2b80 0x7f7b980a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:07.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.357+0000 7f7bb20cd640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bac1082a0 0x7f7bac101410 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:07.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.357+0000 7f7bb20cd640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bac1036e0 0x7f7bac100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:07.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.357+0000 7f7bb20cd640 1 --2- 172.21.15.70:0/2815337314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7bac102d30 0x7f7bac100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:07.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.357+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2815337314 >> 172.21.15.70:0/2815337314 conn(0x7f7bac0fc7d0 msgr2=0x7f7bac105ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:07.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.357+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2815337314 shutdown_connections 2024-09-12T01:50:07.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:07.357+0000 7f7bb20cd640 1 -- 172.21.15.70:0/2815337314 wait complete. 2024-09-12T01:50:07.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:07 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] up:active 2024-09-12T01:50:07.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:07 smithi070 ceph-mon[31177]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T01:50:07.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:07 smithi070 ceph-mon[31177]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T01:50:07.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:07 smithi070 ceph-mon[31177]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T01:50:07.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:07 smithi070 ceph-mon[31177]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T01:50:07.644 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:07 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2815337314' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T01:50:07.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:07 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] up:active 2024-09-12T01:50:07.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:07 smithi191 ceph-mon[35770]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T01:50:07.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:07 smithi191 ceph-mon[35770]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T01:50:07.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:07 smithi191 ceph-mon[35770]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T01:50:07.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:07 smithi191 ceph-mon[35770]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T01:50:07.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:07 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2815337314' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T01:50:07.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:07 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] up:active 2024-09-12T01:50:07.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:07 smithi152 ceph-mon[35055]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T01:50:07.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:07 smithi152 ceph-mon[35055]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T01:50:07.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:07 smithi152 ceph-mon[35055]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-12T01:50:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:07 smithi152 ceph-mon[35055]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-12T01:50:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:07 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2815337314' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T01:50:07.980 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T01:50:08.230 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:08.512 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:50:08 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b[65045]: 2024-09-12T01:50:08.209+0000 7f9c6f4b1640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-12T01:50:08.513 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:50:08 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b[65045]: 2024-09-12T01:50:08.209+0000 7f9c6f4b1640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-12T01:50:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:08 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2815337314' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T01:50:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:08 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] up:active 2024-09-12T01:50:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:08 smithi152 ceph-mon[35055]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T01:50:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:08 smithi152 ceph-mon[35055]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-12T01:50:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:08 smithi152 ceph-mon[35055]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-12T01:50:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:08 smithi152 ceph-mon[35055]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-12T01:50:08.513 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:08 smithi152 ceph-mon[35055]: pgmap v274: 97 pgs: 97 active+clean; 581 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-12T01:50:08.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:08 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2815337314' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T01:50:08.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:08 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] up:active 2024-09-12T01:50:08.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:08 smithi070 ceph-mon[31177]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T01:50:08.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:08 smithi070 ceph-mon[31177]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-12T01:50:08.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:08 smithi070 ceph-mon[31177]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-12T01:50:08.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:08 smithi070 ceph-mon[31177]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-12T01:50:08.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:08 smithi070 ceph-mon[31177]: pgmap v274: 97 pgs: 97 active+clean; 581 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-12T01:50:08.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:08 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2815337314' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T01:50:08.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:08 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] up:active 2024-09-12T01:50:08.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:08 smithi191 ceph-mon[35770]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T01:50:08.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:08 smithi191 ceph-mon[35770]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-12T01:50:08.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:08 smithi191 ceph-mon[35770]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-12T01:50:08.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:08 smithi191 ceph-mon[35770]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-12T01:50:08.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:08 smithi191 ceph-mon[35770]: pgmap v274: 97 pgs: 97 active+clean; 581 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-12T01:50:08.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.688+0000 7f407d9d4640 1 -- 172.21.15.70:0/1037772516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4078102570 msgr2=0x7f40781029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:08.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.688+0000 7f407d9d4640 1 --2- 172.21.15.70:0/1037772516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4078102570 0x7f40781029b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f406c009900 tx=0x7f406c02a480 comp rx=0 tx=0).stop 2024-09-12T01:50:08.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.688+0000 7f407d9d4640 1 -- 172.21.15.70:0/1037772516 shutdown_connections 2024-09-12T01:50:08.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.688+0000 7f407d9d4640 1 --2- 172.21.15.70:0/1037772516 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4078102ef0 0x7f407810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:08.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.688+0000 7f407d9d4640 1 --2- 172.21.15.70:0/1037772516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4078102570 0x7f40781029b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:08.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.688+0000 7f407d9d4640 1 --2- 172.21.15.70:0/1037772516 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4078100e20 0x7f4078101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:08.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.688+0000 7f407d9d4640 1 -- 172.21.15.70:0/1037772516 >> 172.21.15.70:0/1037772516 conn(0x7f40780fc7d0 msgr2=0x7f40780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:08.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.688+0000 7f407d9d4640 1 -- 172.21.15.70:0/1037772516 shutdown_connections 2024-09-12T01:50:08.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.688+0000 7f407d9d4640 1 -- 172.21.15.70:0/1037772516 wait complete. 2024-09-12T01:50:08.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.689+0000 7f407d9d4640 1 Processor -- start 2024-09-12T01:50:08.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.689+0000 7f407d9d4640 1 -- start start 2024-09-12T01:50:08.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.689+0000 7f407d9d4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4078100e20 0x7f40781986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:08.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.689+0000 7f407d9d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4078102570 0x7f4078198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:08.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.689+0000 7f407d9d4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4078102ef0 0x7f407819cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:08.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.689+0000 7f407d9d4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4078112260 con 0x7f4078100e20 2024-09-12T01:50:08.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.689+0000 7f407d9d4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f40781120e0 con 0x7f4078102570 2024-09-12T01:50:08.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.689+0000 7f407d9d4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f40781123e0 con 0x7f4078102ef0 2024-09-12T01:50:08.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.689+0000 7f4076ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4078100e20 0x7f40781986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f4076ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4078100e20 0x7f40781986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48738/0 (socket says 172.21.15.70:48738) 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f4076ffd640 1 -- 172.21.15.70:0/3734164324 learned_addr learned my addr 172.21.15.70:0/3734164324 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f40777fe640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4078102ef0 0x7f407819cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f40767fc640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4078102570 0x7f4078198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f4076ffd640 1 -- 172.21.15.70:0/3734164324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4078102ef0 msgr2=0x7f407819cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f4076ffd640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4078102ef0 0x7f407819cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f4076ffd640 1 -- 172.21.15.70:0/3734164324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4078102570 msgr2=0x7f4078198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f4076ffd640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4078102570 0x7f4078198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f4076ffd640 1 -- 172.21.15.70:0/3734164324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407819d650 con 0x7f4078100e20 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f4076ffd640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4078100e20 0x7f40781986a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f406800ba50 tx=0x7f406800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f407c9d2640 1 -- 172.21.15.70:0/3734164324 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068019070 con 0x7f4078100e20 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f407d9d4640 1 -- 172.21.15.70:0/3734164324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407819d940 con 0x7f4078100e20 2024-09-12T01:50:08.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f407c9d2640 1 -- 172.21.15.70:0/3734164324 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f406800cbe0 con 0x7f4078100e20 2024-09-12T01:50:08.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f407c9d2640 1 -- 172.21.15.70:0/3734164324 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068007770 con 0x7f4078100e20 2024-09-12T01:50:08.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.690+0000 7f407d9d4640 1 -- 172.21.15.70:0/3734164324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40781a5220 con 0x7f4078100e20 2024-09-12T01:50:08.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.691+0000 7f407d9d4640 1 -- 172.21.15.70:0/3734164324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4078101200 con 0x7f4078100e20 2024-09-12T01:50:08.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.693+0000 7f407c9d2640 1 -- 172.21.15.70:0/3734164324 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f406801c070 con 0x7f4078100e20 2024-09-12T01:50:08.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.694+0000 7f407c9d2640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f40600a2b80 0x7f40600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:08.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.694+0000 7f40767fc640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f40600a2b80 0x7f40600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:08.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.694+0000 7f407c9d2640 1 -- 172.21.15.70:0/3734164324 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f40680cea60 con 0x7f4078100e20 2024-09-12T01:50:08.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.694+0000 7f40767fc640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f40600a2b80 0x7f40600a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f40780fec10 tx=0x7f406c005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:08.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.697+0000 7f407c9d2640 1 -- 172.21.15.70:0/3734164324 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f406809bb10 con 0x7f4078100e20 2024-09-12T01:50:08.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:08.900+0000 7f407d9d4640 1 -- 172.21.15.70:0/3734164324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f40781a54b0 con 0x7f4078100e20 2024-09-12T01:50:09.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.372+0000 7f407c9d2640 1 -- 172.21.15.70:0/3734164324 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f406809b410 con 0x7f4078100e20 2024-09-12T01:50:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.374+0000 7f407d9d4640 1 -- 172.21.15.70:0/3734164324 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f40600a2b80 msgr2=0x7f40600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.374+0000 7f407d9d4640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f40600a2b80 0x7f40600a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f40780fec10 tx=0x7f406c005a20 comp rx=0 tx=0).stop 2024-09-12T01:50:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.374+0000 7f407d9d4640 1 -- 172.21.15.70:0/3734164324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4078100e20 msgr2=0x7f40781986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.374+0000 7f407d9d4640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4078100e20 0x7f40781986a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f406800ba50 tx=0x7f406800bf10 comp rx=0 tx=0).stop 2024-09-12T01:50:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.374+0000 7f407d9d4640 1 -- 172.21.15.70:0/3734164324 shutdown_connections 2024-09-12T01:50:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.374+0000 7f407d9d4640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f40600a2b80 0x7f40600a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.374+0000 7f407d9d4640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4078102ef0 0x7f407819cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.374+0000 7f407d9d4640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4078102570 0x7f4078198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.374+0000 7f407d9d4640 1 --2- 172.21.15.70:0/3734164324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4078100e20 0x7f40781986a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.374+0000 7f407d9d4640 1 -- 172.21.15.70:0/3734164324 >> 172.21.15.70:0/3734164324 conn(0x7f40780fc7d0 msgr2=0x7f4078106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.374+0000 7f407d9d4640 1 -- 172.21.15.70:0/3734164324 shutdown_connections 2024-09-12T01:50:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:09.375+0000 7f407d9d4640 1 -- 172.21.15.70:0/3734164324 wait complete. 2024-09-12T01:50:09.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:09 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] up:active 2024-09-12T01:50:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:09 smithi191 ceph-mon[35770]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T01:50:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:09 smithi191 ceph-mon[35770]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T01:50:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:09 smithi191 ceph-mon[35770]: Cluster is now healthy 2024-09-12T01:50:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:09 smithi191 ceph-mon[35770]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-12T01:50:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:09 smithi191 ceph-mon[35770]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T01:50:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:09 smithi191 ceph-mon[35770]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-12T01:50:09.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:09 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3734164324' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:50:09.700 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:09 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] up:active 2024-09-12T01:50:09.700 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:09 smithi070 ceph-mon[31177]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T01:50:09.700 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:09 smithi070 ceph-mon[31177]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T01:50:09.700 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:09 smithi070 ceph-mon[31177]: Cluster is now healthy 2024-09-12T01:50:09.700 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:09 smithi070 ceph-mon[31177]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-12T01:50:09.700 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:09 smithi070 ceph-mon[31177]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T01:50:09.700 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:09 smithi070 ceph-mon[31177]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-12T01:50:09.700 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:09 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3734164324' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:50:09.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:09 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] up:active 2024-09-12T01:50:09.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:09 smithi152 ceph-mon[35055]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T01:50:09.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:09 smithi152 ceph-mon[35055]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T01:50:09.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:09 smithi152 ceph-mon[35055]: Cluster is now healthy 2024-09-12T01:50:09.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:09 smithi152 ceph-mon[35055]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-12T01:50:09.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:09 smithi152 ceph-mon[35055]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T01:50:09.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:09 smithi152 ceph-mon[35055]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-12T01:50:09.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:09 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3734164324' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T01:50:10.041 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-12T01:50:10.041 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T01:50:10.289 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:10.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:10 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3734164324' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T01:50:10.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:10 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] up:active 2024-09-12T01:50:10.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:10 smithi070 ceph-mon[31177]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T01:50:10.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:10 smithi070 ceph-mon[31177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:50:10.671 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:10 smithi070 ceph-mon[31177]: pgmap v275: 97 pgs: 97 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 12 op/s 2024-09-12T01:50:10.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:10 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3734164324' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T01:50:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:10 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] up:active 2024-09-12T01:50:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:10 smithi191 ceph-mon[35770]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T01:50:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:10 smithi191 ceph-mon[35770]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:50:10.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:10 smithi191 ceph-mon[35770]: pgmap v275: 97 pgs: 97 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 12 op/s 2024-09-12T01:50:10.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.753+0000 7f2ef7ada640 1 -- 172.21.15.70:0/2316169463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ef0106f10 msgr2=0x7f2ef010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:10.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.753+0000 7f2ef7ada640 1 --2- 172.21.15.70:0/2316169463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ef0106f10 0x7f2ef010ea90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009ca0 tx=0x7f2ee802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:50:10.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.753+0000 7f2ef7ada640 1 -- 172.21.15.70:0/2316169463 shutdown_connections 2024-09-12T01:50:10.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.753+0000 7f2ef7ada640 1 --2- 172.21.15.70:0/2316169463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ef0106f10 0x7f2ef010ea90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:10.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.753+0000 7f2ef7ada640 1 --2- 172.21.15.70:0/2316169463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef0102790 0x7f2ef01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:10.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.753+0000 7f2ef7ada640 1 --2- 172.21.15.70:0/2316169463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ef0101de0 0x7f2ef01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:10.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.753+0000 7f2ef7ada640 1 -- 172.21.15.70:0/2316169463 >> 172.21.15.70:0/2316169463 conn(0x7f2ef00fd8c0 msgr2=0x7f2ef00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:10.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.753+0000 7f2ef7ada640 1 -- 172.21.15.70:0/2316169463 shutdown_connections 2024-09-12T01:50:10.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.753+0000 7f2ef7ada640 1 -- 172.21.15.70:0/2316169463 wait complete. 2024-09-12T01:50:10.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef7ada640 1 Processor -- start 2024-09-12T01:50:10.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef7ada640 1 -- start start 2024-09-12T01:50:10.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef7ada640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ef0101de0 0x7f2ef01a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:10.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef7ada640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ef0102790 0x7f2ef01a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:10.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef7ada640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef0106f10 0x7f2ef019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:10.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef7ada640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef0112150 con 0x7f2ef0102790 2024-09-12T01:50:10.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef7ada640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef0111fd0 con 0x7f2ef0106f10 2024-09-12T01:50:10.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef7ada640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef01122d0 con 0x7f2ef0101de0 2024-09-12T01:50:10.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef5075640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ef0102790 0x7f2ef01a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:10.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef5075640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ef0102790 0x7f2ef01a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40208/0 (socket says 172.21.15.70:40208) 2024-09-12T01:50:10.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef5075640 1 -- 172.21.15.70:0/1653428373 learned_addr learned my addr 172.21.15.70:0/1653428373 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:10.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef6077640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef0106f10 0x7f2ef019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:10.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef5075640 1 -- 172.21.15.70:0/1653428373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ef0101de0 msgr2=0x7f2ef01a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:10.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef5075640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ef0101de0 0x7f2ef01a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:10.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef5075640 1 -- 172.21.15.70:0/1653428373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef0106f10 msgr2=0x7f2ef019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:10.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef5075640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef0106f10 0x7f2ef019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:10.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef5075640 1 -- 172.21.15.70:0/1653428373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef019af10 con 0x7f2ef0102790 2024-09-12T01:50:10.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.754+0000 7f2ef5075640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ef0102790 0x7f2ef01a0ac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000b4a0 tx=0x7f2ee000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:10.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.755+0000 7f2ee6ffd640 1 -- 172.21.15.70:0/1653428373 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0014070 con 0x7f2ef0102790 2024-09-12T01:50:10.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.755+0000 7f2ee6ffd640 1 -- 172.21.15.70:0/1653428373 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2ee0010b10 con 0x7f2ef0102790 2024-09-12T01:50:10.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.755+0000 7f2ee6ffd640 1 -- 172.21.15.70:0/1653428373 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0017d60 con 0x7f2ef0102790 2024-09-12T01:50:10.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.755+0000 7f2ef7ada640 1 -- 172.21.15.70:0/1653428373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef019b200 con 0x7f2ef0102790 2024-09-12T01:50:10.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.755+0000 7f2ef7ada640 1 -- 172.21.15.70:0/1653428373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef01a7570 con 0x7f2ef0102790 2024-09-12T01:50:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.756+0000 7f2ef7ada640 1 -- 172.21.15.70:0/1653428373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef0102240 con 0x7f2ef0102790 2024-09-12T01:50:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.757+0000 7f2ee6ffd640 1 -- 172.21.15.70:0/1653428373 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2ee0017070 con 0x7f2ef0102790 2024-09-12T01:50:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.758+0000 7f2ee6ffd640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2edc0a2c00 0x7f2edc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.758+0000 7f2ef5876640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2edc0a2c00 0x7f2edc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:10.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.758+0000 7f2ee6ffd640 1 -- 172.21.15.70:0/1653428373 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f2ee00ce1f0 con 0x7f2ef0102790 2024-09-12T01:50:10.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.758+0000 7f2ef5876640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2edc0a2c00 0x7f2edc0a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009710 tx=0x7f2eec006c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:10.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.762+0000 7f2ee6ffd640 1 -- 172.21.15.70:0/1653428373 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ee009b2a0 con 0x7f2ef0102790 2024-09-12T01:50:10.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:10 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3734164324' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T01:50:10.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:10 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] up:active 2024-09-12T01:50:10.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:10 smithi152 ceph-mon[35055]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T01:50:10.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:10 smithi152 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:50:10.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:10 smithi152 ceph-mon[35055]: pgmap v275: 97 pgs: 97 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 12 op/s 2024-09-12T01:50:10.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.949+0000 7f2ef7ada640 1 -- 172.21.15.70:0/1653428373 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2ef0075430 con 0x7f2edc0a2c00 2024-09-12T01:50:10.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.978+0000 7f2ee6ffd640 1 -- 172.21.15.70:0/1653428373 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2ef0075430 con 0x7f2edc0a2c00 2024-09-12T01:50:10.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.980+0000 7f2ef7ada640 1 -- 172.21.15.70:0/1653428373 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2edc0a2c00 msgr2=0x7f2edc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:10.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.980+0000 7f2ef7ada640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2edc0a2c00 0x7f2edc0a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009710 tx=0x7f2eec006c90 comp rx=0 tx=0).stop 2024-09-12T01:50:10.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.981+0000 7f2ef7ada640 1 -- 172.21.15.70:0/1653428373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ef0102790 msgr2=0x7f2ef01a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:10.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.981+0000 7f2ef7ada640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ef0102790 0x7f2ef01a0ac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000b4a0 tx=0x7f2ee000b960 comp rx=0 tx=0).stop 2024-09-12T01:50:10.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.981+0000 7f2ef7ada640 1 -- 172.21.15.70:0/1653428373 shutdown_connections 2024-09-12T01:50:10.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.981+0000 7f2ef7ada640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2edc0a2c00 0x7f2edc0a50c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.981+0000 7f2ef7ada640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ef0106f10 0x7f2ef019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.981+0000 7f2ef7ada640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ef0102790 0x7f2ef01a0ac0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.981+0000 7f2ef7ada640 1 --2- 172.21.15.70:0/1653428373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ef0101de0 0x7f2ef01a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.981+0000 7f2ef7ada640 1 -- 172.21.15.70:0/1653428373 >> 172.21.15.70:0/1653428373 conn(0x7f2ef00fd8c0 msgr2=0x7f2ef00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.981+0000 7f2ef7ada640 1 -- 172.21.15.70:0/1653428373 shutdown_connections 2024-09-12T01:50:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:10.981+0000 7f2ef7ada640 1 -- 172.21.15.70:0/1653428373 wait complete. 2024-09-12T01:50:11.269 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:50:10 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:50:10.954+0000 7f27427d4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:50:11.269 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:50:10 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:50:10.954+0000 7f27427d4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:50:11.269 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:50:10 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:50:10.954+0000 7f27427d4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:50:11.269 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:50:10 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:50:10.954+0000 7f27427d4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:50:11.269 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:50:10 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:50:10.954+0000 7f27427d4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T01:50:11.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T01:50:11.846 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:12.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.270+0000 7f58b8f2b640 1 -- 172.21.15.70:0/1308653115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b410c180 msgr2=0x7f58b410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.270+0000 7f58b8f2b640 1 --2- 172.21.15.70:0/1308653115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b410c180 0x7f58b410e600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009ca0 tx=0x7f58ac02a950 comp rx=0 tx=0).stop 2024-09-12T01:50:12.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.270+0000 7f58b8f2b640 1 -- 172.21.15.70:0/1308653115 shutdown_connections 2024-09-12T01:50:12.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.270+0000 7f58b8f2b640 1 --2- 172.21.15.70:0/1308653115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b410c180 0x7f58b410e600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.270+0000 7f58b8f2b640 1 --2- 172.21.15.70:0/1308653115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58b41036c0 0x7f58b410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.270+0000 7f58b8f2b640 1 --2- 172.21.15.70:0/1308653115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58b4102da0 0x7f58b4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.270+0000 7f58b8f2b640 1 -- 172.21.15.70:0/1308653115 >> 172.21.15.70:0/1308653115 conn(0x7f58b40fc7a0 msgr2=0x7f58b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.270+0000 7f58b8f2b640 1 -- 172.21.15.70:0/1308653115 shutdown_connections 2024-09-12T01:50:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.270+0000 7f58b8f2b640 1 -- 172.21.15.70:0/1308653115 wait complete. 2024-09-12T01:50:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b8f2b640 1 Processor -- start 2024-09-12T01:50:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b8f2b640 1 -- start start 2024-09-12T01:50:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b8f2b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4102da0 0x7f58b41984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b8f2b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58b41036c0 0x7f58b4198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b8f2b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58b410c180 0x7f58b419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b8f2b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4112080 con 0x7f58b4102da0 2024-09-12T01:50:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b8f2b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4111f00 con 0x7f58b410c180 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b8f2b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4112200 con 0x7f58b41036c0 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4102da0 0x7f58b41984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4102da0 0x7f58b41984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40232/0 (socket says 172.21.15.70:40232) 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b259c640 1 -- 172.21.15.70:0/48606927 learned_addr learned my addr 172.21.15.70:0/48606927 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b2d9d640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58b410c180 0x7f58b419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58abfff640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58b41036c0 0x7f58b4198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.271+0000 7f58b259c640 1 -- 172.21.15.70:0/48606927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58b41036c0 msgr2=0x7f58b4198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.272+0000 7f58b259c640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58b41036c0 0x7f58b4198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.272+0000 7f58b259c640 1 -- 172.21.15.70:0/48606927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58b410c180 msgr2=0x7f58b419cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.272+0000 7f58b259c640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58b410c180 0x7f58b419cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.272+0000 7f58b259c640 1 -- 172.21.15.70:0/48606927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b419d490 con 0x7f58b4102da0 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.272+0000 7f58b2d9d640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58b410c180 0x7f58b419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:12.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.272+0000 7f58b259c640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4102da0 0x7f58b41984e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f58a400c890 tx=0x7f58a400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:12.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.272+0000 7f58ab7fe640 1 -- 172.21.15.70:0/48606927 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4004220 con 0x7f58b4102da0 2024-09-12T01:50:12.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.272+0000 7f58b8f2b640 1 -- 172.21.15.70:0/48606927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b419d780 con 0x7f58b4102da0 2024-09-12T01:50:12.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.272+0000 7f58ab7fe640 1 -- 172.21.15.70:0/48606927 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f58a40043c0 con 0x7f58b4102da0 2024-09-12T01:50:12.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.272+0000 7f58ab7fe640 1 -- 172.21.15.70:0/48606927 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4004b10 con 0x7f58b4102da0 2024-09-12T01:50:12.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.272+0000 7f58b8f2b640 1 -- 172.21.15.70:0/48606927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b41a5060 con 0x7f58b4102da0 2024-09-12T01:50:12.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.273+0000 7f58b8f2b640 1 -- 172.21.15.70:0/48606927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b4103180 con 0x7f58b4102da0 2024-09-12T01:50:12.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.274+0000 7f58ab7fe640 1 -- 172.21.15.70:0/48606927 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f58a40051b0 con 0x7f58b4102da0 2024-09-12T01:50:12.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.275+0000 7f58ab7fe640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f58a00a2c10 0x7f58a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.275+0000 7f58abfff640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f58a00a2c10 0x7f58a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.275+0000 7f58ab7fe640 1 -- 172.21.15.70:0/48606927 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f58a40cf150 con 0x7f58b4102da0 2024-09-12T01:50:12.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.275+0000 7f58abfff640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f58a00a2c10 0x7f58a00a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f58b40fece0 tx=0x7f589c005be0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:12.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.279+0000 7f58ab7fe640 1 -- 172.21.15.70:0/48606927 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f58a4014030 con 0x7f58b4102da0 2024-09-12T01:50:12.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.471+0000 7f58b8f2b640 1 -- 172.21.15.70:0/48606927 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f58b40fe480 con 0x7f58a00a2c10 2024-09-12T01:50:12.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.493+0000 7f58ab7fe640 1 -- 172.21.15.70:0/48606927 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f58b40fe480 con 0x7f58a00a2c10 2024-09-12T01:50:12.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.496+0000 7f58b8f2b640 1 -- 172.21.15.70:0/48606927 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f58a00a2c10 msgr2=0x7f58a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.496+0000 7f58b8f2b640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f58a00a2c10 0x7f58a00a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f58b40fece0 tx=0x7f589c005be0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.496+0000 7f58b8f2b640 1 -- 172.21.15.70:0/48606927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4102da0 msgr2=0x7f58b41984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.496+0000 7f58b8f2b640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4102da0 0x7f58b41984e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f58a400c890 tx=0x7f58a400cd50 comp rx=0 tx=0).stop 2024-09-12T01:50:12.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.496+0000 7f58b8f2b640 1 -- 172.21.15.70:0/48606927 shutdown_connections 2024-09-12T01:50:12.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.496+0000 7f58b8f2b640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f58a00a2c10 0x7f58a00a50d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.496+0000 7f58b8f2b640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58b410c180 0x7f58b419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.496+0000 7f58b8f2b640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f58b41036c0 0x7f58b4198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.496+0000 7f58b8f2b640 1 --2- 172.21.15.70:0/48606927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4102da0 0x7f58b41984e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.496+0000 7f58b8f2b640 1 -- 172.21.15.70:0/48606927 >> 172.21.15.70:0/48606927 conn(0x7f58b40fc7a0 msgr2=0x7f58b40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:12.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.496+0000 7f58b8f2b640 1 -- 172.21.15.70:0/48606927 shutdown_connections 2024-09-12T01:50:12.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:12.496+0000 7f58b8f2b640 1 -- 172.21.15.70:0/48606927 wait complete. 2024-09-12T01:50:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:12 smithi152 ceph-mon[35055]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:12 smithi152 ceph-mon[35055]: pgmap v276: 97 pgs: 97 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-09-12T01:50:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:12 smithi152 ceph-mon[35055]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-12T01:50:12.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:12 smithi191 ceph-mon[35770]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:12 smithi191 ceph-mon[35770]: pgmap v276: 97 pgs: 97 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-09-12T01:50:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:12 smithi191 ceph-mon[35770]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-12T01:50:12.962 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:12 smithi070 ceph-mon[31177]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:12.962 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:12 smithi070 ceph-mon[31177]: pgmap v276: 97 pgs: 97 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-09-12T01:50:12.962 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:12 smithi070 ceph-mon[31177]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-12T01:50:13.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T01:50:13.262 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:50:13 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b[65045]: 2024-09-12T01:50:13.209+0000 7f9c6f4b1640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-12T01:50:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:13.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:13 smithi070 ceph-mon[31177]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:13.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.796+0000 7f529d067640 1 -- 172.21.15.70:0/2711550283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5298100ca0 msgr2=0x7f5298106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:13.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.796+0000 7f529d067640 1 --2- 172.21.15.70:0/2711550283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5298100ca0 0x7f5298106840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f528c009930 tx=0x7f528c02a420 comp rx=0 tx=0).stop 2024-09-12T01:50:13.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.796+0000 7f529d067640 1 -- 172.21.15.70:0/2711550283 shutdown_connections 2024-09-12T01:50:13.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.796+0000 7f529d067640 1 --2- 172.21.15.70:0/2711550283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5298106f50 0x7f529810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.796+0000 7f529d067640 1 --2- 172.21.15.70:0/2711550283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5298100ca0 0x7f5298106840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.796+0000 7f529d067640 1 --2- 172.21.15.70:0/2711550283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52981002f0 0x7f52981006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.796+0000 7f529d067640 1 -- 172.21.15.70:0/2711550283 >> 172.21.15.70:0/2711550283 conn(0x7f5298077210 msgr2=0x7f52980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:13.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.796+0000 7f529d067640 1 -- 172.21.15.70:0/2711550283 shutdown_connections 2024-09-12T01:50:13.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.796+0000 7f529d067640 1 -- 172.21.15.70:0/2711550283 wait complete. 2024-09-12T01:50:13.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.797+0000 7f529d067640 1 Processor -- start 2024-09-12T01:50:13.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.797+0000 7f529d067640 1 -- start start 2024-09-12T01:50:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529d067640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52981002f0 0x7f52981a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529d067640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5298100ca0 0x7f52981a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529d067640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5298106f50 0x7f529819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529d067640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5298112120 con 0x7f5298106f50 2024-09-12T01:50:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529d067640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5298111fa0 con 0x7f52981002f0 2024-09-12T01:50:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529d067640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f52981122a0 con 0x7f5298100ca0 2024-09-12T01:50:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5298106f50 0x7f529819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5298106f50 0x7f529819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40250/0 (socket says 172.21.15.70:40250) 2024-09-12T01:50:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529759e640 1 -- 172.21.15.70:0/3603896988 learned_addr learned my addr 172.21.15.70:0/3603896988 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529659c640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5298100ca0 0x7f52981a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f5296d9d640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52981002f0 0x7f52981a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529759e640 1 -- 172.21.15.70:0/3603896988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5298100ca0 msgr2=0x7f52981a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529759e640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5298100ca0 0x7f52981a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529759e640 1 -- 172.21.15.70:0/3603896988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52981002f0 msgr2=0x7f52981a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529759e640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52981002f0 0x7f52981a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529759e640 1 -- 172.21.15.70:0/3603896988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529819ad30 con 0x7f5298106f50 2024-09-12T01:50:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f5296d9d640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52981002f0 0x7f52981a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529759e640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5298106f50 0x7f529819a600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f529000b970 tx=0x7f529000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f527ffff640 1 -- 172.21.15.70:0/3603896988 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290019070 con 0x7f5298106f50 2024-09-12T01:50:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529d067640 1 -- 172.21.15.70:0/3603896988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529819b020 con 0x7f5298106f50 2024-09-12T01:50:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f527ffff640 1 -- 172.21.15.70:0/3603896988 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f529000cb40 con 0x7f5298106f50 2024-09-12T01:50:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f527ffff640 1 -- 172.21.15.70:0/3603896988 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290007700 con 0x7f5298106f50 2024-09-12T01:50:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.798+0000 7f529d067640 1 -- 172.21.15.70:0/3603896988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52981a7310 con 0x7f5298106f50 2024-09-12T01:50:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.800+0000 7f529d067640 1 -- 172.21.15.70:0/3603896988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52981006d0 con 0x7f5298106f50 2024-09-12T01:50:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.801+0000 7f527ffff640 1 -- 172.21.15.70:0/3603896988 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f529001c070 con 0x7f5298106f50 2024-09-12T01:50:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.801+0000 7f527ffff640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f52800a2c10 0x7f52800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.801+0000 7f5296d9d640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f52800a2c10 0x7f52800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.801+0000 7f527ffff640 1 -- 172.21.15.70:0/3603896988 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f52900ce490 con 0x7f5298106f50 2024-09-12T01:50:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.802+0000 7f5296d9d640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f52800a2c10 0x7f52800a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f52880058c0 tx=0x7f5288005ec0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:13.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:13.805+0000 7f527ffff640 1 -- 172.21.15.70:0/3603896988 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f529009af00 con 0x7f5298106f50 2024-09-12T01:50:13.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:13 smithi191 ceph-mon[35770]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:14.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.001+0000 7f529d067640 1 -- 172.21.15.70:0/3603896988 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f529810de50 con 0x7f52800a2c10 2024-09-12T01:50:14.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.006+0000 7f527ffff640 1 -- 172.21.15.70:0/3603896988 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f529810de50 con 0x7f52800a2c10 2024-09-12T01:50:14.006 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/qa/sv_0/83427a08-3706-439e-9982-7d31be218402 2024-09-12T01:50:14.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.008+0000 7f529d067640 1 -- 172.21.15.70:0/3603896988 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f52800a2c10 msgr2=0x7f52800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:14.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.008+0000 7f529d067640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f52800a2c10 0x7f52800a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f52880058c0 tx=0x7f5288005ec0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.008+0000 7f529d067640 1 -- 172.21.15.70:0/3603896988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5298106f50 msgr2=0x7f529819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.008+0000 7f529d067640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5298106f50 0x7f529819a600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f529000b970 tx=0x7f529000be30 comp rx=0 tx=0).stop 2024-09-12T01:50:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.008+0000 7f529d067640 1 -- 172.21.15.70:0/3603896988 shutdown_connections 2024-09-12T01:50:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.008+0000 7f529d067640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f52800a2c10 0x7f52800a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.008+0000 7f529d067640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5298106f50 0x7f529819a600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.008+0000 7f529d067640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5298100ca0 0x7f52981a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.008+0000 7f529d067640 1 --2- 172.21.15.70:0/3603896988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52981002f0 0x7f52981a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.008+0000 7f529d067640 1 -- 172.21.15.70:0/3603896988 >> 172.21.15.70:0/3603896988 conn(0x7f5298077210 msgr2=0x7f5298105760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.008+0000 7f529d067640 1 -- 172.21.15.70:0/3603896988 shutdown_connections 2024-09-12T01:50:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:14.008+0000 7f529d067640 1 -- 172.21.15.70:0/3603896988 wait complete. 2024-09-12T01:50:14.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:13 smithi152 ceph-mon[35055]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:14.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T01:50:14.795 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:14.903 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:14 smithi191 ceph-mon[35770]: pgmap v277: 97 pgs: 97 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 17 op/s 2024-09-12T01:50:14.916 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:14 smithi070 ceph-mon[31177]: pgmap v277: 97 pgs: 97 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 17 op/s 2024-09-12T01:50:15.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:14 smithi152 ceph-mon[35055]: pgmap v277: 97 pgs: 97 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 17 op/s 2024-09-12T01:50:15.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.304+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/2402593080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f28106a80 msgr2=0x7f1f28106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:15.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.304+0000 7f1f2c8b5640 1 --2- 172.21.15.70:0/2402593080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f28106a80 0x7f1f28106e60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009cd0 tx=0x7f1f1802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:50:15.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.304+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/2402593080 shutdown_connections 2024-09-12T01:50:15.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.304+0000 7f1f2c8b5640 1 --2- 172.21.15.70:0/2402593080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f28101420 0x7f1f2810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.304+0000 7f1f2c8b5640 1 --2- 172.21.15.70:0/2402593080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f28100a80 0x7f1f28100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.304+0000 7f1f2c8b5640 1 --2- 172.21.15.70:0/2402593080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f28106a80 0x7f1f28106e60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.304+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/2402593080 >> 172.21.15.70:0/2402593080 conn(0x7f1f280fc7a0 msgr2=0x7f1f280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.304+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/2402593080 shutdown_connections 2024-09-12T01:50:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.305+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/2402593080 wait complete. 2024-09-12T01:50:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.305+0000 7f1f2c8b5640 1 Processor -- start 2024-09-12T01:50:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.305+0000 7f1f2c8b5640 1 -- start start 2024-09-12T01:50:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.305+0000 7f1f2c8b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f28100a80 0x7f1f28198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.305+0000 7f1f2c8b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f28101420 0x7f1f28198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.305+0000 7f1f2c8b5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f28106a80 0x7f1f2819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.305+0000 7f1f2c8b5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1f28112080 con 0x7f1f28100a80 2024-09-12T01:50:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.305+0000 7f1f2c8b5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1f28111f00 con 0x7f1f28101420 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.305+0000 7f1f2c8b5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1f28112200 con 0x7f1f28106a80 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f2659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f28100a80 0x7f1f28198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f2659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f28100a80 0x7f1f28198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40258/0 (socket says 172.21.15.70:40258) 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f2659c640 1 -- 172.21.15.70:0/4287999291 learned_addr learned my addr 172.21.15.70:0/4287999291 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f26d9d640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f28106a80 0x7f1f2819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f25d9b640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f28101420 0x7f1f28198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f2659c640 1 -- 172.21.15.70:0/4287999291 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f28106a80 msgr2=0x7f1f2819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f2659c640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f28106a80 0x7f1f2819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f2659c640 1 -- 172.21.15.70:0/4287999291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f28101420 msgr2=0x7f1f28198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f2659c640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f28101420 0x7f1f28198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f2659c640 1 -- 172.21.15.70:0/4287999291 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2819d3f0 con 0x7f1f28100a80 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f25d9b640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f28101420 0x7f1f28198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f2659c640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f28100a80 0x7f1f28198440 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1f1802ae00 tx=0x7f1f18032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f177fe640 1 -- 172.21.15.70:0/4287999291 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18004240 con 0x7f1f28100a80 2024-09-12T01:50:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f177fe640 1 -- 172.21.15.70:0/4287999291 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f180305a0 con 0x7f1f28100a80 2024-09-12T01:50:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/4287999291 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2819d680 con 0x7f1f28100a80 2024-09-12T01:50:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f177fe640 1 -- 172.21.15.70:0/4287999291 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f180466e0 con 0x7f1f28100a80 2024-09-12T01:50:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.306+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/4287999291 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f281a4fc0 con 0x7f1f28100a80 2024-09-12T01:50:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.307+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/4287999291 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f281021c0 con 0x7f1f28100a80 2024-09-12T01:50:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.308+0000 7f1f177fe640 1 -- 172.21.15.70:0/4287999291 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1f18030b00 con 0x7f1f28100a80 2024-09-12T01:50:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.309+0000 7f1f177fe640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1f100a2c10 0x7f1f100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.309+0000 7f1f25d9b640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1f100a2c10 0x7f1f100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.309+0000 7f1f177fe640 1 -- 172.21.15.70:0/4287999291 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f1f1802e030 con 0x7f1f28100a80 2024-09-12T01:50:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.309+0000 7f1f25d9b640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1f100a2c10 0x7f1f100a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f280fec90 tx=0x7f1f1c005d90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.312+0000 7f1f177fe640 1 -- 172.21.15.70:0/4287999291 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1f1804b060 con 0x7f1f28100a80 2024-09-12T01:50:15.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.504+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/4287999291 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1f280fd420 con 0x7f1f100a2c10 2024-09-12T01:50:15.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.528+0000 7f1f177fe640 1 -- 172.21.15.70:0/4287999291 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1f280fd420 con 0x7f1f100a2c10 2024-09-12T01:50:15.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.530+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/4287999291 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1f100a2c10 msgr2=0x7f1f100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:15.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.530+0000 7f1f2c8b5640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1f100a2c10 0x7f1f100a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1f280fec90 tx=0x7f1f1c005d90 comp rx=0 tx=0).stop 2024-09-12T01:50:15.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.530+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/4287999291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f28100a80 msgr2=0x7f1f28198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:15.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.530+0000 7f1f2c8b5640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f28100a80 0x7f1f28198440 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1f1802ae00 tx=0x7f1f18032c00 comp rx=0 tx=0).stop 2024-09-12T01:50:15.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.530+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/4287999291 shutdown_connections 2024-09-12T01:50:15.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.530+0000 7f1f2c8b5640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1f100a2c10 0x7f1f100a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:15.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.530+0000 7f1f2c8b5640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f28106a80 0x7f1f2819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:15.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.530+0000 7f1f2c8b5640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f28101420 0x7f1f28198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:15.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.530+0000 7f1f2c8b5640 1 --2- 172.21.15.70:0/4287999291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f28100a80 0x7f1f28198440 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:15.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.530+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/4287999291 >> 172.21.15.70:0/4287999291 conn(0x7f1f280fc7a0 msgr2=0x7f1f280fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:15.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.530+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/4287999291 shutdown_connections 2024-09-12T01:50:15.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:15.530+0000 7f1f2c8b5640 1 -- 172.21.15.70:0/4287999291 wait complete. 2024-09-12T01:50:15.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:15 smithi070 ceph-mon[31177]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:15.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:15 smithi191 ceph-mon[35770]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:16.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:15 smithi152 ceph-mon[35055]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:16.128 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T01:50:16.376 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:16.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:16 smithi070 ceph-mon[31177]: pgmap v278: 97 pgs: 97 active+clean; 586 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.3 KiB/s wr, 19 op/s 2024-09-12T01:50:16.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:16 smithi070 ceph-mon[31177]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.821+0000 7f4a78ccb640 1 -- 172.21.15.70:0/834636053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a74106a80 msgr2=0x7f4a74106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.821+0000 7f4a78ccb640 1 --2- 172.21.15.70:0/834636053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a74106a80 0x7f4a74106e60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009930 tx=0x7f4a6402a420 comp rx=0 tx=0).stop 2024-09-12T01:50:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.821+0000 7f4a78ccb640 1 -- 172.21.15.70:0/834636053 shutdown_connections 2024-09-12T01:50:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.821+0000 7f4a78ccb640 1 --2- 172.21.15.70:0/834636053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a74101420 0x7f4a7410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.821+0000 7f4a78ccb640 1 --2- 172.21.15.70:0/834636053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a74100a80 0x7f4a74100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.821+0000 7f4a78ccb640 1 --2- 172.21.15.70:0/834636053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a74106a80 0x7f4a74106e60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.821+0000 7f4a78ccb640 1 -- 172.21.15.70:0/834636053 >> 172.21.15.70:0/834636053 conn(0x7f4a740fc7a0 msgr2=0x7f4a740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.821+0000 7f4a78ccb640 1 -- 172.21.15.70:0/834636053 shutdown_connections 2024-09-12T01:50:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.821+0000 7f4a78ccb640 1 -- 172.21.15.70:0/834636053 wait complete. 2024-09-12T01:50:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a78ccb640 1 Processor -- start 2024-09-12T01:50:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a78ccb640 1 -- start start 2024-09-12T01:50:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a78ccb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a74100a80 0x7f4a74198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a78ccb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a74101420 0x7f4a74198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a78ccb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a74106a80 0x7f4a7419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:16.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a78ccb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74111060 con 0x7f4a74106a80 2024-09-12T01:50:16.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a78ccb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74110ee0 con 0x7f4a74101420 2024-09-12T01:50:16.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a78ccb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4a741111e0 con 0x7f4a74100a80 2024-09-12T01:50:16.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a72d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a74106a80 0x7f4a7419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:16.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a72d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a74106a80 0x7f4a7419cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40272/0 (socket says 172.21.15.70:40272) 2024-09-12T01:50:16.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a72d9d640 1 -- 172.21.15.70:0/2071525474 learned_addr learned my addr 172.21.15.70:0/2071525474 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:16.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a6bfff640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a74101420 0x7f4a74198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:16.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a7259c640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a74100a80 0x7f4a74198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a72d9d640 1 -- 172.21.15.70:0/2071525474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a74100a80 msgr2=0x7f4a74198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a72d9d640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a74100a80 0x7f4a74198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a72d9d640 1 -- 172.21.15.70:0/2071525474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a74101420 msgr2=0x7f4a74198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a72d9d640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a74101420 0x7f4a74198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a72d9d640 1 -- 172.21.15.70:0/2071525474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7419d600 con 0x7f4a74106a80 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.822+0000 7f4a72d9d640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a74106a80 0x7f4a7419cf20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00b970 tx=0x7f4a6c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.823+0000 7f4a6b7fe640 1 -- 172.21.15.70:0/2071525474 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c019070 con 0x7f4a74106a80 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.823+0000 7f4a6b7fe640 1 -- 172.21.15.70:0/2071525474 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4a6c014440 con 0x7f4a74106a80 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.823+0000 7f4a78ccb640 1 -- 172.21.15.70:0/2071525474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7419d8f0 con 0x7f4a74106a80 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.823+0000 7f4a6b7fe640 1 -- 172.21.15.70:0/2071525474 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0075d0 con 0x7f4a74106a80 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.823+0000 7f4a78ccb640 1 -- 172.21.15.70:0/2071525474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a741a51d0 con 0x7f4a74106a80 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.824+0000 7f4a78ccb640 1 -- 172.21.15.70:0/2071525474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a74100f60 con 0x7f4a74106a80 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.825+0000 7f4a6b7fe640 1 -- 172.21.15.70:0/2071525474 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4a6c01c070 con 0x7f4a74106a80 2024-09-12T01:50:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.825+0000 7f4a6b7fe640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4a600a2c10 0x7f4a600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:16.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.826+0000 7f4a7259c640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4a600a2c10 0x7f4a600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:16.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.826+0000 7f4a6b7fe640 1 -- 172.21.15.70:0/2071525474 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f4a6c0ce850 con 0x7f4a74106a80 2024-09-12T01:50:16.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.826+0000 7f4a7259c640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4a600a2c10 0x7f4a600a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009900 tx=0x7f4a640058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:16.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:16.829+0000 7f4a6b7fe640 1 -- 172.21.15.70:0/2071525474 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a6c09b2c0 con 0x7f4a74106a80 2024-09-12T01:50:16.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:16 smithi191 ceph-mon[35770]: pgmap v278: 97 pgs: 97 active+clean; 586 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.3 KiB/s wr, 19 op/s 2024-09-12T01:50:16.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:16 smithi191 ceph-mon[35770]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:17.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:16 smithi152 ceph-mon[35055]: pgmap v278: 97 pgs: 97 active+clean; 586 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.3 KiB/s wr, 19 op/s 2024-09-12T01:50:17.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:16 smithi152 ceph-mon[35055]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:17.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.018+0000 7f4a78ccb640 1 -- 172.21.15.70:0/2071525474 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f4a740fce20 con 0x7f4a600a2c10 2024-09-12T01:50:17.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.022+0000 7f4a6b7fe640 1 -- 172.21.15.70:0/2071525474 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4a740fce20 con 0x7f4a600a2c10 2024-09-12T01:50:17.022 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/qa/sv_1/90465b6d-27c9-4db1-b628-182168bdc951 2024-09-12T01:50:17.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.024+0000 7f4a78ccb640 1 -- 172.21.15.70:0/2071525474 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4a600a2c10 msgr2=0x7f4a600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:17.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.024+0000 7f4a78ccb640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4a600a2c10 0x7f4a600a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009900 tx=0x7f4a640058d0 comp rx=0 tx=0).stop 2024-09-12T01:50:17.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.024+0000 7f4a78ccb640 1 -- 172.21.15.70:0/2071525474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a74106a80 msgr2=0x7f4a7419cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:17.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.024+0000 7f4a78ccb640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a74106a80 0x7f4a7419cf20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00b970 tx=0x7f4a6c00bd70 comp rx=0 tx=0).stop 2024-09-12T01:50:17.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.024+0000 7f4a78ccb640 1 -- 172.21.15.70:0/2071525474 shutdown_connections 2024-09-12T01:50:17.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.024+0000 7f4a78ccb640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4a600a2c10 0x7f4a600a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:17.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.024+0000 7f4a78ccb640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a74106a80 0x7f4a7419cf20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:17.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.024+0000 7f4a78ccb640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a74101420 0x7f4a74198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:17.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.024+0000 7f4a78ccb640 1 --2- 172.21.15.70:0/2071525474 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a74100a80 0x7f4a74198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:17.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.024+0000 7f4a78ccb640 1 -- 172.21.15.70:0/2071525474 >> 172.21.15.70:0/2071525474 conn(0x7f4a740fc7a0 msgr2=0x7f4a741048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:17.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.024+0000 7f4a78ccb640 1 -- 172.21.15.70:0/2071525474 shutdown_connections 2024-09-12T01:50:17.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:17.024+0000 7f4a78ccb640 1 -- 172.21.15.70:0/2071525474 wait complete. 2024-09-12T01:50:17.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:50:17.885 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:18.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.340+0000 7fcdedfd4640 1 -- 172.21.15.70:0/954763174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde8103740 msgr2=0x7fcde8107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:18.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.340+0000 7fcdedfd4640 1 --2- 172.21.15.70:0/954763174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde8103740 0x7fcde8107b80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009930 tx=0x7fcdd002a420 comp rx=0 tx=0).stop 2024-09-12T01:50:18.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 -- 172.21.15.70:0/954763174 shutdown_connections 2024-09-12T01:50:18.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 --2- 172.21.15.70:0/954763174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcde8108290 0x7fcde810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:18.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 --2- 172.21.15.70:0/954763174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde8103740 0x7fcde8107b80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:18.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 --2- 172.21.15.70:0/954763174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8102d90 0x7fcde8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:18.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 -- 172.21.15.70:0/954763174 >> 172.21.15.70:0/954763174 conn(0x7fcde80fc7d0 msgr2=0x7fcde80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:18.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 -- 172.21.15.70:0/954763174 shutdown_connections 2024-09-12T01:50:18.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 -- 172.21.15.70:0/954763174 wait complete. 2024-09-12T01:50:18.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 Processor -- start 2024-09-12T01:50:18.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 -- start start 2024-09-12T01:50:18.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde8102d90 0x7fcde81a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:18.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8103740 0x7fcde81a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:18.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcde8108290 0x7fcde819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:18.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcde81121f0 con 0x7fcde8102d90 2024-09-12T01:50:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8112070 con 0x7fcde8103740 2024-09-12T01:50:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcdedfd4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8112370 con 0x7fcde8108290 2024-09-12T01:50:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcde77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde8102d90 0x7fcde81a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcde77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde8102d90 0x7fcde81a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40290/0 (socket says 172.21.15.70:40290) 2024-09-12T01:50:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.341+0000 7fcde77fe640 1 -- 172.21.15.70:0/2478559817 learned_addr learned my addr 172.21.15.70:0/2478559817 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcde7fff640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcde8108290 0x7fcde819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcddffff640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8103740 0x7fcde81a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcde77fe640 1 -- 172.21.15.70:0/2478559817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcde8108290 msgr2=0x7fcde819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcde77fe640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcde8108290 0x7fcde819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcde77fe640 1 -- 172.21.15.70:0/2478559817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8103740 msgr2=0x7fcde81a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcde77fe640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8103740 0x7fcde81a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:18.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcde77fe640 1 -- 172.21.15.70:0/2478559817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde819af60 con 0x7fcde8102d90 2024-09-12T01:50:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcde77fe640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde8102d90 0x7fcde81a0620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800b4a0 tx=0x7fcdd800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcde57fa640 1 -- 172.21.15.70:0/2478559817 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8014070 con 0x7fcde8102d90 2024-09-12T01:50:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcde57fa640 1 -- 172.21.15.70:0/2478559817 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcdd8010b10 con 0x7fcde8102d90 2024-09-12T01:50:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcdedfd4640 1 -- 172.21.15.70:0/2478559817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde819b250 con 0x7fcde8102d90 2024-09-12T01:50:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcde57fa640 1 -- 172.21.15.70:0/2478559817 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8017d60 con 0x7fcde8102d90 2024-09-12T01:50:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.342+0000 7fcdedfd4640 1 -- 172.21.15.70:0/2478559817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde81a75a0 con 0x7fcde8102d90 2024-09-12T01:50:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.343+0000 7fcdedfd4640 1 -- 172.21.15.70:0/2478559817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde806a7f0 con 0x7fcde8102d90 2024-09-12T01:50:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.344+0000 7fcde57fa640 1 -- 172.21.15.70:0/2478559817 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcdd8017070 con 0x7fcde8102d90 2024-09-12T01:50:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.345+0000 7fcde57fa640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcdd40a2c10 0x7fcdd40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.345+0000 7fcddffff640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcdd40a2c10 0x7fcdd40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.345+0000 7fcde57fa640 1 -- 172.21.15.70:0/2478559817 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fcdd80ce700 con 0x7fcde8102d90 2024-09-12T01:50:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.345+0000 7fcddffff640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcdd40a2c10 0x7fcdd40a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0006010 tx=0x7fcdd0031580 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.348+0000 7fcde57fa640 1 -- 172.21.15.70:0/2478559817 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcdd809b7c0 con 0x7fcde8102d90 2024-09-12T01:50:18.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.553+0000 7fcdedfd4640 1 -- 172.21.15.70:0/2478559817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcde819bc20 con 0x7fcde8102d90 2024-09-12T01:50:18.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.553+0000 7fcde57fa640 1 -- 172.21.15.70:0/2478559817 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7fcdd809b0c0 con 0x7fcde8102d90 2024-09-12T01:50:18.553 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:50:18.554 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-12T01:50:09:375588+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:50:09.375567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:50:18.554 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-12T01:50:18.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.555+0000 7fcdedfd4640 1 -- 172.21.15.70:0/2478559817 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcdd40a2c10 msgr2=0x7fcdd40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:18.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.555+0000 7fcdedfd4640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcdd40a2c10 0x7fcdd40a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0006010 tx=0x7fcdd0031580 comp rx=0 tx=0).stop 2024-09-12T01:50:18.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.555+0000 7fcdedfd4640 1 -- 172.21.15.70:0/2478559817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde8102d90 msgr2=0x7fcde81a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:18.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.555+0000 7fcdedfd4640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde8102d90 0x7fcde81a0620 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800b4a0 tx=0x7fcdd800b960 comp rx=0 tx=0).stop 2024-09-12T01:50:18.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.555+0000 7fcdedfd4640 1 -- 172.21.15.70:0/2478559817 shutdown_connections 2024-09-12T01:50:18.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.555+0000 7fcdedfd4640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcdd40a2c10 0x7fcdd40a50d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:18.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.555+0000 7fcdedfd4640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcde8108290 0x7fcde819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:18.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.555+0000 7fcdedfd4640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde8103740 0x7fcde81a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:18.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.555+0000 7fcdedfd4640 1 --2- 172.21.15.70:0/2478559817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde8102d90 0x7fcde81a0620 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:18.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.555+0000 7fcdedfd4640 1 -- 172.21.15.70:0/2478559817 >> 172.21.15.70:0/2478559817 conn(0x7fcde80fc7d0 msgr2=0x7fcde8101330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:18.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.556+0000 7fcdedfd4640 1 -- 172.21.15.70:0/2478559817 shutdown_connections 2024-09-12T01:50:18.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:18.556+0000 7fcdedfd4640 1 -- 172.21.15.70:0/2478559817 wait complete. 2024-09-12T01:50:18.914 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:18 smithi070 ceph-mon[31177]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:18.914 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:18 smithi070 ceph-mon[31177]: pgmap v279: 97 pgs: 97 active+clean; 624 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.8 KiB/s wr, 23 op/s 2024-09-12T01:50:18.915 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:18 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2478559817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:50:18.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:18 smithi191 ceph-mon[35770]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:18.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:18 smithi191 ceph-mon[35770]: pgmap v279: 97 pgs: 97 active+clean; 624 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.8 KiB/s wr, 23 op/s 2024-09-12T01:50:18.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:18 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2478559817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:50:19.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:18 smithi152 ceph-mon[35055]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:19.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:18 smithi152 ceph-mon[35055]: pgmap v279: 97 pgs: 97 active+clean; 624 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.8 KiB/s wr, 23 op/s 2024-09-12T01:50:19.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:18 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2478559817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:50:19.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:50:19.482 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.932+0000 7ff7faaa5640 1 -- 172.21.15.70:0/2360970569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7f4102790 msgr2=0x7ff7f41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.932+0000 7ff7faaa5640 1 --2- 172.21.15.70:0/2360970569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7f4102790 0x7ff7f41067e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009ca0 tx=0x7ff7e402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:50:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.932+0000 7ff7faaa5640 1 -- 172.21.15.70:0/2360970569 shutdown_connections 2024-09-12T01:50:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.932+0000 7ff7faaa5640 1 --2- 172.21.15.70:0/2360970569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4106f10 0x7ff7f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.932+0000 7ff7faaa5640 1 --2- 172.21.15.70:0/2360970569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7f4102790 0x7ff7f41067e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.932+0000 7ff7faaa5640 1 --2- 172.21.15.70:0/2360970569 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7f4101de0 0x7ff7f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.932+0000 7ff7faaa5640 1 -- 172.21.15.70:0/2360970569 >> 172.21.15.70:0/2360970569 conn(0x7ff7f40fd8c0 msgr2=0x7ff7f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.932+0000 7ff7faaa5640 1 -- 172.21.15.70:0/2360970569 shutdown_connections 2024-09-12T01:50:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.932+0000 7ff7faaa5640 1 -- 172.21.15.70:0/2360970569 wait complete. 2024-09-12T01:50:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7faaa5640 1 Processor -- start 2024-09-12T01:50:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7faaa5640 1 -- start start 2024-09-12T01:50:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7faaa5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4101de0 0x7ff7f4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7faaa5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7f4102790 0x7ff7f4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7faaa5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7f4106f10 0x7ff7f419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7faaa5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f4112050 con 0x7ff7f4106f10 2024-09-12T01:50:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7faaa5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f4111ed0 con 0x7ff7f4101de0 2024-09-12T01:50:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7faaa5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f41121d0 con 0x7ff7f4102790 2024-09-12T01:50:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7f9042640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7f4106f10 0x7ff7f419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7f9042640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7f4106f10 0x7ff7f419cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40306/0 (socket says 172.21.15.70:40306) 2024-09-12T01:50:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7f9042640 1 -- 172.21.15.70:0/4184595219 learned_addr learned my addr 172.21.15.70:0/4184595219 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7f8841640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4101de0 0x7ff7f4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:19.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7f3fff640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7f4102790 0x7ff7f4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:19.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7f9042640 1 -- 172.21.15.70:0/4184595219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7f4102790 msgr2=0x7ff7f4198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:19.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7f9042640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7f4102790 0x7ff7f4198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:19.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7f9042640 1 -- 172.21.15.70:0/4184595219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4101de0 msgr2=0x7ff7f4198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:19.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7f9042640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4101de0 0x7ff7f4198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:19.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7f9042640 1 -- 172.21.15.70:0/4184595219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f419d3c0 con 0x7ff7f4106f10 2024-09-12T01:50:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.933+0000 7ff7f9042640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7f4106f10 0x7ff7f419cce0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00c970 tx=0x7ff7dc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.934+0000 7ff7f1ffb640 1 -- 172.21.15.70:0/4184595219 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc007bb0 con 0x7ff7f4106f10 2024-09-12T01:50:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.934+0000 7ff7f1ffb640 1 -- 172.21.15.70:0/4184595219 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff7dc007d50 con 0x7ff7f4106f10 2024-09-12T01:50:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.934+0000 7ff7faaa5640 1 -- 172.21.15.70:0/4184595219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f419d6b0 con 0x7ff7f4106f10 2024-09-12T01:50:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.934+0000 7ff7f1ffb640 1 -- 172.21.15.70:0/4184595219 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0187e0 con 0x7ff7f4106f10 2024-09-12T01:50:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.934+0000 7ff7faaa5640 1 -- 172.21.15.70:0/4184595219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f41a4f90 con 0x7ff7f4106f10 2024-09-12T01:50:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.935+0000 7ff7faaa5640 1 -- 172.21.15.70:0/4184595219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f41021c0 con 0x7ff7f4106f10 2024-09-12T01:50:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.936+0000 7ff7f1ffb640 1 -- 172.21.15.70:0/4184595219 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff7dc00f450 con 0x7ff7f4106f10 2024-09-12T01:50:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.936+0000 7ff7f1ffb640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff7e00a2c90 0x7ff7e00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.937+0000 7ff7f8841640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff7e00a2c90 0x7ff7e00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.937+0000 7ff7f1ffb640 1 -- 172.21.15.70:0/4184595219 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7ff7dc0cef20 con 0x7ff7f4106f10 2024-09-12T01:50:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.937+0000 7ff7f8841640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff7e00a2c90 0x7ff7e00a5150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00abe0 tx=0x7ff7ec00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:19.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:19.941+0000 7ff7f1ffb640 1 -- 172.21.15.70:0/4184595219 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7dc014030 con 0x7ff7f4106f10 2024-09-12T01:50:20.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.108+0000 7ff7faaa5640 1 -- 172.21.15.70:0/4184595219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7f41a5270 con 0x7ff7f4106f10 2024-09-12T01:50:20.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.110+0000 7ff7f1ffb640 1 -- 172.21.15.70:0/4184595219 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22289 (secure 0 0 0) 0x7ff7dc09bed0 con 0x7ff7f4106f10 2024-09-12T01:50:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:50:20.110 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":81,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:49:57.864065+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:49:54.140097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:49:56.005187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:50:20.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.112+0000 7ff7faaa5640 1 -- 172.21.15.70:0/4184595219 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff7e00a2c90 msgr2=0x7ff7e00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:20.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.112+0000 7ff7faaa5640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff7e00a2c90 0x7ff7e00a5150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00abe0 tx=0x7ff7ec00a2d0 comp rx=0 tx=0).stop 2024-09-12T01:50:20.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.112+0000 7ff7faaa5640 1 -- 172.21.15.70:0/4184595219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7f4106f10 msgr2=0x7ff7f419cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:20.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.112+0000 7ff7faaa5640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7f4106f10 0x7ff7f419cce0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00c970 tx=0x7ff7dc00cd70 comp rx=0 tx=0).stop 2024-09-12T01:50:20.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.112+0000 7ff7faaa5640 1 -- 172.21.15.70:0/4184595219 shutdown_connections 2024-09-12T01:50:20.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.112+0000 7ff7faaa5640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff7e00a2c90 0x7ff7e00a5150 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:20.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.112+0000 7ff7faaa5640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7f4106f10 0x7ff7f419cce0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:20.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.112+0000 7ff7faaa5640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7f4102790 0x7ff7f4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:20.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.112+0000 7ff7faaa5640 1 --2- 172.21.15.70:0/4184595219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7f4101de0 0x7ff7f4198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:20.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.112+0000 7ff7faaa5640 1 -- 172.21.15.70:0/4184595219 >> 172.21.15.70:0/4184595219 conn(0x7ff7f40fd8c0 msgr2=0x7ff7f40fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:20.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.112+0000 7ff7faaa5640 1 -- 172.21.15.70:0/4184595219 shutdown_connections 2024-09-12T01:50:20.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:20.112+0000 7ff7faaa5640 1 -- 172.21.15.70:0/4184595219 wait complete. 2024-09-12T01:50:20.699 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:20 smithi070 ceph-mon[31177]: pgmap v280: 97 pgs: 97 active+clean; 624 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.1 KiB/s wr, 21 op/s 2024-09-12T01:50:20.699 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:20 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/4184595219' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:20.728 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T01:50:20.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:50:20.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:20 smithi191 ceph-mon[35770]: pgmap v280: 97 pgs: 97 active+clean; 624 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.1 KiB/s wr, 21 op/s 2024-09-12T01:50:20.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:20 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/4184595219' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:20.982 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:21.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:20 smithi152 ceph-mon[35055]: pgmap v280: 97 pgs: 97 active+clean; 624 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.1 KiB/s wr, 21 op/s 2024-09-12T01:50:21.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:20 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/4184595219' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.502+0000 7f286a0f7640 1 -- 172.21.15.70:0/2391377433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2864102ef0 msgr2=0x7f286410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.502+0000 7f286a0f7640 1 --2- 172.21.15.70:0/2391377433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2864102ef0 0x7f286410da40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f285c009ca0 tx=0x7f285c02a950 comp rx=0 tx=0).stop 2024-09-12T01:50:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.502+0000 7f286a0f7640 1 -- 172.21.15.70:0/2391377433 shutdown_connections 2024-09-12T01:50:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.502+0000 7f286a0f7640 1 --2- 172.21.15.70:0/2391377433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2864102ef0 0x7f286410da40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.502+0000 7f286a0f7640 1 --2- 172.21.15.70:0/2391377433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2864102570 0x7f28641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.502+0000 7f286a0f7640 1 --2- 172.21.15.70:0/2391377433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2864100e20 0x7f2864101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.502+0000 7f286a0f7640 1 -- 172.21.15.70:0/2391377433 >> 172.21.15.70:0/2391377433 conn(0x7f28640fc7d0 msgr2=0x7f28640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.502+0000 7f286a0f7640 1 -- 172.21.15.70:0/2391377433 shutdown_connections 2024-09-12T01:50:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.502+0000 7f286a0f7640 1 -- 172.21.15.70:0/2391377433 wait complete. 2024-09-12T01:50:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.503+0000 7f286a0f7640 1 Processor -- start 2024-09-12T01:50:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.503+0000 7f286a0f7640 1 -- start start 2024-09-12T01:50:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.503+0000 7f286a0f7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2864100e20 0x7f2864197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.503+0000 7f286a0f7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2864102570 0x7f2864197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.503+0000 7f286a0f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2864102ef0 0x7f2864197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.503+0000 7f286a0f7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f28641110e0 con 0x7f2864102ef0 2024-09-12T01:50:21.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.503+0000 7f286a0f7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2864110f60 con 0x7f2864100e20 2024-09-12T01:50:21.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.503+0000 7f286a0f7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2864111260 con 0x7f2864102570 2024-09-12T01:50:21.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.503+0000 7f2863fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2864102ef0 0x7f2864197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:21.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.503+0000 7f2863fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2864102ef0 0x7f2864197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48038/0 (socket says 172.21.15.70:48038) 2024-09-12T01:50:21.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.503+0000 7f2863fff640 1 -- 172.21.15.70:0/3141036782 learned_addr learned my addr 172.21.15.70:0/3141036782 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:21.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.503+0000 7f28637fe640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2864100e20 0x7f2864197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:21.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.504+0000 7f2863fff640 1 -- 172.21.15.70:0/3141036782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2864102570 msgr2=0x7f2864197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:21.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.504+0000 7f2863fff640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2864102570 0x7f2864197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.504+0000 7f2863fff640 1 -- 172.21.15.70:0/3141036782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2864100e20 msgr2=0x7f2864197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:21.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.504+0000 7f2863fff640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2864100e20 0x7f2864197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.504+0000 7f2863fff640 1 -- 172.21.15.70:0/3141036782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28641a6a70 con 0x7f2864102ef0 2024-09-12T01:50:21.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.504+0000 7f28637fe640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2864100e20 0x7f2864197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:21.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.504+0000 7f2863fff640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2864102ef0 0x7f2864197c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f285c005cc0 tx=0x7f285c02f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:21.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.504+0000 7f2860ff9640 1 -- 172.21.15.70:0/3141036782 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c034040 con 0x7f2864102ef0 2024-09-12T01:50:21.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.504+0000 7f2860ff9640 1 -- 172.21.15.70:0/3141036782 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f285c030940 con 0x7f2864102ef0 2024-09-12T01:50:21.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.504+0000 7f286a0f7640 1 -- 172.21.15.70:0/3141036782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28641a6d00 con 0x7f2864102ef0 2024-09-12T01:50:21.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.504+0000 7f2860ff9640 1 -- 172.21.15.70:0/3141036782 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c0456e0 con 0x7f2864102ef0 2024-09-12T01:50:21.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.504+0000 7f286a0f7640 1 -- 172.21.15.70:0/3141036782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28641a71e0 con 0x7f2864102ef0 2024-09-12T01:50:21.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.505+0000 7f286a0f7640 1 -- 172.21.15.70:0/3141036782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2864101200 con 0x7f2864102ef0 2024-09-12T01:50:21.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.506+0000 7f2860ff9640 1 -- 172.21.15.70:0/3141036782 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f285c037020 con 0x7f2864102ef0 2024-09-12T01:50:21.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.506+0000 7f2860ff9640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f284c0a2c10 0x7f284c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:21.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.507+0000 7f28637fe640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f284c0a2c10 0x7f284c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:21.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.507+0000 7f2860ff9640 1 -- 172.21.15.70:0/3141036782 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f285c0f0040 con 0x7f2864102ef0 2024-09-12T01:50:21.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.507+0000 7f28637fe640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f284c0a2c10 0x7f284c0a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2854009930 tx=0x7f2854008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:21.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.511+0000 7f2860ff9640 1 -- 172.21.15.70:0/3141036782 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f285c0443e0 con 0x7f2864102ef0 2024-09-12T01:50:21.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.680+0000 7f286a0f7640 1 -- 172.21.15.70:0/3141036782 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2864106ee0 con 0x7f284c0a2c10 2024-09-12T01:50:21.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-12T01:50:21.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-12T01:50:21.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-12T01:50:21.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-12T01:50:21.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-12T01:50:21.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2024-09-12T01:50:21.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-12T01:50:21.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-12T01:50:21.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:21 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-12T01:50:21.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.687+0000 7f2860ff9640 1 -- 172.21.15.70:0/3141036782 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258750 (secure 0 0 0) 0x7f2864106ee0 con 0x7f284c0a2c10 2024-09-12T01:50:21.692 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:50:21.694 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:50:21.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.690+0000 7f286a0f7640 1 -- 172.21.15.70:0/3141036782 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f284c0a2c10 msgr2=0x7f284c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:21.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.690+0000 7f286a0f7640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f284c0a2c10 0x7f284c0a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2854009930 tx=0x7f2854008040 comp rx=0 tx=0).stop 2024-09-12T01:50:21.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.690+0000 7f286a0f7640 1 -- 172.21.15.70:0/3141036782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2864102ef0 msgr2=0x7f2864197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:21.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.690+0000 7f286a0f7640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2864102ef0 0x7f2864197c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f285c005cc0 tx=0x7f285c02f790 comp rx=0 tx=0).stop 2024-09-12T01:50:21.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.690+0000 7f286a0f7640 1 -- 172.21.15.70:0/3141036782 shutdown_connections 2024-09-12T01:50:21.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.690+0000 7f286a0f7640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f284c0a2c10 0x7f284c0a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.690+0000 7f286a0f7640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2864102ef0 0x7f2864197c80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.690+0000 7f286a0f7640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2864102570 0x7f2864197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.690+0000 7f286a0f7640 1 --2- 172.21.15.70:0/3141036782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2864100e20 0x7f2864197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:21.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.690+0000 7f286a0f7640 1 -- 172.21.15.70:0/3141036782 >> 172.21.15.70:0/3141036782 conn(0x7f28640fc7d0 msgr2=0x7f28641067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:21.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.690+0000 7f286a0f7640 1 -- 172.21.15.70:0/3141036782 shutdown_connections 2024-09-12T01:50:21.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:21.690+0000 7f286a0f7640 1 -- 172.21.15.70:0/3141036782 wait complete. 2024-09-12T01:50:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-12T01:50:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-12T01:50:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-12T01:50:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-12T01:50:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-12T01:50:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2024-09-12T01:50:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-12T01:50:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-12T01:50:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:21 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-12T01:50:22.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-12T01:50:22.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-12T01:50:22.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-12T01:50:22.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-12T01:50:22.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-12T01:50:22.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]: dispatch 2024-09-12T01:50:22.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-12T01:50:22.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-12T01:50:22.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:21 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-12T01:50:22.241 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-09-12T01:50:21.600652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647806,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":272,"num_read_kb":248,"num_write":414,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365864,"kb_used_data":12456,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575960,"statfs":{"total":1151940427776,"available":1151565783040,"internally_reserved":0,"allocated":12754944,"data_stored":6982008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49550,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":45,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.125266"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309744+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:49:58.309744+0000","last_peered":"2024-09-12T01:49:58.309744+0000","last_clean":"2024-09-12T01:49:58.309744+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:49:58.309744+0000","last_undegraded":"2024-09-12T01:49:58.309744+0000","last_fullsized":"2024-09-12T01:49:58.309744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323858+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:49:58.323858+0000","last_peered":"2024-09-12T01:49:58.323858+0000","last_clean":"2024-09-12T01:49:58.323858+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:49:58.323858+0000","last_undegraded":"2024-09-12T01:49:58.323858+0000","last_fullsized":"2024-09-12T01:49:58.323858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323742+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:49:58.323742+0000","last_peered":"2024-09-12T01:49:58.323742+0000","last_clean":"2024-09-12T01:49:58.323742+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:49:58.323742+0000","last_undegraded":"2024-09-12T01:49:58.323742+0000","last_fullsized":"2024-09-12T01:49:58.323742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323099+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:49:58.323099+0000","last_peered":"2024-09-12T01:49:58.323099+0000","last_clean":"2024-09-12T01:49:58.323099+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:49:58.323099+0000","last_undegraded":"2024-09-12T01:49:58.323099+0000","last_fullsized":"2024-09-12T01:49:58.323099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321019+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:49:58.321019+0000","last_peered":"2024-09-12T01:49:58.321019+0000","last_clean":"2024-09-12T01:49:58.321019+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:49:58.321019+0000","last_undegraded":"2024-09-12T01:49:58.321019+0000","last_fullsized":"2024-09-12T01:49:58.321019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.307738+0000","last_change":"2024-09-12T01:49:57.321601+0000","last_active":"2024-09-12T01:49:58.307738+0000","last_peered":"2024-09-12T01:49:58.307738+0000","last_clean":"2024-09-12T01:49:58.307738+0000","last_became_active":"2024-09-12T01:49:57.321272+0000","last_became_peered":"2024-09-12T01:49:57.321272+0000","last_unstale":"2024-09-12T01:49:58.307738+0000","last_undegraded":"2024-09-12T01:49:58.307738+0000","last_fullsized":"2024-09-12T01:49:58.307738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:31.023019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323483+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:49:58.323483+0000","last_peered":"2024-09-12T01:49:58.323483+0000","last_clean":"2024-09-12T01:49:58.323483+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:49:58.323483+0000","last_undegraded":"2024-09-12T01:49:58.323483+0000","last_fullsized":"2024-09-12T01:49:58.323483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.320562+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:49:58.320562+0000","last_peered":"2024-09-12T01:49:58.320562+0000","last_clean":"2024-09-12T01:49:58.320562+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:49:58.320562+0000","last_undegraded":"2024-09-12T01:49:58.320562+0000","last_fullsized":"2024-09-12T01:49:58.320562+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.322035+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:49:58.322035+0000","last_peered":"2024-09-12T01:49:58.322035+0000","last_clean":"2024-09-12T01:49:58.322035+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:49:58.322035+0000","last_undegraded":"2024-09-12T01:49:58.322035+0000","last_fullsized":"2024-09-12T01:49:58.322035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.308229+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:49:58.308229+0000","last_peered":"2024-09-12T01:49:58.308229+0000","last_clean":"2024-09-12T01:49:58.308229+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:49:58.308229+0000","last_undegraded":"2024-09-12T01:49:58.308229+0000","last_fullsized":"2024-09-12T01:49:58.308229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.324324+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:49:58.324324+0000","last_peered":"2024-09-12T01:49:58.324324+0000","last_clean":"2024-09-12T01:49:58.324324+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:49:58.324324+0000","last_undegraded":"2024-09-12T01:49:58.324324+0000","last_fullsized":"2024-09-12T01:49:58.324324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323129+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:49:58.323129+0000","last_peered":"2024-09-12T01:49:58.323129+0000","last_clean":"2024-09-12T01:49:58.323129+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:49:58.323129+0000","last_undegraded":"2024-09-12T01:49:58.323129+0000","last_fullsized":"2024-09-12T01:49:58.323129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306642+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:49:58.306642+0000","last_peered":"2024-09-12T01:49:58.306642+0000","last_clean":"2024-09-12T01:49:58.306642+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:49:58.306642+0000","last_undegraded":"2024-09-12T01:49:58.306642+0000","last_fullsized":"2024-09-12T01:49:58.306642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323859+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:49:58.323859+0000","last_peered":"2024-09-12T01:49:58.323859+0000","last_clean":"2024-09-12T01:49:58.323859+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:49:58.323859+0000","last_undegraded":"2024-09-12T01:49:58.323859+0000","last_fullsized":"2024-09-12T01:49:58.323859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323782+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:49:58.323782+0000","last_peered":"2024-09-12T01:49:58.323782+0000","last_clean":"2024-09-12T01:49:58.323782+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:49:58.323782+0000","last_undegraded":"2024-09-12T01:49:58.323782+0000","last_fullsized":"2024-09-12T01:49:58.323782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323420+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:49:58.323420+0000","last_peered":"2024-09-12T01:49:58.323420+0000","last_clean":"2024-09-12T01:49:58.323420+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:49:58.323420+0000","last_undegraded":"2024-09-12T01:49:58.323420+0000","last_fullsized":"2024-09-12T01:49:58.323420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309753+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:49:58.309753+0000","last_peered":"2024-09-12T01:49:58.309753+0000","last_clean":"2024-09-12T01:49:58.309753+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:49:58.309753+0000","last_undegraded":"2024-09-12T01:49:58.309753+0000","last_fullsized":"2024-09-12T01:49:58.309753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.320602+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:49:58.320602+0000","last_peered":"2024-09-12T01:49:58.320602+0000","last_clean":"2024-09-12T01:49:58.320602+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:49:58.320602+0000","last_undegraded":"2024-09-12T01:49:58.320602+0000","last_fullsized":"2024-09-12T01:49:58.320602+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.322285+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:49:58.322285+0000","last_peered":"2024-09-12T01:49:58.322285+0000","last_clean":"2024-09-12T01:49:58.322285+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:49:58.322285+0000","last_undegraded":"2024-09-12T01:49:58.322285+0000","last_fullsized":"2024-09-12T01:49:58.322285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309381+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:49:58.309381+0000","last_peered":"2024-09-12T01:49:58.309381+0000","last_clean":"2024-09-12T01:49:58.309381+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:49:58.309381+0000","last_undegraded":"2024-09-12T01:49:58.309381+0000","last_fullsized":"2024-09-12T01:49:58.309381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306751+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:49:58.306751+0000","last_peered":"2024-09-12T01:49:58.306751+0000","last_clean":"2024-09-12T01:49:58.306751+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:49:58.306751+0000","last_undegraded":"2024-09-12T01:49:58.306751+0000","last_fullsized":"2024-09-12T01:49:58.306751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321786+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:49:58.321786+0000","last_peered":"2024-09-12T01:49:58.321786+0000","last_clean":"2024-09-12T01:49:58.321786+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:49:58.321786+0000","last_undegraded":"2024-09-12T01:49:58.321786+0000","last_fullsized":"2024-09-12T01:49:58.321786+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.320630+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:49:58.320630+0000","last_peered":"2024-09-12T01:49:58.320630+0000","last_clean":"2024-09-12T01:49:58.320630+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:49:58.320630+0000","last_undegraded":"2024-09-12T01:49:58.320630+0000","last_fullsized":"2024-09-12T01:49:58.320630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321569+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:49:58.321569+0000","last_peered":"2024-09-12T01:49:58.321569+0000","last_clean":"2024-09-12T01:49:58.321569+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:49:58.321569+0000","last_undegraded":"2024-09-12T01:49:58.321569+0000","last_fullsized":"2024-09-12T01:49:58.321569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321653+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:49:58.321653+0000","last_peered":"2024-09-12T01:49:58.321653+0000","last_clean":"2024-09-12T01:49:58.321653+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:49:58.321653+0000","last_undegraded":"2024-09-12T01:49:58.321653+0000","last_fullsized":"2024-09-12T01:49:58.321653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.322518+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:49:58.322518+0000","last_peered":"2024-09-12T01:49:58.322518+0000","last_clean":"2024-09-12T01:49:58.322518+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:49:58.322518+0000","last_undegraded":"2024-09-12T01:49:58.322518+0000","last_fullsized":"2024-09-12T01:49:58.322518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309573+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:49:58.309573+0000","last_peered":"2024-09-12T01:49:58.309573+0000","last_clean":"2024-09-12T01:49:58.309573+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:49:58.309573+0000","last_undegraded":"2024-09-12T01:49:58.309573+0000","last_fullsized":"2024-09-12T01:49:58.309573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306635+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:49:58.306635+0000","last_peered":"2024-09-12T01:49:58.306635+0000","last_clean":"2024-09-12T01:49:58.306635+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:49:58.306635+0000","last_undegraded":"2024-09-12T01:49:58.306635+0000","last_fullsized":"2024-09-12T01:49:58.306635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.324205+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:49:58.324205+0000","last_peered":"2024-09-12T01:49:58.324205+0000","last_clean":"2024-09-12T01:49:58.324205+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:49:58.324205+0000","last_undegraded":"2024-09-12T01:49:58.324205+0000","last_fullsized":"2024-09-12T01:49:58.324205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321962+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:49:58.321962+0000","last_peered":"2024-09-12T01:49:58.321962+0000","last_clean":"2024-09-12T01:49:58.321962+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:49:58.321962+0000","last_undegraded":"2024-09-12T01:49:58.321962+0000","last_fullsized":"2024-09-12T01:49:58.321962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321986+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:49:58.321986+0000","last_peered":"2024-09-12T01:49:58.321986+0000","last_clean":"2024-09-12T01:49:58.321986+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:49:58.321986+0000","last_undegraded":"2024-09-12T01:49:58.321986+0000","last_fullsized":"2024-09-12T01:49:58.321986+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309495+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:49:58.309495+0000","last_peered":"2024-09-12T01:49:58.309495+0000","last_clean":"2024-09-12T01:49:58.309495+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:49:58.309495+0000","last_undegraded":"2024-09-12T01:49:58.309495+0000","last_fullsized":"2024-09-12T01:49:58.309495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.320936+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:49:58.320936+0000","last_peered":"2024-09-12T01:49:58.320936+0000","last_clean":"2024-09-12T01:49:58.320936+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:49:58.320936+0000","last_undegraded":"2024-09-12T01:49:58.320936+0000","last_fullsized":"2024-09-12T01:49:58.320936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:18.399008+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:50:18.399008+0000","last_peered":"2024-09-12T01:50:18.399008+0000","last_clean":"2024-09-12T01:50:18.399008+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:50:18.399008+0000","last_undegraded":"2024-09-12T01:50:18.399008+0000","last_fullsized":"2024-09-12T01:50:18.399008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321145+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:49:58.321145+0000","last_peered":"2024-09-12T01:49:58.321145+0000","last_clean":"2024-09-12T01:49:58.321145+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:49:58.321145+0000","last_undegraded":"2024-09-12T01:49:58.321145+0000","last_fullsized":"2024-09-12T01:49:58.321145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:07.371422+0000","last_change":"2024-09-12T01:49:55.302461+0000","last_active":"2024-09-12T01:50:07.371422+0000","last_peered":"2024-09-12T01:50:07.371422+0000","last_clean":"2024-09-12T01:50:07.371422+0000","last_became_active":"2024-09-12T01:49:55.300957+0000","last_became_peered":"2024-09-12T01:49:55.300957+0000","last_unstale":"2024-09-12T01:50:07.371422+0000","last_undegraded":"2024-09-12T01:50:07.371422+0000","last_fullsized":"2024-09-12T01:50:07.371422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:13.926080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:06.363305+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:06.363305+0000","last_peered":"2024-09-12T01:50:06.363305+0000","last_clean":"2024-09-12T01:50:06.363305+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:06.363305+0000","last_undegraded":"2024-09-12T01:50:06.363305+0000","last_fullsized":"2024-09-12T01:50:06.363305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321516+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:49:58.321516+0000","last_peered":"2024-09-12T01:49:58.321516+0000","last_clean":"2024-09-12T01:49:58.321516+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:49:58.321516+0000","last_undegraded":"2024-09-12T01:49:58.321516+0000","last_fullsized":"2024-09-12T01:49:58.321516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379193+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:08.379193+0000","last_peered":"2024-09-12T01:50:08.379193+0000","last_clean":"2024-09-12T01:50:08.379193+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:08.379193+0000","last_undegraded":"2024-09-12T01:50:08.379193+0000","last_fullsized":"2024-09-12T01:50:08.379193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.320303+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:49:58.320303+0000","last_peered":"2024-09-12T01:49:58.320303+0000","last_clean":"2024-09-12T01:49:58.320303+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:49:58.320303+0000","last_undegraded":"2024-09-12T01:49:58.320303+0000","last_fullsized":"2024-09-12T01:49:58.320303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:20.400472+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:50:20.400472+0000","last_peered":"2024-09-12T01:50:20.400472+0000","last_clean":"2024-09-12T01:50:20.400472+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:50:20.400472+0000","last_undegraded":"2024-09-12T01:50:20.400472+0000","last_fullsized":"2024-09-12T01:50:20.400472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321965+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:49:58.321965+0000","last_peered":"2024-09-12T01:49:58.321965+0000","last_clean":"2024-09-12T01:49:58.321965+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:49:58.321965+0000","last_undegraded":"2024-09-12T01:49:58.321965+0000","last_fullsized":"2024-09-12T01:49:58.321965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.381217+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:08.381217+0000","last_peered":"2024-09-12T01:50:08.381217+0000","last_clean":"2024-09-12T01:50:08.381217+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:08.381217+0000","last_undegraded":"2024-09-12T01:50:08.381217+0000","last_fullsized":"2024-09-12T01:50:08.381217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.324370+0000","last_change":"2024-09-12T01:49:57.321517+0000","last_active":"2024-09-12T01:49:58.324370+0000","last_peered":"2024-09-12T01:49:58.324370+0000","last_clean":"2024-09-12T01:49:58.324370+0000","last_became_active":"2024-09-12T01:49:57.321228+0000","last_became_peered":"2024-09-12T01:49:57.321228+0000","last_unstale":"2024-09-12T01:49:58.324370+0000","last_undegraded":"2024-09-12T01:49:58.324370+0000","last_fullsized":"2024-09-12T01:49:58.324370+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:44.539388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:07.371589+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:07.371589+0000","last_peered":"2024-09-12T01:50:07.371589+0000","last_clean":"2024-09-12T01:50:07.371589+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:07.371589+0000","last_undegraded":"2024-09-12T01:50:07.371589+0000","last_fullsized":"2024-09-12T01:50:07.371589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321821+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:49:58.321821+0000","last_peered":"2024-09-12T01:49:58.321821+0000","last_clean":"2024-09-12T01:49:58.321821+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:49:58.321821+0000","last_undegraded":"2024-09-12T01:49:58.321821+0000","last_fullsized":"2024-09-12T01:49:58.321821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:20.402561+0000","last_change":"2024-09-12T01:49:55.300385+0000","last_active":"2024-09-12T01:50:20.402561+0000","last_peered":"2024-09-12T01:50:20.402561+0000","last_clean":"2024-09-12T01:50:20.402561+0000","last_became_active":"2024-09-12T01:49:55.300042+0000","last_became_peered":"2024-09-12T01:49:55.300042+0000","last_unstale":"2024-09-12T01:50:20.402561+0000","last_undegraded":"2024-09-12T01:50:20.402561+0000","last_fullsized":"2024-09-12T01:50:20.402561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:23.335345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49603,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":63,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323410+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:49:58.323410+0000","last_peered":"2024-09-12T01:49:58.323410+0000","last_clean":"2024-09-12T01:49:58.323410+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:49:58.323410+0000","last_undegraded":"2024-09-12T01:49:58.323410+0000","last_fullsized":"2024-09-12T01:49:58.323410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:09.382740+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:09.382740+0000","last_peered":"2024-09-12T01:50:09.382740+0000","last_clean":"2024-09-12T01:50:09.382740+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:09.382740+0000","last_undegraded":"2024-09-12T01:50:09.382740+0000","last_fullsized":"2024-09-12T01:50:09.382740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306398+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:49:58.306398+0000","last_peered":"2024-09-12T01:49:58.306398+0000","last_clean":"2024-09-12T01:49:58.306398+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:49:58.306398+0000","last_undegraded":"2024-09-12T01:49:58.306398+0000","last_fullsized":"2024-09-12T01:49:58.306398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379620+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:08.379620+0000","last_peered":"2024-09-12T01:50:08.379620+0000","last_clean":"2024-09-12T01:50:08.379620+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:08.379620+0000","last_undegraded":"2024-09-12T01:50:08.379620+0000","last_fullsized":"2024-09-12T01:50:08.379620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.324062+0000","last_change":"2024-09-12T01:49:57.326773+0000","last_active":"2024-09-12T01:49:58.324062+0000","last_peered":"2024-09-12T01:49:58.324062+0000","last_clean":"2024-09-12T01:49:58.324062+0000","last_became_active":"2024-09-12T01:49:57.326371+0000","last_became_peered":"2024-09-12T01:49:57.326371+0000","last_unstale":"2024-09-12T01:49:58.324062+0000","last_undegraded":"2024-09-12T01:49:58.324062+0000","last_fullsized":"2024-09-12T01:49:58.324062+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:26.758840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:15.394452+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:50:15.394452+0000","last_peered":"2024-09-12T01:50:15.394452+0000","last_clean":"2024-09-12T01:50:15.394452+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:50:15.394452+0000","last_undegraded":"2024-09-12T01:50:15.394452+0000","last_fullsized":"2024-09-12T01:50:15.394452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323342+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:49:58.323342+0000","last_peered":"2024-09-12T01:49:58.323342+0000","last_clean":"2024-09-12T01:49:58.323342+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:49:58.323342+0000","last_undegraded":"2024-09-12T01:49:58.323342+0000","last_fullsized":"2024-09-12T01:49:58.323342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.378548+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:08.378548+0000","last_peered":"2024-09-12T01:50:08.378548+0000","last_clean":"2024-09-12T01:50:08.378548+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:08.378548+0000","last_undegraded":"2024-09-12T01:50:08.378548+0000","last_fullsized":"2024-09-12T01:50:08.378548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321260+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:49:58.321260+0000","last_peered":"2024-09-12T01:49:58.321260+0000","last_clean":"2024-09-12T01:49:58.321260+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:49:58.321260+0000","last_undegraded":"2024-09-12T01:49:58.321260+0000","last_fullsized":"2024-09-12T01:49:58.321260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:07.359930+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:07.359930+0000","last_peered":"2024-09-12T01:50:07.359930+0000","last_clean":"2024-09-12T01:50:07.359930+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:07.359930+0000","last_undegraded":"2024-09-12T01:50:07.359930+0000","last_fullsized":"2024-09-12T01:50:07.359930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309527+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:49:58.309527+0000","last_peered":"2024-09-12T01:49:58.309527+0000","last_clean":"2024-09-12T01:49:58.309527+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:49:58.309527+0000","last_undegraded":"2024-09-12T01:49:58.309527+0000","last_fullsized":"2024-09-12T01:49:58.309527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379004+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:08.379004+0000","last_peered":"2024-09-12T01:50:08.379004+0000","last_clean":"2024-09-12T01:50:08.379004+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:08.379004+0000","last_undegraded":"2024-09-12T01:50:08.379004+0000","last_fullsized":"2024-09-12T01:50:08.379004+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.324382+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:49:58.324382+0000","last_peered":"2024-09-12T01:49:58.324382+0000","last_clean":"2024-09-12T01:49:58.324382+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:49:58.324382+0000","last_undegraded":"2024-09-12T01:49:58.324382+0000","last_fullsized":"2024-09-12T01:49:58.324382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.378167+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:08.378167+0000","last_peered":"2024-09-12T01:50:08.378167+0000","last_clean":"2024-09-12T01:50:08.378167+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:08.378167+0000","last_undegraded":"2024-09-12T01:50:08.378167+0000","last_fullsized":"2024-09-12T01:50:08.378167+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:59.546892+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:49:59.546892+0000","last_peered":"2024-09-12T01:49:59.546892+0000","last_clean":"2024-09-12T01:49:59.546892+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:49:59.546892+0000","last_undegraded":"2024-09-12T01:49:59.546892+0000","last_fullsized":"2024-09-12T01:49:59.546892+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'6","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:17.397480+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:50:17.397480+0000","last_peered":"2024-09-12T01:50:17.397480+0000","last_clean":"2024-09-12T01:50:17.397480+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:50:17.397480+0000","last_undegraded":"2024-09-12T01:50:17.397480+0000","last_fullsized":"2024-09-12T01:50:17.397480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323777+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:49:58.323777+0000","last_peered":"2024-09-12T01:49:58.323777+0000","last_clean":"2024-09-12T01:49:58.323777+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:49:58.323777+0000","last_undegraded":"2024-09-12T01:49:58.323777+0000","last_fullsized":"2024-09-12T01:49:58.323777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":328,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323459+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:49:58.323459+0000","last_peered":"2024-09-12T01:49:58.323459+0000","last_clean":"2024-09-12T01:49:58.323459+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:49:58.323459+0000","last_undegraded":"2024-09-12T01:49:58.323459+0000","last_fullsized":"2024-09-12T01:49:58.323459+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:09.382596+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:09.382596+0000","last_peered":"2024-09-12T01:50:09.382596+0000","last_clean":"2024-09-12T01:50:09.382596+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:09.382596+0000","last_undegraded":"2024-09-12T01:50:09.382596+0000","last_fullsized":"2024-09-12T01:50:09.382596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321790+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:49:58.321790+0000","last_peered":"2024-09-12T01:49:58.321790+0000","last_clean":"2024-09-12T01:49:58.321790+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:49:58.321790+0000","last_undegraded":"2024-09-12T01:49:58.321790+0000","last_fullsized":"2024-09-12T01:49:58.321790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:06.364010+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:06.364010+0000","last_peered":"2024-09-12T01:50:06.364010+0000","last_clean":"2024-09-12T01:50:06.364010+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:06.364010+0000","last_undegraded":"2024-09-12T01:50:06.364010+0000","last_fullsized":"2024-09-12T01:50:06.364010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306365+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:49:58.306365+0000","last_peered":"2024-09-12T01:49:58.306365+0000","last_clean":"2024-09-12T01:49:58.306365+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:49:58.306365+0000","last_undegraded":"2024-09-12T01:49:58.306365+0000","last_fullsized":"2024-09-12T01:49:58.306365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:18.397587+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:50:18.397587+0000","last_peered":"2024-09-12T01:50:18.397587+0000","last_clean":"2024-09-12T01:50:18.397587+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:50:18.397587+0000","last_undegraded":"2024-09-12T01:50:18.397587+0000","last_fullsized":"2024-09-12T01:50:18.397587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321157+0000","last_change":"2024-09-12T01:49:57.325955+0000","last_active":"2024-09-12T01:49:58.321157+0000","last_peered":"2024-09-12T01:49:58.321157+0000","last_clean":"2024-09-12T01:49:58.321157+0000","last_became_active":"2024-09-12T01:49:57.325639+0000","last_became_peered":"2024-09-12T01:49:57.325639+0000","last_unstale":"2024-09-12T01:49:58.321157+0000","last_undegraded":"2024-09-12T01:49:58.321157+0000","last_fullsized":"2024-09-12T01:49:58.321157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:15.271166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"81'6","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:18.397671+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:50:18.397671+0000","last_peered":"2024-09-12T01:50:18.397671+0000","last_clean":"2024-09-12T01:50:18.397671+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:50:18.397671+0000","last_undegraded":"2024-09-12T01:50:18.397671+0000","last_fullsized":"2024-09-12T01:50:18.397671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.308150+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:49:58.308150+0000","last_peered":"2024-09-12T01:49:58.308150+0000","last_clean":"2024-09-12T01:49:58.308150+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:49:58.308150+0000","last_undegraded":"2024-09-12T01:49:58.308150+0000","last_fullsized":"2024-09-12T01:49:58.308150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.320454+0000","last_change":"2024-09-12T01:49:55.712952+0000","last_active":"2024-09-12T01:49:58.320454+0000","last_peered":"2024-09-12T01:49:58.320454+0000","last_clean":"2024-09-12T01:49:58.320454+0000","last_became_active":"2024-09-12T01:49:55.712596+0000","last_became_peered":"2024-09-12T01:49:55.712596+0000","last_unstale":"2024-09-12T01:49:58.320454+0000","last_undegraded":"2024-09-12T01:49:58.320454+0000","last_fullsized":"2024-09-12T01:49:58.320454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:07.260628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:00.540132+0000","last_change":"2024-09-12T01:49:57.313745+0000","last_active":"2024-09-12T01:50:00.540132+0000","last_peered":"2024-09-12T01:50:00.540132+0000","last_clean":"2024-09-12T01:50:00.540132+0000","last_became_active":"2024-09-12T01:49:57.313397+0000","last_became_peered":"2024-09-12T01:49:57.313397+0000","last_unstale":"2024-09-12T01:50:00.540132+0000","last_undegraded":"2024-09-12T01:50:00.540132+0000","last_fullsized":"2024-09-12T01:50:00.540132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:45.032475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379535+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:08.379535+0000","last_peered":"2024-09-12T01:50:08.379535+0000","last_clean":"2024-09-12T01:50:08.379535+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:08.379535+0000","last_undegraded":"2024-09-12T01:50:08.379535+0000","last_fullsized":"2024-09-12T01:50:08.379535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306764+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:49:58.306764+0000","last_peered":"2024-09-12T01:49:58.306764+0000","last_clean":"2024-09-12T01:49:58.306764+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:49:58.306764+0000","last_undegraded":"2024-09-12T01:49:58.306764+0000","last_fullsized":"2024-09-12T01:49:58.306764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:13.320472+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:50:13.320472+0000","last_peered":"2024-09-12T01:50:13.320472+0000","last_clean":"2024-09-12T01:50:13.320472+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:50:13.320472+0000","last_undegraded":"2024-09-12T01:50:13.320472+0000","last_fullsized":"2024-09-12T01:50:13.320472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321603+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:49:58.321603+0000","last_peered":"2024-09-12T01:49:58.321603+0000","last_clean":"2024-09-12T01:49:58.321603+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:49:58.321603+0000","last_undegraded":"2024-09-12T01:49:58.321603+0000","last_fullsized":"2024-09-12T01:49:58.321603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379716+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:08.379716+0000","last_peered":"2024-09-12T01:50:08.379716+0000","last_clean":"2024-09-12T01:50:08.379716+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:08.379716+0000","last_undegraded":"2024-09-12T01:50:08.379716+0000","last_fullsized":"2024-09-12T01:50:08.379716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323854+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:49:58.323854+0000","last_peered":"2024-09-12T01:49:58.323854+0000","last_clean":"2024-09-12T01:49:58.323854+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:49:58.323854+0000","last_undegraded":"2024-09-12T01:49:58.323854+0000","last_fullsized":"2024-09-12T01:49:58.323854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:05.356487+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:05.356487+0000","last_peered":"2024-09-12T01:50:05.356487+0000","last_clean":"2024-09-12T01:50:05.356487+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:05.356487+0000","last_undegraded":"2024-09-12T01:50:05.356487+0000","last_fullsized":"2024-09-12T01:50:05.356487+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.320939+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:49:58.320939+0000","last_peered":"2024-09-12T01:49:58.320939+0000","last_clean":"2024-09-12T01:49:58.320939+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:49:58.320939+0000","last_undegraded":"2024-09-12T01:49:58.320939+0000","last_fullsized":"2024-09-12T01:49:58.320939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.376941+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:08.376941+0000","last_peered":"2024-09-12T01:50:08.376941+0000","last_clean":"2024-09-12T01:50:08.376941+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:08.376941+0000","last_undegraded":"2024-09-12T01:50:08.376941+0000","last_fullsized":"2024-09-12T01:50:08.376941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309528+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:49:58.309528+0000","last_peered":"2024-09-12T01:49:58.309528+0000","last_clean":"2024-09-12T01:49:58.309528+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:49:58.309528+0000","last_undegraded":"2024-09-12T01:49:58.309528+0000","last_fullsized":"2024-09-12T01:49:58.309528+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:07.371917+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:07.371917+0000","last_peered":"2024-09-12T01:50:07.371917+0000","last_clean":"2024-09-12T01:50:07.371917+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:07.371917+0000","last_undegraded":"2024-09-12T01:50:07.371917+0000","last_fullsized":"2024-09-12T01:50:07.371917+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.320761+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:49:58.320761+0000","last_peered":"2024-09-12T01:49:58.320761+0000","last_clean":"2024-09-12T01:49:58.320761+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:49:58.320761+0000","last_undegraded":"2024-09-12T01:49:58.320761+0000","last_fullsized":"2024-09-12T01:49:58.320761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:05.357799+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:05.357799+0000","last_peered":"2024-09-12T01:50:05.357799+0000","last_clean":"2024-09-12T01:50:05.357799+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:05.357799+0000","last_undegraded":"2024-09-12T01:50:05.357799+0000","last_fullsized":"2024-09-12T01:50:05.357799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323872+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:49:58.323872+0000","last_peered":"2024-09-12T01:49:58.323872+0000","last_clean":"2024-09-12T01:49:58.323872+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:49:58.323872+0000","last_undegraded":"2024-09-12T01:49:58.323872+0000","last_fullsized":"2024-09-12T01:49:58.323872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323337+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:49:58.323337+0000","last_peered":"2024-09-12T01:49:58.323337+0000","last_clean":"2024-09-12T01:49:58.323337+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:49:58.323337+0000","last_undegraded":"2024-09-12T01:49:58.323337+0000","last_fullsized":"2024-09-12T01:49:58.323337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.380635+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:08.380635+0000","last_peered":"2024-09-12T01:50:08.380635+0000","last_clean":"2024-09-12T01:50:08.380635+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:08.380635+0000","last_undegraded":"2024-09-12T01:50:08.380635+0000","last_fullsized":"2024-09-12T01:50:08.380635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321631+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:49:58.321631+0000","last_peered":"2024-09-12T01:49:58.321631+0000","last_clean":"2024-09-12T01:49:58.321631+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:49:58.321631+0000","last_undegraded":"2024-09-12T01:49:58.321631+0000","last_fullsized":"2024-09-12T01:49:58.321631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:09.376475+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:09.376475+0000","last_peered":"2024-09-12T01:50:09.376475+0000","last_clean":"2024-09-12T01:50:09.376475+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:09.376475+0000","last_undegraded":"2024-09-12T01:50:09.376475+0000","last_fullsized":"2024-09-12T01:50:09.376475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.324262+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:49:58.324262+0000","last_peered":"2024-09-12T01:49:58.324262+0000","last_clean":"2024-09-12T01:49:58.324262+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:49:58.324262+0000","last_undegraded":"2024-09-12T01:49:58.324262+0000","last_fullsized":"2024-09-12T01:49:58.324262+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.327205+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:49:58.327205+0000","last_peered":"2024-09-12T01:49:58.327205+0000","last_clean":"2024-09-12T01:49:58.327205+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:49:58.327205+0000","last_undegraded":"2024-09-12T01:49:58.327205+0000","last_fullsized":"2024-09-12T01:49:58.327205+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321569+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:49:58.321569+0000","last_peered":"2024-09-12T01:49:58.321569+0000","last_clean":"2024-09-12T01:49:58.321569+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:49:58.321569+0000","last_undegraded":"2024-09-12T01:49:58.321569+0000","last_fullsized":"2024-09-12T01:49:58.321569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:15.393583+0000","last_change":"2024-09-12T01:49:55.300400+0000","last_active":"2024-09-12T01:50:15.393583+0000","last_peered":"2024-09-12T01:50:15.393583+0000","last_clean":"2024-09-12T01:50:15.393583+0000","last_became_active":"2024-09-12T01:49:55.300056+0000","last_became_peered":"2024-09-12T01:49:55.300056+0000","last_unstale":"2024-09-12T01:50:15.393583+0000","last_undegraded":"2024-09-12T01:50:15.393583+0000","last_fullsized":"2024-09-12T01:50:15.393583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:45.640221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57204,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":146,"num_read_kb":139,"num_write":231,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":171612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":421584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776149,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1061823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939674,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":421121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168606,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":421499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397540,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1014412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528361,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":421231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789997,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1511424,"data_stored":1013697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953522,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":420699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":420663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":470962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":471747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":422570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":51748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":52361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:50:22.246 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:50:22.493 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:22.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:22 smithi070 ceph-mon[31177]: pgmap v281: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 KiB/s wr, 19 op/s 2024-09-12T01:50:22.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:22 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-12T01:50:22.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:22 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-12T01:50:22.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:22 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-12T01:50:22.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:22 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-12T01:50:22.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:22 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-12T01:50:22.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:22 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-12T01:50:22.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:22 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-12T01:50:22.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:22 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-12T01:50:22.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:22 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-12T01:50:22.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:22 smithi070 ceph-mon[31177]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T01:50:22.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:22 smithi070 ceph-mon[31177]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:22.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:22 smithi191 ceph-mon[35770]: pgmap v281: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 KiB/s wr, 19 op/s 2024-09-12T01:50:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:22 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-12T01:50:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:22 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-12T01:50:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:22 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-12T01:50:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:22 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-12T01:50:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:22 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-12T01:50:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:22 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-12T01:50:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:22 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-12T01:50:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:22 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-12T01:50:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:22 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-12T01:50:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:22 smithi191 ceph-mon[35770]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T01:50:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:22 smithi191 ceph-mon[35770]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.955+0000 7fc729f86640 1 -- 172.21.15.70:0/4084012026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724106a80 msgr2=0x7fc724106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.955+0000 7fc729f86640 1 --2- 172.21.15.70:0/4084012026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724106a80 0x7fc724106e60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc714009930 tx=0x7fc71402a420 comp rx=0 tx=0).stop 2024-09-12T01:50:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.955+0000 7fc729f86640 1 -- 172.21.15.70:0/4084012026 shutdown_connections 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.955+0000 7fc729f86640 1 --2- 172.21.15.70:0/4084012026 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc724101420 0x7fc72410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.955+0000 7fc729f86640 1 --2- 172.21.15.70:0/4084012026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc724100a80 0x7fc724100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.955+0000 7fc729f86640 1 --2- 172.21.15.70:0/4084012026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724106a80 0x7fc724106e60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.955+0000 7fc729f86640 1 -- 172.21.15.70:0/4084012026 >> 172.21.15.70:0/4084012026 conn(0x7fc7240fc7a0 msgr2=0x7fc7240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.955+0000 7fc729f86640 1 -- 172.21.15.70:0/4084012026 shutdown_connections 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.955+0000 7fc729f86640 1 -- 172.21.15.70:0/4084012026 wait complete. 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.956+0000 7fc729f86640 1 Processor -- start 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.956+0000 7fc729f86640 1 -- start start 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.956+0000 7fc729f86640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc724100a80 0x7fc724198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.956+0000 7fc729f86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724101420 0x7fc724198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.956+0000 7fc729f86640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc724106a80 0x7fc72419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.956+0000 7fc729f86640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc724110fe0 con 0x7fc724101420 2024-09-12T01:50:22.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.956+0000 7fc729f86640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc724110e60 con 0x7fc724100a80 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.956+0000 7fc729f86640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc724111160 con 0x7fc724106a80 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.956+0000 7fc722ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724101420 0x7fc724198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc722ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724101420 0x7fc724198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48060/0 (socket says 172.21.15.70:48060) 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc722ffd640 1 -- 172.21.15.70:0/998328993 learned_addr learned my addr 172.21.15.70:0/998328993 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc7237fe640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc724100a80 0x7fc724198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc722ffd640 1 -- 172.21.15.70:0/998328993 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc724106a80 msgr2=0x7fc72419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc722ffd640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc724106a80 0x7fc72419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc722ffd640 1 -- 172.21.15.70:0/998328993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc724100a80 msgr2=0x7fc724198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc722ffd640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc724100a80 0x7fc724198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc722ffd640 1 -- 172.21.15.70:0/998328993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72419d540 con 0x7fc724101420 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc7237fe640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc724100a80 0x7fc724198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc722ffd640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724101420 0x7fc724198ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00b4a0 tx=0x7fc70c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc720ff9640 1 -- 172.21.15.70:0/998328993 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c014070 con 0x7fc724101420 2024-09-12T01:50:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc729f86640 1 -- 172.21.15.70:0/998328993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72419d830 con 0x7fc724101420 2024-09-12T01:50:22.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc720ff9640 1 -- 172.21.15.70:0/998328993 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc70c010b10 con 0x7fc724101420 2024-09-12T01:50:22.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc720ff9640 1 -- 172.21.15.70:0/998328993 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c017d60 con 0x7fc724101420 2024-09-12T01:50:22.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.957+0000 7fc729f86640 1 -- 172.21.15.70:0/998328993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7241a5110 con 0x7fc724101420 2024-09-12T01:50:22.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.958+0000 7fc729f86640 1 -- 172.21.15.70:0/998328993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc724100ee0 con 0x7fc724101420 2024-09-12T01:50:22.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.959+0000 7fc720ff9640 1 -- 172.21.15.70:0/998328993 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc70c017070 con 0x7fc724101420 2024-09-12T01:50:22.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.960+0000 7fc720ff9640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc7100a2c10 0x7fc7100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:22.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.960+0000 7fc7237fe640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc7100a2c10 0x7fc7100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:22.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.960+0000 7fc720ff9640 1 -- 172.21.15.70:0/998328993 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc70c0ce8b0 con 0x7fc724101420 2024-09-12T01:50:22.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.961+0000 7fc7237fe640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc7100a2c10 0x7fc7100a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc714000c00 tx=0x7fc714032c80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:22.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:22.963+0000 7fc720ff9640 1 -- 172.21.15.70:0/998328993 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc70c09b7c0 con 0x7fc724101420 2024-09-12T01:50:23.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:22 smithi152 ceph-mon[35055]: pgmap v281: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 KiB/s wr, 19 op/s 2024-09-12T01:50:23.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:22 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-12T01:50:23.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:22 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-12T01:50:23.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:22 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-12T01:50:23.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:22 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-12T01:50:23.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:22 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-12T01:50:23.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:22 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-12T01:50:23.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:22 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-12T01:50:23.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:22 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-12T01:50:23.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:22 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-12T01:50:23.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:22 smithi152 ceph-mon[35055]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T01:50:23.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:22 smithi152 ceph-mon[35055]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.126+0000 7fc729f86640 1 -- 172.21.15.70:0/998328993 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc724062630 con 0x7fc7100a2c10 2024-09-12T01:50:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.132+0000 7fc720ff9640 1 -- 172.21.15.70:0/998328993 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258579 (secure 0 0 0) 0x7fc724062630 con 0x7fc7100a2c10 2024-09-12T01:50:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:50:23.135 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:50:23.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.135+0000 7fc729f86640 1 -- 172.21.15.70:0/998328993 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc7100a2c10 msgr2=0x7fc7100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:23.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.135+0000 7fc729f86640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc7100a2c10 0x7fc7100a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc714000c00 tx=0x7fc714032c80 comp rx=0 tx=0).stop 2024-09-12T01:50:23.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.135+0000 7fc729f86640 1 -- 172.21.15.70:0/998328993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724101420 msgr2=0x7fc724198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:23.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.135+0000 7fc729f86640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724101420 0x7fc724198ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00b4a0 tx=0x7fc70c00b960 comp rx=0 tx=0).stop 2024-09-12T01:50:23.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.135+0000 7fc729f86640 1 -- 172.21.15.70:0/998328993 shutdown_connections 2024-09-12T01:50:23.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.135+0000 7fc729f86640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc7100a2c10 0x7fc7100a50d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:23.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.135+0000 7fc729f86640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc724106a80 0x7fc72419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:23.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.135+0000 7fc729f86640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc724101420 0x7fc724198ad0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:23.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.135+0000 7fc729f86640 1 --2- 172.21.15.70:0/998328993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc724100a80 0x7fc724198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:23.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.135+0000 7fc729f86640 1 -- 172.21.15.70:0/998328993 >> 172.21.15.70:0/998328993 conn(0x7fc7240fc7a0 msgr2=0x7fc72406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:23.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.135+0000 7fc729f86640 1 -- 172.21.15.70:0/998328993 shutdown_connections 2024-09-12T01:50:23.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:23.135+0000 7fc729f86640 1 -- 172.21.15.70:0/998328993 wait complete. 2024-09-12T01:50:23.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:23 smithi070 ceph-mon[31177]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T01:50:23.715 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:23 smithi070 ceph-mon[31177]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:23.715 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:23 smithi070 ceph-mon[31177]: pgmap v284: 97 pgs: 4 peering, 93 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2024-09-12T01:50:23.742 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-12T01:50:22.607165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647806,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":279,"num_read_kb":250,"num_write":421,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":344,"ondisk_log_size":344,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365904,"kb_used_data":12488,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575920,"statfs":{"total":1151940427776,"available":1151565742080,"internally_reserved":0,"allocated":12787712,"data_stored":6999410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49404,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":115,"num_read_kb":111,"num_write":35,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.131142"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309744+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:49:58.309744+0000","last_peered":"2024-09-12T01:49:58.309744+0000","last_clean":"2024-09-12T01:49:58.309744+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:49:58.309744+0000","last_undegraded":"2024-09-12T01:49:58.309744+0000","last_fullsized":"2024-09-12T01:49:58.309744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607018+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:50:21.607018+0000","last_peered":"2024-09-12T01:50:21.607018+0000","last_clean":"2024-09-12T01:50:21.607018+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:50:21.607018+0000","last_undegraded":"2024-09-12T01:50:21.607018+0000","last_fullsized":"2024-09-12T01:50:21.607018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607089+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:50:21.607089+0000","last_peered":"2024-09-12T01:50:21.607089+0000","last_clean":"2024-09-12T01:50:21.607089+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:50:21.607089+0000","last_undegraded":"2024-09-12T01:50:21.607089+0000","last_fullsized":"2024-09-12T01:50:21.607089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.605458+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:50:21.605458+0000","last_peered":"2024-09-12T01:50:21.605458+0000","last_clean":"2024-09-12T01:50:21.605458+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:50:21.605458+0000","last_undegraded":"2024-09-12T01:50:21.605458+0000","last_fullsized":"2024-09-12T01:50:21.605458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321019+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:49:58.321019+0000","last_peered":"2024-09-12T01:49:58.321019+0000","last_clean":"2024-09-12T01:49:58.321019+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:49:58.321019+0000","last_undegraded":"2024-09-12T01:49:58.321019+0000","last_fullsized":"2024-09-12T01:49:58.321019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.307738+0000","last_change":"2024-09-12T01:49:57.321601+0000","last_active":"2024-09-12T01:49:58.307738+0000","last_peered":"2024-09-12T01:49:58.307738+0000","last_clean":"2024-09-12T01:49:58.307738+0000","last_became_active":"2024-09-12T01:49:57.321272+0000","last_became_peered":"2024-09-12T01:49:57.321272+0000","last_unstale":"2024-09-12T01:49:58.307738+0000","last_undegraded":"2024-09-12T01:49:58.307738+0000","last_fullsized":"2024-09-12T01:49:58.307738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:31.023019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323483+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:49:58.323483+0000","last_peered":"2024-09-12T01:49:58.323483+0000","last_clean":"2024-09-12T01:49:58.323483+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:49:58.323483+0000","last_undegraded":"2024-09-12T01:49:58.323483+0000","last_fullsized":"2024-09-12T01:49:58.323483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.610488+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:50:21.610488+0000","last_peered":"2024-09-12T01:50:21.610488+0000","last_clean":"2024-09-12T01:50:21.610488+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:50:21.610488+0000","last_undegraded":"2024-09-12T01:50:21.610488+0000","last_fullsized":"2024-09-12T01:50:21.610488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.322035+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:49:58.322035+0000","last_peered":"2024-09-12T01:49:58.322035+0000","last_clean":"2024-09-12T01:49:58.322035+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:49:58.322035+0000","last_undegraded":"2024-09-12T01:49:58.322035+0000","last_fullsized":"2024-09-12T01:49:58.322035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.308229+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:49:58.308229+0000","last_peered":"2024-09-12T01:49:58.308229+0000","last_clean":"2024-09-12T01:49:58.308229+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:49:58.308229+0000","last_undegraded":"2024-09-12T01:49:58.308229+0000","last_fullsized":"2024-09-12T01:49:58.308229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.324324+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:49:58.324324+0000","last_peered":"2024-09-12T01:49:58.324324+0000","last_clean":"2024-09-12T01:49:58.324324+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:49:58.324324+0000","last_undegraded":"2024-09-12T01:49:58.324324+0000","last_fullsized":"2024-09-12T01:49:58.324324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.605561+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:50:21.605561+0000","last_peered":"2024-09-12T01:50:21.605561+0000","last_clean":"2024-09-12T01:50:21.605561+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:50:21.605561+0000","last_undegraded":"2024-09-12T01:50:21.605561+0000","last_fullsized":"2024-09-12T01:50:21.605561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306642+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:49:58.306642+0000","last_peered":"2024-09-12T01:49:58.306642+0000","last_clean":"2024-09-12T01:49:58.306642+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:49:58.306642+0000","last_undegraded":"2024-09-12T01:49:58.306642+0000","last_fullsized":"2024-09-12T01:49:58.306642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607299+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:50:21.607299+0000","last_peered":"2024-09-12T01:50:21.607299+0000","last_clean":"2024-09-12T01:50:21.607299+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:50:21.607299+0000","last_undegraded":"2024-09-12T01:50:21.607299+0000","last_fullsized":"2024-09-12T01:50:21.607299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.606983+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:50:21.606983+0000","last_peered":"2024-09-12T01:50:21.606983+0000","last_clean":"2024-09-12T01:50:21.606983+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:50:21.606983+0000","last_undegraded":"2024-09-12T01:50:21.606983+0000","last_fullsized":"2024-09-12T01:50:21.606983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323420+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:49:58.323420+0000","last_peered":"2024-09-12T01:49:58.323420+0000","last_clean":"2024-09-12T01:49:58.323420+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:49:58.323420+0000","last_undegraded":"2024-09-12T01:49:58.323420+0000","last_fullsized":"2024-09-12T01:49:58.323420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309753+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:49:58.309753+0000","last_peered":"2024-09-12T01:49:58.309753+0000","last_clean":"2024-09-12T01:49:58.309753+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:49:58.309753+0000","last_undegraded":"2024-09-12T01:49:58.309753+0000","last_fullsized":"2024-09-12T01:49:58.309753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.608868+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:50:21.608868+0000","last_peered":"2024-09-12T01:50:21.608868+0000","last_clean":"2024-09-12T01:50:21.608868+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:50:21.608868+0000","last_undegraded":"2024-09-12T01:50:21.608868+0000","last_fullsized":"2024-09-12T01:50:21.608868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.322285+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:49:58.322285+0000","last_peered":"2024-09-12T01:49:58.322285+0000","last_clean":"2024-09-12T01:49:58.322285+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:49:58.322285+0000","last_undegraded":"2024-09-12T01:49:58.322285+0000","last_fullsized":"2024-09-12T01:49:58.322285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309381+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:49:58.309381+0000","last_peered":"2024-09-12T01:49:58.309381+0000","last_clean":"2024-09-12T01:49:58.309381+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:49:58.309381+0000","last_undegraded":"2024-09-12T01:49:58.309381+0000","last_fullsized":"2024-09-12T01:49:58.309381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306751+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:49:58.306751+0000","last_peered":"2024-09-12T01:49:58.306751+0000","last_clean":"2024-09-12T01:49:58.306751+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:49:58.306751+0000","last_undegraded":"2024-09-12T01:49:58.306751+0000","last_fullsized":"2024-09-12T01:49:58.306751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321786+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:49:58.321786+0000","last_peered":"2024-09-12T01:49:58.321786+0000","last_clean":"2024-09-12T01:49:58.321786+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:49:58.321786+0000","last_undegraded":"2024-09-12T01:49:58.321786+0000","last_fullsized":"2024-09-12T01:49:58.321786+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611083+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:50:21.611083+0000","last_peered":"2024-09-12T01:50:21.611083+0000","last_clean":"2024-09-12T01:50:21.611083+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:50:21.611083+0000","last_undegraded":"2024-09-12T01:50:21.611083+0000","last_fullsized":"2024-09-12T01:50:21.611083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321569+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:49:58.321569+0000","last_peered":"2024-09-12T01:49:58.321569+0000","last_clean":"2024-09-12T01:49:58.321569+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:49:58.321569+0000","last_undegraded":"2024-09-12T01:49:58.321569+0000","last_fullsized":"2024-09-12T01:49:58.321569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611476+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:50:21.611476+0000","last_peered":"2024-09-12T01:50:21.611476+0000","last_clean":"2024-09-12T01:50:21.611476+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:50:21.611476+0000","last_undegraded":"2024-09-12T01:50:21.611476+0000","last_fullsized":"2024-09-12T01:50:21.611476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.322518+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:49:58.322518+0000","last_peered":"2024-09-12T01:49:58.322518+0000","last_clean":"2024-09-12T01:49:58.322518+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:49:58.322518+0000","last_undegraded":"2024-09-12T01:49:58.322518+0000","last_fullsized":"2024-09-12T01:49:58.322518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309573+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:49:58.309573+0000","last_peered":"2024-09-12T01:49:58.309573+0000","last_clean":"2024-09-12T01:49:58.309573+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:49:58.309573+0000","last_undegraded":"2024-09-12T01:49:58.309573+0000","last_fullsized":"2024-09-12T01:49:58.309573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306635+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:49:58.306635+0000","last_peered":"2024-09-12T01:49:58.306635+0000","last_clean":"2024-09-12T01:49:58.306635+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:49:58.306635+0000","last_undegraded":"2024-09-12T01:49:58.306635+0000","last_fullsized":"2024-09-12T01:49:58.306635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607271+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:50:21.607271+0000","last_peered":"2024-09-12T01:50:21.607271+0000","last_clean":"2024-09-12T01:50:21.607271+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:50:21.607271+0000","last_undegraded":"2024-09-12T01:50:21.607271+0000","last_fullsized":"2024-09-12T01:50:21.607271+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321962+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:49:58.321962+0000","last_peered":"2024-09-12T01:49:58.321962+0000","last_clean":"2024-09-12T01:49:58.321962+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:49:58.321962+0000","last_undegraded":"2024-09-12T01:49:58.321962+0000","last_fullsized":"2024-09-12T01:49:58.321962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321986+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:49:58.321986+0000","last_peered":"2024-09-12T01:49:58.321986+0000","last_clean":"2024-09-12T01:49:58.321986+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:49:58.321986+0000","last_undegraded":"2024-09-12T01:49:58.321986+0000","last_fullsized":"2024-09-12T01:49:58.321986+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309495+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:49:58.309495+0000","last_peered":"2024-09-12T01:49:58.309495+0000","last_clean":"2024-09-12T01:49:58.309495+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:49:58.309495+0000","last_undegraded":"2024-09-12T01:49:58.309495+0000","last_fullsized":"2024-09-12T01:49:58.309495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.320936+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:49:58.320936+0000","last_peered":"2024-09-12T01:49:58.320936+0000","last_clean":"2024-09-12T01:49:58.320936+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:49:58.320936+0000","last_undegraded":"2024-09-12T01:49:58.320936+0000","last_fullsized":"2024-09-12T01:49:58.320936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:18.399008+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:50:18.399008+0000","last_peered":"2024-09-12T01:50:18.399008+0000","last_clean":"2024-09-12T01:50:18.399008+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:50:18.399008+0000","last_undegraded":"2024-09-12T01:50:18.399008+0000","last_fullsized":"2024-09-12T01:50:18.399008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321145+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:49:58.321145+0000","last_peered":"2024-09-12T01:49:58.321145+0000","last_clean":"2024-09-12T01:49:58.321145+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:49:58.321145+0000","last_undegraded":"2024-09-12T01:49:58.321145+0000","last_fullsized":"2024-09-12T01:49:58.321145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:07.371422+0000","last_change":"2024-09-12T01:49:55.302461+0000","last_active":"2024-09-12T01:50:07.371422+0000","last_peered":"2024-09-12T01:50:07.371422+0000","last_clean":"2024-09-12T01:50:07.371422+0000","last_became_active":"2024-09-12T01:49:55.300957+0000","last_became_peered":"2024-09-12T01:49:55.300957+0000","last_unstale":"2024-09-12T01:50:07.371422+0000","last_undegraded":"2024-09-12T01:50:07.371422+0000","last_fullsized":"2024-09-12T01:50:07.371422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:13.926080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:06.363305+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:06.363305+0000","last_peered":"2024-09-12T01:50:06.363305+0000","last_clean":"2024-09-12T01:50:06.363305+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:06.363305+0000","last_undegraded":"2024-09-12T01:50:06.363305+0000","last_fullsized":"2024-09-12T01:50:06.363305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611016+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:50:21.611016+0000","last_peered":"2024-09-12T01:50:21.611016+0000","last_clean":"2024-09-12T01:50:21.611016+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:50:21.611016+0000","last_undegraded":"2024-09-12T01:50:21.611016+0000","last_fullsized":"2024-09-12T01:50:21.611016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379193+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:08.379193+0000","last_peered":"2024-09-12T01:50:08.379193+0000","last_clean":"2024-09-12T01:50:08.379193+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:08.379193+0000","last_undegraded":"2024-09-12T01:50:08.379193+0000","last_fullsized":"2024-09-12T01:50:08.379193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607628+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:50:21.607628+0000","last_peered":"2024-09-12T01:50:21.607628+0000","last_clean":"2024-09-12T01:50:21.607628+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:50:21.607628+0000","last_undegraded":"2024-09-12T01:50:21.607628+0000","last_fullsized":"2024-09-12T01:50:21.607628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:20.400472+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:50:20.400472+0000","last_peered":"2024-09-12T01:50:20.400472+0000","last_clean":"2024-09-12T01:50:20.400472+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:50:20.400472+0000","last_undegraded":"2024-09-12T01:50:20.400472+0000","last_fullsized":"2024-09-12T01:50:20.400472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321965+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:49:58.321965+0000","last_peered":"2024-09-12T01:49:58.321965+0000","last_clean":"2024-09-12T01:49:58.321965+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:49:58.321965+0000","last_undegraded":"2024-09-12T01:49:58.321965+0000","last_fullsized":"2024-09-12T01:49:58.321965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.381217+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:08.381217+0000","last_peered":"2024-09-12T01:50:08.381217+0000","last_clean":"2024-09-12T01:50:08.381217+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:08.381217+0000","last_undegraded":"2024-09-12T01:50:08.381217+0000","last_fullsized":"2024-09-12T01:50:08.381217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-12T01:49:58.324392+0000","last_change":"2024-09-12T01:50:21.607820+0000","last_active":"2024-09-12T01:50:21.607820+0000","last_peered":"2024-09-12T01:49:58.324392+0000","last_clean":"2024-09-12T01:49:58.324392+0000","last_became_active":"2024-09-12T01:49:57.321228+0000","last_became_peered":"2024-09-12T01:49:57.321228+0000","last_unstale":"2024-09-12T01:49:58.324392+0000","last_undegraded":"2024-09-12T01:49:58.324392+0000","last_fullsized":"2024-09-12T01:49:58.324392+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:07.371589+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:07.371589+0000","last_peered":"2024-09-12T01:50:07.371589+0000","last_clean":"2024-09-12T01:50:07.371589+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:07.371589+0000","last_undegraded":"2024-09-12T01:50:07.371589+0000","last_fullsized":"2024-09-12T01:50:07.371589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321821+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:49:58.321821+0000","last_peered":"2024-09-12T01:49:58.321821+0000","last_clean":"2024-09-12T01:49:58.321821+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:49:58.321821+0000","last_undegraded":"2024-09-12T01:49:58.321821+0000","last_fullsized":"2024-09-12T01:49:58.321821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:20.402561+0000","last_change":"2024-09-12T01:49:55.300385+0000","last_active":"2024-09-12T01:50:20.402561+0000","last_peered":"2024-09-12T01:50:20.402561+0000","last_clean":"2024-09-12T01:50:20.402561+0000","last_became_active":"2024-09-12T01:49:55.300042+0000","last_became_peered":"2024-09-12T01:49:55.300042+0000","last_unstale":"2024-09-12T01:50:20.402561+0000","last_undegraded":"2024-09-12T01:50:20.402561+0000","last_fullsized":"2024-09-12T01:50:20.402561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:23.335345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49603,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":63,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323410+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:49:58.323410+0000","last_peered":"2024-09-12T01:49:58.323410+0000","last_clean":"2024-09-12T01:49:58.323410+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:49:58.323410+0000","last_undegraded":"2024-09-12T01:49:58.323410+0000","last_fullsized":"2024-09-12T01:49:58.323410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:09.382740+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:09.382740+0000","last_peered":"2024-09-12T01:50:09.382740+0000","last_clean":"2024-09-12T01:50:09.382740+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:09.382740+0000","last_undegraded":"2024-09-12T01:50:09.382740+0000","last_fullsized":"2024-09-12T01:50:09.382740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306398+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:49:58.306398+0000","last_peered":"2024-09-12T01:49:58.306398+0000","last_clean":"2024-09-12T01:49:58.306398+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:49:58.306398+0000","last_undegraded":"2024-09-12T01:49:58.306398+0000","last_fullsized":"2024-09-12T01:49:58.306398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379620+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:08.379620+0000","last_peered":"2024-09-12T01:50:08.379620+0000","last_clean":"2024-09-12T01:50:08.379620+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:08.379620+0000","last_undegraded":"2024-09-12T01:50:08.379620+0000","last_fullsized":"2024-09-12T01:50:08.379620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.324062+0000","last_change":"2024-09-12T01:49:57.326773+0000","last_active":"2024-09-12T01:49:58.324062+0000","last_peered":"2024-09-12T01:49:58.324062+0000","last_clean":"2024-09-12T01:49:58.324062+0000","last_became_active":"2024-09-12T01:49:57.326371+0000","last_became_peered":"2024-09-12T01:49:57.326371+0000","last_unstale":"2024-09-12T01:49:58.324062+0000","last_undegraded":"2024-09-12T01:49:58.324062+0000","last_fullsized":"2024-09-12T01:49:58.324062+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:26.758840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.606690+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:50:21.606690+0000","last_peered":"2024-09-12T01:50:21.606690+0000","last_clean":"2024-09-12T01:50:21.606690+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:50:21.606690+0000","last_undegraded":"2024-09-12T01:50:21.606690+0000","last_fullsized":"2024-09-12T01:50:21.606690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323342+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:49:58.323342+0000","last_peered":"2024-09-12T01:49:58.323342+0000","last_clean":"2024-09-12T01:49:58.323342+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:49:58.323342+0000","last_undegraded":"2024-09-12T01:49:58.323342+0000","last_fullsized":"2024-09-12T01:49:58.323342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.378548+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:08.378548+0000","last_peered":"2024-09-12T01:50:08.378548+0000","last_clean":"2024-09-12T01:50:08.378548+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:08.378548+0000","last_undegraded":"2024-09-12T01:50:08.378548+0000","last_fullsized":"2024-09-12T01:50:08.378548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321260+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:49:58.321260+0000","last_peered":"2024-09-12T01:49:58.321260+0000","last_clean":"2024-09-12T01:49:58.321260+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:49:58.321260+0000","last_undegraded":"2024-09-12T01:49:58.321260+0000","last_fullsized":"2024-09-12T01:49:58.321260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:07.359930+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:07.359930+0000","last_peered":"2024-09-12T01:50:07.359930+0000","last_clean":"2024-09-12T01:50:07.359930+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:07.359930+0000","last_undegraded":"2024-09-12T01:50:07.359930+0000","last_fullsized":"2024-09-12T01:50:07.359930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309527+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:49:58.309527+0000","last_peered":"2024-09-12T01:49:58.309527+0000","last_clean":"2024-09-12T01:49:58.309527+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:49:58.309527+0000","last_undegraded":"2024-09-12T01:49:58.309527+0000","last_fullsized":"2024-09-12T01:49:58.309527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379004+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:08.379004+0000","last_peered":"2024-09-12T01:50:08.379004+0000","last_clean":"2024-09-12T01:50:08.379004+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:08.379004+0000","last_undegraded":"2024-09-12T01:50:08.379004+0000","last_fullsized":"2024-09-12T01:50:08.379004+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.324382+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:49:58.324382+0000","last_peered":"2024-09-12T01:49:58.324382+0000","last_clean":"2024-09-12T01:49:58.324382+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:49:58.324382+0000","last_undegraded":"2024-09-12T01:49:58.324382+0000","last_fullsized":"2024-09-12T01:49:58.324382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.378167+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:08.378167+0000","last_peered":"2024-09-12T01:50:08.378167+0000","last_clean":"2024-09-12T01:50:08.378167+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:08.378167+0000","last_undegraded":"2024-09-12T01:50:08.378167+0000","last_fullsized":"2024-09-12T01:50:08.378167+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:59.546892+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:49:59.546892+0000","last_peered":"2024-09-12T01:49:59.546892+0000","last_clean":"2024-09-12T01:49:59.546892+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:49:59.546892+0000","last_undegraded":"2024-09-12T01:49:59.546892+0000","last_fullsized":"2024-09-12T01:49:59.546892+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'6","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:17.397480+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:50:17.397480+0000","last_peered":"2024-09-12T01:50:17.397480+0000","last_clean":"2024-09-12T01:50:17.397480+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:50:17.397480+0000","last_undegraded":"2024-09-12T01:50:17.397480+0000","last_fullsized":"2024-09-12T01:50:17.397480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323777+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:49:58.323777+0000","last_peered":"2024-09-12T01:49:58.323777+0000","last_clean":"2024-09-12T01:49:58.323777+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:49:58.323777+0000","last_undegraded":"2024-09-12T01:49:58.323777+0000","last_fullsized":"2024-09-12T01:49:58.323777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":328,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323459+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:49:58.323459+0000","last_peered":"2024-09-12T01:49:58.323459+0000","last_clean":"2024-09-12T01:49:58.323459+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:49:58.323459+0000","last_undegraded":"2024-09-12T01:49:58.323459+0000","last_fullsized":"2024-09-12T01:49:58.323459+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.605227+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:21.605227+0000","last_peered":"2024-09-12T01:50:21.605227+0000","last_clean":"2024-09-12T01:50:21.605227+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:21.605227+0000","last_undegraded":"2024-09-12T01:50:21.605227+0000","last_fullsized":"2024-09-12T01:50:21.605227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611304+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:50:21.611304+0000","last_peered":"2024-09-12T01:50:21.611304+0000","last_clean":"2024-09-12T01:50:21.611304+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:50:21.611304+0000","last_undegraded":"2024-09-12T01:50:21.611304+0000","last_fullsized":"2024-09-12T01:50:21.611304+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:06.364010+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:06.364010+0000","last_peered":"2024-09-12T01:50:06.364010+0000","last_clean":"2024-09-12T01:50:06.364010+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:06.364010+0000","last_undegraded":"2024-09-12T01:50:06.364010+0000","last_fullsized":"2024-09-12T01:50:06.364010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306365+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:49:58.306365+0000","last_peered":"2024-09-12T01:49:58.306365+0000","last_clean":"2024-09-12T01:49:58.306365+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:49:58.306365+0000","last_undegraded":"2024-09-12T01:49:58.306365+0000","last_fullsized":"2024-09-12T01:49:58.306365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:18.397587+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:50:18.397587+0000","last_peered":"2024-09-12T01:50:18.397587+0000","last_clean":"2024-09-12T01:50:18.397587+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:50:18.397587+0000","last_undegraded":"2024-09-12T01:50:18.397587+0000","last_fullsized":"2024-09-12T01:50:18.397587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":2,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-12T01:49:57.306176+0000","last_change":"2024-09-12T01:50:22.384098+0000","last_active":"2024-09-12T01:49:56.292576+0000","last_peered":"2024-09-12T01:49:56.292576+0000","last_clean":"2024-09-12T01:49:56.292576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:49:57.306176+0000","last_undegraded":"2024-09-12T01:49:57.306176+0000","last_fullsized":"2024-09-12T01:49:57.306176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'6","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:18.397671+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:50:18.397671+0000","last_peered":"2024-09-12T01:50:18.397671+0000","last_clean":"2024-09-12T01:50:18.397671+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:50:18.397671+0000","last_undegraded":"2024-09-12T01:50:18.397671+0000","last_fullsized":"2024-09-12T01:50:18.397671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.308150+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:49:58.308150+0000","last_peered":"2024-09-12T01:49:58.308150+0000","last_clean":"2024-09-12T01:49:58.308150+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:49:58.308150+0000","last_undegraded":"2024-09-12T01:49:58.308150+0000","last_fullsized":"2024-09-12T01:49:58.308150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-12T01:50:07.372486+0000","last_change":"2024-09-12T01:50:21.609087+0000","last_active":"2024-09-12T01:50:21.609087+0000","last_peered":"2024-09-12T01:50:07.372486+0000","last_clean":"2024-09-12T01:50:07.372486+0000","last_became_active":"2024-09-12T01:49:55.712596+0000","last_became_peered":"2024-09-12T01:49:55.712596+0000","last_unstale":"2024-09-12T01:50:07.372486+0000","last_undegraded":"2024-09-12T01:50:07.372486+0000","last_fullsized":"2024-09-12T01:50:07.372486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:00.540132+0000","last_change":"2024-09-12T01:49:57.313745+0000","last_active":"2024-09-12T01:50:00.540132+0000","last_peered":"2024-09-12T01:50:00.540132+0000","last_clean":"2024-09-12T01:50:00.540132+0000","last_became_active":"2024-09-12T01:49:57.313397+0000","last_became_peered":"2024-09-12T01:49:57.313397+0000","last_unstale":"2024-09-12T01:50:00.540132+0000","last_undegraded":"2024-09-12T01:50:00.540132+0000","last_fullsized":"2024-09-12T01:50:00.540132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:45.032475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379535+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:08.379535+0000","last_peered":"2024-09-12T01:50:08.379535+0000","last_clean":"2024-09-12T01:50:08.379535+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:08.379535+0000","last_undegraded":"2024-09-12T01:50:08.379535+0000","last_fullsized":"2024-09-12T01:50:08.379535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306764+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:49:58.306764+0000","last_peered":"2024-09-12T01:49:58.306764+0000","last_clean":"2024-09-12T01:49:58.306764+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:49:58.306764+0000","last_undegraded":"2024-09-12T01:49:58.306764+0000","last_fullsized":"2024-09-12T01:49:58.306764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'13","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.608891+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:50:21.608891+0000","last_peered":"2024-09-12T01:50:21.608891+0000","last_clean":"2024-09-12T01:50:21.608891+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:50:21.608891+0000","last_undegraded":"2024-09-12T01:50:21.608891+0000","last_fullsized":"2024-09-12T01:50:21.608891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611565+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:50:21.611565+0000","last_peered":"2024-09-12T01:50:21.611565+0000","last_clean":"2024-09-12T01:50:21.611565+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:50:21.611565+0000","last_undegraded":"2024-09-12T01:50:21.611565+0000","last_fullsized":"2024-09-12T01:50:21.611565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.605367+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:21.605367+0000","last_peered":"2024-09-12T01:50:21.605367+0000","last_clean":"2024-09-12T01:50:21.605367+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:21.605367+0000","last_undegraded":"2024-09-12T01:50:21.605367+0000","last_fullsized":"2024-09-12T01:50:21.605367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607119+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:50:21.607119+0000","last_peered":"2024-09-12T01:50:21.607119+0000","last_clean":"2024-09-12T01:50:21.607119+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:50:21.607119+0000","last_undegraded":"2024-09-12T01:50:21.607119+0000","last_fullsized":"2024-09-12T01:50:21.607119+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:05.356487+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:05.356487+0000","last_peered":"2024-09-12T01:50:05.356487+0000","last_clean":"2024-09-12T01:50:05.356487+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:05.356487+0000","last_undegraded":"2024-09-12T01:50:05.356487+0000","last_fullsized":"2024-09-12T01:50:05.356487+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.320939+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:49:58.320939+0000","last_peered":"2024-09-12T01:49:58.320939+0000","last_clean":"2024-09-12T01:49:58.320939+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:49:58.320939+0000","last_undegraded":"2024-09-12T01:49:58.320939+0000","last_fullsized":"2024-09-12T01:49:58.320939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611172+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:21.611172+0000","last_peered":"2024-09-12T01:50:21.611172+0000","last_clean":"2024-09-12T01:50:21.611172+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:21.611172+0000","last_undegraded":"2024-09-12T01:50:21.611172+0000","last_fullsized":"2024-09-12T01:50:21.611172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309528+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:49:58.309528+0000","last_peered":"2024-09-12T01:49:58.309528+0000","last_clean":"2024-09-12T01:49:58.309528+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:49:58.309528+0000","last_undegraded":"2024-09-12T01:49:58.309528+0000","last_fullsized":"2024-09-12T01:49:58.309528+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:07.371917+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:07.371917+0000","last_peered":"2024-09-12T01:50:07.371917+0000","last_clean":"2024-09-12T01:50:07.371917+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:07.371917+0000","last_undegraded":"2024-09-12T01:50:07.371917+0000","last_fullsized":"2024-09-12T01:50:07.371917+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611313+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:50:21.611313+0000","last_peered":"2024-09-12T01:50:21.611313+0000","last_clean":"2024-09-12T01:50:21.611313+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:50:21.611313+0000","last_undegraded":"2024-09-12T01:50:21.611313+0000","last_fullsized":"2024-09-12T01:50:21.611313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:05.357799+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:05.357799+0000","last_peered":"2024-09-12T01:50:05.357799+0000","last_clean":"2024-09-12T01:50:05.357799+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:05.357799+0000","last_undegraded":"2024-09-12T01:50:05.357799+0000","last_fullsized":"2024-09-12T01:50:05.357799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323872+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:49:58.323872+0000","last_peered":"2024-09-12T01:49:58.323872+0000","last_clean":"2024-09-12T01:49:58.323872+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:49:58.323872+0000","last_undegraded":"2024-09-12T01:49:58.323872+0000","last_fullsized":"2024-09-12T01:49:58.323872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323337+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:49:58.323337+0000","last_peered":"2024-09-12T01:49:58.323337+0000","last_clean":"2024-09-12T01:49:58.323337+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:49:58.323337+0000","last_undegraded":"2024-09-12T01:49:58.323337+0000","last_fullsized":"2024-09-12T01:49:58.323337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.380635+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:08.380635+0000","last_peered":"2024-09-12T01:50:08.380635+0000","last_clean":"2024-09-12T01:50:08.380635+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:08.380635+0000","last_undegraded":"2024-09-12T01:50:08.380635+0000","last_fullsized":"2024-09-12T01:50:08.380635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321631+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:49:58.321631+0000","last_peered":"2024-09-12T01:49:58.321631+0000","last_clean":"2024-09-12T01:49:58.321631+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:49:58.321631+0000","last_undegraded":"2024-09-12T01:49:58.321631+0000","last_fullsized":"2024-09-12T01:49:58.321631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:09.376475+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:09.376475+0000","last_peered":"2024-09-12T01:50:09.376475+0000","last_clean":"2024-09-12T01:50:09.376475+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:09.376475+0000","last_undegraded":"2024-09-12T01:50:09.376475+0000","last_fullsized":"2024-09-12T01:50:09.376475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607544+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:50:21.607544+0000","last_peered":"2024-09-12T01:50:21.607544+0000","last_clean":"2024-09-12T01:50:21.607544+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:50:21.607544+0000","last_undegraded":"2024-09-12T01:50:21.607544+0000","last_fullsized":"2024-09-12T01:50:21.607544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611632+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:50:21.611632+0000","last_peered":"2024-09-12T01:50:21.611632+0000","last_clean":"2024-09-12T01:50:21.611632+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:50:21.611632+0000","last_undegraded":"2024-09-12T01:50:21.611632+0000","last_fullsized":"2024-09-12T01:50:21.611632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611415+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:50:21.611415+0000","last_peered":"2024-09-12T01:50:21.611415+0000","last_clean":"2024-09-12T01:50:21.611415+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:50:21.611415+0000","last_undegraded":"2024-09-12T01:50:21.611415+0000","last_fullsized":"2024-09-12T01:50:21.611415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":46,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-12T01:50:21.400854+0000","last_change":"2024-09-12T01:50:21.609682+0000","last_active":"2024-09-12T01:50:21.609682+0000","last_peered":"2024-09-12T01:50:21.400854+0000","last_clean":"2024-09-12T01:50:21.400854+0000","last_became_active":"2024-09-12T01:49:55.300056+0000","last_became_peered":"2024-09-12T01:49:55.300056+0000","last_unstale":"2024-09-12T01:50:21.400854+0000","last_undegraded":"2024-09-12T01:50:21.400854+0000","last_fullsized":"2024-09-12T01:50:21.400854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7,8,11],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57204,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":153,"num_read_kb":141,"num_write":238,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":171612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":421584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776149,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1061823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939675,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":429822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168606,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":421499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397540,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1014412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528361,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":421231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789997,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1511424,"data_stored":1013697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953523,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":420699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":429364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":470962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":471747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":422570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":51748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":52361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:50:23.746 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:50:23.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:23 smithi191 ceph-mon[35770]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T01:50:23.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:23 smithi191 ceph-mon[35770]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:23.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:23 smithi191 ceph-mon[35770]: pgmap v284: 97 pgs: 4 peering, 93 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2024-09-12T01:50:23.989 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:24.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:23 smithi152 ceph-mon[35055]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T01:50:24.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:23 smithi152 ceph-mon[35055]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:24.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:23 smithi152 ceph-mon[35055]: pgmap v284: 97 pgs: 4 peering, 93 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2024-09-12T01:50:24.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.456+0000 7f09aa82e640 1 -- 172.21.15.70:0/867908363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a4102dc0 msgr2=0x7f09a41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:24.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.456+0000 7f09aa82e640 1 --2- 172.21.15.70:0/867908363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a4102dc0 0x7f09a41031a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0994009900 tx=0x7f099402a480 comp rx=0 tx=0).stop 2024-09-12T01:50:24.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.456+0000 7f09aa82e640 1 -- 172.21.15.70:0/867908363 shutdown_connections 2024-09-12T01:50:24.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.456+0000 7f09aa82e640 1 --2- 172.21.15.70:0/867908363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09a410c160 0x7f09a410e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:24.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.456+0000 7f09aa82e640 1 --2- 172.21.15.70:0/867908363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09a41036e0 0x7f09a410bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:24.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.456+0000 7f09aa82e640 1 --2- 172.21.15.70:0/867908363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a4102dc0 0x7f09a41031a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:24.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.456+0000 7f09aa82e640 1 -- 172.21.15.70:0/867908363 >> 172.21.15.70:0/867908363 conn(0x7f09a40fc780 msgr2=0x7f09a40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:24.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.456+0000 7f09aa82e640 1 -- 172.21.15.70:0/867908363 shutdown_connections 2024-09-12T01:50:24.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.456+0000 7f09aa82e640 1 -- 172.21.15.70:0/867908363 wait complete. 2024-09-12T01:50:24.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.456+0000 7f09aa82e640 1 Processor -- start 2024-09-12T01:50:24.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.456+0000 7f09aa82e640 1 -- start start 2024-09-12T01:50:24.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09aa82e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a4102dc0 0x7f09a4198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:24.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09aa82e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09a41036e0 0x7f09a4198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:24.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09aa82e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09a410c160 0x7f09a419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:24.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09aa82e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09a41120d0 con 0x7f09a4102dc0 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09aa82e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f09a4111f50 con 0x7f09a41036e0 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09aa82e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f09a4112250 con 0x7f09a410c160 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a4102dc0 0x7f09a4198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a4102dc0 0x7f09a4198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48072/0 (socket says 172.21.15.70:48072) 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09a3fff640 1 -- 172.21.15.70:0/1608826491 learned_addr learned my addr 172.21.15.70:0/1608826491 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f099bfff640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09a41036e0 0x7f09a4198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09a8dcb640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09a410c160 0x7f09a419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09a3fff640 1 -- 172.21.15.70:0/1608826491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09a410c160 msgr2=0x7f09a419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09a3fff640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09a410c160 0x7f09a419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09a3fff640 1 -- 172.21.15.70:0/1608826491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09a41036e0 msgr2=0x7f09a4198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09a3fff640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09a41036e0 0x7f09a4198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09a3fff640 1 -- 172.21.15.70:0/1608826491 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a419d500 con 0x7f09a4102dc0 2024-09-12T01:50:24.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09a3fff640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a4102dc0 0x7f09a4198550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0994006010 tx=0x7f09940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:24.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.457+0000 7f09a1ffb640 1 -- 172.21.15.70:0/1608826491 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099403f030 con 0x7f09a4102dc0 2024-09-12T01:50:24.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.458+0000 7f09a1ffb640 1 -- 172.21.15.70:0/1608826491 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0994003d00 con 0x7f09a4102dc0 2024-09-12T01:50:24.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.458+0000 7f09aa82e640 1 -- 172.21.15.70:0/1608826491 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a419d790 con 0x7f09a4102dc0 2024-09-12T01:50:24.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.458+0000 7f09a1ffb640 1 -- 172.21.15.70:0/1608826491 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994035070 con 0x7f09a4102dc0 2024-09-12T01:50:24.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.458+0000 7f09aa82e640 1 -- 172.21.15.70:0/1608826491 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a41a50d0 con 0x7f09a4102dc0 2024-09-12T01:50:24.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.459+0000 7f09aa82e640 1 -- 172.21.15.70:0/1608826491 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a41031a0 con 0x7f09a4102dc0 2024-09-12T01:50:24.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.460+0000 7f09a1ffb640 1 -- 172.21.15.70:0/1608826491 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0994042030 con 0x7f09a4102dc0 2024-09-12T01:50:24.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.460+0000 7f09a1ffb640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f09900a2c10 0x7f09900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:24.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.461+0000 7f099bfff640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f09900a2c10 0x7f09900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:24.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.461+0000 7f09a1ffb640 1 -- 172.21.15.70:0/1608826491 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f09940ef740 con 0x7f09a4102dc0 2024-09-12T01:50:24.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.461+0000 7f099bfff640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f09900a2c10 0x7f09900a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f09a40fed80 tx=0x7f098c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:24.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.465+0000 7f09a1ffb640 1 -- 172.21.15.70:0/1608826491 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09940bc540 con 0x7f09a4102dc0 2024-09-12T01:50:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.629+0000 7f09aa82e640 1 -- 172.21.15.70:0/1608826491 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09a4062630 con 0x7f09900a2c10 2024-09-12T01:50:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.635+0000 7f09a1ffb640 1 -- 172.21.15.70:0/1608826491 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258576 (secure 0 0 0) 0x7f09a4062630 con 0x7f09900a2c10 2024-09-12T01:50:24.638 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:50:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:50:24.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.639+0000 7f09aa82e640 1 -- 172.21.15.70:0/1608826491 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f09900a2c10 msgr2=0x7f09900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:24.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.639+0000 7f09aa82e640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f09900a2c10 0x7f09900a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f09a40fed80 tx=0x7f098c00a2d0 comp rx=0 tx=0).stop 2024-09-12T01:50:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.639+0000 7f09aa82e640 1 -- 172.21.15.70:0/1608826491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a4102dc0 msgr2=0x7f09a4198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.639+0000 7f09aa82e640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a4102dc0 0x7f09a4198550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0994006010 tx=0x7f09940042f0 comp rx=0 tx=0).stop 2024-09-12T01:50:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.639+0000 7f09aa82e640 1 -- 172.21.15.70:0/1608826491 shutdown_connections 2024-09-12T01:50:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.639+0000 7f09aa82e640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f09900a2c10 0x7f09900a50d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.639+0000 7f09aa82e640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09a410c160 0x7f09a419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.639+0000 7f09aa82e640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09a41036e0 0x7f09a4198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.639+0000 7f09aa82e640 1 --2- 172.21.15.70:0/1608826491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a4102dc0 0x7f09a4198550 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.639+0000 7f09aa82e640 1 -- 172.21.15.70:0/1608826491 >> 172.21.15.70:0/1608826491 conn(0x7f09a40fc780 msgr2=0x7f09a40fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.639+0000 7f09aa82e640 1 -- 172.21.15.70:0/1608826491 shutdown_connections 2024-09-12T01:50:24.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:24.640+0000 7f09aa82e640 1 -- 172.21.15.70:0/1608826491 wait complete. 2024-09-12T01:50:25.299 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-12T01:50:23.478377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647806,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":279,"num_read_kb":250,"num_write":421,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":344,"ondisk_log_size":344,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365904,"kb_used_data":12488,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575920,"statfs":{"total":1151940427776,"available":1151565742080,"internally_reserved":0,"allocated":12787712,"data_stored":6999410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48225,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":91,"num_write":30,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001933"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309744+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:49:58.309744+0000","last_peered":"2024-09-12T01:49:58.309744+0000","last_clean":"2024-09-12T01:49:58.309744+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:49:58.309744+0000","last_undegraded":"2024-09-12T01:49:58.309744+0000","last_fullsized":"2024-09-12T01:49:58.309744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607018+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:50:21.607018+0000","last_peered":"2024-09-12T01:50:21.607018+0000","last_clean":"2024-09-12T01:50:21.607018+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:50:21.607018+0000","last_undegraded":"2024-09-12T01:50:21.607018+0000","last_fullsized":"2024-09-12T01:50:21.607018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607089+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:50:21.607089+0000","last_peered":"2024-09-12T01:50:21.607089+0000","last_clean":"2024-09-12T01:50:21.607089+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:50:21.607089+0000","last_undegraded":"2024-09-12T01:50:21.607089+0000","last_fullsized":"2024-09-12T01:50:21.607089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.605458+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:50:21.605458+0000","last_peered":"2024-09-12T01:50:21.605458+0000","last_clean":"2024-09-12T01:50:21.605458+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:50:21.605458+0000","last_undegraded":"2024-09-12T01:50:21.605458+0000","last_fullsized":"2024-09-12T01:50:21.605458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321019+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:49:58.321019+0000","last_peered":"2024-09-12T01:49:58.321019+0000","last_clean":"2024-09-12T01:49:58.321019+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:49:58.321019+0000","last_undegraded":"2024-09-12T01:49:58.321019+0000","last_fullsized":"2024-09-12T01:49:58.321019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.307738+0000","last_change":"2024-09-12T01:49:57.321601+0000","last_active":"2024-09-12T01:49:58.307738+0000","last_peered":"2024-09-12T01:49:58.307738+0000","last_clean":"2024-09-12T01:49:58.307738+0000","last_became_active":"2024-09-12T01:49:57.321272+0000","last_became_peered":"2024-09-12T01:49:57.321272+0000","last_unstale":"2024-09-12T01:49:58.307738+0000","last_undegraded":"2024-09-12T01:49:58.307738+0000","last_fullsized":"2024-09-12T01:49:58.307738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:31.023019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323483+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:49:58.323483+0000","last_peered":"2024-09-12T01:49:58.323483+0000","last_clean":"2024-09-12T01:49:58.323483+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:49:58.323483+0000","last_undegraded":"2024-09-12T01:49:58.323483+0000","last_fullsized":"2024-09-12T01:49:58.323483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.610488+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:50:21.610488+0000","last_peered":"2024-09-12T01:50:21.610488+0000","last_clean":"2024-09-12T01:50:21.610488+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:50:21.610488+0000","last_undegraded":"2024-09-12T01:50:21.610488+0000","last_fullsized":"2024-09-12T01:50:21.610488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.322035+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:49:58.322035+0000","last_peered":"2024-09-12T01:49:58.322035+0000","last_clean":"2024-09-12T01:49:58.322035+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:49:58.322035+0000","last_undegraded":"2024-09-12T01:49:58.322035+0000","last_fullsized":"2024-09-12T01:49:58.322035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.308229+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:49:58.308229+0000","last_peered":"2024-09-12T01:49:58.308229+0000","last_clean":"2024-09-12T01:49:58.308229+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:49:58.308229+0000","last_undegraded":"2024-09-12T01:49:58.308229+0000","last_fullsized":"2024-09-12T01:49:58.308229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.324324+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:49:58.324324+0000","last_peered":"2024-09-12T01:49:58.324324+0000","last_clean":"2024-09-12T01:49:58.324324+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:49:58.324324+0000","last_undegraded":"2024-09-12T01:49:58.324324+0000","last_fullsized":"2024-09-12T01:49:58.324324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.605561+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:50:21.605561+0000","last_peered":"2024-09-12T01:50:21.605561+0000","last_clean":"2024-09-12T01:50:21.605561+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:50:21.605561+0000","last_undegraded":"2024-09-12T01:50:21.605561+0000","last_fullsized":"2024-09-12T01:50:21.605561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306642+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:49:58.306642+0000","last_peered":"2024-09-12T01:49:58.306642+0000","last_clean":"2024-09-12T01:49:58.306642+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:49:58.306642+0000","last_undegraded":"2024-09-12T01:49:58.306642+0000","last_fullsized":"2024-09-12T01:49:58.306642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607299+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:50:21.607299+0000","last_peered":"2024-09-12T01:50:21.607299+0000","last_clean":"2024-09-12T01:50:21.607299+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:50:21.607299+0000","last_undegraded":"2024-09-12T01:50:21.607299+0000","last_fullsized":"2024-09-12T01:50:21.607299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.606983+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:50:21.606983+0000","last_peered":"2024-09-12T01:50:21.606983+0000","last_clean":"2024-09-12T01:50:21.606983+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:50:21.606983+0000","last_undegraded":"2024-09-12T01:50:21.606983+0000","last_fullsized":"2024-09-12T01:50:21.606983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323420+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:49:58.323420+0000","last_peered":"2024-09-12T01:49:58.323420+0000","last_clean":"2024-09-12T01:49:58.323420+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:49:58.323420+0000","last_undegraded":"2024-09-12T01:49:58.323420+0000","last_fullsized":"2024-09-12T01:49:58.323420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309753+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:49:58.309753+0000","last_peered":"2024-09-12T01:49:58.309753+0000","last_clean":"2024-09-12T01:49:58.309753+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:49:58.309753+0000","last_undegraded":"2024-09-12T01:49:58.309753+0000","last_fullsized":"2024-09-12T01:49:58.309753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.608868+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:50:21.608868+0000","last_peered":"2024-09-12T01:50:21.608868+0000","last_clean":"2024-09-12T01:50:21.608868+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:50:21.608868+0000","last_undegraded":"2024-09-12T01:50:21.608868+0000","last_fullsized":"2024-09-12T01:50:21.608868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.322285+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:49:58.322285+0000","last_peered":"2024-09-12T01:49:58.322285+0000","last_clean":"2024-09-12T01:49:58.322285+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:49:58.322285+0000","last_undegraded":"2024-09-12T01:49:58.322285+0000","last_fullsized":"2024-09-12T01:49:58.322285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309381+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:49:58.309381+0000","last_peered":"2024-09-12T01:49:58.309381+0000","last_clean":"2024-09-12T01:49:58.309381+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:49:58.309381+0000","last_undegraded":"2024-09-12T01:49:58.309381+0000","last_fullsized":"2024-09-12T01:49:58.309381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306751+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:49:58.306751+0000","last_peered":"2024-09-12T01:49:58.306751+0000","last_clean":"2024-09-12T01:49:58.306751+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:49:58.306751+0000","last_undegraded":"2024-09-12T01:49:58.306751+0000","last_fullsized":"2024-09-12T01:49:58.306751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321786+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:49:58.321786+0000","last_peered":"2024-09-12T01:49:58.321786+0000","last_clean":"2024-09-12T01:49:58.321786+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:49:58.321786+0000","last_undegraded":"2024-09-12T01:49:58.321786+0000","last_fullsized":"2024-09-12T01:49:58.321786+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611083+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:50:21.611083+0000","last_peered":"2024-09-12T01:50:21.611083+0000","last_clean":"2024-09-12T01:50:21.611083+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:50:21.611083+0000","last_undegraded":"2024-09-12T01:50:21.611083+0000","last_fullsized":"2024-09-12T01:50:21.611083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321569+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:49:58.321569+0000","last_peered":"2024-09-12T01:49:58.321569+0000","last_clean":"2024-09-12T01:49:58.321569+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:49:58.321569+0000","last_undegraded":"2024-09-12T01:49:58.321569+0000","last_fullsized":"2024-09-12T01:49:58.321569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611476+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:50:21.611476+0000","last_peered":"2024-09-12T01:50:21.611476+0000","last_clean":"2024-09-12T01:50:21.611476+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:50:21.611476+0000","last_undegraded":"2024-09-12T01:50:21.611476+0000","last_fullsized":"2024-09-12T01:50:21.611476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.322518+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:49:58.322518+0000","last_peered":"2024-09-12T01:49:58.322518+0000","last_clean":"2024-09-12T01:49:58.322518+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:49:58.322518+0000","last_undegraded":"2024-09-12T01:49:58.322518+0000","last_fullsized":"2024-09-12T01:49:58.322518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309573+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:49:58.309573+0000","last_peered":"2024-09-12T01:49:58.309573+0000","last_clean":"2024-09-12T01:49:58.309573+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:49:58.309573+0000","last_undegraded":"2024-09-12T01:49:58.309573+0000","last_fullsized":"2024-09-12T01:49:58.309573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306635+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:49:58.306635+0000","last_peered":"2024-09-12T01:49:58.306635+0000","last_clean":"2024-09-12T01:49:58.306635+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:49:58.306635+0000","last_undegraded":"2024-09-12T01:49:58.306635+0000","last_fullsized":"2024-09-12T01:49:58.306635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607271+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:50:21.607271+0000","last_peered":"2024-09-12T01:50:21.607271+0000","last_clean":"2024-09-12T01:50:21.607271+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:50:21.607271+0000","last_undegraded":"2024-09-12T01:50:21.607271+0000","last_fullsized":"2024-09-12T01:50:21.607271+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321962+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:49:58.321962+0000","last_peered":"2024-09-12T01:49:58.321962+0000","last_clean":"2024-09-12T01:49:58.321962+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:49:58.321962+0000","last_undegraded":"2024-09-12T01:49:58.321962+0000","last_fullsized":"2024-09-12T01:49:58.321962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321986+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:49:58.321986+0000","last_peered":"2024-09-12T01:49:58.321986+0000","last_clean":"2024-09-12T01:49:58.321986+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:49:58.321986+0000","last_undegraded":"2024-09-12T01:49:58.321986+0000","last_fullsized":"2024-09-12T01:49:58.321986+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309495+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:49:58.309495+0000","last_peered":"2024-09-12T01:49:58.309495+0000","last_clean":"2024-09-12T01:49:58.309495+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:49:58.309495+0000","last_undegraded":"2024-09-12T01:49:58.309495+0000","last_fullsized":"2024-09-12T01:49:58.309495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.320936+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:49:58.320936+0000","last_peered":"2024-09-12T01:49:58.320936+0000","last_clean":"2024-09-12T01:49:58.320936+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:49:58.320936+0000","last_undegraded":"2024-09-12T01:49:58.320936+0000","last_fullsized":"2024-09-12T01:49:58.320936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:18.399008+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:50:18.399008+0000","last_peered":"2024-09-12T01:50:18.399008+0000","last_clean":"2024-09-12T01:50:18.399008+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:50:18.399008+0000","last_undegraded":"2024-09-12T01:50:18.399008+0000","last_fullsized":"2024-09-12T01:50:18.399008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321145+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:49:58.321145+0000","last_peered":"2024-09-12T01:49:58.321145+0000","last_clean":"2024-09-12T01:49:58.321145+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:49:58.321145+0000","last_undegraded":"2024-09-12T01:49:58.321145+0000","last_fullsized":"2024-09-12T01:49:58.321145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:07.371422+0000","last_change":"2024-09-12T01:49:55.302461+0000","last_active":"2024-09-12T01:50:07.371422+0000","last_peered":"2024-09-12T01:50:07.371422+0000","last_clean":"2024-09-12T01:50:07.371422+0000","last_became_active":"2024-09-12T01:49:55.300957+0000","last_became_peered":"2024-09-12T01:49:55.300957+0000","last_unstale":"2024-09-12T01:50:07.371422+0000","last_undegraded":"2024-09-12T01:50:07.371422+0000","last_fullsized":"2024-09-12T01:50:07.371422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:13.926080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:06.363305+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:06.363305+0000","last_peered":"2024-09-12T01:50:06.363305+0000","last_clean":"2024-09-12T01:50:06.363305+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:06.363305+0000","last_undegraded":"2024-09-12T01:50:06.363305+0000","last_fullsized":"2024-09-12T01:50:06.363305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611016+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:50:21.611016+0000","last_peered":"2024-09-12T01:50:21.611016+0000","last_clean":"2024-09-12T01:50:21.611016+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:50:21.611016+0000","last_undegraded":"2024-09-12T01:50:21.611016+0000","last_fullsized":"2024-09-12T01:50:21.611016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379193+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:08.379193+0000","last_peered":"2024-09-12T01:50:08.379193+0000","last_clean":"2024-09-12T01:50:08.379193+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:08.379193+0000","last_undegraded":"2024-09-12T01:50:08.379193+0000","last_fullsized":"2024-09-12T01:50:08.379193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607628+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:50:21.607628+0000","last_peered":"2024-09-12T01:50:21.607628+0000","last_clean":"2024-09-12T01:50:21.607628+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:50:21.607628+0000","last_undegraded":"2024-09-12T01:50:21.607628+0000","last_fullsized":"2024-09-12T01:50:21.607628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:20.400472+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:50:20.400472+0000","last_peered":"2024-09-12T01:50:20.400472+0000","last_clean":"2024-09-12T01:50:20.400472+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:50:20.400472+0000","last_undegraded":"2024-09-12T01:50:20.400472+0000","last_fullsized":"2024-09-12T01:50:20.400472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321965+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:49:58.321965+0000","last_peered":"2024-09-12T01:49:58.321965+0000","last_clean":"2024-09-12T01:49:58.321965+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:49:58.321965+0000","last_undegraded":"2024-09-12T01:49:58.321965+0000","last_fullsized":"2024-09-12T01:49:58.321965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.381217+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:08.381217+0000","last_peered":"2024-09-12T01:50:08.381217+0000","last_clean":"2024-09-12T01:50:08.381217+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:08.381217+0000","last_undegraded":"2024-09-12T01:50:08.381217+0000","last_fullsized":"2024-09-12T01:50:08.381217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-12T01:49:58.324392+0000","last_change":"2024-09-12T01:50:21.607820+0000","last_active":"2024-09-12T01:50:21.607820+0000","last_peered":"2024-09-12T01:49:58.324392+0000","last_clean":"2024-09-12T01:49:58.324392+0000","last_became_active":"2024-09-12T01:49:57.321228+0000","last_became_peered":"2024-09-12T01:49:57.321228+0000","last_unstale":"2024-09-12T01:49:58.324392+0000","last_undegraded":"2024-09-12T01:49:58.324392+0000","last_fullsized":"2024-09-12T01:49:58.324392+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5,6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:07.371589+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:07.371589+0000","last_peered":"2024-09-12T01:50:07.371589+0000","last_clean":"2024-09-12T01:50:07.371589+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:07.371589+0000","last_undegraded":"2024-09-12T01:50:07.371589+0000","last_fullsized":"2024-09-12T01:50:07.371589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321821+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:49:58.321821+0000","last_peered":"2024-09-12T01:49:58.321821+0000","last_clean":"2024-09-12T01:49:58.321821+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:49:58.321821+0000","last_undegraded":"2024-09-12T01:49:58.321821+0000","last_fullsized":"2024-09-12T01:49:58.321821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:20.402561+0000","last_change":"2024-09-12T01:49:55.300385+0000","last_active":"2024-09-12T01:50:20.402561+0000","last_peered":"2024-09-12T01:50:20.402561+0000","last_clean":"2024-09-12T01:50:20.402561+0000","last_became_active":"2024-09-12T01:49:55.300042+0000","last_became_peered":"2024-09-12T01:49:55.300042+0000","last_unstale":"2024-09-12T01:50:20.402561+0000","last_undegraded":"2024-09-12T01:50:20.402561+0000","last_fullsized":"2024-09-12T01:50:20.402561+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:23.335345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49603,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":63,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323410+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:49:58.323410+0000","last_peered":"2024-09-12T01:49:58.323410+0000","last_clean":"2024-09-12T01:49:58.323410+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:49:58.323410+0000","last_undegraded":"2024-09-12T01:49:58.323410+0000","last_fullsized":"2024-09-12T01:49:58.323410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:09.382740+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:09.382740+0000","last_peered":"2024-09-12T01:50:09.382740+0000","last_clean":"2024-09-12T01:50:09.382740+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:09.382740+0000","last_undegraded":"2024-09-12T01:50:09.382740+0000","last_fullsized":"2024-09-12T01:50:09.382740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306398+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:49:58.306398+0000","last_peered":"2024-09-12T01:49:58.306398+0000","last_clean":"2024-09-12T01:49:58.306398+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:49:58.306398+0000","last_undegraded":"2024-09-12T01:49:58.306398+0000","last_fullsized":"2024-09-12T01:49:58.306398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379620+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:08.379620+0000","last_peered":"2024-09-12T01:50:08.379620+0000","last_clean":"2024-09-12T01:50:08.379620+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:08.379620+0000","last_undegraded":"2024-09-12T01:50:08.379620+0000","last_fullsized":"2024-09-12T01:50:08.379620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.324062+0000","last_change":"2024-09-12T01:49:57.326773+0000","last_active":"2024-09-12T01:49:58.324062+0000","last_peered":"2024-09-12T01:49:58.324062+0000","last_clean":"2024-09-12T01:49:58.324062+0000","last_became_active":"2024-09-12T01:49:57.326371+0000","last_became_peered":"2024-09-12T01:49:57.326371+0000","last_unstale":"2024-09-12T01:49:58.324062+0000","last_undegraded":"2024-09-12T01:49:58.324062+0000","last_fullsized":"2024-09-12T01:49:58.324062+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:26.758840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.606690+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:50:21.606690+0000","last_peered":"2024-09-12T01:50:21.606690+0000","last_clean":"2024-09-12T01:50:21.606690+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:50:21.606690+0000","last_undegraded":"2024-09-12T01:50:21.606690+0000","last_fullsized":"2024-09-12T01:50:21.606690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323342+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:49:58.323342+0000","last_peered":"2024-09-12T01:49:58.323342+0000","last_clean":"2024-09-12T01:49:58.323342+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:49:58.323342+0000","last_undegraded":"2024-09-12T01:49:58.323342+0000","last_fullsized":"2024-09-12T01:49:58.323342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.378548+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:08.378548+0000","last_peered":"2024-09-12T01:50:08.378548+0000","last_clean":"2024-09-12T01:50:08.378548+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:08.378548+0000","last_undegraded":"2024-09-12T01:50:08.378548+0000","last_fullsized":"2024-09-12T01:50:08.378548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321260+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:49:58.321260+0000","last_peered":"2024-09-12T01:49:58.321260+0000","last_clean":"2024-09-12T01:49:58.321260+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:49:58.321260+0000","last_undegraded":"2024-09-12T01:49:58.321260+0000","last_fullsized":"2024-09-12T01:49:58.321260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:07.359930+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:07.359930+0000","last_peered":"2024-09-12T01:50:07.359930+0000","last_clean":"2024-09-12T01:50:07.359930+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:07.359930+0000","last_undegraded":"2024-09-12T01:50:07.359930+0000","last_fullsized":"2024-09-12T01:50:07.359930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309527+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:49:58.309527+0000","last_peered":"2024-09-12T01:49:58.309527+0000","last_clean":"2024-09-12T01:49:58.309527+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:49:58.309527+0000","last_undegraded":"2024-09-12T01:49:58.309527+0000","last_fullsized":"2024-09-12T01:49:58.309527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379004+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:08.379004+0000","last_peered":"2024-09-12T01:50:08.379004+0000","last_clean":"2024-09-12T01:50:08.379004+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:08.379004+0000","last_undegraded":"2024-09-12T01:50:08.379004+0000","last_fullsized":"2024-09-12T01:50:08.379004+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.324382+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:49:58.324382+0000","last_peered":"2024-09-12T01:49:58.324382+0000","last_clean":"2024-09-12T01:49:58.324382+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:49:58.324382+0000","last_undegraded":"2024-09-12T01:49:58.324382+0000","last_fullsized":"2024-09-12T01:49:58.324382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.378167+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:08.378167+0000","last_peered":"2024-09-12T01:50:08.378167+0000","last_clean":"2024-09-12T01:50:08.378167+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:08.378167+0000","last_undegraded":"2024-09-12T01:50:08.378167+0000","last_fullsized":"2024-09-12T01:50:08.378167+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:59.546892+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:49:59.546892+0000","last_peered":"2024-09-12T01:49:59.546892+0000","last_clean":"2024-09-12T01:49:59.546892+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:49:59.546892+0000","last_undegraded":"2024-09-12T01:49:59.546892+0000","last_fullsized":"2024-09-12T01:49:59.546892+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'6","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:17.397480+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:50:17.397480+0000","last_peered":"2024-09-12T01:50:17.397480+0000","last_clean":"2024-09-12T01:50:17.397480+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:50:17.397480+0000","last_undegraded":"2024-09-12T01:50:17.397480+0000","last_fullsized":"2024-09-12T01:50:17.397480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323777+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:49:58.323777+0000","last_peered":"2024-09-12T01:49:58.323777+0000","last_clean":"2024-09-12T01:49:58.323777+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:49:58.323777+0000","last_undegraded":"2024-09-12T01:49:58.323777+0000","last_fullsized":"2024-09-12T01:49:58.323777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":328,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323459+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:49:58.323459+0000","last_peered":"2024-09-12T01:49:58.323459+0000","last_clean":"2024-09-12T01:49:58.323459+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:49:58.323459+0000","last_undegraded":"2024-09-12T01:49:58.323459+0000","last_fullsized":"2024-09-12T01:49:58.323459+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.605227+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:21.605227+0000","last_peered":"2024-09-12T01:50:21.605227+0000","last_clean":"2024-09-12T01:50:21.605227+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:21.605227+0000","last_undegraded":"2024-09-12T01:50:21.605227+0000","last_fullsized":"2024-09-12T01:50:21.605227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611304+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:50:21.611304+0000","last_peered":"2024-09-12T01:50:21.611304+0000","last_clean":"2024-09-12T01:50:21.611304+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:50:21.611304+0000","last_undegraded":"2024-09-12T01:50:21.611304+0000","last_fullsized":"2024-09-12T01:50:21.611304+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:06.364010+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:06.364010+0000","last_peered":"2024-09-12T01:50:06.364010+0000","last_clean":"2024-09-12T01:50:06.364010+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:06.364010+0000","last_undegraded":"2024-09-12T01:50:06.364010+0000","last_fullsized":"2024-09-12T01:50:06.364010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306365+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:49:58.306365+0000","last_peered":"2024-09-12T01:49:58.306365+0000","last_clean":"2024-09-12T01:49:58.306365+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:49:58.306365+0000","last_undegraded":"2024-09-12T01:49:58.306365+0000","last_fullsized":"2024-09-12T01:49:58.306365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:18.397587+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:50:18.397587+0000","last_peered":"2024-09-12T01:50:18.397587+0000","last_clean":"2024-09-12T01:50:18.397587+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:50:18.397587+0000","last_undegraded":"2024-09-12T01:50:18.397587+0000","last_fullsized":"2024-09-12T01:50:18.397587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":2,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-12T01:49:57.306176+0000","last_change":"2024-09-12T01:50:22.384098+0000","last_active":"2024-09-12T01:49:56.292576+0000","last_peered":"2024-09-12T01:49:56.292576+0000","last_clean":"2024-09-12T01:49:56.292576+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:49:57.306176+0000","last_undegraded":"2024-09-12T01:49:57.306176+0000","last_fullsized":"2024-09-12T01:49:57.306176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'6","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:18.397671+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:50:18.397671+0000","last_peered":"2024-09-12T01:50:18.397671+0000","last_clean":"2024-09-12T01:50:18.397671+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:50:18.397671+0000","last_undegraded":"2024-09-12T01:50:18.397671+0000","last_fullsized":"2024-09-12T01:50:18.397671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.308150+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:49:58.308150+0000","last_peered":"2024-09-12T01:49:58.308150+0000","last_clean":"2024-09-12T01:49:58.308150+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:49:58.308150+0000","last_undegraded":"2024-09-12T01:49:58.308150+0000","last_fullsized":"2024-09-12T01:49:58.308150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-12T01:50:07.372486+0000","last_change":"2024-09-12T01:50:21.609087+0000","last_active":"2024-09-12T01:50:21.609087+0000","last_peered":"2024-09-12T01:50:07.372486+0000","last_clean":"2024-09-12T01:50:07.372486+0000","last_became_active":"2024-09-12T01:49:55.712596+0000","last_became_peered":"2024-09-12T01:49:55.712596+0000","last_unstale":"2024-09-12T01:50:07.372486+0000","last_undegraded":"2024-09-12T01:50:07.372486+0000","last_fullsized":"2024-09-12T01:50:07.372486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:00.540132+0000","last_change":"2024-09-12T01:49:57.313745+0000","last_active":"2024-09-12T01:50:00.540132+0000","last_peered":"2024-09-12T01:50:00.540132+0000","last_clean":"2024-09-12T01:50:00.540132+0000","last_became_active":"2024-09-12T01:49:57.313397+0000","last_became_peered":"2024-09-12T01:49:57.313397+0000","last_unstale":"2024-09-12T01:50:00.540132+0000","last_undegraded":"2024-09-12T01:50:00.540132+0000","last_fullsized":"2024-09-12T01:50:00.540132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:45.032475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.379535+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:08.379535+0000","last_peered":"2024-09-12T01:50:08.379535+0000","last_clean":"2024-09-12T01:50:08.379535+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:08.379535+0000","last_undegraded":"2024-09-12T01:50:08.379535+0000","last_fullsized":"2024-09-12T01:50:08.379535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.306764+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:49:58.306764+0000","last_peered":"2024-09-12T01:49:58.306764+0000","last_clean":"2024-09-12T01:49:58.306764+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:49:58.306764+0000","last_undegraded":"2024-09-12T01:49:58.306764+0000","last_fullsized":"2024-09-12T01:49:58.306764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'13","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.608891+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:50:21.608891+0000","last_peered":"2024-09-12T01:50:21.608891+0000","last_clean":"2024-09-12T01:50:21.608891+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:50:21.608891+0000","last_undegraded":"2024-09-12T01:50:21.608891+0000","last_fullsized":"2024-09-12T01:50:21.608891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611565+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:50:21.611565+0000","last_peered":"2024-09-12T01:50:21.611565+0000","last_clean":"2024-09-12T01:50:21.611565+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:50:21.611565+0000","last_undegraded":"2024-09-12T01:50:21.611565+0000","last_fullsized":"2024-09-12T01:50:21.611565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.605367+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:21.605367+0000","last_peered":"2024-09-12T01:50:21.605367+0000","last_clean":"2024-09-12T01:50:21.605367+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:21.605367+0000","last_undegraded":"2024-09-12T01:50:21.605367+0000","last_fullsized":"2024-09-12T01:50:21.605367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607119+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:50:21.607119+0000","last_peered":"2024-09-12T01:50:21.607119+0000","last_clean":"2024-09-12T01:50:21.607119+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:50:21.607119+0000","last_undegraded":"2024-09-12T01:50:21.607119+0000","last_fullsized":"2024-09-12T01:50:21.607119+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:05.356487+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:05.356487+0000","last_peered":"2024-09-12T01:50:05.356487+0000","last_clean":"2024-09-12T01:50:05.356487+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:05.356487+0000","last_undegraded":"2024-09-12T01:50:05.356487+0000","last_fullsized":"2024-09-12T01:50:05.356487+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.320939+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:49:58.320939+0000","last_peered":"2024-09-12T01:49:58.320939+0000","last_clean":"2024-09-12T01:49:58.320939+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:49:58.320939+0000","last_undegraded":"2024-09-12T01:49:58.320939+0000","last_fullsized":"2024-09-12T01:49:58.320939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611172+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:21.611172+0000","last_peered":"2024-09-12T01:50:21.611172+0000","last_clean":"2024-09-12T01:50:21.611172+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:21.611172+0000","last_undegraded":"2024-09-12T01:50:21.611172+0000","last_fullsized":"2024-09-12T01:50:21.611172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.309528+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:49:58.309528+0000","last_peered":"2024-09-12T01:49:58.309528+0000","last_clean":"2024-09-12T01:49:58.309528+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:49:58.309528+0000","last_undegraded":"2024-09-12T01:49:58.309528+0000","last_fullsized":"2024-09-12T01:49:58.309528+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:07.371917+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:07.371917+0000","last_peered":"2024-09-12T01:50:07.371917+0000","last_clean":"2024-09-12T01:50:07.371917+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:07.371917+0000","last_undegraded":"2024-09-12T01:50:07.371917+0000","last_fullsized":"2024-09-12T01:50:07.371917+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611313+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:50:21.611313+0000","last_peered":"2024-09-12T01:50:21.611313+0000","last_clean":"2024-09-12T01:50:21.611313+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:50:21.611313+0000","last_undegraded":"2024-09-12T01:50:21.611313+0000","last_fullsized":"2024-09-12T01:50:21.611313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:05.357799+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:05.357799+0000","last_peered":"2024-09-12T01:50:05.357799+0000","last_clean":"2024-09-12T01:50:05.357799+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:05.357799+0000","last_undegraded":"2024-09-12T01:50:05.357799+0000","last_fullsized":"2024-09-12T01:50:05.357799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323872+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:49:58.323872+0000","last_peered":"2024-09-12T01:49:58.323872+0000","last_clean":"2024-09-12T01:49:58.323872+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:49:58.323872+0000","last_undegraded":"2024-09-12T01:49:58.323872+0000","last_fullsized":"2024-09-12T01:49:58.323872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.323337+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:49:58.323337+0000","last_peered":"2024-09-12T01:49:58.323337+0000","last_clean":"2024-09-12T01:49:58.323337+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:49:58.323337+0000","last_undegraded":"2024-09-12T01:49:58.323337+0000","last_fullsized":"2024-09-12T01:49:58.323337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:08.380635+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:08.380635+0000","last_peered":"2024-09-12T01:50:08.380635+0000","last_clean":"2024-09-12T01:50:08.380635+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:08.380635+0000","last_undegraded":"2024-09-12T01:50:08.380635+0000","last_fullsized":"2024-09-12T01:50:08.380635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:49:58.321631+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:49:58.321631+0000","last_peered":"2024-09-12T01:49:58.321631+0000","last_clean":"2024-09-12T01:49:58.321631+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:49:58.321631+0000","last_undegraded":"2024-09-12T01:49:58.321631+0000","last_fullsized":"2024-09-12T01:49:58.321631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T01:50:09.376475+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:09.376475+0000","last_peered":"2024-09-12T01:50:09.376475+0000","last_clean":"2024-09-12T01:50:09.376475+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:09.376475+0000","last_undegraded":"2024-09-12T01:50:09.376475+0000","last_fullsized":"2024-09-12T01:50:09.376475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.607544+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:50:21.607544+0000","last_peered":"2024-09-12T01:50:21.607544+0000","last_clean":"2024-09-12T01:50:21.607544+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:50:21.607544+0000","last_undegraded":"2024-09-12T01:50:21.607544+0000","last_fullsized":"2024-09-12T01:50:21.607544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611632+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:50:21.611632+0000","last_peered":"2024-09-12T01:50:21.611632+0000","last_clean":"2024-09-12T01:50:21.611632+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:50:21.611632+0000","last_undegraded":"2024-09-12T01:50:21.611632+0000","last_fullsized":"2024-09-12T01:50:21.611632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611415+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:50:21.611415+0000","last_peered":"2024-09-12T01:50:21.611415+0000","last_clean":"2024-09-12T01:50:21.611415+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:50:21.611415+0000","last_undegraded":"2024-09-12T01:50:21.611415+0000","last_fullsized":"2024-09-12T01:50:21.611415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":46,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-12T01:50:21.400854+0000","last_change":"2024-09-12T01:50:21.609682+0000","last_active":"2024-09-12T01:50:21.609682+0000","last_peered":"2024-09-12T01:50:21.400854+0000","last_clean":"2024-09-12T01:50:21.400854+0000","last_became_active":"2024-09-12T01:49:55.300056+0000","last_became_peered":"2024-09-12T01:49:55.300056+0000","last_unstale":"2024-09-12T01:50:21.400854+0000","last_undegraded":"2024-09-12T01:50:21.400854+0000","last_fullsized":"2024-09-12T01:50:21.400854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7,8,11],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57204,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":153,"num_read_kb":141,"num_write":238,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":171612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":421584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776149,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1061823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939675,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":429822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168606,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":421499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397540,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1014412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528361,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":421231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789997,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1511424,"data_stored":1013697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953523,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":420699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":429364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":470962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":471747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":422570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":51748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":52361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:50:25.303 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-12T01:50:25.303 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 14, 'reported_epoch': 81, 'state': 'peering', 'last_fresh': '2024-09-12T01:49:58.324392+0000', 'last_change': '2024-09-12T01:50:21.607820+0000', 'last_active': '2024-09-12T01:50:21.607820+0000', 'last_peered': '2024-09-12T01:49:58.324392+0000', 'last_clean': '2024-09-12T01:49:58.324392+0000', 'last_became_active': '2024-09-12T01:49:57.321228+0000', 'last_became_peered': '2024-09-12T01:49:57.321228+0000', 'last_unstale': '2024-09-12T01:49:58.324392+0000', 'last_undegraded': '2024-09-12T01:49:58.324392+0000', 'last_fullsized': '2024-09-12T01:49:58.324392+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 80, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:49:56.292576+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:49:56.292576+0000', 'last_clean_scrub_stamp': '2024-09-12T01:49:56.292576+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6, 5], 'acting': [0, 6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4, 5, 6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:50:25.304 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-12T01:50:25.304 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 82, 'state': 'peering', 'last_fresh': '2024-09-12T01:49:57.306176+0000', 'last_change': '2024-09-12T01:50:22.384098+0000', 'last_active': '2024-09-12T01:49:56.292576+0000', 'last_peered': '2024-09-12T01:49:56.292576+0000', 'last_clean': '2024-09-12T01:49:56.292576+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:49:57.306176+0000', 'last_undegraded': '2024-09-12T01:49:57.306176+0000', 'last_fullsized': '2024-09-12T01:49:57.306176+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 80, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:49:56.292576+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:49:56.292576+0000', 'last_clean_scrub_stamp': '2024-09-12T01:49:56.292576+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 2, 4], 'acting': [9, 2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2024-09-12T01:50:25.304 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.4 is not active+clean 2024-09-12T01:50:25.304 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.4', 'version': "81'1", 'reported_seq': 20, 'reported_epoch': 81, 'state': 'peering', 'last_fresh': '2024-09-12T01:50:07.372486+0000', 'last_change': '2024-09-12T01:50:21.609087+0000', 'last_active': '2024-09-12T01:50:21.609087+0000', 'last_peered': '2024-09-12T01:50:07.372486+0000', 'last_clean': '2024-09-12T01:50:07.372486+0000', 'last_became_active': '2024-09-12T01:49:55.712596+0000', 'last_became_peered': '2024-09-12T01:49:55.712596+0000', 'last_unstale': '2024-09-12T01:50:07.372486+0000', 'last_undegraded': '2024-09-12T01:50:07.372486+0000', 'last_fullsized': '2024-09-12T01:50:07.372486+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 78, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:49:54.276163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:49:54.276163+0000', 'last_clean_scrub_stamp': '2024-09-12T01:49:54.276163+0000', 'objects_scrubbed': 0, 'log_size': 1, 'log_dups_size': 0, 'ondisk_log_size': 1, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 11, 0], 'acting': [9, 11, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 2, 11], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2024-09-12T01:50:25.304 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.1f is not active+clean 2024-09-12T01:50:25.304 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.1f', 'version': "81'13", 'reported_seq': 46, 'reported_epoch': 81, 'state': 'peering', 'last_fresh': '2024-09-12T01:50:21.400854+0000', 'last_change': '2024-09-12T01:50:21.609682+0000', 'last_active': '2024-09-12T01:50:21.609682+0000', 'last_peered': '2024-09-12T01:50:21.400854+0000', 'last_clean': '2024-09-12T01:50:21.400854+0000', 'last_became_active': '2024-09-12T01:49:55.300056+0000', 'last_became_peered': '2024-09-12T01:49:55.300056+0000', 'last_unstale': '2024-09-12T01:50:21.400854+0000', 'last_undegraded': '2024-09-12T01:50:21.400854+0000', 'last_fullsized': '2024-09-12T01:50:21.400854+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 78, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:49:54.276163+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:49:54.276163+0000', 'last_clean_scrub_stamp': '2024-09-12T01:49:54.276163+0000', 'objects_scrubbed': 0, 'log_size': 13, 'log_dups_size': 0, 'ondisk_log_size': 13, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 672, 'num_objects': 6, 'num_object_clones': 0, 'num_object_copies': 18, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 6, 'num_whiteouts': 0, 'num_read': 11, 'num_read_kb': 11, 'num_write': 14, 'num_write_kb': 2, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 4, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 11, 8], 'acting': [9, 11, 8], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7, 8, 11], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2024-09-12T01:50:25.305 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph status --format=json 2024-09-12T01:50:25.549 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:26.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.088+0000 7fa8d0000640 1 -- 172.21.15.70:0/4142674269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8c8102790 msgr2=0x7fa8c81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:26.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.088+0000 7fa8d0000640 1 --2- 172.21.15.70:0/4142674269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8c8102790 0x7fa8c81067e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009900 tx=0x7fa8b802a410 comp rx=0 tx=0).stop 2024-09-12T01:50:26.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.088+0000 7fa8d0000640 1 -- 172.21.15.70:0/4142674269 shutdown_connections 2024-09-12T01:50:26.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.088+0000 7fa8d0000640 1 --2- 172.21.15.70:0/4142674269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c8106f10 0x7fa8c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:26.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.088+0000 7fa8d0000640 1 --2- 172.21.15.70:0/4142674269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8c8102790 0x7fa8c81067e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:26.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.088+0000 7fa8d0000640 1 --2- 172.21.15.70:0/4142674269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8c8101de0 0x7fa8c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:26.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.088+0000 7fa8d0000640 1 -- 172.21.15.70:0/4142674269 >> 172.21.15.70:0/4142674269 conn(0x7fa8c80fd8c0 msgr2=0x7fa8c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.088+0000 7fa8d0000640 1 -- 172.21.15.70:0/4142674269 shutdown_connections 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.088+0000 7fa8d0000640 1 -- 172.21.15.70:0/4142674269 wait complete. 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8d0000640 1 Processor -- start 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8d0000640 1 -- start start 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8d0000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8c8101de0 0x7fa8c8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8d0000640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c8102790 0x7fa8c8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8d0000640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8c8106f10 0x7fa8c819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8d0000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c8112050 con 0x7fa8c8101de0 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8d0000640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c8111ed0 con 0x7fa8c8102790 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8d0000640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81121d0 con 0x7fa8c8106f10 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8cdd9c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8c8101de0 0x7fa8c8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8cdd9c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8c8101de0 0x7fa8c8198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48086/0 (socket says 172.21.15.70:48086) 2024-09-12T01:50:26.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8cdd9c640 1 -- 172.21.15.70:0/950774586 learned_addr learned my addr 172.21.15.70:0/950774586 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8cd59b640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c8102790 0x7fa8c8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8ce59d640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8c8106f10 0x7fa8c819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.089+0000 7fa8cdd9c640 1 -- 172.21.15.70:0/950774586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8c8106f10 msgr2=0x7fa8c819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.090+0000 7fa8cdd9c640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8c8106f10 0x7fa8c819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.090+0000 7fa8cdd9c640 1 -- 172.21.15.70:0/950774586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c8102790 msgr2=0x7fa8c8198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.090+0000 7fa8cdd9c640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c8102790 0x7fa8c8198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.090+0000 7fa8cdd9c640 1 -- 172.21.15.70:0/950774586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c819d4b0 con 0x7fa8c8101de0 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.090+0000 7fa8ce59d640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8c8106f10 0x7fa8c819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.090+0000 7fa8cdd9c640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8c8101de0 0x7fa8c8198500 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c920 tx=0x7fa8c400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.090+0000 7fa8beffd640 1 -- 172.21.15.70:0/950774586 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4007c70 con 0x7fa8c8101de0 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.090+0000 7fa8beffd640 1 -- 172.21.15.70:0/950774586 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8c4007e10 con 0x7fa8c8101de0 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.090+0000 7fa8d0000640 1 -- 172.21.15.70:0/950774586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c819d7a0 con 0x7fa8c8101de0 2024-09-12T01:50:26.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.090+0000 7fa8beffd640 1 -- 172.21.15.70:0/950774586 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4018940 con 0x7fa8c8101de0 2024-09-12T01:50:26.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.090+0000 7fa8d0000640 1 -- 172.21.15.70:0/950774586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c81a5080 con 0x7fa8c8101de0 2024-09-12T01:50:26.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.091+0000 7fa8d0000640 1 -- 172.21.15.70:0/950774586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c81021c0 con 0x7fa8c8101de0 2024-09-12T01:50:26.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.092+0000 7fa8beffd640 1 -- 172.21.15.70:0/950774586 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa8c4018b20 con 0x7fa8c8101de0 2024-09-12T01:50:26.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.093+0000 7fa8beffd640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa8b40a2c10 0x7fa8b40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:26.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.093+0000 7fa8cd59b640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa8b40a2c10 0x7fa8b40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:26.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.093+0000 7fa8beffd640 1 -- 172.21.15.70:0/950774586 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa8c40cf420 con 0x7fa8c8101de0 2024-09-12T01:50:26.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.093+0000 7fa8cd59b640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa8b40a2c10 0x7fa8b40a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80fe130 tx=0x7fa8b80095f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:26.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.097+0000 7fa8beffd640 1 -- 172.21.15.70:0/950774586 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8c4014030 con 0x7fa8c8101de0 2024-09-12T01:50:26.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.330+0000 7fa8d0000640 1 -- 172.21.15.70:0/950774586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa8c810a1b0 con 0x7fa8c8101de0 2024-09-12T01:50:26.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.330+0000 7fa8beffd640 1 -- 172.21.15.70:0/950774586 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3373 (secure 0 0 0) 0x7fa8c400de20 con 0x7fa8c8101de0 2024-09-12T01:50:26.333 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:50:26.333 INFO:teuthology.orchestra.run.smithi070.stdout:{"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":377,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":83,"num_osds":12,"num_up_osds":12,"osd_up_since":1726105749,"num_in_osds":12,"osd_in_since":1726105726,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":93},{"state_name":"peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":102,"data_bytes":647806,"bytes_used":374919168,"bytes_avail":1151565508608,"bytes_total":1151940427776,"inactive_pgs_ratio":0.041237112134695053,"read_bytes_sec":6398,"write_bytes_sec":1663,"read_op_per_sec":8,"write_op_per_sec":1},"fsmap":{"epoch":27,"btime":"2024-09-12T01:50:09:375588+0000","id":1,"up":5,"in":5,"max":5,"by_rank":[{"filesystem_id":1,"rank":4,"name":"g","status":"up:standby-replay","gid":14637},{"filesystem_id":1,"rank":3,"name":"a","status":"up:standby-replay","gid":14649},{"filesystem_id":1,"rank":2,"name":"k","status":"up:standby-replay","gid":24392},{"filesystem_id":1,"rank":1,"name":"l","status":"up:standby-replay","gid":24394},{"filesystem_id":1,"rank":0,"name":"e","status":"up:standby-replay","gid":24416},{"filesystem_id":1,"rank":4,"name":"f","status":"up:active","gid":24427},{"filesystem_id":1,"rank":3,"name":"c","status":"up:active","gid":24433},{"filesystem_id":1,"rank":2,"name":"h","status":"up:active","gid":24437},{"filesystem_id":1,"rank":1,"name":"i","status":"up:active","gid":24445},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24452}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.70:8443/"}},"servicemap":{"epoch":19,"modified":"2024-09-12T01:50:23.478432+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"k":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"l":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T01:50:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.332+0000 7fa8d0000640 1 -- 172.21.15.70:0/950774586 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa8b40a2c10 msgr2=0x7fa8b40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.332+0000 7fa8d0000640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa8b40a2c10 0x7fa8b40a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80fe130 tx=0x7fa8b80095f0 comp rx=0 tx=0).stop 2024-09-12T01:50:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.332+0000 7fa8d0000640 1 -- 172.21.15.70:0/950774586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8c8101de0 msgr2=0x7fa8c8198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.332+0000 7fa8d0000640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8c8101de0 0x7fa8c8198500 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c920 tx=0x7fa8c400cde0 comp rx=0 tx=0).stop 2024-09-12T01:50:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.332+0000 7fa8d0000640 1 -- 172.21.15.70:0/950774586 shutdown_connections 2024-09-12T01:50:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.332+0000 7fa8d0000640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa8b40a2c10 0x7fa8b40a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.332+0000 7fa8d0000640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8c8106f10 0x7fa8c819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.332+0000 7fa8d0000640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c8102790 0x7fa8c8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.332+0000 7fa8d0000640 1 --2- 172.21.15.70:0/950774586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8c8101de0 0x7fa8c8198500 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.332+0000 7fa8d0000640 1 -- 172.21.15.70:0/950774586 >> 172.21.15.70:0/950774586 conn(0x7fa8c80fd8c0 msgr2=0x7fa8c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.332+0000 7fa8d0000640 1 -- 172.21.15.70:0/950774586 shutdown_connections 2024-09-12T01:50:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:26.332+0000 7fa8d0000640 1 -- 172.21.15.70:0/950774586 wait complete. 2024-09-12T01:50:26.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:26 smithi070 ceph-mon[31177]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:26.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:26 smithi070 ceph-mon[31177]: pgmap v285: 97 pgs: 4 peering, 93 active+clean; 633 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-12T01:50:26.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:26 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/950774586' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-12T01:50:26.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:26 smithi191 ceph-mon[35770]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:26.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:26 smithi191 ceph-mon[35770]: pgmap v285: 97 pgs: 4 peering, 93 active+clean; 633 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-12T01:50:26.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:26 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/950774586' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-12T01:50:26.988 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:50:26.988 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:50:27.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:26 smithi152 ceph-mon[35055]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:27.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:26 smithi152 ceph-mon[35055]: pgmap v285: 97 pgs: 4 peering, 93 active+clean; 633 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-12T01:50:27.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:26 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/950774586' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-12T01:50:27.234 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:27.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.683+0000 7f264684f640 1 -- 172.21.15.70:0/1050246299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2640100e20 msgr2=0x7f2640101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.683+0000 7f264684f640 1 --2- 172.21.15.70:0/1050246299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2640100e20 0x7f2640101200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2630009900 tx=0x7f263002a480 comp rx=0 tx=0).stop 2024-09-12T01:50:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.683+0000 7f264684f640 1 -- 172.21.15.70:0/1050246299 shutdown_connections 2024-09-12T01:50:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.683+0000 7f264684f640 1 --2- 172.21.15.70:0/1050246299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2640102ef0 0x7f264010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.683+0000 7f264684f640 1 --2- 172.21.15.70:0/1050246299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2640102570 0x7f26401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.683+0000 7f264684f640 1 --2- 172.21.15.70:0/1050246299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2640100e20 0x7f2640101200 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.683+0000 7f264684f640 1 -- 172.21.15.70:0/1050246299 >> 172.21.15.70:0/1050246299 conn(0x7f26400fc7d0 msgr2=0x7f26400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.683+0000 7f264684f640 1 -- 172.21.15.70:0/1050246299 shutdown_connections 2024-09-12T01:50:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.684+0000 7f264684f640 1 -- 172.21.15.70:0/1050246299 wait complete. 2024-09-12T01:50:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.684+0000 7f264684f640 1 Processor -- start 2024-09-12T01:50:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.684+0000 7f264684f640 1 -- start start 2024-09-12T01:50:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.684+0000 7f264684f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2640100e20 0x7f2640198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.684+0000 7f264684f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2640102570 0x7f2640198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.684+0000 7f264684f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2640102ef0 0x7f264019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.684+0000 7f264684f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26401110e0 con 0x7f2640102ef0 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.684+0000 7f264684f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2640110f60 con 0x7f2640100e20 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.684+0000 7f264684f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2640111260 con 0x7f2640102570 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f2644dec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2640102ef0 0x7f264019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f2644dec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2640102ef0 0x7f264019ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48108/0 (socket says 172.21.15.70:48108) 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f2644dec640 1 -- 172.21.15.70:0/2190636968 learned_addr learned my addr 172.21.15.70:0/2190636968 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f263ffff640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2640100e20 0x7f2640198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f263f7fe640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2640102570 0x7f2640198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f2644dec640 1 -- 172.21.15.70:0/2190636968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2640102570 msgr2=0x7f2640198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f2644dec640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2640102570 0x7f2640198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f2644dec640 1 -- 172.21.15.70:0/2190636968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2640100e20 msgr2=0x7f2640198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f2644dec640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2640100e20 0x7f2640198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f2644dec640 1 -- 172.21.15.70:0/2190636968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264019d5b0 con 0x7f2640102ef0 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f2644dec640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2640102ef0 0x7f264019ced0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f263800b970 tx=0x7f263800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f263d7fa640 1 -- 172.21.15.70:0/2190636968 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638019070 con 0x7f2640102ef0 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f263d7fa640 1 -- 172.21.15.70:0/2190636968 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f263800cb40 con 0x7f2640102ef0 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f264684f640 1 -- 172.21.15.70:0/2190636968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264019d8a0 con 0x7f2640102ef0 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f263d7fa640 1 -- 172.21.15.70:0/2190636968 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638007700 con 0x7f2640102ef0 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.685+0000 7f264684f640 1 -- 172.21.15.70:0/2190636968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26401a5180 con 0x7f2640102ef0 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.686+0000 7f264684f640 1 -- 172.21.15.70:0/2190636968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2640101200 con 0x7f2640102ef0 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.688+0000 7f263d7fa640 1 -- 172.21.15.70:0/2190636968 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f263801c070 con 0x7f2640102ef0 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.688+0000 7f263d7fa640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f26280a2c10 0x7f26280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.688+0000 7f263ffff640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f26280a2c10 0x7f26280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.688+0000 7f263d7fa640 1 -- 172.21.15.70:0/2190636968 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f26380ce630 con 0x7f2640102ef0 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.689+0000 7f263ffff640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f26280a2c10 0x7f26280a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2630009230 tx=0x7f26300058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.692+0000 7f263d7fa640 1 -- 172.21.15.70:0/2190636968 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f263809aef0 con 0x7f2640102ef0 2024-09-12T01:50:27.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.857+0000 7f264684f640 1 -- 172.21.15.70:0/2190636968 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f264010a110 con 0x7f26280a2c10 2024-09-12T01:50:27.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.863+0000 7f263d7fa640 1 -- 172.21.15.70:0/2190636968 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258779 (secure 0 0 0) 0x7f2630031760 con 0x7f26280a2c10 2024-09-12T01:50:27.865 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:50:27.866 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:50:27.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.866+0000 7f264684f640 1 -- 172.21.15.70:0/2190636968 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f26280a2c10 msgr2=0x7f26280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:27.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.866+0000 7f264684f640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f26280a2c10 0x7f26280a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2630009230 tx=0x7f26300058d0 comp rx=0 tx=0).stop 2024-09-12T01:50:27.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.866+0000 7f264684f640 1 -- 172.21.15.70:0/2190636968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2640102ef0 msgr2=0x7f264019ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:27.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.866+0000 7f264684f640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2640102ef0 0x7f264019ced0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f263800b970 tx=0x7f263800be30 comp rx=0 tx=0).stop 2024-09-12T01:50:27.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.866+0000 7f264684f640 1 -- 172.21.15.70:0/2190636968 shutdown_connections 2024-09-12T01:50:27.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.866+0000 7f264684f640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f26280a2c10 0x7f26280a50d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:27.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.866+0000 7f264684f640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2640102ef0 0x7f264019ced0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:27.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.866+0000 7f264684f640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2640102570 0x7f2640198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:27.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.866+0000 7f264684f640 1 --2- 172.21.15.70:0/2190636968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2640100e20 0x7f2640198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:27.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.866+0000 7f264684f640 1 -- 172.21.15.70:0/2190636968 >> 172.21.15.70:0/2190636968 conn(0x7f26400fc7d0 msgr2=0x7f264006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:27.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.866+0000 7f264684f640 1 -- 172.21.15.70:0/2190636968 shutdown_connections 2024-09-12T01:50:27.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:27.866+0000 7f264684f640 1 -- 172.21.15.70:0/2190636968 wait complete. 2024-09-12T01:50:28.529 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-09-12T01:50:27.479271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652063,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":321,"num_read_kb":276,"num_write":424,"num_write_kb":3067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1231128,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":296,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366372,"kb_used_data":12896,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575452,"statfs":{"total":1151940427776,"available":1151565262848,"internally_reserved":0,"allocated":13205504,"data_stored":7243501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12912,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":71,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":50392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001910"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681555+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:50:22.681555+0000","last_peered":"2024-09-12T01:50:22.681555+0000","last_clean":"2024-09-12T01:50:22.681555+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:50:22.681555+0000","last_undegraded":"2024-09-12T01:50:22.681555+0000","last_fullsized":"2024-09-12T01:50:22.681555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610122+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:50:22.610122+0000","last_peered":"2024-09-12T01:50:22.610122+0000","last_clean":"2024-09-12T01:50:22.610122+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:50:22.610122+0000","last_undegraded":"2024-09-12T01:50:22.610122+0000","last_fullsized":"2024-09-12T01:50:22.610122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610144+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:50:22.610144+0000","last_peered":"2024-09-12T01:50:22.610144+0000","last_clean":"2024-09-12T01:50:22.610144+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:50:22.610144+0000","last_undegraded":"2024-09-12T01:50:22.610144+0000","last_fullsized":"2024-09-12T01:50:22.610144+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.682256+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:50:22.682256+0000","last_peered":"2024-09-12T01:50:22.682256+0000","last_clean":"2024-09-12T01:50:22.682256+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:50:22.682256+0000","last_undegraded":"2024-09-12T01:50:22.682256+0000","last_fullsized":"2024-09-12T01:50:22.682256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611131+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:50:22.611131+0000","last_peered":"2024-09-12T01:50:22.611131+0000","last_clean":"2024-09-12T01:50:22.611131+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:50:22.611131+0000","last_undegraded":"2024-09-12T01:50:22.611131+0000","last_fullsized":"2024-09-12T01:50:22.611131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614193+0000","last_change":"2024-09-12T01:50:22.614193+0000","last_active":"2024-09-12T01:50:22.614193+0000","last_peered":"2024-09-12T01:50:22.614193+0000","last_clean":"2024-09-12T01:50:22.614193+0000","last_became_active":"2024-09-12T01:50:22.613816+0000","last_became_peered":"2024-09-12T01:50:22.613816+0000","last_unstale":"2024-09-12T01:50:22.614193+0000","last_undegraded":"2024-09-12T01:50:22.614193+0000","last_fullsized":"2024-09-12T01:50:22.614193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:29.504176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612817+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:50:22.612817+0000","last_peered":"2024-09-12T01:50:22.612817+0000","last_clean":"2024-09-12T01:50:22.612817+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:50:22.612817+0000","last_undegraded":"2024-09-12T01:50:22.612817+0000","last_fullsized":"2024-09-12T01:50:22.612817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.610488+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:50:21.610488+0000","last_peered":"2024-09-12T01:50:21.610488+0000","last_clean":"2024-09-12T01:50:21.610488+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:50:21.610488+0000","last_undegraded":"2024-09-12T01:50:21.610488+0000","last_fullsized":"2024-09-12T01:50:21.610488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611663+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:50:22.611663+0000","last_peered":"2024-09-12T01:50:22.611663+0000","last_clean":"2024-09-12T01:50:22.611663+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:50:22.611663+0000","last_undegraded":"2024-09-12T01:50:22.611663+0000","last_fullsized":"2024-09-12T01:50:22.611663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610750+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:50:22.610750+0000","last_peered":"2024-09-12T01:50:22.610750+0000","last_clean":"2024-09-12T01:50:22.610750+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:50:22.610750+0000","last_undegraded":"2024-09-12T01:50:22.610750+0000","last_fullsized":"2024-09-12T01:50:22.610750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613460+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:50:22.613460+0000","last_peered":"2024-09-12T01:50:22.613460+0000","last_clean":"2024-09-12T01:50:22.613460+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:50:22.613460+0000","last_undegraded":"2024-09-12T01:50:22.613460+0000","last_fullsized":"2024-09-12T01:50:22.613460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.682287+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:50:22.682287+0000","last_peered":"2024-09-12T01:50:22.682287+0000","last_clean":"2024-09-12T01:50:22.682287+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:50:22.682287+0000","last_undegraded":"2024-09-12T01:50:22.682287+0000","last_fullsized":"2024-09-12T01:50:22.682287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614251+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:50:22.614251+0000","last_peered":"2024-09-12T01:50:22.614251+0000","last_clean":"2024-09-12T01:50:22.614251+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:50:22.614251+0000","last_undegraded":"2024-09-12T01:50:22.614251+0000","last_fullsized":"2024-09-12T01:50:22.614251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610012+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:50:22.610012+0000","last_peered":"2024-09-12T01:50:22.610012+0000","last_clean":"2024-09-12T01:50:22.610012+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:50:22.610012+0000","last_undegraded":"2024-09-12T01:50:22.610012+0000","last_fullsized":"2024-09-12T01:50:22.610012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.609996+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:50:22.609996+0000","last_peered":"2024-09-12T01:50:22.609996+0000","last_clean":"2024-09-12T01:50:22.609996+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:50:22.609996+0000","last_undegraded":"2024-09-12T01:50:22.609996+0000","last_fullsized":"2024-09-12T01:50:22.609996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610813+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:50:22.610813+0000","last_peered":"2024-09-12T01:50:22.610813+0000","last_clean":"2024-09-12T01:50:22.610813+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:50:22.610813+0000","last_undegraded":"2024-09-12T01:50:22.610813+0000","last_fullsized":"2024-09-12T01:50:22.610813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681621+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:50:22.681621+0000","last_peered":"2024-09-12T01:50:22.681621+0000","last_clean":"2024-09-12T01:50:22.681621+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:50:22.681621+0000","last_undegraded":"2024-09-12T01:50:22.681621+0000","last_fullsized":"2024-09-12T01:50:22.681621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.608515+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:50:22.608515+0000","last_peered":"2024-09-12T01:50:22.608515+0000","last_clean":"2024-09-12T01:50:22.608515+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:50:22.608515+0000","last_undegraded":"2024-09-12T01:50:22.608515+0000","last_fullsized":"2024-09-12T01:50:22.608515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612632+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:50:22.612632+0000","last_peered":"2024-09-12T01:50:22.612632+0000","last_clean":"2024-09-12T01:50:22.612632+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:50:22.612632+0000","last_undegraded":"2024-09-12T01:50:22.612632+0000","last_fullsized":"2024-09-12T01:50:22.612632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681171+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:50:22.681171+0000","last_peered":"2024-09-12T01:50:22.681171+0000","last_clean":"2024-09-12T01:50:22.681171+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:50:22.681171+0000","last_undegraded":"2024-09-12T01:50:22.681171+0000","last_fullsized":"2024-09-12T01:50:22.681171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614316+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:50:22.614316+0000","last_peered":"2024-09-12T01:50:22.614316+0000","last_clean":"2024-09-12T01:50:22.614316+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:50:22.614316+0000","last_undegraded":"2024-09-12T01:50:22.614316+0000","last_fullsized":"2024-09-12T01:50:22.614316+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611147+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:50:22.611147+0000","last_peered":"2024-09-12T01:50:22.611147+0000","last_clean":"2024-09-12T01:50:22.611147+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:50:22.611147+0000","last_undegraded":"2024-09-12T01:50:22.611147+0000","last_fullsized":"2024-09-12T01:50:22.611147+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611083+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:50:21.611083+0000","last_peered":"2024-09-12T01:50:21.611083+0000","last_clean":"2024-09-12T01:50:21.611083+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:50:21.611083+0000","last_undegraded":"2024-09-12T01:50:21.611083+0000","last_fullsized":"2024-09-12T01:50:21.611083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.628919+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:50:22.628919+0000","last_peered":"2024-09-12T01:50:22.628919+0000","last_clean":"2024-09-12T01:50:22.628919+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:50:22.628919+0000","last_undegraded":"2024-09-12T01:50:22.628919+0000","last_fullsized":"2024-09-12T01:50:22.628919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611476+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:50:21.611476+0000","last_peered":"2024-09-12T01:50:21.611476+0000","last_clean":"2024-09-12T01:50:21.611476+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:50:21.611476+0000","last_undegraded":"2024-09-12T01:50:21.611476+0000","last_fullsized":"2024-09-12T01:50:21.611476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612637+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:50:22.612637+0000","last_peered":"2024-09-12T01:50:22.612637+0000","last_clean":"2024-09-12T01:50:22.612637+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:50:22.612637+0000","last_undegraded":"2024-09-12T01:50:22.612637+0000","last_fullsized":"2024-09-12T01:50:22.612637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681201+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:50:22.681201+0000","last_peered":"2024-09-12T01:50:22.681201+0000","last_clean":"2024-09-12T01:50:22.681201+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:50:22.681201+0000","last_undegraded":"2024-09-12T01:50:22.681201+0000","last_fullsized":"2024-09-12T01:50:22.681201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613758+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:50:22.613758+0000","last_peered":"2024-09-12T01:50:22.613758+0000","last_clean":"2024-09-12T01:50:22.613758+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:50:22.613758+0000","last_undegraded":"2024-09-12T01:50:22.613758+0000","last_fullsized":"2024-09-12T01:50:22.613758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610182+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:50:22.610182+0000","last_peered":"2024-09-12T01:50:22.610182+0000","last_clean":"2024-09-12T01:50:22.610182+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:50:22.610182+0000","last_undegraded":"2024-09-12T01:50:22.610182+0000","last_fullsized":"2024-09-12T01:50:22.610182+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611958+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:50:22.611958+0000","last_peered":"2024-09-12T01:50:22.611958+0000","last_clean":"2024-09-12T01:50:22.611958+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:50:22.611958+0000","last_undegraded":"2024-09-12T01:50:22.611958+0000","last_fullsized":"2024-09-12T01:50:22.611958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611944+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:50:22.611944+0000","last_peered":"2024-09-12T01:50:22.611944+0000","last_clean":"2024-09-12T01:50:22.611944+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:50:22.611944+0000","last_undegraded":"2024-09-12T01:50:22.611944+0000","last_fullsized":"2024-09-12T01:50:22.611944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.680947+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:50:22.680947+0000","last_peered":"2024-09-12T01:50:22.680947+0000","last_clean":"2024-09-12T01:50:22.680947+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:50:22.680947+0000","last_undegraded":"2024-09-12T01:50:22.680947+0000","last_fullsized":"2024-09-12T01:50:22.680947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611008+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:50:22.611008+0000","last_peered":"2024-09-12T01:50:22.611008+0000","last_clean":"2024-09-12T01:50:22.611008+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:50:22.611008+0000","last_undegraded":"2024-09-12T01:50:22.611008+0000","last_fullsized":"2024-09-12T01:50:22.611008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":47,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:23.404779+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:50:23.404779+0000","last_peered":"2024-09-12T01:50:23.404779+0000","last_clean":"2024-09-12T01:50:23.404779+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:50:23.404779+0000","last_undegraded":"2024-09-12T01:50:23.404779+0000","last_fullsized":"2024-09-12T01:50:23.404779+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629134+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:50:22.629134+0000","last_peered":"2024-09-12T01:50:22.629134+0000","last_clean":"2024-09-12T01:50:22.629134+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:50:22.629134+0000","last_undegraded":"2024-09-12T01:50:22.629134+0000","last_fullsized":"2024-09-12T01:50:22.629134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.688704+0000","last_change":"2024-09-12T01:50:22.688704+0000","last_active":"2024-09-12T01:50:22.688704+0000","last_peered":"2024-09-12T01:50:22.688704+0000","last_clean":"2024-09-12T01:50:22.688704+0000","last_became_active":"2024-09-12T01:50:22.682640+0000","last_became_peered":"2024-09-12T01:50:22.682640+0000","last_unstale":"2024-09-12T01:50:22.688704+0000","last_undegraded":"2024-09-12T01:50:22.688704+0000","last_fullsized":"2024-09-12T01:50:22.688704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.731438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614069+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:22.614069+0000","last_peered":"2024-09-12T01:50:22.614069+0000","last_clean":"2024-09-12T01:50:22.614069+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:22.614069+0000","last_undegraded":"2024-09-12T01:50:22.614069+0000","last_fullsized":"2024-09-12T01:50:22.614069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611016+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:50:21.611016+0000","last_peered":"2024-09-12T01:50:21.611016+0000","last_clean":"2024-09-12T01:50:21.611016+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:50:21.611016+0000","last_undegraded":"2024-09-12T01:50:21.611016+0000","last_fullsized":"2024-09-12T01:50:21.611016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629145+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:22.629145+0000","last_peered":"2024-09-12T01:50:22.629145+0000","last_clean":"2024-09-12T01:50:22.629145+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:22.629145+0000","last_undegraded":"2024-09-12T01:50:22.629145+0000","last_fullsized":"2024-09-12T01:50:22.629145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.608239+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:50:22.608239+0000","last_peered":"2024-09-12T01:50:22.608239+0000","last_clean":"2024-09-12T01:50:22.608239+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:50:22.608239+0000","last_undegraded":"2024-09-12T01:50:22.608239+0000","last_fullsized":"2024-09-12T01:50:22.608239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":60,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:25.406458+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:50:25.406458+0000","last_peered":"2024-09-12T01:50:25.406458+0000","last_clean":"2024-09-12T01:50:25.406458+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:50:25.406458+0000","last_undegraded":"2024-09-12T01:50:25.406458+0000","last_fullsized":"2024-09-12T01:50:25.406458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611544+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:50:22.611544+0000","last_peered":"2024-09-12T01:50:22.611544+0000","last_clean":"2024-09-12T01:50:22.611544+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:50:22.611544+0000","last_undegraded":"2024-09-12T01:50:22.611544+0000","last_fullsized":"2024-09-12T01:50:22.611544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613318+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:22.613318+0000","last_peered":"2024-09-12T01:50:22.613318+0000","last_clean":"2024-09-12T01:50:22.613318+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:22.613318+0000","last_undegraded":"2024-09-12T01:50:22.613318+0000","last_fullsized":"2024-09-12T01:50:22.613318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.630618+0000","last_change":"2024-09-12T01:50:22.630618+0000","last_active":"2024-09-12T01:50:22.630618+0000","last_peered":"2024-09-12T01:50:22.630618+0000","last_clean":"2024-09-12T01:50:22.630618+0000","last_became_active":"2024-09-12T01:50:22.630327+0000","last_became_peered":"2024-09-12T01:50:22.630327+0000","last_unstale":"2024-09-12T01:50:22.630618+0000","last_undegraded":"2024-09-12T01:50:22.630618+0000","last_fullsized":"2024-09-12T01:50:22.630618+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.647257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629439+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:22.629439+0000","last_peered":"2024-09-12T01:50:22.629439+0000","last_clean":"2024-09-12T01:50:22.629439+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:22.629439+0000","last_undegraded":"2024-09-12T01:50:22.629439+0000","last_fullsized":"2024-09-12T01:50:22.629439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611367+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:50:22.611367+0000","last_peered":"2024-09-12T01:50:22.611367+0000","last_clean":"2024-09-12T01:50:22.611367+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:50:22.611367+0000","last_undegraded":"2024-09-12T01:50:22.611367+0000","last_fullsized":"2024-09-12T01:50:22.611367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'28","reported_seq":109,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:24.692969+0000","last_change":"2024-09-12T01:50:22.696674+0000","last_active":"2024-09-12T01:50:24.692969+0000","last_peered":"2024-09-12T01:50:24.692969+0000","last_clean":"2024-09-12T01:50:24.692969+0000","last_became_active":"2024-09-12T01:50:22.683417+0000","last_became_peered":"2024-09-12T01:50:22.683417+0000","last_unstale":"2024-09-12T01:50:24.692969+0000","last_undegraded":"2024-09-12T01:50:24.692969+0000","last_fullsized":"2024-09-12T01:50:24.692969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:35.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53860,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":69,"num_write":30,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":49603,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611363+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:50:22.611363+0000","last_peered":"2024-09-12T01:50:22.611363+0000","last_clean":"2024-09-12T01:50:22.611363+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:50:22.611363+0000","last_undegraded":"2024-09-12T01:50:22.611363+0000","last_fullsized":"2024-09-12T01:50:22.611363+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612213+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:22.612213+0000","last_peered":"2024-09-12T01:50:22.612213+0000","last_clean":"2024-09-12T01:50:22.612213+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:22.612213+0000","last_undegraded":"2024-09-12T01:50:22.612213+0000","last_fullsized":"2024-09-12T01:50:22.612213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613776+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:50:22.613776+0000","last_peered":"2024-09-12T01:50:22.613776+0000","last_clean":"2024-09-12T01:50:22.613776+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:50:22.613776+0000","last_undegraded":"2024-09-12T01:50:22.613776+0000","last_fullsized":"2024-09-12T01:50:22.613776+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629035+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:22.629035+0000","last_peered":"2024-09-12T01:50:22.629035+0000","last_clean":"2024-09-12T01:50:22.629035+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:22.629035+0000","last_undegraded":"2024-09-12T01:50:22.629035+0000","last_fullsized":"2024-09-12T01:50:22.629035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.616527+0000","last_change":"2024-09-12T01:50:22.616527+0000","last_active":"2024-09-12T01:50:22.616527+0000","last_peered":"2024-09-12T01:50:22.616527+0000","last_clean":"2024-09-12T01:50:22.616527+0000","last_became_active":"2024-09-12T01:50:22.616150+0000","last_became_peered":"2024-09-12T01:50:22.616150+0000","last_unstale":"2024-09-12T01:50:22.616527+0000","last_undegraded":"2024-09-12T01:50:22.616527+0000","last_fullsized":"2024-09-12T01:50:22.616527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:58.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":47,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:25.406815+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:50:25.406815+0000","last_peered":"2024-09-12T01:50:25.406815+0000","last_clean":"2024-09-12T01:50:25.406815+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:50:25.406815+0000","last_undegraded":"2024-09-12T01:50:25.406815+0000","last_fullsized":"2024-09-12T01:50:25.406815+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612514+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:50:22.612514+0000","last_peered":"2024-09-12T01:50:22.612514+0000","last_clean":"2024-09-12T01:50:22.612514+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:50:22.612514+0000","last_undegraded":"2024-09-12T01:50:22.612514+0000","last_fullsized":"2024-09-12T01:50:22.612514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610857+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:22.610857+0000","last_peered":"2024-09-12T01:50:22.610857+0000","last_clean":"2024-09-12T01:50:22.610857+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:22.610857+0000","last_undegraded":"2024-09-12T01:50:22.610857+0000","last_fullsized":"2024-09-12T01:50:22.610857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629097+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:50:22.629097+0000","last_peered":"2024-09-12T01:50:22.629097+0000","last_clean":"2024-09-12T01:50:22.629097+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:50:22.629097+0000","last_undegraded":"2024-09-12T01:50:22.629097+0000","last_fullsized":"2024-09-12T01:50:22.629097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611513+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:22.611513+0000","last_peered":"2024-09-12T01:50:22.611513+0000","last_clean":"2024-09-12T01:50:22.611513+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:22.611513+0000","last_undegraded":"2024-09-12T01:50:22.611513+0000","last_fullsized":"2024-09-12T01:50:22.611513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681162+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:50:22.681162+0000","last_peered":"2024-09-12T01:50:22.681162+0000","last_clean":"2024-09-12T01:50:22.681162+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:50:22.681162+0000","last_undegraded":"2024-09-12T01:50:22.681162+0000","last_fullsized":"2024-09-12T01:50:22.681162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613947+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:22.613947+0000","last_peered":"2024-09-12T01:50:22.613947+0000","last_clean":"2024-09-12T01:50:22.613947+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:22.613947+0000","last_undegraded":"2024-09-12T01:50:22.613947+0000","last_fullsized":"2024-09-12T01:50:22.613947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612841+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:50:22.612841+0000","last_peered":"2024-09-12T01:50:22.612841+0000","last_clean":"2024-09-12T01:50:22.612841+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:50:22.612841+0000","last_undegraded":"2024-09-12T01:50:22.612841+0000","last_fullsized":"2024-09-12T01:50:22.612841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629587+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:22.629587+0000","last_peered":"2024-09-12T01:50:22.629587+0000","last_clean":"2024-09-12T01:50:22.629587+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:22.629587+0000","last_undegraded":"2024-09-12T01:50:22.629587+0000","last_fullsized":"2024-09-12T01:50:22.629587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613199+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:50:22.613199+0000","last_peered":"2024-09-12T01:50:22.613199+0000","last_clean":"2024-09-12T01:50:22.613199+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:50:22.613199+0000","last_undegraded":"2024-09-12T01:50:22.613199+0000","last_fullsized":"2024-09-12T01:50:22.613199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'6","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612555+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:50:22.612555+0000","last_peered":"2024-09-12T01:50:22.612555+0000","last_clean":"2024-09-12T01:50:22.612555+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:50:22.612555+0000","last_undegraded":"2024-09-12T01:50:22.612555+0000","last_fullsized":"2024-09-12T01:50:22.612555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613509+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:50:22.613509+0000","last_peered":"2024-09-12T01:50:22.613509+0000","last_clean":"2024-09-12T01:50:22.613509+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:50:22.613509+0000","last_undegraded":"2024-09-12T01:50:22.613509+0000","last_fullsized":"2024-09-12T01:50:22.613509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612676+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:50:22.612676+0000","last_peered":"2024-09-12T01:50:22.612676+0000","last_clean":"2024-09-12T01:50:22.612676+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:50:22.612676+0000","last_undegraded":"2024-09-12T01:50:22.612676+0000","last_fullsized":"2024-09-12T01:50:22.612676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681903+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:22.681903+0000","last_peered":"2024-09-12T01:50:22.681903+0000","last_clean":"2024-09-12T01:50:22.681903+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:22.681903+0000","last_undegraded":"2024-09-12T01:50:22.681903+0000","last_fullsized":"2024-09-12T01:50:22.681903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611304+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:50:21.611304+0000","last_peered":"2024-09-12T01:50:21.611304+0000","last_clean":"2024-09-12T01:50:21.611304+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:50:21.611304+0000","last_undegraded":"2024-09-12T01:50:21.611304+0000","last_fullsized":"2024-09-12T01:50:21.611304+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612642+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:22.612642+0000","last_peered":"2024-09-12T01:50:22.612642+0000","last_clean":"2024-09-12T01:50:22.612642+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:22.612642+0000","last_undegraded":"2024-09-12T01:50:22.612642+0000","last_fullsized":"2024-09-12T01:50:22.612642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613899+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:50:22.613899+0000","last_peered":"2024-09-12T01:50:22.613899+0000","last_clean":"2024-09-12T01:50:22.613899+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:50:22.613899+0000","last_undegraded":"2024-09-12T01:50:22.613899+0000","last_fullsized":"2024-09-12T01:50:22.613899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:23.403930+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:50:23.403930+0000","last_peered":"2024-09-12T01:50:23.403930+0000","last_clean":"2024-09-12T01:50:23.403930+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:50:23.403930+0000","last_undegraded":"2024-09-12T01:50:23.403930+0000","last_fullsized":"2024-09-12T01:50:23.403930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.682963+0000","last_change":"2024-09-12T01:50:22.682963+0000","last_active":"2024-09-12T01:50:22.682963+0000","last_peered":"2024-09-12T01:50:22.682963+0000","last_clean":"2024-09-12T01:50:22.682963+0000","last_became_active":"2024-09-12T01:50:22.682611+0000","last_became_peered":"2024-09-12T01:50:22.682611+0000","last_unstale":"2024-09-12T01:50:22.682963+0000","last_undegraded":"2024-09-12T01:50:22.682963+0000","last_fullsized":"2024-09-12T01:50:22.682963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:01.295098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'6","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.684120+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:50:22.684120+0000","last_peered":"2024-09-12T01:50:22.684120+0000","last_clean":"2024-09-12T01:50:22.684120+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:50:22.684120+0000","last_undegraded":"2024-09-12T01:50:22.684120+0000","last_fullsized":"2024-09-12T01:50:22.684120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610718+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:50:22.610718+0000","last_peered":"2024-09-12T01:50:22.610718+0000","last_clean":"2024-09-12T01:50:22.610718+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:50:22.610718+0000","last_undegraded":"2024-09-12T01:50:22.610718+0000","last_fullsized":"2024-09-12T01:50:22.610718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.683026+0000","last_change":"2024-09-12T01:50:22.683026+0000","last_active":"2024-09-12T01:50:22.683026+0000","last_peered":"2024-09-12T01:50:22.683026+0000","last_clean":"2024-09-12T01:50:22.683026+0000","last_became_active":"2024-09-12T01:50:22.682461+0000","last_became_peered":"2024-09-12T01:50:22.682461+0000","last_unstale":"2024-09-12T01:50:22.683026+0000","last_undegraded":"2024-09-12T01:50:22.683026+0000","last_fullsized":"2024-09-12T01:50:22.683026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.470081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.618050+0000","last_change":"2024-09-12T01:50:22.618050+0000","last_active":"2024-09-12T01:50:22.618050+0000","last_peered":"2024-09-12T01:50:22.618050+0000","last_clean":"2024-09-12T01:50:22.618050+0000","last_became_active":"2024-09-12T01:50:22.614871+0000","last_became_peered":"2024-09-12T01:50:22.614871+0000","last_unstale":"2024-09-12T01:50:22.618050+0000","last_undegraded":"2024-09-12T01:50:22.618050+0000","last_fullsized":"2024-09-12T01:50:22.618050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:47.652568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611446+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:22.611446+0000","last_peered":"2024-09-12T01:50:22.611446+0000","last_clean":"2024-09-12T01:50:22.611446+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:22.611446+0000","last_undegraded":"2024-09-12T01:50:22.611446+0000","last_fullsized":"2024-09-12T01:50:22.611446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613847+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:50:22.613847+0000","last_peered":"2024-09-12T01:50:22.613847+0000","last_clean":"2024-09-12T01:50:22.613847+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:50:22.613847+0000","last_undegraded":"2024-09-12T01:50:22.613847+0000","last_fullsized":"2024-09-12T01:50:22.613847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'14","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.608589+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:50:22.608589+0000","last_peered":"2024-09-12T01:50:22.608589+0000","last_clean":"2024-09-12T01:50:22.608589+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:50:22.608589+0000","last_undegraded":"2024-09-12T01:50:22.608589+0000","last_fullsized":"2024-09-12T01:50:22.608589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611565+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:50:21.611565+0000","last_peered":"2024-09-12T01:50:21.611565+0000","last_clean":"2024-09-12T01:50:21.611565+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:50:21.611565+0000","last_undegraded":"2024-09-12T01:50:21.611565+0000","last_fullsized":"2024-09-12T01:50:21.611565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681518+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:22.681518+0000","last_peered":"2024-09-12T01:50:22.681518+0000","last_clean":"2024-09-12T01:50:22.681518+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:22.681518+0000","last_undegraded":"2024-09-12T01:50:22.681518+0000","last_fullsized":"2024-09-12T01:50:22.681518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610152+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:50:22.610152+0000","last_peered":"2024-09-12T01:50:22.610152+0000","last_clean":"2024-09-12T01:50:22.610152+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:50:22.610152+0000","last_undegraded":"2024-09-12T01:50:22.610152+0000","last_fullsized":"2024-09-12T01:50:22.610152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611066+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:22.611066+0000","last_peered":"2024-09-12T01:50:22.611066+0000","last_clean":"2024-09-12T01:50:22.611066+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:22.611066+0000","last_undegraded":"2024-09-12T01:50:22.611066+0000","last_fullsized":"2024-09-12T01:50:22.611066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611019+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:50:22.611019+0000","last_peered":"2024-09-12T01:50:22.611019+0000","last_clean":"2024-09-12T01:50:22.611019+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:50:22.611019+0000","last_undegraded":"2024-09-12T01:50:22.611019+0000","last_fullsized":"2024-09-12T01:50:22.611019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611172+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:21.611172+0000","last_peered":"2024-09-12T01:50:21.611172+0000","last_clean":"2024-09-12T01:50:21.611172+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:21.611172+0000","last_undegraded":"2024-09-12T01:50:21.611172+0000","last_fullsized":"2024-09-12T01:50:21.611172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.680978+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:50:22.680978+0000","last_peered":"2024-09-12T01:50:22.680978+0000","last_clean":"2024-09-12T01:50:22.680978+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:50:22.680978+0000","last_undegraded":"2024-09-12T01:50:22.680978+0000","last_fullsized":"2024-09-12T01:50:22.680978+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612092+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:22.612092+0000","last_peered":"2024-09-12T01:50:22.612092+0000","last_clean":"2024-09-12T01:50:22.612092+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:22.612092+0000","last_undegraded":"2024-09-12T01:50:22.612092+0000","last_fullsized":"2024-09-12T01:50:22.612092+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611313+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:50:21.611313+0000","last_peered":"2024-09-12T01:50:21.611313+0000","last_clean":"2024-09-12T01:50:21.611313+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:50:21.611313+0000","last_undegraded":"2024-09-12T01:50:21.611313+0000","last_fullsized":"2024-09-12T01:50:21.611313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611281+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:22.611281+0000","last_peered":"2024-09-12T01:50:22.611281+0000","last_clean":"2024-09-12T01:50:22.611281+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:22.611281+0000","last_undegraded":"2024-09-12T01:50:22.611281+0000","last_fullsized":"2024-09-12T01:50:22.611281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612942+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:50:22.612942+0000","last_peered":"2024-09-12T01:50:22.612942+0000","last_clean":"2024-09-12T01:50:22.612942+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:50:22.612942+0000","last_undegraded":"2024-09-12T01:50:22.612942+0000","last_fullsized":"2024-09-12T01:50:22.612942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629449+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:50:22.629449+0000","last_peered":"2024-09-12T01:50:22.629449+0000","last_clean":"2024-09-12T01:50:22.629449+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:50:22.629449+0000","last_undegraded":"2024-09-12T01:50:22.629449+0000","last_fullsized":"2024-09-12T01:50:22.629449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611510+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:22.611510+0000","last_peered":"2024-09-12T01:50:22.611510+0000","last_clean":"2024-09-12T01:50:22.611510+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:22.611510+0000","last_undegraded":"2024-09-12T01:50:22.611510+0000","last_fullsized":"2024-09-12T01:50:22.611510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610811+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:50:22.610811+0000","last_peered":"2024-09-12T01:50:22.610811+0000","last_clean":"2024-09-12T01:50:22.610811+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:50:22.610811+0000","last_undegraded":"2024-09-12T01:50:22.610811+0000","last_fullsized":"2024-09-12T01:50:22.610811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611302+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:22.611302+0000","last_peered":"2024-09-12T01:50:22.611302+0000","last_clean":"2024-09-12T01:50:22.611302+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:22.611302+0000","last_undegraded":"2024-09-12T01:50:22.611302+0000","last_fullsized":"2024-09-12T01:50:22.611302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610330+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:50:22.610330+0000","last_peered":"2024-09-12T01:50:22.610330+0000","last_clean":"2024-09-12T01:50:22.610330+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:50:22.610330+0000","last_undegraded":"2024-09-12T01:50:22.610330+0000","last_fullsized":"2024-09-12T01:50:22.610330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611632+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:50:21.611632+0000","last_peered":"2024-09-12T01:50:21.611632+0000","last_clean":"2024-09-12T01:50:21.611632+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:50:21.611632+0000","last_undegraded":"2024-09-12T01:50:21.611632+0000","last_fullsized":"2024-09-12T01:50:21.611632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T01:50:21.611415+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:50:21.611415+0000","last_peered":"2024-09-12T01:50:21.611415+0000","last_clean":"2024-09-12T01:50:21.611415+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:50:21.611415+0000","last_undegraded":"2024-09-12T01:50:21.611415+0000","last_fullsized":"2024-09-12T01:50:21.611415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":74,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:25.688035+0000","last_change":"2024-09-12T01:50:22.691988+0000","last_active":"2024-09-12T01:50:25.688035+0000","last_peered":"2024-09-12T01:50:25.688035+0000","last_clean":"2024-09-12T01:50:25.688035+0000","last_became_active":"2024-09-12T01:50:22.682676+0000","last_became_peered":"2024-09-12T01:50:22.682676+0000","last_unstale":"2024-09-12T01:50:25.688035+0000","last_undegraded":"2024-09-12T01:50:25.688035+0000","last_fullsized":"2024-09-12T01:50:25.688035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:56.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61461,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":195,"num_read_kb":167,"num_write":241,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":50275,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":184383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547218,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":439429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32760,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712392,"statfs":{"total":95995035648,"available":95961489408,"internally_reserved":0,"allocated":1605632,"data_stored":1083253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":438411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168607,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":438672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397541,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1523712,"data_stored":1030913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528362,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":921600,"data_stored":438404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789998,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1544192,"data_stored":1030870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":491732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":429364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":991232,"data_stored":489533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":493177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":942080,"data_stored":439743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":56005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":54560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":55596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:50:28.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:28 smithi070 ceph-mon[31177]: pgmap v286: 97 pgs: 97 active+clean; 637 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.2 KiB/s wr, 12 op/s; 6.1 KiB/s, 1 objects/s recovering 2024-09-12T01:50:28.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:28 smithi191 ceph-mon[35770]: pgmap v286: 97 pgs: 97 active+clean; 637 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.2 KiB/s wr, 12 op/s; 6.1 KiB/s, 1 objects/s recovering 2024-09-12T01:50:29.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:28 smithi152 ceph-mon[35055]: pgmap v286: 97 pgs: 97 active+clean; 637 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.2 KiB/s wr, 12 op/s; 6.1 KiB/s, 1 objects/s recovering 2024-09-12T01:50:29.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:29 smithi191 ceph-mon[35770]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:30.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:29 smithi152 ceph-mon[35055]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:30.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:29 smithi070 ceph-mon[31177]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:30.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:30 smithi070 ceph-mon[31177]: pgmap v287: 97 pgs: 97 active+clean; 637 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s; 6.1 KiB/s, 1 objects/s recovering 2024-09-12T01:50:30.914 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:30 smithi152 ceph-mon[35055]: pgmap v287: 97 pgs: 97 active+clean; 637 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s; 6.1 KiB/s, 1 objects/s recovering 2024-09-12T01:50:30.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:30 smithi191 ceph-mon[35770]: pgmap v287: 97 pgs: 97 active+clean; 637 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s; 6.1 KiB/s, 1 objects/s recovering 2024-09-12T01:50:31.534 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:50:31.783 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:32.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.209+0000 7f7a4d068640 1 -- 172.21.15.70:0/1027906482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a48102dd0 msgr2=0x7f7a481031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:32.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.209+0000 7f7a4d068640 1 --2- 172.21.15.70:0/1027906482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a48102dd0 0x7f7a481031b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009930 tx=0x7f7a3802a440 comp rx=0 tx=0).stop 2024-09-12T01:50:32.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.209+0000 7f7a4d068640 1 -- 172.21.15.70:0/1027906482 shutdown_connections 2024-09-12T01:50:32.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.209+0000 7f7a4d068640 1 --2- 172.21.15.70:0/1027906482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a48108300 0x7f7a4810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:32.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.209+0000 7f7a4d068640 1 --2- 172.21.15.70:0/1027906482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a48103780 0x7f7a48107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:32.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.209+0000 7f7a4d068640 1 --2- 172.21.15.70:0/1027906482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a48102dd0 0x7f7a481031b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:32.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.209+0000 7f7a4d068640 1 -- 172.21.15.70:0/1027906482 >> 172.21.15.70:0/1027906482 conn(0x7f7a480fc7d0 msgr2=0x7f7a480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:32.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.209+0000 7f7a4d068640 1 -- 172.21.15.70:0/1027906482 shutdown_connections 2024-09-12T01:50:32.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.209+0000 7f7a4d068640 1 -- 172.21.15.70:0/1027906482 wait complete. 2024-09-12T01:50:32.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.210+0000 7f7a4d068640 1 Processor -- start 2024-09-12T01:50:32.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.210+0000 7f7a4d068640 1 -- start start 2024-09-12T01:50:32.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.210+0000 7f7a4d068640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a48102dd0 0x7f7a481986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:32.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.210+0000 7f7a4d068640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a48103780 0x7f7a48198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.210+0000 7f7a4d068640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a48108300 0x7f7a4819cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.210+0000 7f7a4d068640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7a48112230 con 0x7f7a48108300 2024-09-12T01:50:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.210+0000 7f7a4d068640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7a481120b0 con 0x7f7a48103780 2024-09-12T01:50:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.210+0000 7f7a4d068640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7a481123b0 con 0x7f7a48102dd0 2024-09-12T01:50:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.210+0000 7f7a4759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a48108300 0x7f7a4819cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.210+0000 7f7a4759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a48108300 0x7f7a4819cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34796/0 (socket says 172.21.15.70:34796) 2024-09-12T01:50:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.210+0000 7f7a4759e640 1 -- 172.21.15.70:0/1492724346 learned_addr learned my addr 172.21.15.70:0/1492724346 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.210+0000 7f7a4659c640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a48103780 0x7f7a48198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.211+0000 7f7a46d9d640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a48102dd0 0x7f7a481986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.211+0000 7f7a4759e640 1 -- 172.21.15.70:0/1492724346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a48102dd0 msgr2=0x7f7a481986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.211+0000 7f7a4759e640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a48102dd0 0x7f7a481986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.211+0000 7f7a4759e640 1 -- 172.21.15.70:0/1492724346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a48103780 msgr2=0x7f7a48198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:32.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.211+0000 7f7a4759e640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a48103780 0x7f7a48198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:32.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.211+0000 7f7a4759e640 1 -- 172.21.15.70:0/1492724346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4819d6a0 con 0x7f7a48108300 2024-09-12T01:50:32.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.211+0000 7f7a4759e640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a48108300 0x7f7a4819cfc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000eaa0 tx=0x7f7a4000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:32.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.211+0000 7f7a3ffff640 1 -- 172.21.15.70:0/1492724346 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40004d20 con 0x7f7a48108300 2024-09-12T01:50:32.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.211+0000 7f7a4d068640 1 -- 172.21.15.70:0/1492724346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4819d990 con 0x7f7a48108300 2024-09-12T01:50:32.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.211+0000 7f7a3ffff640 1 -- 172.21.15.70:0/1492724346 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7a40005020 con 0x7f7a48108300 2024-09-12T01:50:32.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.211+0000 7f7a3ffff640 1 -- 172.21.15.70:0/1492724346 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a400116b0 con 0x7f7a48108300 2024-09-12T01:50:32.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.211+0000 7f7a4d068640 1 -- 172.21.15.70:0/1492724346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a481a5270 con 0x7f7a48108300 2024-09-12T01:50:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.212+0000 7f7a4d068640 1 -- 172.21.15.70:0/1492724346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4806a7b0 con 0x7f7a48108300 2024-09-12T01:50:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.213+0000 7f7a3ffff640 1 -- 172.21.15.70:0/1492724346 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7a400051d0 con 0x7f7a48108300 2024-09-12T01:50:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.214+0000 7f7a3ffff640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7a340a2c10 0x7f7a340a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.214+0000 7f7a46d9d640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7a340a2c10 0x7f7a340a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.214+0000 7f7a3ffff640 1 -- 172.21.15.70:0/1492724346 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7a400cf770 con 0x7f7a48108300 2024-09-12T01:50:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.215+0000 7f7a46d9d640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7a340a2c10 0x7f7a340a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009900 tx=0x7f7a380058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.217+0000 7f7a3ffff640 1 -- 172.21.15.70:0/1492724346 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a40016030 con 0x7f7a48108300 2024-09-12T01:50:32.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.382+0000 7f7a4d068640 1 -- 172.21.15.70:0/1492724346 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a48062630 con 0x7f7a340a2c10 2024-09-12T01:50:32.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.388+0000 7f7a3ffff640 1 -- 172.21.15.70:0/1492724346 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258779 (secure 0 0 0) 0x7f7a48062630 con 0x7f7a340a2c10 2024-09-12T01:50:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:50:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:50:32.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.391+0000 7f7a4d068640 1 -- 172.21.15.70:0/1492724346 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7a340a2c10 msgr2=0x7f7a340a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:32.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.391+0000 7f7a4d068640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7a340a2c10 0x7f7a340a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009900 tx=0x7f7a380058d0 comp rx=0 tx=0).stop 2024-09-12T01:50:32.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.391+0000 7f7a4d068640 1 -- 172.21.15.70:0/1492724346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a48108300 msgr2=0x7f7a4819cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:32.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.391+0000 7f7a4d068640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a48108300 0x7f7a4819cfc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000eaa0 tx=0x7f7a4000eea0 comp rx=0 tx=0).stop 2024-09-12T01:50:32.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.392+0000 7f7a4d068640 1 -- 172.21.15.70:0/1492724346 shutdown_connections 2024-09-12T01:50:32.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.392+0000 7f7a4d068640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7a340a2c10 0x7f7a340a50d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:32.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.392+0000 7f7a4d068640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a48108300 0x7f7a4819cfc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:32.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.392+0000 7f7a4d068640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a48103780 0x7f7a48198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:32.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.392+0000 7f7a4d068640 1 --2- 172.21.15.70:0/1492724346 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7a48102dd0 0x7f7a481986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:32.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.392+0000 7f7a4d068640 1 -- 172.21.15.70:0/1492724346 >> 172.21.15.70:0/1492724346 conn(0x7f7a480fc7d0 msgr2=0x7f7a481063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:32.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.392+0000 7f7a4d068640 1 -- 172.21.15.70:0/1492724346 shutdown_connections 2024-09-12T01:50:32.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:32.392+0000 7f7a4d068640 1 -- 172.21.15.70:0/1492724346 wait complete. 2024-09-12T01:50:32.921 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:32 smithi070 ceph-mon[31177]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 10 op/s; 5.0 KiB/s, 1 objects/s recovering 2024-09-12T01:50:32.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:32 smithi191 ceph-mon[35770]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 10 op/s; 5.0 KiB/s, 1 objects/s recovering 2024-09-12T01:50:33.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:32 smithi152 ceph-mon[35055]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 10 op/s; 5.0 KiB/s, 1 objects/s recovering 2024-09-12T01:50:33.205 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-12T01:50:31.480504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658861,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":362,"num_read_kb":303,"num_write":427,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1231128,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366328,"kb_used_data":12868,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575496,"statfs":{"total":1151940427776,"available":1151565307904,"internally_reserved":0,"allocated":13176832,"data_stored":7215849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11055,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":55,"num_write":13,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":50392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.879851"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681555+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:50:22.681555+0000","last_peered":"2024-09-12T01:50:22.681555+0000","last_clean":"2024-09-12T01:50:22.681555+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:50:22.681555+0000","last_undegraded":"2024-09-12T01:50:22.681555+0000","last_fullsized":"2024-09-12T01:50:22.681555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610122+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:50:22.610122+0000","last_peered":"2024-09-12T01:50:22.610122+0000","last_clean":"2024-09-12T01:50:22.610122+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:50:22.610122+0000","last_undegraded":"2024-09-12T01:50:22.610122+0000","last_fullsized":"2024-09-12T01:50:22.610122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610144+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:50:22.610144+0000","last_peered":"2024-09-12T01:50:22.610144+0000","last_clean":"2024-09-12T01:50:22.610144+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:50:22.610144+0000","last_undegraded":"2024-09-12T01:50:22.610144+0000","last_fullsized":"2024-09-12T01:50:22.610144+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.682256+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:50:22.682256+0000","last_peered":"2024-09-12T01:50:22.682256+0000","last_clean":"2024-09-12T01:50:22.682256+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:50:22.682256+0000","last_undegraded":"2024-09-12T01:50:22.682256+0000","last_fullsized":"2024-09-12T01:50:22.682256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611131+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:50:22.611131+0000","last_peered":"2024-09-12T01:50:22.611131+0000","last_clean":"2024-09-12T01:50:22.611131+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:50:22.611131+0000","last_undegraded":"2024-09-12T01:50:22.611131+0000","last_fullsized":"2024-09-12T01:50:22.611131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614193+0000","last_change":"2024-09-12T01:50:22.614193+0000","last_active":"2024-09-12T01:50:22.614193+0000","last_peered":"2024-09-12T01:50:22.614193+0000","last_clean":"2024-09-12T01:50:22.614193+0000","last_became_active":"2024-09-12T01:50:22.613816+0000","last_became_peered":"2024-09-12T01:50:22.613816+0000","last_unstale":"2024-09-12T01:50:22.614193+0000","last_undegraded":"2024-09-12T01:50:22.614193+0000","last_fullsized":"2024-09-12T01:50:22.614193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:29.504176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612817+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:50:22.612817+0000","last_peered":"2024-09-12T01:50:22.612817+0000","last_clean":"2024-09-12T01:50:22.612817+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:50:22.612817+0000","last_undegraded":"2024-09-12T01:50:22.612817+0000","last_fullsized":"2024-09-12T01:50:22.612817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613485+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:50:22.613485+0000","last_peered":"2024-09-12T01:50:22.613485+0000","last_clean":"2024-09-12T01:50:22.613485+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:50:22.613485+0000","last_undegraded":"2024-09-12T01:50:22.613485+0000","last_fullsized":"2024-09-12T01:50:22.613485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611663+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:50:22.611663+0000","last_peered":"2024-09-12T01:50:22.611663+0000","last_clean":"2024-09-12T01:50:22.611663+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:50:22.611663+0000","last_undegraded":"2024-09-12T01:50:22.611663+0000","last_fullsized":"2024-09-12T01:50:22.611663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610750+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:50:22.610750+0000","last_peered":"2024-09-12T01:50:22.610750+0000","last_clean":"2024-09-12T01:50:22.610750+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:50:22.610750+0000","last_undegraded":"2024-09-12T01:50:22.610750+0000","last_fullsized":"2024-09-12T01:50:22.610750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613460+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:50:22.613460+0000","last_peered":"2024-09-12T01:50:22.613460+0000","last_clean":"2024-09-12T01:50:22.613460+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:50:22.613460+0000","last_undegraded":"2024-09-12T01:50:22.613460+0000","last_fullsized":"2024-09-12T01:50:22.613460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.682287+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:50:22.682287+0000","last_peered":"2024-09-12T01:50:22.682287+0000","last_clean":"2024-09-12T01:50:22.682287+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:50:22.682287+0000","last_undegraded":"2024-09-12T01:50:22.682287+0000","last_fullsized":"2024-09-12T01:50:22.682287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614251+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:50:22.614251+0000","last_peered":"2024-09-12T01:50:22.614251+0000","last_clean":"2024-09-12T01:50:22.614251+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:50:22.614251+0000","last_undegraded":"2024-09-12T01:50:22.614251+0000","last_fullsized":"2024-09-12T01:50:22.614251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610012+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:50:22.610012+0000","last_peered":"2024-09-12T01:50:22.610012+0000","last_clean":"2024-09-12T01:50:22.610012+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:50:22.610012+0000","last_undegraded":"2024-09-12T01:50:22.610012+0000","last_fullsized":"2024-09-12T01:50:22.610012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.609996+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:50:22.609996+0000","last_peered":"2024-09-12T01:50:22.609996+0000","last_clean":"2024-09-12T01:50:22.609996+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:50:22.609996+0000","last_undegraded":"2024-09-12T01:50:22.609996+0000","last_fullsized":"2024-09-12T01:50:22.609996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610813+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:50:22.610813+0000","last_peered":"2024-09-12T01:50:22.610813+0000","last_clean":"2024-09-12T01:50:22.610813+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:50:22.610813+0000","last_undegraded":"2024-09-12T01:50:22.610813+0000","last_fullsized":"2024-09-12T01:50:22.610813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681621+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:50:22.681621+0000","last_peered":"2024-09-12T01:50:22.681621+0000","last_clean":"2024-09-12T01:50:22.681621+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:50:22.681621+0000","last_undegraded":"2024-09-12T01:50:22.681621+0000","last_fullsized":"2024-09-12T01:50:22.681621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.608515+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:50:22.608515+0000","last_peered":"2024-09-12T01:50:22.608515+0000","last_clean":"2024-09-12T01:50:22.608515+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:50:22.608515+0000","last_undegraded":"2024-09-12T01:50:22.608515+0000","last_fullsized":"2024-09-12T01:50:22.608515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612632+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:50:22.612632+0000","last_peered":"2024-09-12T01:50:22.612632+0000","last_clean":"2024-09-12T01:50:22.612632+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:50:22.612632+0000","last_undegraded":"2024-09-12T01:50:22.612632+0000","last_fullsized":"2024-09-12T01:50:22.612632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681171+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:50:22.681171+0000","last_peered":"2024-09-12T01:50:22.681171+0000","last_clean":"2024-09-12T01:50:22.681171+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:50:22.681171+0000","last_undegraded":"2024-09-12T01:50:22.681171+0000","last_fullsized":"2024-09-12T01:50:22.681171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614316+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:50:22.614316+0000","last_peered":"2024-09-12T01:50:22.614316+0000","last_clean":"2024-09-12T01:50:22.614316+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:50:22.614316+0000","last_undegraded":"2024-09-12T01:50:22.614316+0000","last_fullsized":"2024-09-12T01:50:22.614316+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611147+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:50:22.611147+0000","last_peered":"2024-09-12T01:50:22.611147+0000","last_clean":"2024-09-12T01:50:22.611147+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:50:22.611147+0000","last_undegraded":"2024-09-12T01:50:22.611147+0000","last_fullsized":"2024-09-12T01:50:22.611147+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613661+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:50:22.613661+0000","last_peered":"2024-09-12T01:50:22.613661+0000","last_clean":"2024-09-12T01:50:22.613661+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:50:22.613661+0000","last_undegraded":"2024-09-12T01:50:22.613661+0000","last_fullsized":"2024-09-12T01:50:22.613661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.628919+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:50:22.628919+0000","last_peered":"2024-09-12T01:50:22.628919+0000","last_clean":"2024-09-12T01:50:22.628919+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:50:22.628919+0000","last_undegraded":"2024-09-12T01:50:22.628919+0000","last_fullsized":"2024-09-12T01:50:22.628919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614394+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:50:22.614394+0000","last_peered":"2024-09-12T01:50:22.614394+0000","last_clean":"2024-09-12T01:50:22.614394+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:50:22.614394+0000","last_undegraded":"2024-09-12T01:50:22.614394+0000","last_fullsized":"2024-09-12T01:50:22.614394+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612637+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:50:22.612637+0000","last_peered":"2024-09-12T01:50:22.612637+0000","last_clean":"2024-09-12T01:50:22.612637+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:50:22.612637+0000","last_undegraded":"2024-09-12T01:50:22.612637+0000","last_fullsized":"2024-09-12T01:50:22.612637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681201+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:50:22.681201+0000","last_peered":"2024-09-12T01:50:22.681201+0000","last_clean":"2024-09-12T01:50:22.681201+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:50:22.681201+0000","last_undegraded":"2024-09-12T01:50:22.681201+0000","last_fullsized":"2024-09-12T01:50:22.681201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613758+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:50:22.613758+0000","last_peered":"2024-09-12T01:50:22.613758+0000","last_clean":"2024-09-12T01:50:22.613758+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:50:22.613758+0000","last_undegraded":"2024-09-12T01:50:22.613758+0000","last_fullsized":"2024-09-12T01:50:22.613758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610182+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:50:22.610182+0000","last_peered":"2024-09-12T01:50:22.610182+0000","last_clean":"2024-09-12T01:50:22.610182+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:50:22.610182+0000","last_undegraded":"2024-09-12T01:50:22.610182+0000","last_fullsized":"2024-09-12T01:50:22.610182+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611958+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:50:22.611958+0000","last_peered":"2024-09-12T01:50:22.611958+0000","last_clean":"2024-09-12T01:50:22.611958+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:50:22.611958+0000","last_undegraded":"2024-09-12T01:50:22.611958+0000","last_fullsized":"2024-09-12T01:50:22.611958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611944+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:50:22.611944+0000","last_peered":"2024-09-12T01:50:22.611944+0000","last_clean":"2024-09-12T01:50:22.611944+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:50:22.611944+0000","last_undegraded":"2024-09-12T01:50:22.611944+0000","last_fullsized":"2024-09-12T01:50:22.611944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.680947+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:50:22.680947+0000","last_peered":"2024-09-12T01:50:22.680947+0000","last_clean":"2024-09-12T01:50:22.680947+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:50:22.680947+0000","last_undegraded":"2024-09-12T01:50:22.680947+0000","last_fullsized":"2024-09-12T01:50:22.680947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611008+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:50:22.611008+0000","last_peered":"2024-09-12T01:50:22.611008+0000","last_clean":"2024-09-12T01:50:22.611008+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:50:22.611008+0000","last_undegraded":"2024-09-12T01:50:22.611008+0000","last_fullsized":"2024-09-12T01:50:22.611008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:28.411590+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:50:28.411590+0000","last_peered":"2024-09-12T01:50:28.411590+0000","last_clean":"2024-09-12T01:50:28.411590+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:50:28.411590+0000","last_undegraded":"2024-09-12T01:50:28.411590+0000","last_fullsized":"2024-09-12T01:50:28.411590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629134+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:50:22.629134+0000","last_peered":"2024-09-12T01:50:22.629134+0000","last_clean":"2024-09-12T01:50:22.629134+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:50:22.629134+0000","last_undegraded":"2024-09-12T01:50:22.629134+0000","last_fullsized":"2024-09-12T01:50:22.629134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.688704+0000","last_change":"2024-09-12T01:50:22.688704+0000","last_active":"2024-09-12T01:50:22.688704+0000","last_peered":"2024-09-12T01:50:22.688704+0000","last_clean":"2024-09-12T01:50:22.688704+0000","last_became_active":"2024-09-12T01:50:22.682640+0000","last_became_peered":"2024-09-12T01:50:22.682640+0000","last_unstale":"2024-09-12T01:50:22.688704+0000","last_undegraded":"2024-09-12T01:50:22.688704+0000","last_fullsized":"2024-09-12T01:50:22.688704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.731438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614069+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:22.614069+0000","last_peered":"2024-09-12T01:50:22.614069+0000","last_clean":"2024-09-12T01:50:22.614069+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:22.614069+0000","last_undegraded":"2024-09-12T01:50:22.614069+0000","last_fullsized":"2024-09-12T01:50:22.614069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613533+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:50:22.613533+0000","last_peered":"2024-09-12T01:50:22.613533+0000","last_clean":"2024-09-12T01:50:22.613533+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:50:22.613533+0000","last_undegraded":"2024-09-12T01:50:22.613533+0000","last_fullsized":"2024-09-12T01:50:22.613533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629145+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:22.629145+0000","last_peered":"2024-09-12T01:50:22.629145+0000","last_clean":"2024-09-12T01:50:22.629145+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:22.629145+0000","last_undegraded":"2024-09-12T01:50:22.629145+0000","last_fullsized":"2024-09-12T01:50:22.629145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.608239+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:50:22.608239+0000","last_peered":"2024-09-12T01:50:22.608239+0000","last_clean":"2024-09-12T01:50:22.608239+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:50:22.608239+0000","last_undegraded":"2024-09-12T01:50:22.608239+0000","last_fullsized":"2024-09-12T01:50:22.608239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":70,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:30.413701+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:50:30.413701+0000","last_peered":"2024-09-12T01:50:30.413701+0000","last_clean":"2024-09-12T01:50:30.413701+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:50:30.413701+0000","last_undegraded":"2024-09-12T01:50:30.413701+0000","last_fullsized":"2024-09-12T01:50:30.413701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611544+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:50:22.611544+0000","last_peered":"2024-09-12T01:50:22.611544+0000","last_clean":"2024-09-12T01:50:22.611544+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:50:22.611544+0000","last_undegraded":"2024-09-12T01:50:22.611544+0000","last_fullsized":"2024-09-12T01:50:22.611544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613318+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:22.613318+0000","last_peered":"2024-09-12T01:50:22.613318+0000","last_clean":"2024-09-12T01:50:22.613318+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:22.613318+0000","last_undegraded":"2024-09-12T01:50:22.613318+0000","last_fullsized":"2024-09-12T01:50:22.613318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.630618+0000","last_change":"2024-09-12T01:50:22.630618+0000","last_active":"2024-09-12T01:50:22.630618+0000","last_peered":"2024-09-12T01:50:22.630618+0000","last_clean":"2024-09-12T01:50:22.630618+0000","last_became_active":"2024-09-12T01:50:22.630327+0000","last_became_peered":"2024-09-12T01:50:22.630327+0000","last_unstale":"2024-09-12T01:50:22.630618+0000","last_undegraded":"2024-09-12T01:50:22.630618+0000","last_fullsized":"2024-09-12T01:50:22.630618+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.647257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629439+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:22.629439+0000","last_peered":"2024-09-12T01:50:22.629439+0000","last_clean":"2024-09-12T01:50:22.629439+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:22.629439+0000","last_undegraded":"2024-09-12T01:50:22.629439+0000","last_fullsized":"2024-09-12T01:50:22.629439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611367+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:50:22.611367+0000","last_peered":"2024-09-12T01:50:22.611367+0000","last_clean":"2024-09-12T01:50:22.611367+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:50:22.611367+0000","last_undegraded":"2024-09-12T01:50:22.611367+0000","last_fullsized":"2024-09-12T01:50:22.611367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'31","reported_seq":123,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:29.700799+0000","last_change":"2024-09-12T01:50:22.696674+0000","last_active":"2024-09-12T01:50:29.700799+0000","last_peered":"2024-09-12T01:50:29.700799+0000","last_clean":"2024-09-12T01:50:29.700799+0000","last_became_active":"2024-09-12T01:50:22.683417+0000","last_became_peered":"2024-09-12T01:50:22.683417+0000","last_unstale":"2024-09-12T01:50:29.700799+0000","last_undegraded":"2024-09-12T01:50:29.700799+0000","last_fullsized":"2024-09-12T01:50:29.700799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:35.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60658,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":81,"num_write":33,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":49603,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611363+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:50:22.611363+0000","last_peered":"2024-09-12T01:50:22.611363+0000","last_clean":"2024-09-12T01:50:22.611363+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:50:22.611363+0000","last_undegraded":"2024-09-12T01:50:22.611363+0000","last_fullsized":"2024-09-12T01:50:22.611363+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612213+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:22.612213+0000","last_peered":"2024-09-12T01:50:22.612213+0000","last_clean":"2024-09-12T01:50:22.612213+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:22.612213+0000","last_undegraded":"2024-09-12T01:50:22.612213+0000","last_fullsized":"2024-09-12T01:50:22.612213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613776+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:50:22.613776+0000","last_peered":"2024-09-12T01:50:22.613776+0000","last_clean":"2024-09-12T01:50:22.613776+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:50:22.613776+0000","last_undegraded":"2024-09-12T01:50:22.613776+0000","last_fullsized":"2024-09-12T01:50:22.613776+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629035+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:22.629035+0000","last_peered":"2024-09-12T01:50:22.629035+0000","last_clean":"2024-09-12T01:50:22.629035+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:22.629035+0000","last_undegraded":"2024-09-12T01:50:22.629035+0000","last_fullsized":"2024-09-12T01:50:22.629035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.616527+0000","last_change":"2024-09-12T01:50:22.616527+0000","last_active":"2024-09-12T01:50:22.616527+0000","last_peered":"2024-09-12T01:50:22.616527+0000","last_clean":"2024-09-12T01:50:22.616527+0000","last_became_active":"2024-09-12T01:50:22.616150+0000","last_became_peered":"2024-09-12T01:50:22.616150+0000","last_unstale":"2024-09-12T01:50:22.616527+0000","last_undegraded":"2024-09-12T01:50:22.616527+0000","last_fullsized":"2024-09-12T01:50:22.616527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:58.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":47,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:25.406815+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:50:25.406815+0000","last_peered":"2024-09-12T01:50:25.406815+0000","last_clean":"2024-09-12T01:50:25.406815+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:50:25.406815+0000","last_undegraded":"2024-09-12T01:50:25.406815+0000","last_fullsized":"2024-09-12T01:50:25.406815+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612514+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:50:22.612514+0000","last_peered":"2024-09-12T01:50:22.612514+0000","last_clean":"2024-09-12T01:50:22.612514+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:50:22.612514+0000","last_undegraded":"2024-09-12T01:50:22.612514+0000","last_fullsized":"2024-09-12T01:50:22.612514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610857+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:22.610857+0000","last_peered":"2024-09-12T01:50:22.610857+0000","last_clean":"2024-09-12T01:50:22.610857+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:22.610857+0000","last_undegraded":"2024-09-12T01:50:22.610857+0000","last_fullsized":"2024-09-12T01:50:22.610857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629097+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:50:22.629097+0000","last_peered":"2024-09-12T01:50:22.629097+0000","last_clean":"2024-09-12T01:50:22.629097+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:50:22.629097+0000","last_undegraded":"2024-09-12T01:50:22.629097+0000","last_fullsized":"2024-09-12T01:50:22.629097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611513+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:22.611513+0000","last_peered":"2024-09-12T01:50:22.611513+0000","last_clean":"2024-09-12T01:50:22.611513+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:22.611513+0000","last_undegraded":"2024-09-12T01:50:22.611513+0000","last_fullsized":"2024-09-12T01:50:22.611513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681162+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:50:22.681162+0000","last_peered":"2024-09-12T01:50:22.681162+0000","last_clean":"2024-09-12T01:50:22.681162+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:50:22.681162+0000","last_undegraded":"2024-09-12T01:50:22.681162+0000","last_fullsized":"2024-09-12T01:50:22.681162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613947+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:22.613947+0000","last_peered":"2024-09-12T01:50:22.613947+0000","last_clean":"2024-09-12T01:50:22.613947+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:22.613947+0000","last_undegraded":"2024-09-12T01:50:22.613947+0000","last_fullsized":"2024-09-12T01:50:22.613947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612841+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:50:22.612841+0000","last_peered":"2024-09-12T01:50:22.612841+0000","last_clean":"2024-09-12T01:50:22.612841+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:50:22.612841+0000","last_undegraded":"2024-09-12T01:50:22.612841+0000","last_fullsized":"2024-09-12T01:50:22.612841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629587+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:22.629587+0000","last_peered":"2024-09-12T01:50:22.629587+0000","last_clean":"2024-09-12T01:50:22.629587+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:22.629587+0000","last_undegraded":"2024-09-12T01:50:22.629587+0000","last_fullsized":"2024-09-12T01:50:22.629587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613199+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:50:22.613199+0000","last_peered":"2024-09-12T01:50:22.613199+0000","last_clean":"2024-09-12T01:50:22.613199+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:50:22.613199+0000","last_undegraded":"2024-09-12T01:50:22.613199+0000","last_fullsized":"2024-09-12T01:50:22.613199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'6","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:27.410074+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:50:27.410074+0000","last_peered":"2024-09-12T01:50:27.410074+0000","last_clean":"2024-09-12T01:50:27.410074+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:50:27.410074+0000","last_undegraded":"2024-09-12T01:50:27.410074+0000","last_fullsized":"2024-09-12T01:50:27.410074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613509+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:50:22.613509+0000","last_peered":"2024-09-12T01:50:22.613509+0000","last_clean":"2024-09-12T01:50:22.613509+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:50:22.613509+0000","last_undegraded":"2024-09-12T01:50:22.613509+0000","last_fullsized":"2024-09-12T01:50:22.613509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612676+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:50:22.612676+0000","last_peered":"2024-09-12T01:50:22.612676+0000","last_clean":"2024-09-12T01:50:22.612676+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:50:22.612676+0000","last_undegraded":"2024-09-12T01:50:22.612676+0000","last_fullsized":"2024-09-12T01:50:22.612676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681903+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:22.681903+0000","last_peered":"2024-09-12T01:50:22.681903+0000","last_clean":"2024-09-12T01:50:22.681903+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:22.681903+0000","last_undegraded":"2024-09-12T01:50:22.681903+0000","last_fullsized":"2024-09-12T01:50:22.681903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613887+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:50:22.613887+0000","last_peered":"2024-09-12T01:50:22.613887+0000","last_clean":"2024-09-12T01:50:22.613887+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:50:22.613887+0000","last_undegraded":"2024-09-12T01:50:22.613887+0000","last_fullsized":"2024-09-12T01:50:22.613887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612642+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:22.612642+0000","last_peered":"2024-09-12T01:50:22.612642+0000","last_clean":"2024-09-12T01:50:22.612642+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:22.612642+0000","last_undegraded":"2024-09-12T01:50:22.612642+0000","last_fullsized":"2024-09-12T01:50:22.612642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613899+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:50:22.613899+0000","last_peered":"2024-09-12T01:50:22.613899+0000","last_clean":"2024-09-12T01:50:22.613899+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:50:22.613899+0000","last_undegraded":"2024-09-12T01:50:22.613899+0000","last_fullsized":"2024-09-12T01:50:22.613899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:28.410318+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:50:28.410318+0000","last_peered":"2024-09-12T01:50:28.410318+0000","last_clean":"2024-09-12T01:50:28.410318+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:50:28.410318+0000","last_undegraded":"2024-09-12T01:50:28.410318+0000","last_fullsized":"2024-09-12T01:50:28.410318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.682963+0000","last_change":"2024-09-12T01:50:22.682963+0000","last_active":"2024-09-12T01:50:22.682963+0000","last_peered":"2024-09-12T01:50:22.682963+0000","last_clean":"2024-09-12T01:50:22.682963+0000","last_became_active":"2024-09-12T01:50:22.682611+0000","last_became_peered":"2024-09-12T01:50:22.682611+0000","last_unstale":"2024-09-12T01:50:22.682963+0000","last_undegraded":"2024-09-12T01:50:22.682963+0000","last_fullsized":"2024-09-12T01:50:22.682963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:01.295098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'6","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:27.691114+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:50:27.691114+0000","last_peered":"2024-09-12T01:50:27.691114+0000","last_clean":"2024-09-12T01:50:27.691114+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:50:27.691114+0000","last_undegraded":"2024-09-12T01:50:27.691114+0000","last_fullsized":"2024-09-12T01:50:27.691114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610718+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:50:22.610718+0000","last_peered":"2024-09-12T01:50:22.610718+0000","last_clean":"2024-09-12T01:50:22.610718+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:50:22.610718+0000","last_undegraded":"2024-09-12T01:50:22.610718+0000","last_fullsized":"2024-09-12T01:50:22.610718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.683026+0000","last_change":"2024-09-12T01:50:22.683026+0000","last_active":"2024-09-12T01:50:22.683026+0000","last_peered":"2024-09-12T01:50:22.683026+0000","last_clean":"2024-09-12T01:50:22.683026+0000","last_became_active":"2024-09-12T01:50:22.682461+0000","last_became_peered":"2024-09-12T01:50:22.682461+0000","last_unstale":"2024-09-12T01:50:22.683026+0000","last_undegraded":"2024-09-12T01:50:22.683026+0000","last_fullsized":"2024-09-12T01:50:22.683026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.470081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.618050+0000","last_change":"2024-09-12T01:50:22.618050+0000","last_active":"2024-09-12T01:50:22.618050+0000","last_peered":"2024-09-12T01:50:22.618050+0000","last_clean":"2024-09-12T01:50:22.618050+0000","last_became_active":"2024-09-12T01:50:22.614871+0000","last_became_peered":"2024-09-12T01:50:22.614871+0000","last_unstale":"2024-09-12T01:50:22.618050+0000","last_undegraded":"2024-09-12T01:50:22.618050+0000","last_fullsized":"2024-09-12T01:50:22.618050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:47.652568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611446+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:22.611446+0000","last_peered":"2024-09-12T01:50:22.611446+0000","last_clean":"2024-09-12T01:50:22.611446+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:22.611446+0000","last_undegraded":"2024-09-12T01:50:22.611446+0000","last_fullsized":"2024-09-12T01:50:22.611446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613847+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:50:22.613847+0000","last_peered":"2024-09-12T01:50:22.613847+0000","last_clean":"2024-09-12T01:50:22.613847+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:50:22.613847+0000","last_undegraded":"2024-09-12T01:50:22.613847+0000","last_fullsized":"2024-09-12T01:50:22.613847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'14","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.608589+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:50:22.608589+0000","last_peered":"2024-09-12T01:50:22.608589+0000","last_clean":"2024-09-12T01:50:22.608589+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:50:22.608589+0000","last_undegraded":"2024-09-12T01:50:22.608589+0000","last_fullsized":"2024-09-12T01:50:22.608589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614482+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:50:22.614482+0000","last_peered":"2024-09-12T01:50:22.614482+0000","last_clean":"2024-09-12T01:50:22.614482+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:50:22.614482+0000","last_undegraded":"2024-09-12T01:50:22.614482+0000","last_fullsized":"2024-09-12T01:50:22.614482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681518+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:22.681518+0000","last_peered":"2024-09-12T01:50:22.681518+0000","last_clean":"2024-09-12T01:50:22.681518+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:22.681518+0000","last_undegraded":"2024-09-12T01:50:22.681518+0000","last_fullsized":"2024-09-12T01:50:22.681518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610152+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:50:22.610152+0000","last_peered":"2024-09-12T01:50:22.610152+0000","last_clean":"2024-09-12T01:50:22.610152+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:50:22.610152+0000","last_undegraded":"2024-09-12T01:50:22.610152+0000","last_fullsized":"2024-09-12T01:50:22.610152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611066+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:22.611066+0000","last_peered":"2024-09-12T01:50:22.611066+0000","last_clean":"2024-09-12T01:50:22.611066+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:22.611066+0000","last_undegraded":"2024-09-12T01:50:22.611066+0000","last_fullsized":"2024-09-12T01:50:22.611066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611019+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:50:22.611019+0000","last_peered":"2024-09-12T01:50:22.611019+0000","last_clean":"2024-09-12T01:50:22.611019+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:50:22.611019+0000","last_undegraded":"2024-09-12T01:50:22.611019+0000","last_fullsized":"2024-09-12T01:50:22.611019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613860+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:22.613860+0000","last_peered":"2024-09-12T01:50:22.613860+0000","last_clean":"2024-09-12T01:50:22.613860+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:22.613860+0000","last_undegraded":"2024-09-12T01:50:22.613860+0000","last_fullsized":"2024-09-12T01:50:22.613860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.680978+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:50:22.680978+0000","last_peered":"2024-09-12T01:50:22.680978+0000","last_clean":"2024-09-12T01:50:22.680978+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:50:22.680978+0000","last_undegraded":"2024-09-12T01:50:22.680978+0000","last_fullsized":"2024-09-12T01:50:22.680978+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612092+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:22.612092+0000","last_peered":"2024-09-12T01:50:22.612092+0000","last_clean":"2024-09-12T01:50:22.612092+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:22.612092+0000","last_undegraded":"2024-09-12T01:50:22.612092+0000","last_fullsized":"2024-09-12T01:50:22.612092+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613663+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:50:22.613663+0000","last_peered":"2024-09-12T01:50:22.613663+0000","last_clean":"2024-09-12T01:50:22.613663+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:50:22.613663+0000","last_undegraded":"2024-09-12T01:50:22.613663+0000","last_fullsized":"2024-09-12T01:50:22.613663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611281+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:22.611281+0000","last_peered":"2024-09-12T01:50:22.611281+0000","last_clean":"2024-09-12T01:50:22.611281+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:22.611281+0000","last_undegraded":"2024-09-12T01:50:22.611281+0000","last_fullsized":"2024-09-12T01:50:22.611281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612942+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:50:22.612942+0000","last_peered":"2024-09-12T01:50:22.612942+0000","last_clean":"2024-09-12T01:50:22.612942+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:50:22.612942+0000","last_undegraded":"2024-09-12T01:50:22.612942+0000","last_fullsized":"2024-09-12T01:50:22.612942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629449+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:50:22.629449+0000","last_peered":"2024-09-12T01:50:22.629449+0000","last_clean":"2024-09-12T01:50:22.629449+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:50:22.629449+0000","last_undegraded":"2024-09-12T01:50:22.629449+0000","last_fullsized":"2024-09-12T01:50:22.629449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611510+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:22.611510+0000","last_peered":"2024-09-12T01:50:22.611510+0000","last_clean":"2024-09-12T01:50:22.611510+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:22.611510+0000","last_undegraded":"2024-09-12T01:50:22.611510+0000","last_fullsized":"2024-09-12T01:50:22.611510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610811+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:50:22.610811+0000","last_peered":"2024-09-12T01:50:22.610811+0000","last_clean":"2024-09-12T01:50:22.610811+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:50:22.610811+0000","last_undegraded":"2024-09-12T01:50:22.610811+0000","last_fullsized":"2024-09-12T01:50:22.610811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611302+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:22.611302+0000","last_peered":"2024-09-12T01:50:22.611302+0000","last_clean":"2024-09-12T01:50:22.611302+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:22.611302+0000","last_undegraded":"2024-09-12T01:50:22.611302+0000","last_fullsized":"2024-09-12T01:50:22.611302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610330+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:50:22.610330+0000","last_peered":"2024-09-12T01:50:22.610330+0000","last_clean":"2024-09-12T01:50:22.610330+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:50:22.610330+0000","last_undegraded":"2024-09-12T01:50:22.610330+0000","last_fullsized":"2024-09-12T01:50:22.610330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614331+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:50:22.614331+0000","last_peered":"2024-09-12T01:50:22.614331+0000","last_clean":"2024-09-12T01:50:22.614331+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:50:22.614331+0000","last_undegraded":"2024-09-12T01:50:22.614331+0000","last_fullsized":"2024-09-12T01:50:22.614331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614167+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:50:22.614167+0000","last_peered":"2024-09-12T01:50:22.614167+0000","last_clean":"2024-09-12T01:50:22.614167+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:50:22.614167+0000","last_undegraded":"2024-09-12T01:50:22.614167+0000","last_fullsized":"2024-09-12T01:50:22.614167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":74,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:25.688035+0000","last_change":"2024-09-12T01:50:22.691988+0000","last_active":"2024-09-12T01:50:25.688035+0000","last_peered":"2024-09-12T01:50:25.688035+0000","last_clean":"2024-09-12T01:50:25.688035+0000","last_became_active":"2024-09-12T01:50:22.682676+0000","last_became_peered":"2024-09-12T01:50:22.682676+0000","last_unstale":"2024-09-12T01:50:25.688035+0000","last_undegraded":"2024-09-12T01:50:25.688035+0000","last_fullsized":"2024-09-12T01:50:25.688035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:56.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68259,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":236,"num_read_kb":194,"num_write":244,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":50275,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":197979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547219,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":439429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32760,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712392,"statfs":{"total":95995035648,"available":95961489408,"internally_reserved":0,"allocated":1613824,"data_stored":1090051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":438411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397542,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1523712,"data_stored":1030913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528363,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":921600,"data_stored":438404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1544192,"data_stored":1030870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":491732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":437719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":439930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":499975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":942080,"data_stored":439743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":54560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:50:33.209 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T01:50:33.209 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T01:50:33.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T01:50:33.454 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:33.806 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:33 smithi070 ceph-mon[31177]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:33.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.893+0000 7f8665eca640 1 -- 172.21.15.70:0/1197932393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8660101d10 msgr2=0x7f8660102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:33.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.893+0000 7f8665eca640 1 --2- 172.21.15.70:0/1197932393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8660101d10 0x7f8660102190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8654009900 tx=0x7f865402a410 comp rx=0 tx=0).stop 2024-09-12T01:50:33.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.893+0000 7f8665eca640 1 -- 172.21.15.70:0/1197932393 shutdown_connections 2024-09-12T01:50:33.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.893+0000 7f8665eca640 1 --2- 172.21.15.70:0/1197932393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86601026d0 0x7f8660108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:33.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.893+0000 7f8665eca640 1 --2- 172.21.15.70:0/1197932393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8660101d10 0x7f8660102190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:33.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.893+0000 7f8665eca640 1 --2- 172.21.15.70:0/1197932393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8660100b10 0x7f8660100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:33.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.893+0000 7f8665eca640 1 -- 172.21.15.70:0/1197932393 >> 172.21.15.70:0/1197932393 conn(0x7f86600fc2a0 msgr2=0x7f86600fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:33.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.893+0000 7f8665eca640 1 -- 172.21.15.70:0/1197932393 shutdown_connections 2024-09-12T01:50:33.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.893+0000 7f8665eca640 1 -- 172.21.15.70:0/1197932393 wait complete. 2024-09-12T01:50:33.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f8665eca640 1 Processor -- start 2024-09-12T01:50:33.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f8665eca640 1 -- start start 2024-09-12T01:50:33.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f8665eca640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8660100b10 0x7f866006b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:33.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f8665eca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8660101d10 0x7f866019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:33.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f8665eca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86601026d0 0x7f866019f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:33.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f8665eca640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f866010c8d0 con 0x7f86601026d0 2024-09-12T01:50:33.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f8665eca640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f866010c750 con 0x7f8660101d10 2024-09-12T01:50:33.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f8665eca640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f866010ca50 con 0x7f8660100b10 2024-09-12T01:50:33.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f865ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86601026d0 0x7f866019f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:33.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f865ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86601026d0 0x7f866019f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34828/0 (socket says 172.21.15.70:34828) 2024-09-12T01:50:33.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f865ffff640 1 -- 172.21.15.70:0/2726061962 learned_addr learned my addr 172.21.15.70:0/2726061962 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:33.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f865f7fe640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8660100b10 0x7f866006b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:33.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.894+0000 7f865effd640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8660101d10 0x7f866019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:33.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.895+0000 7f865ffff640 1 -- 172.21.15.70:0/2726061962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8660100b10 msgr2=0x7f866006b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:33.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.895+0000 7f865ffff640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8660100b10 0x7f866006b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:33.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.895+0000 7f865ffff640 1 -- 172.21.15.70:0/2726061962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8660101d10 msgr2=0x7f866019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:33.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.895+0000 7f865ffff640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8660101d10 0x7f866019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:33.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.895+0000 7f865ffff640 1 -- 172.21.15.70:0/2726061962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866019fb80 con 0x7f86601026d0 2024-09-12T01:50:33.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.895+0000 7f865effd640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8660101d10 0x7f866019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:33.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.895+0000 7f865ffff640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86601026d0 0x7f866019f2c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f865800cce0 tx=0x7f865800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:33.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.895+0000 7f865cff9640 1 -- 172.21.15.70:0/2726061962 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865800f450 con 0x7f86601026d0 2024-09-12T01:50:33.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.895+0000 7f865cff9640 1 -- 172.21.15.70:0/2726061962 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f865800faf0 con 0x7f86601026d0 2024-09-12T01:50:33.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.895+0000 7f8665eca640 1 -- 172.21.15.70:0/2726061962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f866019fe70 con 0x7f86601026d0 2024-09-12T01:50:33.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.895+0000 7f865cff9640 1 -- 172.21.15.70:0/2726061962 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658018cc0 con 0x7f86601026d0 2024-09-12T01:50:33.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.895+0000 7f8665eca640 1 -- 172.21.15.70:0/2726061962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86601a02d0 con 0x7f86601026d0 2024-09-12T01:50:33.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.896+0000 7f8665eca640 1 -- 172.21.15.70:0/2726061962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8660107e40 con 0x7f86601026d0 2024-09-12T01:50:33.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.897+0000 7f865cff9640 1 -- 172.21.15.70:0/2726061962 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f865800f5f0 con 0x7f86601026d0 2024-09-12T01:50:33.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.898+0000 7f865cff9640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86480a2c10 0x7f86480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:33.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.898+0000 7f865f7fe640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86480a2c10 0x7f86480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:33.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.898+0000 7f865cff9640 1 -- 172.21.15.70:0/2726061962 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f86580cf660 con 0x7f86601026d0 2024-09-12T01:50:33.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.898+0000 7f865f7fe640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86480a2c10 0x7f86480a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f866006b870 tx=0x7f865000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:33.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:33.902+0000 7f865cff9640 1 -- 172.21.15.70:0/2726061962 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8658014030 con 0x7f86601026d0 2024-09-12T01:50:33.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:33 smithi191 ceph-mon[35770]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:33 smithi152 ceph-mon[35055]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:50:34.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.130+0000 7f8665eca640 1 -- 172.21.15.70:0/2726061962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f866002d970 con 0x7f86601026d0 2024-09-12T01:50:34.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.132+0000 7f865cff9640 1 -- 172.21.15.70:0/2726061962 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7f865809c460 con 0x7f86601026d0 2024-09-12T01:50:34.133 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-09-12T01:50:34.133 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDqSOJmpezmBxAAGOQ18v12iuCnqKmOT5oJeg== 2024-09-12T01:50:34.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.135+0000 7f8665eca640 1 -- 172.21.15.70:0/2726061962 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86480a2c10 msgr2=0x7f86480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:34.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.135+0000 7f8665eca640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86480a2c10 0x7f86480a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f866006b870 tx=0x7f865000b410 comp rx=0 tx=0).stop 2024-09-12T01:50:34.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.135+0000 7f8665eca640 1 -- 172.21.15.70:0/2726061962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86601026d0 msgr2=0x7f866019f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:34.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.135+0000 7f8665eca640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86601026d0 0x7f866019f2c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f865800cce0 tx=0x7f865800a620 comp rx=0 tx=0).stop 2024-09-12T01:50:34.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.135+0000 7f8665eca640 1 -- 172.21.15.70:0/2726061962 shutdown_connections 2024-09-12T01:50:34.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.135+0000 7f8665eca640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86480a2c10 0x7f86480a50d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:34.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.135+0000 7f8665eca640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86601026d0 0x7f866019f2c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:34.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.135+0000 7f8665eca640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8660101d10 0x7f866019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:34.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.135+0000 7f8665eca640 1 --2- 172.21.15.70:0/2726061962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8660100b10 0x7f866006b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:34.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.135+0000 7f8665eca640 1 -- 172.21.15.70:0/2726061962 >> 172.21.15.70:0/2726061962 conn(0x7f86600fc2a0 msgr2=0x7f8660105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:34.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.135+0000 7f8665eca640 1 -- 172.21.15.70:0/2726061962 shutdown_connections 2024-09-12T01:50:34.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:34.135+0000 7f8665eca640 1 -- 172.21.15.70:0/2726061962 wait complete. 2024-09-12T01:50:34.727 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:34 smithi070 ceph-mon[31177]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.3 KiB/s wr, 9 op/s; 4.5 KiB/s, 1 objects/s recovering 2024-09-12T01:50:34.727 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:34 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2726061962' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:50:34.727 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:34 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2726061962' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:50:34.756 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:50:34.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T01:50:34.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T01:50:34.792 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T01:50:34.793 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T01:50:34.793 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T01:50:34.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:34 smithi191 ceph-mon[35770]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.3 KiB/s wr, 9 op/s; 4.5 KiB/s, 1 objects/s recovering 2024-09-12T01:50:34.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:34 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2726061962' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:50:34.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:34 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2726061962' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:50:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:34 smithi152 ceph-mon[35055]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.3 KiB/s wr, 9 op/s; 4.5 KiB/s, 1 objects/s recovering 2024-09-12T01:50:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:34 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2726061962' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:50:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:34 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2726061962' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:50:35.074 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.517+0000 7f79aedda640 1 -- 172.21.15.70:0/3625732938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8100480 msgr2=0x7f79a8100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.517+0000 7f79aedda640 1 --2- 172.21.15.70:0/3625732938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8100480 0x7f79a8100860 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f79a400adb0 tx=0x7f79a402b7a0 comp rx=0 tx=0).stop 2024-09-12T01:50:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.517+0000 7f79aedda640 1 -- 172.21.15.70:0/3625732938 shutdown_connections 2024-09-12T01:50:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.517+0000 7f79aedda640 1 --2- 172.21.15.70:0/3625732938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a81055b0 0x7f79a810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.517+0000 7f79aedda640 1 --2- 172.21.15.70:0/3625732938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79a8100e30 0x7f79a8104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.517+0000 7f79aedda640 1 --2- 172.21.15.70:0/3625732938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8100480 0x7f79a8100860 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.517+0000 7f79aedda640 1 -- 172.21.15.70:0/3625732938 >> 172.21.15.70:0/3625732938 conn(0x7f79a8077210 msgr2=0x7f79a80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.517+0000 7f79aedda640 1 -- 172.21.15.70:0/3625732938 shutdown_connections 2024-09-12T01:50:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.517+0000 7f79aedda640 1 -- 172.21.15.70:0/3625732938 wait complete. 2024-09-12T01:50:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.518+0000 7f79aedda640 1 Processor -- start 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.518+0000 7f79aedda640 1 -- start start 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.518+0000 7f79aedda640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79a8100480 0x7f79a81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.518+0000 7f79aedda640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8100e30 0x7f79a8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.518+0000 7f79aedda640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a81055b0 0x7f79a819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.518+0000 7f79aedda640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79a810fee0 con 0x7f79a8100e30 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.518+0000 7f79aedda640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f79a810fd60 con 0x7f79a81055b0 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.518+0000 7f79aedda640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f79a8110060 con 0x7f79a8100480 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.518+0000 7f799ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8100e30 0x7f79a8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.518+0000 7f799ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8100e30 0x7f79a8198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34844/0 (socket says 172.21.15.70:34844) 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.518+0000 7f799ffff640 1 -- 172.21.15.70:0/1244168223 learned_addr learned my addr 172.21.15.70:0/1244168223 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.518+0000 7f79ad377640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a81055b0 0x7f79a819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f79acb76640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79a8100480 0x7f79a81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f799ffff640 1 -- 172.21.15.70:0/1244168223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79a8100480 msgr2=0x7f79a81985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f799ffff640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79a8100480 0x7f79a81985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f799ffff640 1 -- 172.21.15.70:0/1244168223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a81055b0 msgr2=0x7f79a819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f799ffff640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a81055b0 0x7f79a819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f799ffff640 1 -- 172.21.15.70:0/1244168223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a819d550 con 0x7f79a8100e30 2024-09-12T01:50:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f79acb76640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79a8100480 0x7f79a81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f799ffff640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8100e30 0x7f79a8198ae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f799800b4a0 tx=0x7f799800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f799dffb640 1 -- 172.21.15.70:0/1244168223 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7998014070 con 0x7f79a8100e30 2024-09-12T01:50:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f79aedda640 1 -- 172.21.15.70:0/1244168223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a819d840 con 0x7f79a8100e30 2024-09-12T01:50:35.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f799dffb640 1 -- 172.21.15.70:0/1244168223 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7998010b10 con 0x7f79a8100e30 2024-09-12T01:50:35.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f799dffb640 1 -- 172.21.15.70:0/1244168223 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7998017d60 con 0x7f79a8100e30 2024-09-12T01:50:35.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.519+0000 7f79aedda640 1 -- 172.21.15.70:0/1244168223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a81a5120 con 0x7f79a8100e30 2024-09-12T01:50:35.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.520+0000 7f79aedda640 1 -- 172.21.15.70:0/1244168223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a8100860 con 0x7f79a8100e30 2024-09-12T01:50:35.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.521+0000 7f799dffb640 1 -- 172.21.15.70:0/1244168223 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7998017070 con 0x7f79a8100e30 2024-09-12T01:50:35.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.522+0000 7f799dffb640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79900a2c10 0x7f79900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:35.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.522+0000 7f79acb76640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79900a2c10 0x7f79900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:35.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.522+0000 7f799dffb640 1 -- 172.21.15.70:0/1244168223 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f79980ce4d0 con 0x7f79a8100e30 2024-09-12T01:50:35.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.522+0000 7f79acb76640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79900a2c10 0x7f79900a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f79a4000f80 tx=0x7f79a4005ef0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:35.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.526+0000 7f799dffb640 1 -- 172.21.15.70:0/1244168223 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f799809b3e0 con 0x7f79a8100e30 2024-09-12T01:50:35.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.741+0000 7f79aedda640 1 -- 172.21.15.70:0/1244168223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f79a810a800 con 0x7f79a8100e30 2024-09-12T01:50:35.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.745+0000 7f799dffb640 1 -- 172.21.15.70:0/1244168223 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263197 (secure 0 0 0) 0x7f799809ace0 con 0x7f79a8100e30 2024-09-12T01:50:35.750 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:50:35.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.748+0000 7f79aedda640 1 -- 172.21.15.70:0/1244168223 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79900a2c10 msgr2=0x7f79900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:35.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.748+0000 7f79aedda640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79900a2c10 0x7f79900a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f79a4000f80 tx=0x7f79a4005ef0 comp rx=0 tx=0).stop 2024-09-12T01:50:35.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.748+0000 7f79aedda640 1 -- 172.21.15.70:0/1244168223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8100e30 msgr2=0x7f79a8198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:35.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.748+0000 7f79aedda640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8100e30 0x7f79a8198ae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f799800b4a0 tx=0x7f799800b960 comp rx=0 tx=0).stop 2024-09-12T01:50:35.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.748+0000 7f79aedda640 1 -- 172.21.15.70:0/1244168223 shutdown_connections 2024-09-12T01:50:35.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.748+0000 7f79aedda640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79900a2c10 0x7f79900a50d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:35.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.748+0000 7f79aedda640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a81055b0 0x7f79a819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:35.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.748+0000 7f79aedda640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79a8100e30 0x7f79a8198ae0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:35.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.748+0000 7f79aedda640 1 --2- 172.21.15.70:0/1244168223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79a8100480 0x7f79a81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:35.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.748+0000 7f79aedda640 1 -- 172.21.15.70:0/1244168223 >> 172.21.15.70:0/1244168223 conn(0x7f79a8077210 msgr2=0x7f79a8103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:35.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.748+0000 7f79aedda640 1 -- 172.21.15.70:0/1244168223 shutdown_connections 2024-09-12T01:50:35.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:35.748+0000 7f79aedda640 1 -- 172.21.15.70:0/1244168223 wait complete. 2024-09-12T01:50:36.320 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"flags":0,"active_gid":14148,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":633920150},{"type":"v1","addr":"172.21.15.70:6801","nonce":633920150}]},"active_addr":"172.21.15.70:6801/633920150","active_change":"2024-09-12T01:43:21.394841+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.70:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3471713785}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":110357308}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2790890908}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2750318068}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1323001515}]}]} 2024-09-12T01:50:36.328 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T01:50:36.328 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T01:50:36.329 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:50:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:36.808 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:36 smithi070 ceph-mon[31177]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 4.1 KiB/s, 1 objects/s recovering 2024-09-12T01:50:36.808 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:36 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1244168223' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:50:36.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:36 smithi191 ceph-mon[35770]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 4.1 KiB/s, 1 objects/s recovering 2024-09-12T01:50:36.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:36 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1244168223' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:50:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.008+0000 7f6ec82af640 1 -- 172.21.15.70:0/4072646277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ec0106f10 msgr2=0x7f6ec010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.008+0000 7f6ec82af640 1 --2- 172.21.15.70:0/4072646277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ec0106f10 0x7f6ec010ea90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009ca0 tx=0x7f6eb002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:50:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.008+0000 7f6ec82af640 1 -- 172.21.15.70:0/4072646277 shutdown_connections 2024-09-12T01:50:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.008+0000 7f6ec82af640 1 --2- 172.21.15.70:0/4072646277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ec0106f10 0x7f6ec010ea90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.008+0000 7f6ec82af640 1 --2- 172.21.15.70:0/4072646277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ec0102790 0x7f6ec01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.008+0000 7f6ec82af640 1 --2- 172.21.15.70:0/4072646277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ec0101de0 0x7f6ec01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.008+0000 7f6ec82af640 1 -- 172.21.15.70:0/4072646277 >> 172.21.15.70:0/4072646277 conn(0x7f6ec00fd8c0 msgr2=0x7f6ec00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.008+0000 7f6ec82af640 1 -- 172.21.15.70:0/4072646277 shutdown_connections 2024-09-12T01:50:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.008+0000 7f6ec82af640 1 -- 172.21.15.70:0/4072646277 wait complete. 2024-09-12T01:50:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.008+0000 7f6ec82af640 1 Processor -- start 2024-09-12T01:50:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.008+0000 7f6ec82af640 1 -- start start 2024-09-12T01:50:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec82af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ec0101de0 0x7f6ec0198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec82af640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ec0102790 0x7f6ec0198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec82af640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ec0106f10 0x7f6ec019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec82af640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec01120d0 con 0x7f6ec0101de0 2024-09-12T01:50:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec82af640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec0111f50 con 0x7f6ec0106f10 2024-09-12T01:50:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec82af640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec0112250 con 0x7f6ec0102790 2024-09-12T01:50:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec604b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ec0101de0 0x7f6ec0198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec604b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ec0101de0 0x7f6ec0198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34860/0 (socket says 172.21.15.70:34860) 2024-09-12T01:50:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec604b640 1 -- 172.21.15.70:0/63888257 learned_addr learned my addr 172.21.15.70:0/63888257 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec684c640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ec0106f10 0x7f6ec019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec584a640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ec0102790 0x7f6ec0198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec604b640 1 -- 172.21.15.70:0/63888257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ec0102790 msgr2=0x7f6ec0198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec604b640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ec0102790 0x7f6ec0198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec604b640 1 -- 172.21.15.70:0/63888257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ec0106f10 msgr2=0x7f6ec019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec604b640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ec0106f10 0x7f6ec019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec604b640 1 -- 172.21.15.70:0/63888257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec019d500 con 0x7f6ec0101de0 2024-09-12T01:50:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec684c640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ec0106f10 0x7f6ec019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec604b640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ec0101de0 0x7f6ec0198550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800d950 tx=0x7f6eb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ebf7fe640 1 -- 172.21.15.70:0/63888257 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8017070 con 0x7f6ec0101de0 2024-09-12T01:50:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ebf7fe640 1 -- 172.21.15.70:0/63888257 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6eb8009c30 con 0x7f6ec0101de0 2024-09-12T01:50:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.009+0000 7f6ec82af640 1 -- 172.21.15.70:0/63888257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec019d7f0 con 0x7f6ec0101de0 2024-09-12T01:50:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.010+0000 7f6ebf7fe640 1 -- 172.21.15.70:0/63888257 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800f740 con 0x7f6ec0101de0 2024-09-12T01:50:37.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:36 smithi152 ceph-mon[35055]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 4.1 KiB/s, 1 objects/s recovering 2024-09-12T01:50:37.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:36 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1244168223' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:50:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.010+0000 7f6ec82af640 1 -- 172.21.15.70:0/63888257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec01a50d0 con 0x7f6ec0101de0 2024-09-12T01:50:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.011+0000 7f6ec82af640 1 -- 172.21.15.70:0/63888257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec01021c0 con 0x7f6ec0101de0 2024-09-12T01:50:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.012+0000 7f6ebf7fe640 1 -- 172.21.15.70:0/63888257 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6eb8010a80 con 0x7f6ec0101de0 2024-09-12T01:50:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.012+0000 7f6ebf7fe640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6ea80a2c90 0x7f6ea80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.012+0000 7f6ec584a640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6ea80a2c90 0x7f6ea80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:37.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.013+0000 7f6ebf7fe640 1 -- 172.21.15.70:0/63888257 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6eb80cee20 con 0x7f6ec0101de0 2024-09-12T01:50:37.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.013+0000 7f6ec584a640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6ea80a2c90 0x7f6ea80a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6ec00ff770 tx=0x7f6eb4008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:37.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.016+0000 7f6ebf7fe640 1 -- 172.21.15.70:0/63888257 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6eb8009de0 con 0x7f6ec0101de0 2024-09-12T01:50:37.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.183+0000 7f6ec82af640 1 -- 172.21.15.70:0/63888257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ec010a0f0 con 0x7f6ec0101de0 2024-09-12T01:50:37.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.185+0000 7f6ebf7fe640 1 -- 172.21.15.70:0/63888257 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22713 (secure 0 0 0) 0x7f6eb809bc60 con 0x7f6ec0101de0 2024-09-12T01:50:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:50:37.187 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:50:22.600430+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:49:54.140097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:49:56.005187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:50:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.187+0000 7f6ec82af640 1 -- 172.21.15.70:0/63888257 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6ea80a2c90 msgr2=0x7f6ea80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.187+0000 7f6ec82af640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6ea80a2c90 0x7f6ea80a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6ec00ff770 tx=0x7f6eb4008040 comp rx=0 tx=0).stop 2024-09-12T01:50:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.187+0000 7f6ec82af640 1 -- 172.21.15.70:0/63888257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ec0101de0 msgr2=0x7f6ec0198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:37.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.187+0000 7f6ec82af640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ec0101de0 0x7f6ec0198550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800d950 tx=0x7f6eb800de10 comp rx=0 tx=0).stop 2024-09-12T01:50:37.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.188+0000 7f6ec82af640 1 -- 172.21.15.70:0/63888257 shutdown_connections 2024-09-12T01:50:37.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.188+0000 7f6ec82af640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6ea80a2c90 0x7f6ea80a5150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:37.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.188+0000 7f6ec82af640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ec0106f10 0x7f6ec019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:37.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.188+0000 7f6ec82af640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ec0102790 0x7f6ec0198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:37.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.188+0000 7f6ec82af640 1 --2- 172.21.15.70:0/63888257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ec0101de0 0x7f6ec0198550 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:37.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.188+0000 7f6ec82af640 1 -- 172.21.15.70:0/63888257 >> 172.21.15.70:0/63888257 conn(0x7f6ec00fd8c0 msgr2=0x7f6ec00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:37.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.188+0000 7f6ec82af640 1 -- 172.21.15.70:0/63888257 shutdown_connections 2024-09-12T01:50:37.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:37.188+0000 7f6ec82af640 1 -- 172.21.15.70:0/63888257 wait complete. 2024-09-12T01:50:37.705 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:37 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/63888257' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:37.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:37 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/63888257' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:37.981 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T01:50:37.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:50:38.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:37 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/63888257' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:38.228 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:38.614 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:38 smithi070 ceph-mon[31177]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 4.1 KiB/s, 1 objects/s recovering 2024-09-12T01:50:38.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.694+0000 7f8a1844b640 1 -- 172.21.15.70:0/1484914767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10102570 msgr2=0x7f8a101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:38.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.694+0000 7f8a1844b640 1 --2- 172.21.15.70:0/1484914767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10102570 0x7f8a101029b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009980 tx=0x7f8a0402c6b0 comp rx=0 tx=0).stop 2024-09-12T01:50:38.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.694+0000 7f8a1844b640 1 -- 172.21.15.70:0/1484914767 shutdown_connections 2024-09-12T01:50:38.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.694+0000 7f8a1844b640 1 --2- 172.21.15.70:0/1484914767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a10102ef0 0x7f8a1010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:38.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.694+0000 7f8a1844b640 1 --2- 172.21.15.70:0/1484914767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10102570 0x7f8a101029b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:38.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.694+0000 7f8a1844b640 1 --2- 172.21.15.70:0/1484914767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a10100e20 0x7f8a10101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:38.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.694+0000 7f8a1844b640 1 -- 172.21.15.70:0/1484914767 >> 172.21.15.70:0/1484914767 conn(0x7f8a100fc7d0 msgr2=0x7f8a100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:38.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.694+0000 7f8a1844b640 1 -- 172.21.15.70:0/1484914767 shutdown_connections 2024-09-12T01:50:38.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.694+0000 7f8a1844b640 1 -- 172.21.15.70:0/1484914767 wait complete. 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a1844b640 1 Processor -- start 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a1844b640 1 -- start start 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a1844b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a10100e20 0x7f8a101964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a1844b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a10102570 0x7f8a10196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a1844b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10102ef0 0x7f8a1019ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a1844b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1010ffe0 con 0x7f8a10102ef0 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a1844b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1010fe60 con 0x7f8a10102570 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a1844b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8a10110160 con 0x7f8a10100e20 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a169e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10102ef0 0x7f8a1019ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a169e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10102ef0 0x7f8a1019ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34884/0 (socket says 172.21.15.70:34884) 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a169e8640 1 -- 172.21.15.70:0/3569032872 learned_addr learned my addr 172.21.15.70:0/3569032872 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a169e8640 1 -- 172.21.15.70:0/3569032872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a10100e20 msgr2=0x7f8a101964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:38.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a169e8640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a10100e20 0x7f8a101964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a169e8640 1 -- 172.21.15.70:0/3569032872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a10102570 msgr2=0x7f8a10196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.695+0000 7f8a159e6640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a10102570 0x7f8a10196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.696+0000 7f8a169e8640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a10102570 0x7f8a10196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.696+0000 7f8a169e8640 1 -- 172.21.15.70:0/3569032872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1019b470 con 0x7f8a10102ef0 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.696+0000 7f8a159e6640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a10102570 0x7f8a10196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.696+0000 7f8a169e8640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10102ef0 0x7f8a1019ad90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000eaa0 tx=0x7f8a0000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.696+0000 7f8a0f7fe640 1 -- 172.21.15.70:0/3569032872 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0000cdb0 con 0x7f8a10102ef0 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.696+0000 7f8a1844b640 1 -- 172.21.15.70:0/3569032872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1019b760 con 0x7f8a10102ef0 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.696+0000 7f8a0f7fe640 1 -- 172.21.15.70:0/3569032872 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8a00004b20 con 0x7f8a10102ef0 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.696+0000 7f8a0f7fe640 1 -- 172.21.15.70:0/3569032872 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00011760 con 0x7f8a10102ef0 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.696+0000 7f8a1844b640 1 -- 172.21.15.70:0/3569032872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a101a3040 con 0x7f8a10102ef0 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.697+0000 7f8a1844b640 1 -- 172.21.15.70:0/3569032872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a10101200 con 0x7f8a10102ef0 2024-09-12T01:50:38.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.698+0000 7f8a0f7fe640 1 -- 172.21.15.70:0/3569032872 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8a00004cd0 con 0x7f8a10102ef0 2024-09-12T01:50:38.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.699+0000 7f8a0f7fe640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f89f80a2c10 0x7f89f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:38.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.699+0000 7f8a161e7640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f89f80a2c10 0x7f89f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:38.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.699+0000 7f8a0f7fe640 1 -- 172.21.15.70:0/3569032872 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8a000cf4f0 con 0x7f8a10102ef0 2024-09-12T01:50:38.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.699+0000 7f8a161e7640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f89f80a2c10 0x7f89f80a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009710 tx=0x7f8a08006c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:38.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.703+0000 7f8a0f7fe640 1 -- 172.21.15.70:0/3569032872 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8a00016030 con 0x7f8a10102ef0 2024-09-12T01:50:38.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.870+0000 7f8a1844b640 1 -- 172.21.15.70:0/3569032872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a10109090 con 0x7f8a10102ef0 2024-09-12T01:50:38.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.871+0000 7f8a0f7fe640 1 -- 172.21.15.70:0/3569032872 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22713 (secure 0 0 0) 0x7f8a0009c2f0 con 0x7f8a10102ef0 2024-09-12T01:50:38.872 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:50:38.872 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:50:22.600430+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:49:54.140097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:49:56.005187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:50:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.873+0000 7f8a1844b640 1 -- 172.21.15.70:0/3569032872 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f89f80a2c10 msgr2=0x7f89f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.873+0000 7f8a1844b640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f89f80a2c10 0x7f89f80a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009710 tx=0x7f8a08006c90 comp rx=0 tx=0).stop 2024-09-12T01:50:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.873+0000 7f8a1844b640 1 -- 172.21.15.70:0/3569032872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10102ef0 msgr2=0x7f8a1019ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.873+0000 7f8a1844b640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10102ef0 0x7f8a1019ad90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000eaa0 tx=0x7f8a0000ef60 comp rx=0 tx=0).stop 2024-09-12T01:50:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.873+0000 7f8a1844b640 1 -- 172.21.15.70:0/3569032872 shutdown_connections 2024-09-12T01:50:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.873+0000 7f8a1844b640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f89f80a2c10 0x7f89f80a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.873+0000 7f8a1844b640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a10102ef0 0x7f8a1019ad90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.873+0000 7f8a1844b640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8a10102570 0x7f8a10196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.873+0000 7f8a1844b640 1 --2- 172.21.15.70:0/3569032872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a10100e20 0x7f8a101964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.873+0000 7f8a1844b640 1 -- 172.21.15.70:0/3569032872 >> 172.21.15.70:0/3569032872 conn(0x7f8a100fc7d0 msgr2=0x7f8a10105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:38.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.873+0000 7f8a1844b640 1 -- 172.21.15.70:0/3569032872 shutdown_connections 2024-09-12T01:50:38.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:38.873+0000 7f8a1844b640 1 -- 172.21.15.70:0/3569032872 wait complete. 2024-09-12T01:50:38.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:38 smithi191 ceph-mon[35770]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 4.1 KiB/s, 1 objects/s recovering 2024-09-12T01:50:39.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:38 smithi152 ceph-mon[35055]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 4.1 KiB/s, 1 objects/s recovering 2024-09-12T01:50:39.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T01:50:39.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T01:50:39.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T01:50:39.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T01:50:39.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T01:50:39.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T01:50:39.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T01:50:39.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T01:50:39.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T01:50:39.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T01:50:39.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T01:50:39.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T01:50:39.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:39 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3569032872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:39.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:39 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3569032872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:40.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:39 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3569032872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:50:40.272 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:40.274 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:40.274 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:40.277 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:40.284 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:40.285 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:40.287 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:40.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:40 smithi070 ceph-mon[31177]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T01:50:40.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:40 smithi191 ceph-mon[35770]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T01:50:41.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:40 smithi152 ceph-mon[35055]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T01:50:41.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.117+0000 7faab4741640 1 -- 172.21.15.70:0/106962241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaac102570 msgr2=0x7faaac1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:41.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 --2- 172.21.15.70:0/106962241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaac102570 0x7faaac1029b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009900 tx=0x7faaa002a480 comp rx=0 tx=0).stop 2024-09-12T01:50:41.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 -- 172.21.15.70:0/106962241 shutdown_connections 2024-09-12T01:50:41.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 --2- 172.21.15.70:0/106962241 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaac102ef0 0x7faaac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 --2- 172.21.15.70:0/106962241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaac102570 0x7faaac1029b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 --2- 172.21.15.70:0/106962241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaac100e20 0x7faaac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 -- 172.21.15.70:0/106962241 >> 172.21.15.70:0/106962241 conn(0x7faaac0fc7d0 msgr2=0x7faaac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:41.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 -- 172.21.15.70:0/106962241 shutdown_connections 2024-09-12T01:50:41.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 -- 172.21.15.70:0/106962241 wait complete. 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 Processor -- start 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 -- start start 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaac100e20 0x7faaac197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaac102570 0x7faaac197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaac102ef0 0x7faaac19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faaac1110e0 con 0x7faaac102ef0 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faaac110f60 con 0x7faaac102570 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.118+0000 7faab4741640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faaac111260 con 0x7faaac100e20 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab2cde640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaac102ef0 0x7faaac19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab2cde640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaac102ef0 0x7faaac19be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33714/0 (socket says 172.21.15.70:33714) 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab2cde640 1 -- 172.21.15.70:0/1611984142 learned_addr learned my addr 172.21.15.70:0/1611984142 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab1cdc640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaac102570 0x7faaac197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab24dd640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaac100e20 0x7faaac197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:41.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab2cde640 1 -- 172.21.15.70:0/1611984142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaac100e20 msgr2=0x7faaac197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:41.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab2cde640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaac100e20 0x7faaac197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab2cde640 1 -- 172.21.15.70:0/1611984142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaac102570 msgr2=0x7faaac197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:41.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab2cde640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaac102570 0x7faaac197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab2cde640 1 -- 172.21.15.70:0/1611984142 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac19c530 con 0x7faaac102ef0 2024-09-12T01:50:41.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab1cdc640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaac102570 0x7faaac197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:41.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab2cde640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaac102ef0 0x7faaac19be50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009fd0 tx=0x7faaa400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:41.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faaab7fe640 1 -- 172.21.15.70:0/1611984142 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4011830 con 0x7faaac102ef0 2024-09-12T01:50:41.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab4741640 1 -- 172.21.15.70:0/1611984142 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaac19c820 con 0x7faaac102ef0 2024-09-12T01:50:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faaab7fe640 1 -- 172.21.15.70:0/1611984142 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faaa4016070 con 0x7faaac102ef0 2024-09-12T01:50:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faaab7fe640 1 -- 172.21.15.70:0/1611984142 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa400f2e0 con 0x7faaac102ef0 2024-09-12T01:50:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.119+0000 7faab4741640 1 -- 172.21.15.70:0/1611984142 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaac069f70 con 0x7faaac102ef0 2024-09-12T01:50:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.120+0000 7faab4741640 1 -- 172.21.15.70:0/1611984142 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faaac107240 con 0x7faaac102ef0 2024-09-12T01:50:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.121+0000 7faaab7fe640 1 -- 172.21.15.70:0/1611984142 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faaa401b460 con 0x7faaac102ef0 2024-09-12T01:50:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.122+0000 7faaab7fe640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faa940a4e20 0x7faa940a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.122+0000 7faab24dd640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faa940a4e20 0x7faa940a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.122+0000 7faaab7fe640 1 -- 172.21.15.70:0/1611984142 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faaa40cf2c0 con 0x7faaac102ef0 2024-09-12T01:50:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.123+0000 7faaab7fe640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312] conn(0x7faa940aea50 0x7faa940b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.123+0000 7faaab7fe640 1 -- 172.21.15.70:0/1611984142 --> [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faaa4022e50 con 0x7faa940aea50 2024-09-12T01:50:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.123+0000 7faaab7fe640 1 -- 172.21.15.70:0/1611984142 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7faaa40cf6b0 con 0x7faaac102ef0 2024-09-12T01:50:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.123+0000 7faab24dd640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faa940a4e20 0x7faa940a72e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa9c007350 tx=0x7faa9c0072e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.123+0000 7faab1cdc640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312] conn(0x7faa940aea50 0x7faa940b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.123+0000 7faab1cdc640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312] conn(0x7faa940aea50 0x7faa940b0ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.124+0000 7faaab7fe640 1 -- 172.21.15.70:0/1611984142 <== osd.7 v2:172.21.15.152:6816/33447312 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faaa4022e50 con 0x7faa940aea50 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.137+0000 7faab4741640 1 -- 172.21.15.70:0/1611984142 --> [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faaac1021b0 con 0x7faa940aea50 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.138+0000 7faaab7fe640 1 -- 172.21.15.70:0/1611984142 <== osd.7 v2:172.21.15.152:6816/33447312 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faaac1021b0 con 0x7faa940aea50 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.139+0000 7faab4741640 1 -- 172.21.15.70:0/1611984142 >> [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312] conn(0x7faa940aea50 msgr2=0x7faa940b0ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.139+0000 7faab4741640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312] conn(0x7faa940aea50 0x7faa940b0ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.139+0000 7faab4741640 1 -- 172.21.15.70:0/1611984142 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faa940a4e20 msgr2=0x7faa940a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.139+0000 7faab4741640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faa940a4e20 0x7faa940a72e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa9c007350 tx=0x7faa9c0072e0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.139+0000 7faab4741640 1 -- 172.21.15.70:0/1611984142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaac102ef0 msgr2=0x7faaac19be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.139+0000 7faab4741640 1 --2- 172.21.15.70:0/1611984142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaac102ef0 0x7faaac19be50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009fd0 tx=0x7faaa400b8e0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.139+0000 7faab2cde640 1 -- 172.21.15.70:0/1611984142 reap_dead start 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.139+0000 7faab4741640 1 -- 172.21.15.70:0/1611984142 shutdown_connections 2024-09-12T01:50:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.139+0000 7faab4741640 1 -- 172.21.15.70:0/1611984142 >> 172.21.15.70:0/1611984142 conn(0x7faaac0fc7d0 msgr2=0x7faaac106860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:41.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.139+0000 7faab4741640 1 -- 172.21.15.70:0/1611984142 shutdown_connections 2024-09-12T01:50:41.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.139+0000 7faab4741640 1 -- 172.21.15.70:0/1611984142 wait complete. 2024-09-12T01:50:41.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.005+0000 7fec53659640 1 -- 172.21.15.70:0/3327346274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c106f10 msgr2=0x7fec4c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:41.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.005+0000 7fec53659640 1 --2- 172.21.15.70:0/3327346274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c106f10 0x7fec4c10ea90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fec44009ca0 tx=0x7fec4402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.005+0000 7fec53659640 1 -- 172.21.15.70:0/3327346274 shutdown_connections 2024-09-12T01:50:41.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.005+0000 7fec53659640 1 --2- 172.21.15.70:0/3327346274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c106f10 0x7fec4c10ea90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.005+0000 7fec53659640 1 --2- 172.21.15.70:0/3327346274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec4c102790 0x7fec4c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.005+0000 7fec53659640 1 --2- 172.21.15.70:0/3327346274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec4c101de0 0x7fec4c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.005+0000 7fec53659640 1 -- 172.21.15.70:0/3327346274 >> 172.21.15.70:0/3327346274 conn(0x7fec4c0fd8c0 msgr2=0x7fec4c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:41.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.005+0000 7fec53659640 1 -- 172.21.15.70:0/3327346274 shutdown_connections 2024-09-12T01:50:41.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.005+0000 7fec53659640 1 -- 172.21.15.70:0/3327346274 wait complete. 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.005+0000 7fec53659640 1 Processor -- start 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec53659640 1 -- start start 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec53659640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec4c101de0 0x7fec4c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec53659640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c102790 0x7fec4c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec53659640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec4c106f10 0x7fec4c19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec53659640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c112150 con 0x7fec4c102790 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec53659640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c111fd0 con 0x7fec4c106f10 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec53659640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c1122d0 con 0x7fec4c101de0 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec50bf4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c102790 0x7fec4c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec50bf4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c102790 0x7fec4c198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33690/0 (socket says 172.21.15.70:33690) 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec50bf4640 1 -- 172.21.15.70:0/2678170204 learned_addr learned my addr 172.21.15.70:0/2678170204 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec51bf6640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec4c106f10 0x7fec4c19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:41.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec513f5640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec4c101de0 0x7fec4c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:41.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec50bf4640 1 -- 172.21.15.70:0/2678170204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec4c101de0 msgr2=0x7fec4c1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:41.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec50bf4640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec4c101de0 0x7fec4c1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec50bf4640 1 -- 172.21.15.70:0/2678170204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec4c106f10 msgr2=0x7fec4c19cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:41.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec50bf4640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec4c106f10 0x7fec4c19cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec50bf4640 1 -- 172.21.15.70:0/2678170204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c19d5a0 con 0x7fec4c102790 2024-09-12T01:50:41.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec51bf6640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec4c106f10 0x7fec4c19cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:41.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.006+0000 7fec50bf4640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c102790 0x7fec4c198b30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00b4a0 tx=0x7fec3c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:41.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.007+0000 7fec427fc640 1 -- 172.21.15.70:0/2678170204 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c014070 con 0x7fec4c102790 2024-09-12T01:50:41.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.007+0000 7fec53659640 1 -- 172.21.15.70:0/2678170204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec4c19d890 con 0x7fec4c102790 2024-09-12T01:50:41.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.007+0000 7fec427fc640 1 -- 172.21.15.70:0/2678170204 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec3c010b10 con 0x7fec4c102790 2024-09-12T01:50:41.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.007+0000 7fec427fc640 1 -- 172.21.15.70:0/2678170204 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c017d60 con 0x7fec4c102790 2024-09-12T01:50:41.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.007+0000 7fec53659640 1 -- 172.21.15.70:0/2678170204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec4c1a5170 con 0x7fec4c102790 2024-09-12T01:50:41.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.008+0000 7fec53659640 1 -- 172.21.15.70:0/2678170204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec4c062980 con 0x7fec4c102790 2024-09-12T01:50:41.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.009+0000 7fec427fc640 1 -- 172.21.15.70:0/2678170204 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fec3c017070 con 0x7fec4c102790 2024-09-12T01:50:41.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.009+0000 7fec427fc640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fec380a2c90 0x7fec380a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:41.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.009+0000 7fec513f5640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fec380a2c90 0x7fec380a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:41.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.010+0000 7fec427fc640 1 -- 172.21.15.70:0/2678170204 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fec3c0ce490 con 0x7fec4c102790 2024-09-12T01:50:41.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.010+0000 7fec427fc640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909] conn(0x7fec380ac8c0 0x7fec380aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:41.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.010+0000 7fec427fc640 1 -- 172.21.15.70:0/2678170204 --> [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec380af430 con 0x7fec380ac8c0 2024-09-12T01:50:41.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.010+0000 7fec427fc640 1 -- 172.21.15.70:0/2678170204 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fec3c0d5050 con 0x7fec4c102790 2024-09-12T01:50:41.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.010+0000 7fec513f5640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fec380a2c90 0x7fec380a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec48009890 tx=0x7fec48008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:41.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.010+0000 7fec51bf6640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909] conn(0x7fec380ac8c0 0x7fec380aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:41.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.010+0000 7fec51bf6640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909] conn(0x7fec380ac8c0 0x7fec380aed60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:41.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.011+0000 7fec427fc640 1 -- 172.21.15.70:0/2678170204 <== osd.3 v2:172.21.15.70:6810/934346909 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec380af430 con 0x7fec380ac8c0 2024-09-12T01:50:41.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec53659640 1 -- 172.21.15.70:0/2678170204 --> [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec4c062db0 con 0x7fec380ac8c0 2024-09-12T01:50:41.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec427fc640 1 -- 172.21.15.70:0/2678170204 <== osd.3 v2:172.21.15.70:6810/934346909 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fec4c062db0 con 0x7fec380ac8c0 2024-09-12T01:50:41.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec53659640 1 -- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909] conn(0x7fec380ac8c0 msgr2=0x7fec380aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:41.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec53659640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909] conn(0x7fec380ac8c0 0x7fec380aed60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:41.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec53659640 1 -- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fec380a2c90 msgr2=0x7fec380a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:41.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec53659640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fec380a2c90 0x7fec380a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec48009890 tx=0x7fec48008040 comp rx=0 tx=0).stop 2024-09-12T01:50:41.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec53659640 1 -- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c102790 msgr2=0x7fec4c198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:41.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec53659640 1 --2- 172.21.15.70:0/2678170204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c102790 0x7fec4c198b30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00b4a0 tx=0x7fec3c00b960 comp rx=0 tx=0).stop 2024-09-12T01:50:41.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec51bf6640 1 -- 172.21.15.70:0/2678170204 reap_dead start 2024-09-12T01:50:41.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec53659640 1 -- 172.21.15.70:0/2678170204 shutdown_connections 2024-09-12T01:50:41.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec53659640 1 -- 172.21.15.70:0/2678170204 >> 172.21.15.70:0/2678170204 conn(0x7fec4c0fd8c0 msgr2=0x7fec4c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:41.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec53659640 1 -- 172.21.15.70:0/2678170204 shutdown_connections 2024-09-12T01:50:41.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:41.025+0000 7fec53659640 1 -- 172.21.15.70:0/2678170204 wait complete. 2024-09-12T01:50:42.329 INFO:teuthology.orchestra.run.smithi070.stdout:107374182460 2024-09-12T01:50:42.329 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T01:50:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.711+0000 7f8cc619f640 1 -- 172.21.15.70:0/2329518843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cc01002b0 msgr2=0x7f8cc0100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.711+0000 7f8cc619f640 1 --2- 172.21.15.70:0/2329518843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cc01002b0 0x7f8cc0100690 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8009ca0 tx=0x7f8cb802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.711+0000 7f8cc619f640 1 -- 172.21.15.70:0/2329518843 shutdown_connections 2024-09-12T01:50:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.711+0000 7f8cc619f640 1 --2- 172.21.15.70:0/2329518843 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cc01053e0 0x7f8cc010cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.711+0000 7f8cc619f640 1 --2- 172.21.15.70:0/2329518843 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0100c60 0x7f8cc0104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.711+0000 7f8cc619f640 1 --2- 172.21.15.70:0/2329518843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cc01002b0 0x7f8cc0100690 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.711+0000 7f8cc619f640 1 -- 172.21.15.70:0/2329518843 >> 172.21.15.70:0/2329518843 conn(0x7f8cc0077070 msgr2=0x7f8cc00fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.711+0000 7f8cc619f640 1 -- 172.21.15.70:0/2329518843 shutdown_connections 2024-09-12T01:50:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.711+0000 7f8cc619f640 1 -- 172.21.15.70:0/2329518843 wait complete. 2024-09-12T01:50:42.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc619f640 1 Processor -- start 2024-09-12T01:50:42.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc619f640 1 -- start start 2024-09-12T01:50:42.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc619f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cc01002b0 0x7f8cc00fc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:42.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc619f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0100c60 0x7f8cc00fca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:42.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc619f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cc01053e0 0x7f8cc00fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc619f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc0110ef0 con 0x7f8cc01002b0 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc619f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc0110d70 con 0x7f8cc0100c60 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc619f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc0111070 con 0x7f8cc01053e0 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc519d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cc01002b0 0x7f8cc00fc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc519d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cc01002b0 0x7f8cc00fc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33726/0 (socket says 172.21.15.70:33726) 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc519d640 1 -- 172.21.15.70:0/839202450 learned_addr learned my addr 172.21.15.70:0/839202450 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc499c640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0100c60 0x7f8cc00fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc599e640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cc01053e0 0x7f8cc00fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc519d640 1 -- 172.21.15.70:0/839202450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cc01053e0 msgr2=0x7f8cc00fcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc519d640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cc01053e0 0x7f8cc00fcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc519d640 1 -- 172.21.15.70:0/839202450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0100c60 msgr2=0x7f8cc00fca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc519d640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0100c60 0x7f8cc00fca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc519d640 1 -- 172.21.15.70:0/839202450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc01a6970 con 0x7f8cc01002b0 2024-09-12T01:50:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc599e640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cc01053e0 0x7f8cc00fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.712+0000 7f8cc499c640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cc0100c60 0x7f8cc00fca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:50:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.713+0000 7f8cc519d640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cc01002b0 0x7f8cc00fc540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8cb802aeb0 tx=0x7f8cb8031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.713+0000 7f8cbe7fc640 1 -- 172.21.15.70:0/839202450 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8031840 con 0x7f8cc01002b0 2024-09-12T01:50:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.713+0000 7f8cc619f640 1 -- 172.21.15.70:0/839202450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc01a6c00 con 0x7f8cc01002b0 2024-09-12T01:50:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.713+0000 7f8cbe7fc640 1 -- 172.21.15.70:0/839202450 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cb8004540 con 0x7f8cc01002b0 2024-09-12T01:50:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.713+0000 7f8cbe7fc640 1 -- 172.21.15.70:0/839202450 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb802fe00 con 0x7f8cc01002b0 2024-09-12T01:50:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.713+0000 7f8cc619f640 1 -- 172.21.15.70:0/839202450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc01a7190 con 0x7f8cc01002b0 2024-09-12T01:50:42.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.714+0000 7f8cc619f640 1 -- 172.21.15.70:0/839202450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8cac001030 con 0x7f8cc01002b0 2024-09-12T01:50:42.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.715+0000 7f8cbe7fc640 1 -- 172.21.15.70:0/839202450 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8cb80046f0 con 0x7f8cc01002b0 2024-09-12T01:50:42.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.716+0000 7f8cbe7fc640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8ca80a2c10 0x7f8ca80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.716+0000 7f8cc499c640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8ca80a2c10 0x7f8ca80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.716+0000 7f8cbe7fc640 1 -- 172.21.15.70:0/839202450 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8cb80f0620 con 0x7f8cc01002b0 2024-09-12T01:50:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.716+0000 7f8cbe7fc640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530] conn(0x7f8ca80ac710 0x7f8ca80aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.716+0000 7f8cbe7fc640 1 -- 172.21.15.70:0/839202450 --> [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ca80af280 con 0x7f8ca80ac710 2024-09-12T01:50:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.716+0000 7f8cbe7fc640 1 -- 172.21.15.70:0/839202450 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f8cb80f7050 con 0x7f8cc01002b0 2024-09-12T01:50:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.716+0000 7f8cc499c640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8ca80a2c10 0x7f8ca80a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00fdfd0 tx=0x7f8cb4009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.716+0000 7f8cc599e640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530] conn(0x7f8ca80ac710 0x7f8ca80aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.717+0000 7f8cc599e640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530] conn(0x7f8ca80ac710 0x7f8ca80aebb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:42.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.718+0000 7f8cbe7fc640 1 -- 172.21.15.70:0/839202450 <== osd.11 v2:172.21.15.191:6824/1166888530 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ca80af280 con 0x7f8ca80ac710 2024-09-12T01:50:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.732+0000 7f8cc619f640 1 -- 172.21.15.70:0/839202450 --> [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8cac002dd0 con 0x7f8ca80ac710 2024-09-12T01:50:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.733+0000 7f8cbe7fc640 1 -- 172.21.15.70:0/839202450 <== osd.11 v2:172.21.15.191:6824/1166888530 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8cac002dd0 con 0x7f8ca80ac710 2024-09-12T01:50:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.733+0000 7f8cc619f640 1 -- 172.21.15.70:0/839202450 >> [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530] conn(0x7f8ca80ac710 msgr2=0x7f8ca80aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.733+0000 7f8cc619f640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530] conn(0x7f8ca80ac710 0x7f8ca80aebb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.733+0000 7f8cc619f640 1 -- 172.21.15.70:0/839202450 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8ca80a2c10 msgr2=0x7f8ca80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.733+0000 7f8cc619f640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8ca80a2c10 0x7f8ca80a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00fdfd0 tx=0x7f8cb4009110 comp rx=0 tx=0).stop 2024-09-12T01:50:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.733+0000 7f8cc619f640 1 -- 172.21.15.70:0/839202450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cc01002b0 msgr2=0x7f8cc00fc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.733+0000 7f8cc619f640 1 --2- 172.21.15.70:0/839202450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cc01002b0 0x7f8cc00fc540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8cb802aeb0 tx=0x7f8cb8031450 comp rx=0 tx=0).stop 2024-09-12T01:50:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.733+0000 7f8cc599e640 1 -- 172.21.15.70:0/839202450 reap_dead start 2024-09-12T01:50:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.733+0000 7f8cc619f640 1 -- 172.21.15.70:0/839202450 shutdown_connections 2024-09-12T01:50:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.733+0000 7f8cc619f640 1 -- 172.21.15.70:0/839202450 >> 172.21.15.70:0/839202450 conn(0x7f8cc0077070 msgr2=0x7f8cc010db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.733+0000 7f8cc619f640 1 -- 172.21.15.70:0/839202450 shutdown_connections 2024-09-12T01:50:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.733+0000 7f8cc619f640 1 -- 172.21.15.70:0/839202450 wait complete. 2024-09-12T01:50:42.816 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:42 smithi070 ceph-mon[31177]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-12T01:50:42.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.896+0000 7f4e4f609640 1 -- 172.21.15.70:0/2943785353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48102790 msgr2=0x7f4e481067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:42.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.896+0000 7f4e4f609640 1 --2- 172.21.15.70:0/2943785353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48102790 0x7f4e481067e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009900 tx=0x7f4e3802a410 comp rx=0 tx=0).stop 2024-09-12T01:50:42.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.896+0000 7f4e4f609640 1 -- 172.21.15.70:0/2943785353 shutdown_connections 2024-09-12T01:50:42.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.896+0000 7f4e4f609640 1 --2- 172.21.15.70:0/2943785353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e48106f10 0x7f4e4810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.896+0000 7f4e4f609640 1 --2- 172.21.15.70:0/2943785353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48102790 0x7f4e481067e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.896+0000 7f4e4f609640 1 --2- 172.21.15.70:0/2943785353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e48101de0 0x7f4e481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.896+0000 7f4e4f609640 1 -- 172.21.15.70:0/2943785353 >> 172.21.15.70:0/2943785353 conn(0x7f4e480fd8c0 msgr2=0x7f4e480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:42.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.896+0000 7f4e4f609640 1 -- 172.21.15.70:0/2943785353 shutdown_connections 2024-09-12T01:50:42.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.896+0000 7f4e4f609640 1 -- 172.21.15.70:0/2943785353 wait complete. 2024-09-12T01:50:42.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.896+0000 7f4e4f609640 1 Processor -- start 2024-09-12T01:50:42.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4f609640 1 -- start start 2024-09-12T01:50:42.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4f609640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48101de0 0x7f4e48198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4f609640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e48102790 0x7f4e48198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4f609640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e48106f10 0x7f4e4819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4f609640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4e48112090 con 0x7f4e48101de0 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4f609640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4e48111f10 con 0x7f4e48102790 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4f609640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4e48112210 con 0x7f4e48106f10 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4d3a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48101de0 0x7f4e48198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4d3a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48101de0 0x7f4e48198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33752/0 (socket says 172.21.15.70:33752) 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4d3a5640 1 -- 172.21.15.70:0/1846339133 learned_addr learned my addr 172.21.15.70:0/1846339133 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4cba4640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e48102790 0x7f4e48198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4d3a5640 1 -- 172.21.15.70:0/1846339133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e48106f10 msgr2=0x7f4e4819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4d3a5640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e48106f10 0x7f4e4819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4d3a5640 1 -- 172.21.15.70:0/1846339133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e48102790 msgr2=0x7f4e48198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:42.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4d3a5640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e48102790 0x7f4e48198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4d3a5640 1 -- 172.21.15.70:0/1846339133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4819d4c0 con 0x7f4e48101de0 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4cba4640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e48102790 0x7f4e48198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e4d3a5640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48101de0 0x7f4e48198510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400d770 tx=0x7f4e4400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.897+0000 7f4e3e7fc640 1 -- 172.21.15.70:0/1846339133 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44017070 con 0x7f4e48101de0 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.898+0000 7f4e4f609640 1 -- 172.21.15.70:0/1846339133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4819d7b0 con 0x7f4e48101de0 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.898+0000 7f4e3e7fc640 1 -- 172.21.15.70:0/1846339133 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4e44005520 con 0x7f4e48101de0 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.898+0000 7f4e3e7fc640 1 -- 172.21.15.70:0/1846339133 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44010460 con 0x7f4e48101de0 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.898+0000 7f4e4f609640 1 -- 172.21.15.70:0/1846339133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e481a5090 con 0x7f4e48101de0 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.898+0000 7f4e4f609640 1 -- 172.21.15.70:0/1846339133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e48062980 con 0x7f4e48101de0 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.900+0000 7f4e3e7fc640 1 -- 172.21.15.70:0/1846339133 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4e44004ea0 con 0x7f4e48101de0 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.900+0000 7f4e3e7fc640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4e340a2c10 0x7f4e340a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.900+0000 7f4e4cba4640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4e340a2c10 0x7f4e340a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:42.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.900+0000 7f4e3e7fc640 1 -- 172.21.15.70:0/1846339133 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4e440cf1a0 con 0x7f4e48101de0 2024-09-12T01:50:42.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.901+0000 7f4e3e7fc640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283] conn(0x7f4e340ac840 0x7f4e340aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:42.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.901+0000 7f4e3e7fc640 1 -- 172.21.15.70:0/1846339133 --> [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e44001d30 con 0x7f4e340ac840 2024-09-12T01:50:42.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.901+0000 7f4e3e7fc640 1 -- 172.21.15.70:0/1846339133 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f4e440cf5d0 con 0x7f4e48101de0 2024-09-12T01:50:42.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.901+0000 7f4e4dba6640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283] conn(0x7f4e340ac840 0x7f4e340aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:42.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.901+0000 7f4e4cba4640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4e340a2c10 0x7f4e340a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e481088e0 tx=0x7f4e38005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:42.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.901+0000 7f4e4dba6640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283] conn(0x7f4e340ac840 0x7f4e340aece0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:42.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.902+0000 7f4e3e7fc640 1 -- 172.21.15.70:0/1846339133 <== osd.6 v2:172.21.15.70:6818/2771056283 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e44001d30 con 0x7f4e340ac840 2024-09-12T01:50:42.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.915+0000 7f4e4f609640 1 -- 172.21.15.70:0/1846339133 --> [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4e48062e00 con 0x7f4e340ac840 2024-09-12T01:50:42.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.915+0000 7f4e3e7fc640 1 -- 172.21.15.70:0/1846339133 <== osd.6 v2:172.21.15.70:6818/2771056283 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4e48062e00 con 0x7f4e340ac840 2024-09-12T01:50:42.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.915+0000 7f4e4f609640 1 -- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283] conn(0x7f4e340ac840 msgr2=0x7f4e340aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:42.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.915+0000 7f4e4f609640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283] conn(0x7f4e340ac840 0x7f4e340aece0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:42.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.916+0000 7f4e4f609640 1 -- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4e340a2c10 msgr2=0x7f4e340a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:42.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.916+0000 7f4e4f609640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4e340a2c10 0x7f4e340a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e481088e0 tx=0x7f4e38005a20 comp rx=0 tx=0).stop 2024-09-12T01:50:42.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.916+0000 7f4e4f609640 1 -- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48101de0 msgr2=0x7f4e48198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:42.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.916+0000 7f4e4f609640 1 --2- 172.21.15.70:0/1846339133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e48101de0 0x7f4e48198510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400d770 tx=0x7f4e4400dc30 comp rx=0 tx=0).stop 2024-09-12T01:50:42.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.916+0000 7f4e4dba6640 1 -- 172.21.15.70:0/1846339133 reap_dead start 2024-09-12T01:50:42.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.916+0000 7f4e4f609640 1 -- 172.21.15.70:0/1846339133 shutdown_connections 2024-09-12T01:50:42.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.916+0000 7f4e4f609640 1 -- 172.21.15.70:0/1846339133 >> 172.21.15.70:0/1846339133 conn(0x7f4e480fd8c0 msgr2=0x7f4e480fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:42.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.916+0000 7f4e4f609640 1 -- 172.21.15.70:0/1846339133 shutdown_connections 2024-09-12T01:50:42.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:42.916+0000 7f4e4f609640 1 -- 172.21.15.70:0/1846339133 wait complete. 2024-09-12T01:50:42.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:42 smithi191 ceph-mon[35770]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-12T01:50:43.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:42 smithi152 ceph-mon[35055]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-12T01:50:43.615 INFO:teuthology.orchestra.run.smithi070.stdout:193273528366 2024-09-12T01:50:43.616 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T01:50:44.016 INFO:teuthology.orchestra.run.smithi070.stdout:210453397545 2024-09-12T01:50:44.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T01:50:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:44.842 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:44 smithi070 ceph-mon[31177]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:50:44.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.840+0000 7f6536391640 1 -- 172.21.15.70:0/2092666471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6530101de0 msgr2=0x7f65301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.840+0000 7f6536391640 1 --2- 172.21.15.70:0/2092666471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6530101de0 0x7f65301021c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6520009900 tx=0x7f652002a410 comp rx=0 tx=0).stop 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.840+0000 7f6536391640 1 -- 172.21.15.70:0/2092666471 shutdown_connections 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.840+0000 7f6536391640 1 --2- 172.21.15.70:0/2092666471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6530106f10 0x7f653010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.840+0000 7f6536391640 1 --2- 172.21.15.70:0/2092666471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6530102790 0x7f65301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.840+0000 7f6536391640 1 --2- 172.21.15.70:0/2092666471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6530101de0 0x7f65301021c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.840+0000 7f6536391640 1 -- 172.21.15.70:0/2092666471 >> 172.21.15.70:0/2092666471 conn(0x7f65300fd8c0 msgr2=0x7f65300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.840+0000 7f6536391640 1 -- 172.21.15.70:0/2092666471 shutdown_connections 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.840+0000 7f6536391640 1 -- 172.21.15.70:0/2092666471 wait complete. 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.841+0000 7f6536391640 1 Processor -- start 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.841+0000 7f6536391640 1 -- start start 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f6536391640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6530101de0 0x7f6530198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f6536391640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6530102790 0x7f6530198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f6536391640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6530106f10 0x7f653019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f6536391640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6530112150 con 0x7f6530101de0 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f6536391640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6530111fd0 con 0x7f6530102790 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f6536391640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f65301122d0 con 0x7f6530106f10 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f652ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6530101de0 0x7f6530198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f652ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6530101de0 0x7f6530198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33770/0 (socket says 172.21.15.70:33770) 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f652ffff640 1 -- 172.21.15.70:0/3244085306 learned_addr learned my addr 172.21.15.70:0/3244085306 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f6527fff640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6530102790 0x7f6530198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f653492e640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6530106f10 0x7f653019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f652ffff640 1 -- 172.21.15.70:0/3244085306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6530106f10 msgr2=0x7f653019cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f652ffff640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6530106f10 0x7f653019cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f652ffff640 1 -- 172.21.15.70:0/3244085306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6530102790 msgr2=0x7f6530198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f652ffff640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6530102790 0x7f6530198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f652ffff640 1 -- 172.21.15.70:0/3244085306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653019d620 con 0x7f6530101de0 2024-09-12T01:50:44.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f653492e640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6530106f10 0x7f653019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f652ffff640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6530101de0 0x7f6530198670 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6520006010 tx=0x7f65200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f652dffb640 1 -- 172.21.15.70:0/3244085306 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652003f030 con 0x7f6530101de0 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f6536391640 1 -- 172.21.15.70:0/3244085306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653019d8b0 con 0x7f6530101de0 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f652dffb640 1 -- 172.21.15.70:0/3244085306 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6520003d00 con 0x7f6530101de0 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f652dffb640 1 -- 172.21.15.70:0/3244085306 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520035070 con 0x7f6530101de0 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.842+0000 7f6536391640 1 -- 172.21.15.70:0/3244085306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65301a51f0 con 0x7f6530101de0 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.843+0000 7f6536391640 1 -- 172.21.15.70:0/3244085306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6530062980 con 0x7f6530101de0 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.845+0000 7f652dffb640 1 -- 172.21.15.70:0/3244085306 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6520042030 con 0x7f6530101de0 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.845+0000 7f652dffb640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f651c0a2c10 0x7f651c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.846+0000 7f6527fff640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f651c0a2c10 0x7f651c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.846+0000 7f652dffb640 1 -- 172.21.15.70:0/3244085306 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f65200eff00 con 0x7f6530101de0 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.846+0000 7f652dffb640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837] conn(0x7f651c0ac840 0x7f651c0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.846+0000 7f652dffb640 1 -- 172.21.15.70:0/3244085306 --> [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6520001d30 con 0x7f651c0ac840 2024-09-12T01:50:44.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.846+0000 7f652dffb640 1 -- 172.21.15.70:0/3244085306 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f65200f0330 con 0x7f6530101de0 2024-09-12T01:50:44.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.846+0000 7f653492e640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837] conn(0x7f651c0ac840 0x7f651c0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.846+0000 7f6527fff640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f651c0a2c10 0x7f651c0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f65300ffe20 tx=0x7f6518008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:44.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.846+0000 7f653492e640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837] conn(0x7f651c0ac840 0x7f651c0aece0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:44.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.847+0000 7f652dffb640 1 -- 172.21.15.70:0/3244085306 <== osd.0 v2:172.21.15.70:6802/4255694837 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6520001d30 con 0x7f651c0ac840 2024-09-12T01:50:44.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.861+0000 7f6536391640 1 -- 172.21.15.70:0/3244085306 --> [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6530062e00 con 0x7f651c0ac840 2024-09-12T01:50:44.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.861+0000 7f652dffb640 1 -- 172.21.15.70:0/3244085306 <== osd.0 v2:172.21.15.70:6802/4255694837 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6530062e00 con 0x7f651c0ac840 2024-09-12T01:50:44.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.861+0000 7f6536391640 1 -- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837] conn(0x7f651c0ac840 msgr2=0x7f651c0aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.861+0000 7f6536391640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837] conn(0x7f651c0ac840 0x7f651c0aece0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.861+0000 7f6536391640 1 -- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f651c0a2c10 msgr2=0x7f651c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.861+0000 7f6536391640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f651c0a2c10 0x7f651c0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f65300ffe20 tx=0x7f6518008040 comp rx=0 tx=0).stop 2024-09-12T01:50:44.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.861+0000 7f6536391640 1 -- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6530101de0 msgr2=0x7f6530198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.861+0000 7f6536391640 1 --2- 172.21.15.70:0/3244085306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6530101de0 0x7f6530198670 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6520006010 tx=0x7f65200042f0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.861+0000 7f653492e640 1 -- 172.21.15.70:0/3244085306 reap_dead start 2024-09-12T01:50:44.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.862+0000 7f6536391640 1 -- 172.21.15.70:0/3244085306 shutdown_connections 2024-09-12T01:50:44.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.862+0000 7f6536391640 1 -- 172.21.15.70:0/3244085306 >> 172.21.15.70:0/3244085306 conn(0x7f65300fd8c0 msgr2=0x7f65300fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:44.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.862+0000 7f6536391640 1 -- 172.21.15.70:0/3244085306 shutdown_connections 2024-09-12T01:50:44.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:44.862+0000 7f6536391640 1 -- 172.21.15.70:0/3244085306 wait complete. 2024-09-12T01:50:44.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:44 smithi191 ceph-mon[35770]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:50:45.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:44 smithi152 ceph-mon[35055]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:50:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.275+0000 7f3085e0a640 1 -- 172.21.15.70:0/2342126733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3080101df0 msgr2=0x7f30801021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.275+0000 7f3085e0a640 1 --2- 172.21.15.70:0/2342126733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3080101df0 0x7f30801021d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3070009900 tx=0x7f307002a410 comp rx=0 tx=0).stop 2024-09-12T01:50:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.275+0000 7f3085e0a640 1 -- 172.21.15.70:0/2342126733 shutdown_connections 2024-09-12T01:50:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.275+0000 7f3085e0a640 1 --2- 172.21.15.70:0/2342126733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3080106f20 0x7f308010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.275+0000 7f3085e0a640 1 --2- 172.21.15.70:0/2342126733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30801027a0 0x7f30801067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.275+0000 7f3085e0a640 1 --2- 172.21.15.70:0/2342126733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3080101df0 0x7f30801021d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.275+0000 7f3085e0a640 1 -- 172.21.15.70:0/2342126733 >> 172.21.15.70:0/2342126733 conn(0x7f30800fd8f0 msgr2=0x7f30800ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.275+0000 7f3085e0a640 1 -- 172.21.15.70:0/2342126733 shutdown_connections 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.275+0000 7f3085e0a640 1 -- 172.21.15.70:0/2342126733 wait complete. 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.275+0000 7f3085e0a640 1 Processor -- start 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.275+0000 7f3085e0a640 1 -- start start 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f3085e0a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3080101df0 0x7f3080198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f3085e0a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30801027a0 0x7f3080198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f3085e0a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3080106f20 0x7f308019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f3085e0a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30801120e0 con 0x7f30801027a0 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f3085e0a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3080111f60 con 0x7f3080106f20 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f3085e0a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3080112260 con 0x7f3080101df0 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f307effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30801027a0 0x7f3080198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:45.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f307effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30801027a0 0x7f3080198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33796/0 (socket says 172.21.15.70:33796) 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f307effd640 1 -- 172.21.15.70:0/855572559 learned_addr learned my addr 172.21.15.70:0/855572559 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f307ffff640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3080106f20 0x7f308019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f307f7fe640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3080101df0 0x7f3080198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f307effd640 1 -- 172.21.15.70:0/855572559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3080101df0 msgr2=0x7f3080198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f307effd640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3080101df0 0x7f3080198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f307effd640 1 -- 172.21.15.70:0/855572559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3080106f20 msgr2=0x7f308019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f307effd640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3080106f20 0x7f308019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f307effd640 1 -- 172.21.15.70:0/855572559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308019d530 con 0x7f30801027a0 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f307ffff640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3080106f20 0x7f308019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.276+0000 7f307effd640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30801027a0 0x7f3080198ac0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f306800d950 tx=0x7f306800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.277+0000 7f307cff9640 1 -- 172.21.15.70:0/855572559 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068017070 con 0x7f30801027a0 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.277+0000 7f307cff9640 1 -- 172.21.15.70:0/855572559 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3068009c30 con 0x7f30801027a0 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.277+0000 7f3085e0a640 1 -- 172.21.15.70:0/855572559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f308019d820 con 0x7f30801027a0 2024-09-12T01:50:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.277+0000 7f307cff9640 1 -- 172.21.15.70:0/855572559 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306800f740 con 0x7f30801027a0 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.277+0000 7f3085e0a640 1 -- 172.21.15.70:0/855572559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30801a5100 con 0x7f30801027a0 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.277+0000 7f3085e0a640 1 -- 172.21.15.70:0/855572559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3080062980 con 0x7f30801027a0 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.279+0000 7f307cff9640 1 -- 172.21.15.70:0/855572559 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3068010a80 con 0x7f30801027a0 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.280+0000 7f307cff9640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f306c0a2c10 0x7f306c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.280+0000 7f307f7fe640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f306c0a2c10 0x7f306c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.280+0000 7f307cff9640 1 -- 172.21.15.70:0/855572559 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f30680cf2b0 con 0x7f30801027a0 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.280+0000 7f307cff9640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083] conn(0x7f306c0ac840 0x7f306c0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.280+0000 7f307cff9640 1 -- 172.21.15.70:0/855572559 --> [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f306c0af3b0 con 0x7f306c0ac840 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.280+0000 7f307cff9640 1 -- 172.21.15.70:0/855572559 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f30680cf6e0 con 0x7f30801027a0 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.280+0000 7f307f7fe640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f306c0a2c10 0x7f306c0a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3070005ab0 tx=0x7f3070005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.280+0000 7f307ffff640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083] conn(0x7f306c0ac840 0x7f306c0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.281+0000 7f307ffff640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083] conn(0x7f306c0ac840 0x7f306c0aece0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.282+0000 7f307cff9640 1 -- 172.21.15.70:0/855572559 <== osd.2 v2:172.21.15.191:6800/3832730083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f306c0af3b0 con 0x7f306c0ac840 2024-09-12T01:50:45.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.295+0000 7f3085e0a640 1 -- 172.21.15.70:0/855572559 --> [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3080062e00 con 0x7f306c0ac840 2024-09-12T01:50:45.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.295+0000 7f307cff9640 1 -- 172.21.15.70:0/855572559 <== osd.2 v2:172.21.15.191:6800/3832730083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3080062e00 con 0x7f306c0ac840 2024-09-12T01:50:45.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.296+0000 7f3085e0a640 1 -- 172.21.15.70:0/855572559 >> [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083] conn(0x7f306c0ac840 msgr2=0x7f306c0aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:45.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.296+0000 7f3085e0a640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083] conn(0x7f306c0ac840 0x7f306c0aece0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.296+0000 7f3085e0a640 1 -- 172.21.15.70:0/855572559 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f306c0a2c10 msgr2=0x7f306c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:45.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.296+0000 7f3085e0a640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f306c0a2c10 0x7f306c0a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3070005ab0 tx=0x7f3070005a20 comp rx=0 tx=0).stop 2024-09-12T01:50:45.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.296+0000 7f3085e0a640 1 -- 172.21.15.70:0/855572559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30801027a0 msgr2=0x7f3080198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:45.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.296+0000 7f3085e0a640 1 --2- 172.21.15.70:0/855572559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30801027a0 0x7f3080198ac0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f306800d950 tx=0x7f306800de10 comp rx=0 tx=0).stop 2024-09-12T01:50:45.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.296+0000 7f307ffff640 1 -- 172.21.15.70:0/855572559 reap_dead start 2024-09-12T01:50:45.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.296+0000 7f3085e0a640 1 -- 172.21.15.70:0/855572559 shutdown_connections 2024-09-12T01:50:45.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.296+0000 7f3085e0a640 1 -- 172.21.15.70:0/855572559 >> 172.21.15.70:0/855572559 conn(0x7f30800fd8f0 msgr2=0x7f30800fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:45.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.296+0000 7f3085e0a640 1 -- 172.21.15.70:0/855572559 shutdown_connections 2024-09-12T01:50:45.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:45.296+0000 7f3085e0a640 1 -- 172.21.15.70:0/855572559 wait complete. 2024-09-12T01:50:45.915 INFO:teuthology.orchestra.run.smithi070.stdout:77309411394 2024-09-12T01:50:45.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T01:50:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.552+0000 7f5e1ae80640 1 -- 172.21.15.70:0/1499182347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e14101de0 msgr2=0x7f5e141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:46.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.552+0000 7f5e1ae80640 1 --2- 172.21.15.70:0/1499182347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e14101de0 0x7f5e141021c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009900 tx=0x7f5e0c02a410 comp rx=0 tx=0).stop 2024-09-12T01:50:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.552+0000 7f5e1ae80640 1 -- 172.21.15.70:0/1499182347 shutdown_connections 2024-09-12T01:50:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.552+0000 7f5e1ae80640 1 --2- 172.21.15.70:0/1499182347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e14106f10 0x7f5e1410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.552+0000 7f5e1ae80640 1 --2- 172.21.15.70:0/1499182347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e14102790 0x7f5e141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.552+0000 7f5e1ae80640 1 --2- 172.21.15.70:0/1499182347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e14101de0 0x7f5e141021c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.552+0000 7f5e1ae80640 1 -- 172.21.15.70:0/1499182347 >> 172.21.15.70:0/1499182347 conn(0x7f5e140fd8c0 msgr2=0x7f5e140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.552+0000 7f5e1ae80640 1 -- 172.21.15.70:0/1499182347 shutdown_connections 2024-09-12T01:50:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.552+0000 7f5e1ae80640 1 -- 172.21.15.70:0/1499182347 wait complete. 2024-09-12T01:50:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.552+0000 7f5e1ae80640 1 Processor -- start 2024-09-12T01:50:46.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1ae80640 1 -- start start 2024-09-12T01:50:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1ae80640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e14101de0 0x7f5e141985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1ae80640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e14102790 0x7f5e14198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1ae80640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e14106f10 0x7f5e1419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1ae80640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14112120 con 0x7f5e14106f10 2024-09-12T01:50:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1ae80640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14111fa0 con 0x7f5e14101de0 2024-09-12T01:50:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1ae80640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5e141122a0 con 0x7f5e14102790 2024-09-12T01:50:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1941d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e14106f10 0x7f5e1419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1941d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e14106f10 0x7f5e1419ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33816/0 (socket says 172.21.15.70:33816) 2024-09-12T01:50:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1941d640 1 -- 172.21.15.70:0/3245216994 learned_addr learned my addr 172.21.15.70:0/3245216994 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:46.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e18c1c640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e14101de0 0x7f5e141985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:46.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e13fff640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e14102790 0x7f5e14198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:46.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1941d640 1 -- 172.21.15.70:0/3245216994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e14102790 msgr2=0x7f5e14198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:46.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1941d640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e14102790 0x7f5e14198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:46.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1941d640 1 -- 172.21.15.70:0/3245216994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e14101de0 msgr2=0x7f5e141985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:46.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1941d640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e14101de0 0x7f5e141985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:46.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1941d640 1 -- 172.21.15.70:0/3245216994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1419d550 con 0x7f5e14106f10 2024-09-12T01:50:46.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e13fff640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e14102790 0x7f5e14198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:46.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1941d640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e14106f10 0x7f5e1419ce70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c970 tx=0x7f5dfc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:46.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e11ffb640 1 -- 172.21.15.70:0/3245216994 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc007bb0 con 0x7f5e14106f10 2024-09-12T01:50:46.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e11ffb640 1 -- 172.21.15.70:0/3245216994 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5dfc007d50 con 0x7f5e14106f10 2024-09-12T01:50:46.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e1ae80640 1 -- 172.21.15.70:0/3245216994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1419d840 con 0x7f5e14106f10 2024-09-12T01:50:46.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.553+0000 7f5e11ffb640 1 -- 172.21.15.70:0/3245216994 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00f450 con 0x7f5e14106f10 2024-09-12T01:50:46.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.554+0000 7f5e1ae80640 1 -- 172.21.15.70:0/3245216994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e141a5120 con 0x7f5e14106f10 2024-09-12T01:50:46.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.554+0000 7f5e1ae80640 1 -- 172.21.15.70:0/3245216994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e14062980 con 0x7f5e14106f10 2024-09-12T01:50:46.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.556+0000 7f5e11ffb640 1 -- 172.21.15.70:0/3245216994 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5dfc005000 con 0x7f5e14106f10 2024-09-12T01:50:46.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.556+0000 7f5e11ffb640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5e000a2c10 0x7f5e000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:46.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.556+0000 7f5e18c1c640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5e000a2c10 0x7f5e000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:46.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.556+0000 7f5e11ffb640 1 -- 172.21.15.70:0/3245216994 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5dfc0cf2e0 con 0x7f5e14106f10 2024-09-12T01:50:46.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.557+0000 7f5e11ffb640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043] conn(0x7f5e000ac840 0x7f5e000aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:46.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.557+0000 7f5e11ffb640 1 -- 172.21.15.70:0/3245216994 --> [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e000af3b0 con 0x7f5e000ac840 2024-09-12T01:50:46.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.557+0000 7f5e11ffb640 1 -- 172.21.15.70:0/3245216994 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f5dfc0cf710 con 0x7f5e14106f10 2024-09-12T01:50:46.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.557+0000 7f5e13fff640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043] conn(0x7f5e000ac840 0x7f5e000aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:46.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.557+0000 7f5e18c1c640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5e000a2c10 0x7f5e000a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c000c00 tx=0x7f5e0c005e80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:46.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.557+0000 7f5e13fff640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043] conn(0x7f5e000ac840 0x7f5e000aece0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.558+0000 7f5e11ffb640 1 -- 172.21.15.70:0/3245216994 <== osd.9 v2:172.21.15.70:6826/1622332043 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e000af3b0 con 0x7f5e000ac840 2024-09-12T01:50:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.571+0000 7f5e1ae80640 1 -- 172.21.15.70:0/3245216994 --> [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e14062e00 con 0x7f5e000ac840 2024-09-12T01:50:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.571+0000 7f5e11ffb640 1 -- 172.21.15.70:0/3245216994 <== osd.9 v2:172.21.15.70:6826/1622332043 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5e14062e00 con 0x7f5e000ac840 2024-09-12T01:50:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.572+0000 7f5e1ae80640 1 -- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043] conn(0x7f5e000ac840 msgr2=0x7f5e000aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.572+0000 7f5e1ae80640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043] conn(0x7f5e000ac840 0x7f5e000aece0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.572+0000 7f5e1ae80640 1 -- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5e000a2c10 msgr2=0x7f5e000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.572+0000 7f5e1ae80640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5e000a2c10 0x7f5e000a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c000c00 tx=0x7f5e0c005e80 comp rx=0 tx=0).stop 2024-09-12T01:50:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.572+0000 7f5e1ae80640 1 -- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e14106f10 msgr2=0x7f5e1419ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.572+0000 7f5e1ae80640 1 --2- 172.21.15.70:0/3245216994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e14106f10 0x7f5e1419ce70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c970 tx=0x7f5dfc00ce30 comp rx=0 tx=0).stop 2024-09-12T01:50:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.572+0000 7f5e1941d640 1 -- 172.21.15.70:0/3245216994 reap_dead start 2024-09-12T01:50:46.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.572+0000 7f5e1ae80640 1 -- 172.21.15.70:0/3245216994 shutdown_connections 2024-09-12T01:50:46.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.572+0000 7f5e1ae80640 1 -- 172.21.15.70:0/3245216994 >> 172.21.15.70:0/3245216994 conn(0x7f5e140fd8c0 msgr2=0x7f5e140fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:46.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.572+0000 7f5e1ae80640 1 -- 172.21.15.70:0/3245216994 shutdown_connections 2024-09-12T01:50:46.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:46.572+0000 7f5e1ae80640 1 -- 172.21.15.70:0/3245216994 wait complete. 2024-09-12T01:50:46.756 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:46 smithi070 ceph-mon[31177]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T01:50:46.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:46 smithi191 ceph-mon[35770]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T01:50:47.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:46 smithi152 ceph-mon[35055]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T01:50:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.356+0000 7f6931fce640 1 -- 172.21.15.70:0/984721153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f692c101420 msgr2=0x7f692c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.356+0000 7f6931fce640 1 --2- 172.21.15.70:0/984721153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f692c101420 0x7f692c10d950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6924009cd0 tx=0x7f692402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.356+0000 7f6931fce640 1 -- 172.21.15.70:0/984721153 shutdown_connections 2024-09-12T01:50:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.356+0000 7f6931fce640 1 --2- 172.21.15.70:0/984721153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f692c101420 0x7f692c10d950 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.356+0000 7f6931fce640 1 --2- 172.21.15.70:0/984721153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f692c100a80 0x7f692c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.356+0000 7f6931fce640 1 --2- 172.21.15.70:0/984721153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f692c106a80 0x7f692c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.356+0000 7f6931fce640 1 -- 172.21.15.70:0/984721153 >> 172.21.15.70:0/984721153 conn(0x7f692c0fc7a0 msgr2=0x7f692c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.356+0000 7f6931fce640 1 -- 172.21.15.70:0/984721153 shutdown_connections 2024-09-12T01:50:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.356+0000 7f6931fce640 1 -- 172.21.15.70:0/984721153 wait complete. 2024-09-12T01:50:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.357+0000 7f6931fce640 1 Processor -- start 2024-09-12T01:50:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.357+0000 7f6931fce640 1 -- start start 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.357+0000 7f6931fce640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f692c100a80 0x7f692c1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.357+0000 7f6931fce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f692c101420 0x7f692c1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.357+0000 7f6931fce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f692c106a80 0x7f692c1a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.357+0000 7f6931fce640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f692c110fe0 con 0x7f692c101420 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.357+0000 7f6931fce640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f692c110e60 con 0x7f692c106a80 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.357+0000 7f6931fce640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f692c111160 con 0x7f692c100a80 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.357+0000 7f6923fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f692c101420 0x7f692c1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f6923fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f692c101420 0x7f692c1998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33822/0 (socket says 172.21.15.70:33822) 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f6923fff640 1 -- 172.21.15.70:0/1183688000 learned_addr learned my addr 172.21.15.70:0/1183688000 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f692bfff640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f692c106a80 0x7f692c1a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f692b7fe640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f692c100a80 0x7f692c1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f6923fff640 1 -- 172.21.15.70:0/1183688000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f692c100a80 msgr2=0x7f692c1993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:47.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f6923fff640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f692c100a80 0x7f692c1993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f6923fff640 1 -- 172.21.15.70:0/1183688000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f692c106a80 msgr2=0x7f692c1a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f6923fff640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f692c106a80 0x7f692c1a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f6923fff640 1 -- 172.21.15.70:0/1183688000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c1a4970 con 0x7f692c101420 2024-09-12T01:50:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f692b7fe640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f692c100a80 0x7f692c1993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f6923fff640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f692c101420 0x7f692c1998f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f691400d950 tx=0x7f691400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f69297fa640 1 -- 172.21.15.70:0/1183688000 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6914017070 con 0x7f692c101420 2024-09-12T01:50:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f69297fa640 1 -- 172.21.15.70:0/1183688000 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6914009c30 con 0x7f692c101420 2024-09-12T01:50:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f6931fce640 1 -- 172.21.15.70:0/1183688000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692c1a4b40 con 0x7f692c101420 2024-09-12T01:50:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f69297fa640 1 -- 172.21.15.70:0/1183688000 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691400f740 con 0x7f692c101420 2024-09-12T01:50:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.358+0000 7f6931fce640 1 -- 172.21.15.70:0/1183688000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f692c1a5050 con 0x7f692c101420 2024-09-12T01:50:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.359+0000 7f6931fce640 1 -- 172.21.15.70:0/1183688000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f692c0fe7c0 con 0x7f692c101420 2024-09-12T01:50:47.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.360+0000 7f69297fa640 1 -- 172.21.15.70:0/1183688000 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6914010a80 con 0x7f692c101420 2024-09-12T01:50:47.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.361+0000 7f69297fa640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f69180a2c10 0x7f69180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:47.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.361+0000 7f692b7fe640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f69180a2c10 0x7f69180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:47.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.361+0000 7f69297fa640 1 -- 172.21.15.70:0/1183688000 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f69140cf200 con 0x7f692c101420 2024-09-12T01:50:47.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.361+0000 7f69297fa640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072] conn(0x7f69180ac840 0x7f69180aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:47.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.361+0000 7f69297fa640 1 -- 172.21.15.70:0/1183688000 --> [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6914016ec0 con 0x7f69180ac840 2024-09-12T01:50:47.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.361+0000 7f69297fa640 1 -- 172.21.15.70:0/1183688000 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f69140cf630 con 0x7f692c101420 2024-09-12T01:50:47.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.361+0000 7f692b7fe640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f69180a2c10 0x7f69180a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f691c006fd0 tx=0x7f691c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:47.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.362+0000 7f692bfff640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072] conn(0x7f69180ac840 0x7f69180aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:47.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.362+0000 7f692bfff640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072] conn(0x7f69180ac840 0x7f69180aece0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:47.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.363+0000 7f69297fa640 1 -- 172.21.15.70:0/1183688000 <== osd.8 v2:172.21.15.191:6816/1717172072 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6914016ec0 con 0x7f69180ac840 2024-09-12T01:50:47.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.376+0000 7f6931fce640 1 -- 172.21.15.70:0/1183688000 --> [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f692c1021c0 con 0x7f69180ac840 2024-09-12T01:50:47.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.377+0000 7f69297fa640 1 -- 172.21.15.70:0/1183688000 <== osd.8 v2:172.21.15.191:6816/1717172072 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f692c1021c0 con 0x7f69180ac840 2024-09-12T01:50:47.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.377+0000 7f6931fce640 1 -- 172.21.15.70:0/1183688000 >> [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072] conn(0x7f69180ac840 msgr2=0x7f69180aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:47.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.377+0000 7f6931fce640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072] conn(0x7f69180ac840 0x7f69180aece0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:47.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.377+0000 7f6931fce640 1 -- 172.21.15.70:0/1183688000 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f69180a2c10 msgr2=0x7f69180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:47.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.377+0000 7f6931fce640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f69180a2c10 0x7f69180a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f691c006fd0 tx=0x7f691c008040 comp rx=0 tx=0).stop 2024-09-12T01:50:47.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.377+0000 7f6931fce640 1 -- 172.21.15.70:0/1183688000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f692c101420 msgr2=0x7f692c1998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:47.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.377+0000 7f6931fce640 1 --2- 172.21.15.70:0/1183688000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f692c101420 0x7f692c1998f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f691400d950 tx=0x7f691400de10 comp rx=0 tx=0).stop 2024-09-12T01:50:47.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.377+0000 7f692bfff640 1 -- 172.21.15.70:0/1183688000 reap_dead start 2024-09-12T01:50:47.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.377+0000 7f6931fce640 1 -- 172.21.15.70:0/1183688000 shutdown_connections 2024-09-12T01:50:47.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.377+0000 7f6931fce640 1 -- 172.21.15.70:0/1183688000 >> 172.21.15.70:0/1183688000 conn(0x7f692c0fc7a0 msgr2=0x7f692c0fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:47.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.377+0000 7f6931fce640 1 -- 172.21.15.70:0/1183688000 shutdown_connections 2024-09-12T01:50:47.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:47.377+0000 7f6931fce640 1 -- 172.21.15.70:0/1183688000 wait complete. 2024-09-12T01:50:48.162 INFO:teuthology.orchestra.run.smithi070.stdout:322122547222 2024-09-12T01:50:48.163 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T01:50:48.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.340+0000 7f49ea182640 1 -- 172.21.15.70:0/559291050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e4100eb0 msgr2=0x7f49e4106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:48.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.340+0000 7f49ea182640 1 --2- 172.21.15.70:0/559291050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e4100eb0 0x7f49e4106840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009900 tx=0x7f49d802a410 comp rx=0 tx=0).stop 2024-09-12T01:50:48.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.340+0000 7f49ea182640 1 -- 172.21.15.70:0/559291050 shutdown_connections 2024-09-12T01:50:48.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.340+0000 7f49ea182640 1 --2- 172.21.15.70:0/559291050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49e4106f70 0x7f49e410eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:48.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.340+0000 7f49ea182640 1 --2- 172.21.15.70:0/559291050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e4100eb0 0x7f49e4106840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:48.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.340+0000 7f49ea182640 1 --2- 172.21.15.70:0/559291050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49e4100500 0x7f49e41008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:48.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.340+0000 7f49ea182640 1 -- 172.21.15.70:0/559291050 >> 172.21.15.70:0/559291050 conn(0x7f49e40fc5c0 msgr2=0x7f49e40fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:48.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.340+0000 7f49ea182640 1 -- 172.21.15.70:0/559291050 shutdown_connections 2024-09-12T01:50:48.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.340+0000 7f49ea182640 1 -- 172.21.15.70:0/559291050 wait complete. 2024-09-12T01:50:48.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.340+0000 7f49ea182640 1 Processor -- start 2024-09-12T01:50:48.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.340+0000 7f49ea182640 1 -- start start 2024-09-12T01:50:48.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49ea182640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49e4100500 0x7f49e4101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:48.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49ea182640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49e4100eb0 0x7f49e41019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:48.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49ea182640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e4106f70 0x7f49e4101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:48.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49ea182640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49e4112070 con 0x7f49e4106f70 2024-09-12T01:50:48.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49ea182640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f49e4111ef0 con 0x7f49e4100eb0 2024-09-12T01:50:48.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49ea182640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f49e41121f0 con 0x7f49e4100500 2024-09-12T01:50:48.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49e3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e4106f70 0x7f49e4101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:48.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49e3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e4106f70 0x7f49e4101f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33842/0 (socket says 172.21.15.70:33842) 2024-09-12T01:50:48.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49e3fff640 1 -- 172.21.15.70:0/2159953049 learned_addr learned my addr 172.21.15.70:0/2159953049 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:48.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49e37fe640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49e4100500 0x7f49e4101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:48.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49e2ffd640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49e4100eb0 0x7f49e41019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:48.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49e3fff640 1 -- 172.21.15.70:0/2159953049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49e4100500 msgr2=0x7f49e4101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:48.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49e3fff640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49e4100500 0x7f49e4101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:48.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49e3fff640 1 -- 172.21.15.70:0/2159953049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49e4100eb0 msgr2=0x7f49e41019c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:48.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49e3fff640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49e4100eb0 0x7f49e41019c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:48.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49e3fff640 1 -- 172.21.15.70:0/2159953049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e41a6970 con 0x7f49e4106f70 2024-09-12T01:50:48.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.341+0000 7f49e3fff640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e4106f70 0x7f49e4101f00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00eb10 tx=0x7f49dc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:48.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.342+0000 7f49e0ff9640 1 -- 172.21.15.70:0/2159953049 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc004b20 con 0x7f49e4106f70 2024-09-12T01:50:48.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.342+0000 7f49ea182640 1 -- 172.21.15.70:0/2159953049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e41a6c60 con 0x7f49e4106f70 2024-09-12T01:50:48.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.342+0000 7f49e0ff9640 1 -- 172.21.15.70:0/2159953049 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f49dc004cc0 con 0x7f49e4106f70 2024-09-12T01:50:48.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.342+0000 7f49e0ff9640 1 -- 172.21.15.70:0/2159953049 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0107f0 con 0x7f49e4106f70 2024-09-12T01:50:48.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.342+0000 7f49ea182640 1 -- 172.21.15.70:0/2159953049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e41a7170 con 0x7f49e4106f70 2024-09-12T01:50:48.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.343+0000 7f49ea182640 1 -- 172.21.15.70:0/2159953049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49e4062880 con 0x7f49e4106f70 2024-09-12T01:50:48.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.344+0000 7f49e0ff9640 1 -- 172.21.15.70:0/2159953049 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f49dc005020 con 0x7f49e4106f70 2024-09-12T01:50:48.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.345+0000 7f49e0ff9640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f49cc0a2c90 0x7f49cc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:48.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.345+0000 7f49e37fe640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f49cc0a2c90 0x7f49cc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:48.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.345+0000 7f49e0ff9640 1 -- 172.21.15.70:0/2159953049 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f49dc0cfb40 con 0x7f49e4106f70 2024-09-12T01:50:48.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.345+0000 7f49e0ff9640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857] conn(0x7f49cc0ac8c0 0x7f49cc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:48.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.345+0000 7f49e0ff9640 1 -- 172.21.15.70:0/2159953049 --> [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49dc01ee50 con 0x7f49cc0ac8c0 2024-09-12T01:50:48.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.345+0000 7f49e0ff9640 1 -- 172.21.15.70:0/2159953049 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f49dc0cff70 con 0x7f49e4106f70 2024-09-12T01:50:48.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.346+0000 7f49e2ffd640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857] conn(0x7f49cc0ac8c0 0x7f49cc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:48.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.346+0000 7f49e37fe640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f49cc0a2c90 0x7f49cc0a5150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f49e4069fc0 tx=0x7f49d4005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:48.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.346+0000 7f49e2ffd640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857] conn(0x7f49cc0ac8c0 0x7f49cc0aed60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:48.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.347+0000 7f49e0ff9640 1 -- 172.21.15.70:0/2159953049 <== osd.4 v2:172.21.15.152:6808/2197110857 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49dc01ee50 con 0x7f49cc0ac8c0 2024-09-12T01:50:48.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.361+0000 7f49ea182640 1 -- 172.21.15.70:0/2159953049 --> [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49e4062b50 con 0x7f49cc0ac8c0 2024-09-12T01:50:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.362+0000 7f49e0ff9640 1 -- 172.21.15.70:0/2159953049 <== osd.4 v2:172.21.15.152:6808/2197110857 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f49e4062b50 con 0x7f49cc0ac8c0 2024-09-12T01:50:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.362+0000 7f49ea182640 1 -- 172.21.15.70:0/2159953049 >> [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857] conn(0x7f49cc0ac8c0 msgr2=0x7f49cc0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.362+0000 7f49ea182640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857] conn(0x7f49cc0ac8c0 0x7f49cc0aed60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.362+0000 7f49ea182640 1 -- 172.21.15.70:0/2159953049 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f49cc0a2c90 msgr2=0x7f49cc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.362+0000 7f49ea182640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f49cc0a2c90 0x7f49cc0a5150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f49e4069fc0 tx=0x7f49d4005f90 comp rx=0 tx=0).stop 2024-09-12T01:50:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.362+0000 7f49ea182640 1 -- 172.21.15.70:0/2159953049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e4106f70 msgr2=0x7f49e4101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.362+0000 7f49ea182640 1 --2- 172.21.15.70:0/2159953049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e4106f70 0x7f49e4101f00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00eb10 tx=0x7f49dc00c2d0 comp rx=0 tx=0).stop 2024-09-12T01:50:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.362+0000 7f49e3fff640 1 -- 172.21.15.70:0/2159953049 reap_dead start 2024-09-12T01:50:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.363+0000 7f49ea182640 1 -- 172.21.15.70:0/2159953049 shutdown_connections 2024-09-12T01:50:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.363+0000 7f49ea182640 1 -- 172.21.15.70:0/2159953049 >> 172.21.15.70:0/2159953049 conn(0x7f49e40fc5c0 msgr2=0x7f49e4105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.363+0000 7f49ea182640 1 -- 172.21.15.70:0/2159953049 shutdown_connections 2024-09-12T01:50:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:48.363+0000 7f49ea182640 1 -- 172.21.15.70:0/2159953049 wait complete. 2024-09-12T01:50:48.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:48 smithi070 ceph-mon[31177]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:50:48.869 INFO:teuthology.orchestra.run.smithi070.stdout:270582939680 2024-09-12T01:50:48.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T01:50:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:48 smithi191 ceph-mon[35770]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:50:49.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:48 smithi152 ceph-mon[35055]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:50:49.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.264+0000 7f4ec6a75640 1 -- 172.21.15.70:0/4183479950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec0101de0 msgr2=0x7f4ec01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:49.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.264+0000 7f4ec6a75640 1 --2- 172.21.15.70:0/4183479950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec0101de0 0x7f4ec01021c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009900 tx=0x7f4eb402a410 comp rx=0 tx=0).stop 2024-09-12T01:50:49.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.264+0000 7f4ec6a75640 1 -- 172.21.15.70:0/4183479950 shutdown_connections 2024-09-12T01:50:49.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.264+0000 7f4ec6a75640 1 --2- 172.21.15.70:0/4183479950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0106f10 0x7f4ec010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:49.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.264+0000 7f4ec6a75640 1 --2- 172.21.15.70:0/4183479950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ec0102790 0x7f4ec01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:49.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.264+0000 7f4ec6a75640 1 --2- 172.21.15.70:0/4183479950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec0101de0 0x7f4ec01021c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:49.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.264+0000 7f4ec6a75640 1 -- 172.21.15.70:0/4183479950 >> 172.21.15.70:0/4183479950 conn(0x7f4ec00fd8c0 msgr2=0x7f4ec00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:49.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.264+0000 7f4ec6a75640 1 -- 172.21.15.70:0/4183479950 shutdown_connections 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.264+0000 7f4ec6a75640 1 -- 172.21.15.70:0/4183479950 wait complete. 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec6a75640 1 Processor -- start 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec6a75640 1 -- start start 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec6a75640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec0101de0 0x7f4ec0198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec6a75640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0102790 0x7f4ec0198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec6a75640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ec0106f10 0x7f4ec019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec6a75640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec0112090 con 0x7f4ec0101de0 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec6a75640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec0111f10 con 0x7f4ec0102790 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec6a75640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec0112210 con 0x7f4ec0106f10 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec4811640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec0101de0 0x7f4ec0198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec4811640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec0101de0 0x7f4ec0198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33848/0 (socket says 172.21.15.70:33848) 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec4811640 1 -- 172.21.15.70:0/391124776 learned_addr learned my addr 172.21.15.70:0/391124776 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:49.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ebffff640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0102790 0x7f4ec0198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec5012640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ec0106f10 0x7f4ec019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec4811640 1 -- 172.21.15.70:0/391124776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ec0106f10 msgr2=0x7f4ec019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec4811640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ec0106f10 0x7f4ec019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec4811640 1 -- 172.21.15.70:0/391124776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0102790 msgr2=0x7f4ec0198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec4811640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0102790 0x7f4ec0198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.265+0000 7f4ec4811640 1 -- 172.21.15.70:0/391124776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec019d4e0 con 0x7f4ec0101de0 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.266+0000 7f4ec4811640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec0101de0 0x7f4ec0198530 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4006010 tx=0x7f4eb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.266+0000 7f4ebdffb640 1 -- 172.21.15.70:0/391124776 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb403f030 con 0x7f4ec0101de0 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.266+0000 7f4ebdffb640 1 -- 172.21.15.70:0/391124776 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4eb4003d00 con 0x7f4ec0101de0 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.266+0000 7f4ec6a75640 1 -- 172.21.15.70:0/391124776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec019d770 con 0x7f4ec0101de0 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.266+0000 7f4ebdffb640 1 -- 172.21.15.70:0/391124776 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4035070 con 0x7f4ec0101de0 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.266+0000 7f4ec6a75640 1 -- 172.21.15.70:0/391124776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec01a50b0 con 0x7f4ec0101de0 2024-09-12T01:50:49.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.267+0000 7f4ec6a75640 1 -- 172.21.15.70:0/391124776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ec0062900 con 0x7f4ec0101de0 2024-09-12T01:50:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.268+0000 7f4ebdffb640 1 -- 172.21.15.70:0/391124776 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4eb4042030 con 0x7f4ec0101de0 2024-09-12T01:50:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.269+0000 7f4ebdffb640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4eb00a2c90 0x7f4eb00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.269+0000 7f4ebffff640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4eb00a2c90 0x7f4eb00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.269+0000 7f4ebdffb640 1 -- 172.21.15.70:0/391124776 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4eb40efff0 con 0x7f4ec0101de0 2024-09-12T01:50:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.269+0000 7f4ebdffb640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241] conn(0x7f4eb00ac8c0 0x7f4eb00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.269+0000 7f4ebdffb640 1 -- 172.21.15.70:0/391124776 --> [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4eb00af430 con 0x7f4eb00ac8c0 2024-09-12T01:50:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.269+0000 7f4ebdffb640 1 -- 172.21.15.70:0/391124776 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f4eb40f0420 con 0x7f4ec0101de0 2024-09-12T01:50:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.269+0000 7f4ebffff640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4eb00a2c90 0x7f4eb00a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4eac005fd0 tx=0x7f4eac005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.269+0000 7f4ec5012640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241] conn(0x7f4eb00ac8c0 0x7f4eb00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.270+0000 7f4ec5012640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241] conn(0x7f4eb00ac8c0 0x7f4eb00aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.271+0000 7f4ebdffb640 1 -- 172.21.15.70:0/391124776 <== osd.1 v2:172.21.15.152:6800/3805912241 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4eb00af430 con 0x7f4eb00ac8c0 2024-09-12T01:50:49.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.284+0000 7f4ec6a75640 1 -- 172.21.15.70:0/391124776 --> [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ec0062d00 con 0x7f4eb00ac8c0 2024-09-12T01:50:49.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.284+0000 7f4ebdffb640 1 -- 172.21.15.70:0/391124776 <== osd.1 v2:172.21.15.152:6800/3805912241 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4ec0062d00 con 0x7f4eb00ac8c0 2024-09-12T01:50:49.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.285+0000 7f4ec6a75640 1 -- 172.21.15.70:0/391124776 >> [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241] conn(0x7f4eb00ac8c0 msgr2=0x7f4eb00aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:49.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.285+0000 7f4ec6a75640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241] conn(0x7f4eb00ac8c0 0x7f4eb00aed60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:49.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.285+0000 7f4ec6a75640 1 -- 172.21.15.70:0/391124776 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4eb00a2c90 msgr2=0x7f4eb00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:49.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.285+0000 7f4ec6a75640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4eb00a2c90 0x7f4eb00a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4eac005fd0 tx=0x7f4eac005850 comp rx=0 tx=0).stop 2024-09-12T01:50:49.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.285+0000 7f4ec6a75640 1 -- 172.21.15.70:0/391124776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec0101de0 msgr2=0x7f4ec0198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:49.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.285+0000 7f4ec6a75640 1 --2- 172.21.15.70:0/391124776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ec0101de0 0x7f4ec0198530 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4006010 tx=0x7f4eb40042f0 comp rx=0 tx=0).stop 2024-09-12T01:50:49.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.285+0000 7f4ec5012640 1 -- 172.21.15.70:0/391124776 reap_dead start 2024-09-12T01:50:49.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.285+0000 7f4ec6a75640 1 -- 172.21.15.70:0/391124776 shutdown_connections 2024-09-12T01:50:49.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.285+0000 7f4ec6a75640 1 -- 172.21.15.70:0/391124776 >> 172.21.15.70:0/391124776 conn(0x7f4ec00fd8c0 msgr2=0x7f4ec00feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:49.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.285+0000 7f4ec6a75640 1 -- 172.21.15.70:0/391124776 shutdown_connections 2024-09-12T01:50:49.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:49.285+0000 7f4ec6a75640 1 -- 172.21.15.70:0/391124776 wait complete. 2024-09-12T01:50:49.945 INFO:teuthology.orchestra.run.smithi070.stdout:55834574920 2024-09-12T01:50:49.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T01:50:50.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.097+0000 7f24ab3cc640 1 -- 172.21.15.70:0/211644673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a41036e0 msgr2=0x7f24a4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:50.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.097+0000 7f24ab3cc640 1 --2- 172.21.15.70:0/211644673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a41036e0 0x7f24a4107b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2494009930 tx=0x7f249402a420 comp rx=0 tx=0).stop 2024-09-12T01:50:50.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.097+0000 7f24ab3cc640 1 -- 172.21.15.70:0/211644673 shutdown_connections 2024-09-12T01:50:50.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.097+0000 7f24ab3cc640 1 --2- 172.21.15.70:0/211644673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a41082a0 0x7f24a410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:50.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.097+0000 7f24ab3cc640 1 --2- 172.21.15.70:0/211644673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a41036e0 0x7f24a4107b90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:50.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.097+0000 7f24ab3cc640 1 --2- 172.21.15.70:0/211644673 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24a4102d30 0x7f24a4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:50.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.097+0000 7f24ab3cc640 1 -- 172.21.15.70:0/211644673 >> 172.21.15.70:0/211644673 conn(0x7f24a40fc7d0 msgr2=0x7f24a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:50.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.097+0000 7f24ab3cc640 1 -- 172.21.15.70:0/211644673 shutdown_connections 2024-09-12T01:50:50.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.097+0000 7f24ab3cc640 1 -- 172.21.15.70:0/211644673 wait complete. 2024-09-12T01:50:50.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24ab3cc640 1 Processor -- start 2024-09-12T01:50:50.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24ab3cc640 1 -- start start 2024-09-12T01:50:50.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24ab3cc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a4102d30 0x7f24a4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:50.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24ab3cc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a41036e0 0x7f24a4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:50.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24ab3cc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24a41082a0 0x7f24a4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:50.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24ab3cc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24a41121c0 con 0x7f24a41036e0 2024-09-12T01:50:50.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24ab3cc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4112040 con 0x7f24a4102d30 2024-09-12T01:50:50.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24ab3cc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4112340 con 0x7f24a41082a0 2024-09-12T01:50:50.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24a8967640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a41036e0 0x7f24a4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:50.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24a8967640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a41036e0 0x7f24a4100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33864/0 (socket says 172.21.15.70:33864) 2024-09-12T01:50:50.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24a8967640 1 -- 172.21.15.70:0/1191855238 learned_addr learned my addr 172.21.15.70:0/1191855238 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:50.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24a9168640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a4102d30 0x7f24a4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:50.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24a9969640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24a41082a0 0x7f24a4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:50.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24a8967640 1 -- 172.21.15.70:0/1191855238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24a41082a0 msgr2=0x7f24a4101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:50.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.098+0000 7f24a8967640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24a41082a0 0x7f24a4101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:50.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.099+0000 7f24a8967640 1 -- 172.21.15.70:0/1191855238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a4102d30 msgr2=0x7f24a4100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:50.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.099+0000 7f24a8967640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a4102d30 0x7f24a4100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:50.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.099+0000 7f24a8967640 1 -- 172.21.15.70:0/1191855238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a41a6ba0 con 0x7f24a41036e0 2024-09-12T01:50:50.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.099+0000 7f24a9168640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a4102d30 0x7f24a4100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:50:50.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.099+0000 7f24a8967640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a41036e0 0x7f24a4100ed0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2494004770 tx=0x7f24940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:50.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.099+0000 7f249a7fc640 1 -- 172.21.15.70:0/1191855238 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249403f030 con 0x7f24a41036e0 2024-09-12T01:50:50.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.099+0000 7f249a7fc640 1 -- 172.21.15.70:0/1191855238 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2494003d00 con 0x7f24a41036e0 2024-09-12T01:50:50.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.099+0000 7f24ab3cc640 1 -- 172.21.15.70:0/1191855238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a41a6e30 con 0x7f24a41036e0 2024-09-12T01:50:50.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.099+0000 7f249a7fc640 1 -- 172.21.15.70:0/1191855238 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494035070 con 0x7f24a41036e0 2024-09-12T01:50:50.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.099+0000 7f24ab3cc640 1 -- 172.21.15.70:0/1191855238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a41a7280 con 0x7f24a41036e0 2024-09-12T01:50:50.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.100+0000 7f24ab3cc640 1 -- 172.21.15.70:0/1191855238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f24a4062900 con 0x7f24a41036e0 2024-09-12T01:50:50.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.101+0000 7f249a7fc640 1 -- 172.21.15.70:0/1191855238 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2494042030 con 0x7f24a41036e0 2024-09-12T01:50:50.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.102+0000 7f249a7fc640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24900a2c10 0x7f24900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:50.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.102+0000 7f249a7fc640 1 -- 172.21.15.70:0/1191855238 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f24940ef990 con 0x7f24a41036e0 2024-09-12T01:50:50.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.102+0000 7f24a9168640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24900a2c10 0x7f24900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:50.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.102+0000 7f249a7fc640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422] conn(0x7f24900ac840 0x7f24900aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:50.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.102+0000 7f249a7fc640 1 -- 172.21.15.70:0/1191855238 --> [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24900af3b0 con 0x7f24900ac840 2024-09-12T01:50:50.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.102+0000 7f249a7fc640 1 -- 172.21.15.70:0/1191855238 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f24940efdc0 con 0x7f24a41036e0 2024-09-12T01:50:50.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.102+0000 7f24a9168640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24900a2c10 0x7f24900a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f24a0005fd0 tx=0x7f24a000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:50.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.102+0000 7f24a9969640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422] conn(0x7f24900ac840 0x7f24900aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:50.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.103+0000 7f24a9969640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422] conn(0x7f24900ac840 0x7f24900aece0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:50.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.104+0000 7f249a7fc640 1 -- 172.21.15.70:0/1191855238 <== osd.5 v2:172.21.15.191:6808/2424359422 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f24900af3b0 con 0x7f24900ac840 2024-09-12T01:50:50.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.117+0000 7f24ab3cc640 1 -- 172.21.15.70:0/1191855238 --> [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f24a4062d30 con 0x7f24900ac840 2024-09-12T01:50:50.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.118+0000 7f249a7fc640 1 -- 172.21.15.70:0/1191855238 <== osd.5 v2:172.21.15.191:6808/2424359422 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f24a4062d30 con 0x7f24900ac840 2024-09-12T01:50:50.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.118+0000 7f24ab3cc640 1 -- 172.21.15.70:0/1191855238 >> [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422] conn(0x7f24900ac840 msgr2=0x7f24900aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:50.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.118+0000 7f24ab3cc640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422] conn(0x7f24900ac840 0x7f24900aece0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:50.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.119+0000 7f24ab3cc640 1 -- 172.21.15.70:0/1191855238 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24900a2c10 msgr2=0x7f24900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:50.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.119+0000 7f24ab3cc640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24900a2c10 0x7f24900a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f24a0005fd0 tx=0x7f24a000b390 comp rx=0 tx=0).stop 2024-09-12T01:50:50.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.119+0000 7f24ab3cc640 1 -- 172.21.15.70:0/1191855238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a41036e0 msgr2=0x7f24a4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:50.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.119+0000 7f24ab3cc640 1 --2- 172.21.15.70:0/1191855238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24a41036e0 0x7f24a4100ed0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2494004770 tx=0x7f24940042f0 comp rx=0 tx=0).stop 2024-09-12T01:50:50.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.119+0000 7f24a9969640 1 -- 172.21.15.70:0/1191855238 reap_dead start 2024-09-12T01:50:50.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.119+0000 7f24ab3cc640 1 -- 172.21.15.70:0/1191855238 shutdown_connections 2024-09-12T01:50:50.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.119+0000 7f24ab3cc640 1 -- 172.21.15.70:0/1191855238 >> 172.21.15.70:0/1191855238 conn(0x7f24a40fc7d0 msgr2=0x7f24a4105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:50.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.119+0000 7f24ab3cc640 1 -- 172.21.15.70:0/1191855238 shutdown_connections 2024-09-12T01:50:50.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:50.119+0000 7f24ab3cc640 1 -- 172.21.15.70:0/1191855238 wait complete. 2024-09-12T01:50:50.659 INFO:teuthology.orchestra.run.smithi070.stdout:34359738443 2024-09-12T01:50:50.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T01:50:50.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:50 smithi191 ceph-mon[35770]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:50:50.950 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:50 smithi070 ceph-mon[31177]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:50:51.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:50 smithi152 ceph-mon[35055]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:50:51.323 INFO:teuthology.orchestra.run.smithi070.stdout:137438953529 2024-09-12T01:50:51.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T01:50:51.924 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:51 smithi070 ceph-mon[31177]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:50:51.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:51 smithi191 ceph-mon[35770]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:50:51.967 INFO:teuthology.orchestra.run.smithi070.stdout:158913790003 2024-09-12T01:50:51.967 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T01:50:52.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:51 smithi152 ceph-mon[35055]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:50:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.196+0000 7f2fc4e15640 1 -- 172.21.15.70:0/655750068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fc01036e0 msgr2=0x7f2fc0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.196+0000 7f2fc4e15640 1 --2- 172.21.15.70:0/655750068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fc01036e0 0x7f2fc0107b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009930 tx=0x7f2fb402a420 comp rx=0 tx=0).stop 2024-09-12T01:50:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.197+0000 7f2fc4e15640 1 -- 172.21.15.70:0/655750068 shutdown_connections 2024-09-12T01:50:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.197+0000 7f2fc4e15640 1 --2- 172.21.15.70:0/655750068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc01082a0 0x7f2fc010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.197+0000 7f2fc4e15640 1 --2- 172.21.15.70:0/655750068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fc01036e0 0x7f2fc0107b90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.197+0000 7f2fc4e15640 1 --2- 172.21.15.70:0/655750068 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fc0102d30 0x7f2fc0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.197+0000 7f2fc4e15640 1 -- 172.21.15.70:0/655750068 >> 172.21.15.70:0/655750068 conn(0x7f2fc00fc7d0 msgr2=0x7f2fc00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.197+0000 7f2fc4e15640 1 -- 172.21.15.70:0/655750068 shutdown_connections 2024-09-12T01:50:52.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.197+0000 7f2fc4e15640 1 -- 172.21.15.70:0/655750068 wait complete. 2024-09-12T01:50:52.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.197+0000 7f2fc4e15640 1 Processor -- start 2024-09-12T01:50:52.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fc4e15640 1 -- start start 2024-09-12T01:50:52.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fc4e15640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc0102d30 0x7f2fc01986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:52.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fc4e15640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fc01036e0 0x7f2fc0198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:52.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fc4e15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fc01082a0 0x7f2fc019cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:52.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fc4e15640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc0112210 con 0x7f2fc01082a0 2024-09-12T01:50:52.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fc4e15640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc0112090 con 0x7f2fc0102d30 2024-09-12T01:50:52.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fc4e15640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc0112390 con 0x7f2fc01036e0 2024-09-12T01:50:52.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fbed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fc01082a0 0x7f2fc019cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:52.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fbe59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc0102d30 0x7f2fc01986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:52.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fbe59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc0102d30 0x7f2fc01986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:58928/0 (socket says 172.21.15.70:58928) 2024-09-12T01:50:52.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fbe59c640 1 -- 172.21.15.70:0/3457678559 learned_addr learned my addr 172.21.15.70:0/3457678559 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:52.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fbdd9b640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fc01036e0 0x7f2fc0198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:52.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fbed9d640 1 -- 172.21.15.70:0/3457678559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fc01036e0 msgr2=0x7f2fc0198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:52.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fbed9d640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2fc01036e0 0x7f2fc0198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:52.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fbed9d640 1 -- 172.21.15.70:0/3457678559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc0102d30 msgr2=0x7f2fc01986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:52.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fbed9d640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc0102d30 0x7f2fc01986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:52.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.198+0000 7f2fbed9d640 1 -- 172.21.15.70:0/3457678559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc019d650 con 0x7f2fc01082a0 2024-09-12T01:50:52.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.199+0000 7f2fbed9d640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fc01082a0 0x7f2fc019cf70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800e940 tx=0x7f2fb800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:52.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.199+0000 7f2faf7fe640 1 -- 172.21.15.70:0/3457678559 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8004d20 con 0x7f2fc01082a0 2024-09-12T01:50:52.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.199+0000 7f2faf7fe640 1 -- 172.21.15.70:0/3457678559 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2fb800cb20 con 0x7f2fc01082a0 2024-09-12T01:50:52.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.199+0000 7f2fc4e15640 1 -- 172.21.15.70:0/3457678559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc019d940 con 0x7f2fc01082a0 2024-09-12T01:50:52.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.199+0000 7f2faf7fe640 1 -- 172.21.15.70:0/3457678559 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80116b0 con 0x7f2fc01082a0 2024-09-12T01:50:52.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.199+0000 7f2fc4e15640 1 -- 172.21.15.70:0/3457678559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc01a5220 con 0x7f2fc01082a0 2024-09-12T01:50:52.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.200+0000 7f2fc4e15640 1 -- 172.21.15.70:0/3457678559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2fc0062980 con 0x7f2fc01082a0 2024-09-12T01:50:52.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.201+0000 7f2faf7fe640 1 -- 172.21.15.70:0/3457678559 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2fb8005020 con 0x7f2fc01082a0 2024-09-12T01:50:52.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.202+0000 7f2faf7fe640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2fa80a2c10 0x7f2fa80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:52.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.202+0000 7f2fbe59c640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2fa80a2c10 0x7f2fa80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:52.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.202+0000 7f2faf7fe640 1 -- 172.21.15.70:0/3457678559 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2fb80cf1c0 con 0x7f2fc01082a0 2024-09-12T01:50:52.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.202+0000 7f2faf7fe640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437] conn(0x7f2fa80ac840 0x7f2fa80aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.202+0000 7f2faf7fe640 1 -- 172.21.15.70:0/3457678559 --> [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fa80af3b0 con 0x7f2fa80ac840 2024-09-12T01:50:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.202+0000 7f2faf7fe640 1 -- 172.21.15.70:0/3457678559 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f2fb80d6050 con 0x7f2fc01082a0 2024-09-12T01:50:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.202+0000 7f2fbe59c640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2fa80a2c10 0x7f2fa80a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000bca0 tx=0x7f2fb000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.203+0000 7f2fbdd9b640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437] conn(0x7f2fa80ac840 0x7f2fa80aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.203+0000 7f2fbdd9b640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437] conn(0x7f2fa80ac840 0x7f2fa80aece0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.204+0000 7f2faf7fe640 1 -- 172.21.15.70:0/3457678559 <== osd.10 v2:172.21.15.152:6824/3382303437 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2fa80af3b0 con 0x7f2fa80ac840 2024-09-12T01:50:52.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.219+0000 7f2fc4e15640 1 -- 172.21.15.70:0/3457678559 --> [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2fc0062e00 con 0x7f2fa80ac840 2024-09-12T01:50:52.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.219+0000 7f2faf7fe640 1 -- 172.21.15.70:0/3457678559 <== osd.10 v2:172.21.15.152:6824/3382303437 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2fc0062e00 con 0x7f2fa80ac840 2024-09-12T01:50:52.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.220+0000 7f2fc4e15640 1 -- 172.21.15.70:0/3457678559 >> [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437] conn(0x7f2fa80ac840 msgr2=0x7f2fa80aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:52.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.220+0000 7f2fc4e15640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437] conn(0x7f2fa80ac840 0x7f2fa80aece0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:52.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.220+0000 7f2fc4e15640 1 -- 172.21.15.70:0/3457678559 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2fa80a2c10 msgr2=0x7f2fa80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:52.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.220+0000 7f2fc4e15640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2fa80a2c10 0x7f2fa80a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000bca0 tx=0x7f2fb000b410 comp rx=0 tx=0).stop 2024-09-12T01:50:52.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.220+0000 7f2fc4e15640 1 -- 172.21.15.70:0/3457678559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fc01082a0 msgr2=0x7f2fc019cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:52.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.220+0000 7f2fc4e15640 1 --2- 172.21.15.70:0/3457678559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fc01082a0 0x7f2fc019cf70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800e940 tx=0x7f2fb800ee00 comp rx=0 tx=0).stop 2024-09-12T01:50:52.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.220+0000 7f2fbed9d640 1 -- 172.21.15.70:0/3457678559 reap_dead start 2024-09-12T01:50:52.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.220+0000 7f2fc4e15640 1 -- 172.21.15.70:0/3457678559 shutdown_connections 2024-09-12T01:50:52.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.220+0000 7f2fc4e15640 1 -- 172.21.15.70:0/3457678559 >> 172.21.15.70:0/3457678559 conn(0x7f2fc00fc7d0 msgr2=0x7f2fc0105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:52.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.221+0000 7f2fc4e15640 1 -- 172.21.15.70:0/3457678559 shutdown_connections 2024-09-12T01:50:52.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:52.221+0000 7f2fc4e15640 1 -- 172.21.15.70:0/3457678559 wait complete. 2024-09-12T01:50:52.476 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:52.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:52 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:52.913 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:52 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:52.914 INFO:teuthology.orchestra.run.smithi070.stdout:240518168612 2024-09-12T01:50:52.914 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T01:50:52.915 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:52 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:53.349 INFO:teuthology.orchestra.run.smithi070.stdout:292057776156 2024-09-12T01:50:53.349 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T01:50:53.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.846+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/3561702747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d58101df0 msgr2=0x7f1d581021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:53.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.846+0000 7f1d5ddb6640 1 --2- 172.21.15.70:0/3561702747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d58101df0 0x7f1d581021d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009900 tx=0x7f1d4802a410 comp rx=0 tx=0).stop 2024-09-12T01:50:53.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.846+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/3561702747 shutdown_connections 2024-09-12T01:50:53.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.846+0000 7f1d5ddb6640 1 --2- 172.21.15.70:0/3561702747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d58106f20 0x7f1d5810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:53.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.846+0000 7f1d5ddb6640 1 --2- 172.21.15.70:0/3561702747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1d581027a0 0x7f1d581067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:53.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.846+0000 7f1d5ddb6640 1 --2- 172.21.15.70:0/3561702747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d58101df0 0x7f1d581021d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.846+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/3561702747 >> 172.21.15.70:0/3561702747 conn(0x7f1d580fd8b0 msgr2=0x7f1d580ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.846+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/3561702747 shutdown_connections 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.846+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/3561702747 wait complete. 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.846+0000 7f1d5ddb6640 1 Processor -- start 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d5ddb6640 1 -- start start 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d5ddb6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d58101df0 0x7f1d58198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d5ddb6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1d581027a0 0x7f1d58198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d5ddb6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d58106f20 0x7f1d5819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d5ddb6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d581120a0 con 0x7f1d58101df0 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d5ddb6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1d58111f20 con 0x7f1d58106f20 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d5ddb6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1d58112220 con 0x7f1d581027a0 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d58101df0 0x7f1d58198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:53.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d58101df0 0x7f1d58198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35870/0 (socket says 172.21.15.70:35870) 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d577fe640 1 -- 172.21.15.70:0/2734076587 learned_addr learned my addr 172.21.15.70:0/2734076587 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d57fff640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d58106f20 0x7f1d5819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d4ffff640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1d581027a0 0x7f1d58198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d577fe640 1 -- 172.21.15.70:0/2734076587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1d581027a0 msgr2=0x7f1d58198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d577fe640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1d581027a0 0x7f1d58198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d577fe640 1 -- 172.21.15.70:0/2734076587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d58106f20 msgr2=0x7f1d5819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d577fe640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d58106f20 0x7f1d5819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d577fe640 1 -- 172.21.15.70:0/2734076587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5819d4b0 con 0x7f1d58101df0 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d577fe640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d58101df0 0x7f1d58198500 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1d48006010 tx=0x7f1d480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d557fa640 1 -- 172.21.15.70:0/2734076587 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4803f030 con 0x7f1d58101df0 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.847+0000 7f1d557fa640 1 -- 172.21.15.70:0/2734076587 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d48003d00 con 0x7f1d58101df0 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.848+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/2734076587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5819d740 con 0x7f1d58101df0 2024-09-12T01:50:53.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.848+0000 7f1d557fa640 1 -- 172.21.15.70:0/2734076587 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48035070 con 0x7f1d58101df0 2024-09-12T01:50:53.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.848+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/2734076587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d581a5080 con 0x7f1d58101df0 2024-09-12T01:50:53.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.848+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/2734076587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d581032d0 con 0x7f1d58101df0 2024-09-12T01:50:53.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.850+0000 7f1d557fa640 1 -- 172.21.15.70:0/2734076587 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1d48042030 con 0x7f1d58101df0 2024-09-12T01:50:53.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.850+0000 7f1d557fa640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1d440a2c10 0x7f1d440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:53.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.850+0000 7f1d4ffff640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1d440a2c10 0x7f1d440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:53.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.851+0000 7f1d557fa640 1 -- 172.21.15.70:0/2734076587 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1d480efa70 con 0x7f1d58101df0 2024-09-12T01:50:53.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.851+0000 7f1d4ffff640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1d440a2c10 0x7f1d440a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1d40005fd0 tx=0x7f1d40005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:53.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:53.854+0000 7f1d557fa640 1 -- 172.21.15.70:0/2734076587 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d480bc930 con 0x7f1d58101df0 2024-09-12T01:50:53.883 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:54.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.037+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/2734076587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1d5810a100 con 0x7f1d58101df0 2024-09-12T01:50:54.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.038+0000 7f1d557fa640 1 -- 172.21.15.70:0/2734076587 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1d480bc230 con 0x7f1d58101df0 2024-09-12T01:50:54.038 INFO:teuthology.orchestra.run.smithi070.stdout:107374182463 2024-09-12T01:50:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.040+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/2734076587 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1d440a2c10 msgr2=0x7f1d440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.040+0000 7f1d5ddb6640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1d440a2c10 0x7f1d440a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1d40005fd0 tx=0x7f1d40005850 comp rx=0 tx=0).stop 2024-09-12T01:50:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.040+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/2734076587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d58101df0 msgr2=0x7f1d58198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.040+0000 7f1d5ddb6640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d58101df0 0x7f1d58198500 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1d48006010 tx=0x7f1d480042f0 comp rx=0 tx=0).stop 2024-09-12T01:50:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.040+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/2734076587 shutdown_connections 2024-09-12T01:50:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.040+0000 7f1d5ddb6640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f1d440a2c10 0x7f1d440a50d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.040+0000 7f1d5ddb6640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d58106f20 0x7f1d5819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.040+0000 7f1d5ddb6640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1d581027a0 0x7f1d58198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.040+0000 7f1d5ddb6640 1 --2- 172.21.15.70:0/2734076587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d58101df0 0x7f1d58198500 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.040+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/2734076587 >> 172.21.15.70:0/2734076587 conn(0x7f1d580fd8b0 msgr2=0x7f1d580feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.040+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/2734076587 shutdown_connections 2024-09-12T01:50:54.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:54.040+0000 7f1d5ddb6640 1 -- 172.21.15.70:0/2734076587 wait complete. 2024-09-12T01:50:54.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:54 smithi191 ceph-mon[35770]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-12T01:50:54.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:54 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:50:54.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:54 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:50:54.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:54 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:50:54.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:54 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:50:54.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:54 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2734076587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:50:54.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:54 smithi070 ceph-mon[31177]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-12T01:50:54.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:54 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:50:54.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:54 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:50:54.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:54 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:50:54.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:54 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:50:54.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:54 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2734076587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:50:54.985 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182460 got 107374182463 for osd.3 2024-09-12T01:50:54.985 DEBUG:teuthology.parallel:result is None 2024-09-12T01:50:55.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:54 smithi152 ceph-mon[35055]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-12T01:50:55.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:54 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:50:55.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:54 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:50:55.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:54 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:50:55.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:54 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:50:55.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:54 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2734076587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:50:55.041 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:55.044 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:55.044 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:55.046 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:50:55.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.342+0000 7fe8ca68d640 1 -- 172.21.15.70:0/55990032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c4100a80 msgr2=0x7fe8c4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:55.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.342+0000 7fe8ca68d640 1 --2- 172.21.15.70:0/55990032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c4100a80 0x7fe8c4100ee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009930 tx=0x7fe8b802a420 comp rx=0 tx=0).stop 2024-09-12T01:50:55.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.342+0000 7fe8ca68d640 1 -- 172.21.15.70:0/55990032 shutdown_connections 2024-09-12T01:50:55.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.342+0000 7fe8ca68d640 1 --2- 172.21.15.70:0/55990032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8c4101420 0x7fe8c410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.342+0000 7fe8ca68d640 1 --2- 172.21.15.70:0/55990032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c4100a80 0x7fe8c4100ee0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.342+0000 7fe8ca68d640 1 --2- 172.21.15.70:0/55990032 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8c4106a80 0x7fe8c4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.342+0000 7fe8ca68d640 1 -- 172.21.15.70:0/55990032 >> 172.21.15.70:0/55990032 conn(0x7fe8c40fc7a0 msgr2=0x7fe8c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.342+0000 7fe8ca68d640 1 -- 172.21.15.70:0/55990032 shutdown_connections 2024-09-12T01:50:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.342+0000 7fe8ca68d640 1 -- 172.21.15.70:0/55990032 wait complete. 2024-09-12T01:50:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.343+0000 7fe8ca68d640 1 Processor -- start 2024-09-12T01:50:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.343+0000 7fe8ca68d640 1 -- start start 2024-09-12T01:50:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.343+0000 7fe8ca68d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c4100a80 0x7fe8c41973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.343+0000 7fe8ca68d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8c4101420 0x7fe8c4197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.343+0000 7fe8ca68d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8c4106a80 0x7fe8c419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.343+0000 7fe8ca68d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c4110fa0 con 0x7fe8c4100a80 2024-09-12T01:50:55.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.343+0000 7fe8ca68d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c4110e20 con 0x7fe8c4106a80 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.343+0000 7fe8ca68d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c4111120 con 0x7fe8c4101420 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c4100a80 0x7fe8c41973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c4100a80 0x7fe8c41973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35888/0 (socket says 172.21.15.70:35888) 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c3fff640 1 -- 172.21.15.70:0/2987243407 learned_addr learned my addr 172.21.15.70:0/2987243407 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c8c2a640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8c4106a80 0x7fe8c419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c37fe640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8c4101420 0x7fe8c4197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c3fff640 1 -- 172.21.15.70:0/2987243407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8c4101420 msgr2=0x7fe8c4197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c3fff640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8c4101420 0x7fe8c4197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c3fff640 1 -- 172.21.15.70:0/2987243407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8c4106a80 msgr2=0x7fe8c419bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c3fff640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8c4106a80 0x7fe8c419bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c3fff640 1 -- 172.21.15.70:0/2987243407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c419c3a0 con 0x7fe8c4100a80 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c37fe640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8c4101420 0x7fe8c4197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:55.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c3fff640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c4100a80 0x7fe8c41973f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400c970 tx=0x7fe8b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:55.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c17fa640 1 -- 172.21.15.70:0/2987243407 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4007bb0 con 0x7fe8c4100a80 2024-09-12T01:50:55.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c17fa640 1 -- 172.21.15.70:0/2987243407 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8b4007d50 con 0x7fe8c4100a80 2024-09-12T01:50:55.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8ca68d640 1 -- 172.21.15.70:0/2987243407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c419c690 con 0x7fe8c4100a80 2024-09-12T01:50:55.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8c17fa640 1 -- 172.21.15.70:0/2987243407 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400f4b0 con 0x7fe8c4100a80 2024-09-12T01:50:55.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.344+0000 7fe8ca68d640 1 -- 172.21.15.70:0/2987243407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c41a3f70 con 0x7fe8c4100a80 2024-09-12T01:50:55.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.345+0000 7fe8ca68d640 1 -- 172.21.15.70:0/2987243407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c4100ee0 con 0x7fe8c4100a80 2024-09-12T01:50:55.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.346+0000 7fe8c17fa640 1 -- 172.21.15.70:0/2987243407 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe8b40046c0 con 0x7fe8c4100a80 2024-09-12T01:50:55.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.347+0000 7fe8c17fa640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fe8ac0a2c10 0x7fe8ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:55.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.348+0000 7fe8c37fe640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fe8ac0a2c10 0x7fe8ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:55.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.348+0000 7fe8c17fa640 1 -- 172.21.15.70:0/2987243407 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe8b40cf350 con 0x7fe8c4100a80 2024-09-12T01:50:55.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.348+0000 7fe8c37fe640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fe8ac0a2c10 0x7fe8ac0a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8000c00 tx=0x7fe8b8032d60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:55.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.351+0000 7fe8c17fa640 1 -- 172.21.15.70:0/2987243407 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe8b4014030 con 0x7fe8c4100a80 2024-09-12T01:50:55.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.527+0000 7fe8ca68d640 1 -- 172.21.15.70:0/2987243407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fe8c4198750 con 0x7fe8c4100a80 2024-09-12T01:50:55.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.527+0000 7fe8c17fa640 1 -- 172.21.15.70:0/2987243407 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe8b409c110 con 0x7fe8c4100a80 2024-09-12T01:50:55.528 INFO:teuthology.orchestra.run.smithi070.stdout:270582939682 2024-09-12T01:50:55.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.529+0000 7fe8ca68d640 1 -- 172.21.15.70:0/2987243407 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fe8ac0a2c10 msgr2=0x7fe8ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:55.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.530+0000 7fe8ca68d640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fe8ac0a2c10 0x7fe8ac0a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8000c00 tx=0x7fe8b8032d60 comp rx=0 tx=0).stop 2024-09-12T01:50:55.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.530+0000 7fe8ca68d640 1 -- 172.21.15.70:0/2987243407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c4100a80 msgr2=0x7fe8c41973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:55.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.530+0000 7fe8ca68d640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c4100a80 0x7fe8c41973f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400c970 tx=0x7fe8b400ce30 comp rx=0 tx=0).stop 2024-09-12T01:50:55.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.530+0000 7fe8ca68d640 1 -- 172.21.15.70:0/2987243407 shutdown_connections 2024-09-12T01:50:55.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.530+0000 7fe8ca68d640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fe8ac0a2c10 0x7fe8ac0a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:55.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.530+0000 7fe8ca68d640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8c4106a80 0x7fe8c419bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:55.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.530+0000 7fe8ca68d640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8c4101420 0x7fe8c4197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:55.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.530+0000 7fe8ca68d640 1 --2- 172.21.15.70:0/2987243407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c4100a80 0x7fe8c41973f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:55.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.530+0000 7fe8ca68d640 1 -- 172.21.15.70:0/2987243407 >> 172.21.15.70:0/2987243407 conn(0x7fe8c40fc7a0 msgr2=0x7fe8c40fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:55.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.530+0000 7fe8ca68d640 1 -- 172.21.15.70:0/2987243407 shutdown_connections 2024-09-12T01:50:55.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:55.530+0000 7fe8ca68d640 1 -- 172.21.15.70:0/2987243407 wait complete. 2024-09-12T01:50:55.866 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:55 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2987243407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T01:50:55.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:55 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2987243407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T01:50:56.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:55 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2987243407' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T01:50:56.188 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939680 got 270582939682 for osd.9 2024-09-12T01:50:56.188 DEBUG:teuthology.parallel:result is None 2024-09-12T01:50:56.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.359+0000 7f138fc1b640 1 -- 172.21.15.70:0/3540269524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388100e30 msgr2=0x7f1388104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:56.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.359+0000 7f138fc1b640 1 --2- 172.21.15.70:0/3540269524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388100e30 0x7f1388104e80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1384009900 tx=0x7f138402a410 comp rx=0 tx=0).stop 2024-09-12T01:50:56.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.359+0000 7f138fc1b640 1 -- 172.21.15.70:0/3540269524 shutdown_connections 2024-09-12T01:50:56.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.359+0000 7f138fc1b640 1 --2- 172.21.15.70:0/3540269524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13881055b0 0x7f138810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:56.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.359+0000 7f138fc1b640 1 --2- 172.21.15.70:0/3540269524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388100e30 0x7f1388104e80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:56.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.359+0000 7f138fc1b640 1 --2- 172.21.15.70:0/3540269524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1388100480 0x7f1388100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:56.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.359+0000 7f138fc1b640 1 -- 172.21.15.70:0/3540269524 >> 172.21.15.70:0/3540269524 conn(0x7f1388077210 msgr2=0x7f13880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:56.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.359+0000 7f138fc1b640 1 -- 172.21.15.70:0/3540269524 shutdown_connections 2024-09-12T01:50:56.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.359+0000 7f138fc1b640 1 -- 172.21.15.70:0/3540269524 wait complete. 2024-09-12T01:50:56.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.360+0000 7f138fc1b640 1 Processor -- start 2024-09-12T01:50:56.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.360+0000 7f138fc1b640 1 -- start start 2024-09-12T01:50:56.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.360+0000 7f138fc1b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1388100480 0x7f13881970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:56.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.360+0000 7f138fc1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388100e30 0x7f1388197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:56.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.360+0000 7f138fc1b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13881055b0 0x7f1388197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:56.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.360+0000 7f138fc1b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13881106f0 con 0x7f1388100e30 2024-09-12T01:50:56.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.360+0000 7f138fc1b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1388110570 con 0x7f13881055b0 2024-09-12T01:50:56.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.360+0000 7f138fc1b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1388110870 con 0x7f1388100480 2024-09-12T01:50:56.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138d1b6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388100e30 0x7f1388197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:56.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138d1b6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388100e30 0x7f1388197600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35898/0 (socket says 172.21.15.70:35898) 2024-09-12T01:50:56.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138d1b6640 1 -- 172.21.15.70:0/4004855937 learned_addr learned my addr 172.21.15.70:0/4004855937 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:56.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138e1b8640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13881055b0 0x7f1388197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:56.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138d9b7640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1388100480 0x7f13881970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:56.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138d1b6640 1 -- 172.21.15.70:0/4004855937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1388100480 msgr2=0x7f13881970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:56.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138d1b6640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1388100480 0x7f13881970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:56.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138d1b6640 1 -- 172.21.15.70:0/4004855937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13881055b0 msgr2=0x7f1388197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:56.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138d1b6640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13881055b0 0x7f1388197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:56.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138d1b6640 1 -- 172.21.15.70:0/4004855937 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13881a6930 con 0x7f1388100e30 2024-09-12T01:50:56.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138d1b6640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388100e30 0x7f1388197600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1384006010 tx=0x7f13840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:56.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f137effd640 1 -- 172.21.15.70:0/4004855937 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138403f030 con 0x7f1388100e30 2024-09-12T01:50:56.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f137effd640 1 -- 172.21.15.70:0/4004855937 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1384003d00 con 0x7f1388100e30 2024-09-12T01:50:56.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138fc1b640 1 -- 172.21.15.70:0/4004855937 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13881a6bc0 con 0x7f1388100e30 2024-09-12T01:50:56.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f137effd640 1 -- 172.21.15.70:0/4004855937 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384035070 con 0x7f1388100e30 2024-09-12T01:50:56.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.361+0000 7f138fc1b640 1 -- 172.21.15.70:0/4004855937 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13881a70f0 con 0x7f1388100e30 2024-09-12T01:50:56.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.362+0000 7f138fc1b640 1 -- 172.21.15.70:0/4004855937 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1388100860 con 0x7f1388100e30 2024-09-12T01:50:56.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.364+0000 7f137effd640 1 -- 172.21.15.70:0/4004855937 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1384042030 con 0x7f1388100e30 2024-09-12T01:50:56.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.364+0000 7f137effd640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f13740a2c90 0x7f13740a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:56.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.364+0000 7f138d9b7640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f13740a2c90 0x7f13740a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:56.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.364+0000 7f137effd640 1 -- 172.21.15.70:0/4004855937 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f13840ef370 con 0x7f1388100e30 2024-09-12T01:50:56.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.365+0000 7f138d9b7640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f13740a2c90 0x7f13740a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f137800abe0 tx=0x7f137800a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:56.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.368+0000 7f137effd640 1 -- 172.21.15.70:0/4004855937 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13840bc170 con 0x7f1388100e30 2024-09-12T01:50:56.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.553+0000 7f138fc1b640 1 -- 172.21.15.70:0/4004855937 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f13881a7460 con 0x7f1388100e30 2024-09-12T01:50:56.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.553+0000 7f137effd640 1 -- 172.21.15.70:0/4004855937 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13840bba70 con 0x7f1388100e30 2024-09-12T01:50:56.553 INFO:teuthology.orchestra.run.smithi070.stdout:77309411396 2024-09-12T01:50:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.555+0000 7f138fc1b640 1 -- 172.21.15.70:0/4004855937 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f13740a2c90 msgr2=0x7f13740a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.555+0000 7f138fc1b640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f13740a2c90 0x7f13740a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f137800abe0 tx=0x7f137800a2d0 comp rx=0 tx=0).stop 2024-09-12T01:50:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.555+0000 7f138fc1b640 1 -- 172.21.15.70:0/4004855937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388100e30 msgr2=0x7f1388197600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.555+0000 7f138fc1b640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388100e30 0x7f1388197600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1384006010 tx=0x7f13840042f0 comp rx=0 tx=0).stop 2024-09-12T01:50:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.555+0000 7f138fc1b640 1 -- 172.21.15.70:0/4004855937 shutdown_connections 2024-09-12T01:50:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.555+0000 7f138fc1b640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f13740a2c90 0x7f13740a5150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.555+0000 7f138fc1b640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13881055b0 0x7f1388197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.555+0000 7f138fc1b640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1388100e30 0x7f1388197600 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.555+0000 7f138fc1b640 1 --2- 172.21.15.70:0/4004855937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1388100480 0x7f13881970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.555+0000 7f138fc1b640 1 -- 172.21.15.70:0/4004855937 >> 172.21.15.70:0/4004855937 conn(0x7f1388077210 msgr2=0x7f1388103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.555+0000 7f138fc1b640 1 -- 172.21.15.70:0/4004855937 shutdown_connections 2024-09-12T01:50:56.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:56.555+0000 7f138fc1b640 1 -- 172.21.15.70:0/4004855937 wait complete. 2024-09-12T01:50:56.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:56 smithi070 ceph-mon[31177]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-12T01:50:56.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:56 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/4004855937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:50:56.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:56 smithi191 ceph-mon[35770]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-12T01:50:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:56 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/4004855937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:50:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:56 smithi152 ceph-mon[35055]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-12T01:50:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:56 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/4004855937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:50:57.145 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411394 got 77309411396 for osd.2 2024-09-12T01:50:57.145 DEBUG:teuthology.parallel:result is None 2024-09-12T01:50:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.527+0000 7f7c89ce7640 1 -- 172.21.15.70:0/3112737479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c84101dd0 msgr2=0x7f7c841021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.527+0000 7f7c89ce7640 1 --2- 172.21.15.70:0/3112737479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c84101dd0 0x7f7c841021b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009900 tx=0x7f7c7402a410 comp rx=0 tx=0).stop 2024-09-12T01:50:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.527+0000 7f7c89ce7640 1 -- 172.21.15.70:0/3112737479 shutdown_connections 2024-09-12T01:50:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.527+0000 7f7c89ce7640 1 --2- 172.21.15.70:0/3112737479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c84106f00 0x7f7c8410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.527+0000 7f7c89ce7640 1 --2- 172.21.15.70:0/3112737479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c84102780 0x7f7c841067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.527+0000 7f7c89ce7640 1 --2- 172.21.15.70:0/3112737479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c84101dd0 0x7f7c841021b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.527+0000 7f7c89ce7640 1 -- 172.21.15.70:0/3112737479 >> 172.21.15.70:0/3112737479 conn(0x7f7c840fd8b0 msgr2=0x7f7c840ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.527+0000 7f7c89ce7640 1 -- 172.21.15.70:0/3112737479 shutdown_connections 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.527+0000 7f7c89ce7640 1 -- 172.21.15.70:0/3112737479 wait complete. 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c89ce7640 1 Processor -- start 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c89ce7640 1 -- start start 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c89ce7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c84101dd0 0x7f7c840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c89ce7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c84102780 0x7f7c84074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c89ce7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c84106f00 0x7f7c84074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c89ce7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7c84112080 con 0x7f7c84101dd0 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c89ce7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7c84111f00 con 0x7f7c84102780 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c89ce7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7c84112200 con 0x7f7c84106f00 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c84101dd0 0x7f7c840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c84101dd0 0x7f7c840744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35946/0 (socket says 172.21.15.70:35946) 2024-09-12T01:50:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c837fe640 1 -- 172.21.15.70:0/418154896 learned_addr learned my addr 172.21.15.70:0/418154896 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c83fff640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c84106f00 0x7f7c84074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.528+0000 7f7c82ffd640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c84102780 0x7f7c84074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.529+0000 7f7c837fe640 1 -- 172.21.15.70:0/418154896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c84106f00 msgr2=0x7f7c84074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.529+0000 7f7c837fe640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c84106f00 0x7f7c84074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.529+0000 7f7c837fe640 1 -- 172.21.15.70:0/418154896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c84102780 msgr2=0x7f7c84074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.529+0000 7f7c837fe640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c84102780 0x7f7c84074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.529+0000 7f7c837fe640 1 -- 172.21.15.70:0/418154896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c841a6a60 con 0x7f7c84101dd0 2024-09-12T01:50:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.529+0000 7f7c83fff640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c84106f00 0x7f7c84074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.529+0000 7f7c837fe640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c84101dd0 0x7f7c840744f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7c74006010 tx=0x7f7c740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.529+0000 7f7c80ff9640 1 -- 172.21.15.70:0/418154896 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7403f030 con 0x7f7c84101dd0 2024-09-12T01:50:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.529+0000 7f7c89ce7640 1 -- 172.21.15.70:0/418154896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c841a6cf0 con 0x7f7c84101dd0 2024-09-12T01:50:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.529+0000 7f7c80ff9640 1 -- 172.21.15.70:0/418154896 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c74003d00 con 0x7f7c84101dd0 2024-09-12T01:50:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.529+0000 7f7c80ff9640 1 -- 172.21.15.70:0/418154896 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c74035070 con 0x7f7c84101dd0 2024-09-12T01:50:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.529+0000 7f7c89ce7640 1 -- 172.21.15.70:0/418154896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c841a7180 con 0x7f7c84101dd0 2024-09-12T01:50:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.530+0000 7f7c89ce7640 1 -- 172.21.15.70:0/418154896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c841021b0 con 0x7f7c84101dd0 2024-09-12T01:50:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.532+0000 7f7c80ff9640 1 -- 172.21.15.70:0/418154896 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7c74042030 con 0x7f7c84101dd0 2024-09-12T01:50:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.532+0000 7f7c80ff9640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7c6c0a2c10 0x7f7c6c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.533+0000 7f7c82ffd640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7c6c0a2c10 0x7f7c6c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.533+0000 7f7c80ff9640 1 -- 172.21.15.70:0/418154896 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7c740ef7b0 con 0x7f7c84101dd0 2024-09-12T01:50:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.533+0000 7f7c82ffd640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7c6c0a2c10 0x7f7c6c0a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c78005fd0 tx=0x7f7c78005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:57.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.537+0000 7f7c80ff9640 1 -- 172.21.15.70:0/418154896 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c740bc670 con 0x7f7c84101dd0 2024-09-12T01:50:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.722+0000 7f7c89ce7640 1 -- 172.21.15.70:0/418154896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7c8410a0e0 con 0x7f7c84101dd0 2024-09-12T01:50:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.723+0000 7f7c80ff9640 1 -- 172.21.15.70:0/418154896 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7c740bbf70 con 0x7f7c84101dd0 2024-09-12T01:50:57.723 INFO:teuthology.orchestra.run.smithi070.stdout:137438953531 2024-09-12T01:50:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.725+0000 7f7c89ce7640 1 -- 172.21.15.70:0/418154896 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7c6c0a2c10 msgr2=0x7f7c6c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.725+0000 7f7c89ce7640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7c6c0a2c10 0x7f7c6c0a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c78005fd0 tx=0x7f7c78005850 comp rx=0 tx=0).stop 2024-09-12T01:50:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.725+0000 7f7c89ce7640 1 -- 172.21.15.70:0/418154896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c84101dd0 msgr2=0x7f7c840744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.725+0000 7f7c89ce7640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c84101dd0 0x7f7c840744f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7c74006010 tx=0x7f7c740042f0 comp rx=0 tx=0).stop 2024-09-12T01:50:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.725+0000 7f7c89ce7640 1 -- 172.21.15.70:0/418154896 shutdown_connections 2024-09-12T01:50:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.725+0000 7f7c89ce7640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7c6c0a2c10 0x7f7c6c0a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.725+0000 7f7c89ce7640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c84106f00 0x7f7c84074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.725+0000 7f7c89ce7640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c84102780 0x7f7c84074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.725+0000 7f7c89ce7640 1 --2- 172.21.15.70:0/418154896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c84101dd0 0x7f7c840744f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.725+0000 7f7c89ce7640 1 -- 172.21.15.70:0/418154896 >> 172.21.15.70:0/418154896 conn(0x7f7c840fd8b0 msgr2=0x7f7c840fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.725+0000 7f7c89ce7640 1 -- 172.21.15.70:0/418154896 shutdown_connections 2024-09-12T01:50:57.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.725+0000 7f7c89ce7640 1 -- 172.21.15.70:0/418154896 wait complete. 2024-09-12T01:50:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.416+0000 7f43afb2a640 1 -- 172.21.15.70:0/4177751909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8102ef0 msgr2=0x7f43a810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.416+0000 7f43afb2a640 1 --2- 172.21.15.70:0/4177751909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8102ef0 0x7f43a810da40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4398009ca0 tx=0x7f439802a950 comp rx=0 tx=0).stop 2024-09-12T01:50:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.417+0000 7f43afb2a640 1 -- 172.21.15.70:0/4177751909 shutdown_connections 2024-09-12T01:50:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.417+0000 7f43afb2a640 1 --2- 172.21.15.70:0/4177751909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8102ef0 0x7f43a810da40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.417+0000 7f43afb2a640 1 --2- 172.21.15.70:0/4177751909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8102570 0x7f43a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.417+0000 7f43afb2a640 1 --2- 172.21.15.70:0/4177751909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43a8100e20 0x7f43a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.417+0000 7f43afb2a640 1 -- 172.21.15.70:0/4177751909 >> 172.21.15.70:0/4177751909 conn(0x7f43a80fc7d0 msgr2=0x7f43a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.417+0000 7f43afb2a640 1 -- 172.21.15.70:0/4177751909 shutdown_connections 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.417+0000 7f43afb2a640 1 -- 172.21.15.70:0/4177751909 wait complete. 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.417+0000 7f43afb2a640 1 Processor -- start 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.417+0000 7f43afb2a640 1 -- start start 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43afb2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100e20 0x7f43a80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43afb2a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43a8102570 0x7f43a80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43afb2a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8102ef0 0x7f43a80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43afb2a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81110e0 con 0x7f43a8100e20 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43afb2a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8110f60 con 0x7f43a8102ef0 2024-09-12T01:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43afb2a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8111260 con 0x7f43a8102570 2024-09-12T01:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43ad8c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100e20 0x7f43a80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43ad8c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100e20 0x7f43a80fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35924/0 (socket says 172.21.15.70:35924) 2024-09-12T01:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43ad8c6640 1 -- 172.21.15.70:0/2113218771 learned_addr learned my addr 172.21.15.70:0/2113218771 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43ad0c5640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43a8102570 0x7f43a80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43ae0c7640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8102ef0 0x7f43a80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43ad8c6640 1 -- 172.21.15.70:0/2113218771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43a8102570 msgr2=0x7f43a80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43ad8c6640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43a8102570 0x7f43a80fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43ad8c6640 1 -- 172.21.15.70:0/2113218771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8102ef0 msgr2=0x7f43a80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43ad8c6640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8102ef0 0x7f43a80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43ad8c6640 1 -- 172.21.15.70:0/2113218771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a81a6af0 con 0x7f43a8100e20 2024-09-12T01:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43ae0c7640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8102ef0 0x7f43a80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43ad8c6640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100e20 0x7f43a80fcc80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f43a000b4a0 tx=0x7f43a000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2113218771 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0014070 con 0x7f43a8100e20 2024-09-12T01:50:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2113218771 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f43a0010b10 con 0x7f43a8100e20 2024-09-12T01:50:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43afb2a640 1 -- 172.21.15.70:0/2113218771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a81a6de0 con 0x7f43a8100e20 2024-09-12T01:50:58.249 INFO:teuthology.orchestra.run.smithi070.stdout:193273528369 2024-09-12T01:50:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2113218771 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0017d60 con 0x7f43a8100e20 2024-09-12T01:50:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.418+0000 7f43afb2a640 1 -- 172.21.15.70:0/2113218771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a81a7240 con 0x7f43a8100e20 2024-09-12T01:50:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.419+0000 7f43afb2a640 1 -- 172.21.15.70:0/2113218771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a8101200 con 0x7f43a8100e20 2024-09-12T01:50:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.420+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2113218771 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f43a0017070 con 0x7f43a8100e20 2024-09-12T01:50:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.421+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f43900a2c10 0x7f43900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.421+0000 7f43ad0c5640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f43900a2c10 0x7f43900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.421+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2113218771 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f43a00ce490 con 0x7f43a8100e20 2024-09-12T01:50:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.422+0000 7f43ad0c5640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f43900a2c10 0x7f43900a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f43a80fe710 tx=0x7f439c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.426+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2113218771 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43a009b3a0 con 0x7f43a8100e20 2024-09-12T01:50:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.634+0000 7f43afb2a640 1 -- 172.21.15.70:0/2113218771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f43a810a0a0 con 0x7f43a8100e20 2024-09-12T01:50:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.634+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2113218771 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f43a009aca0 con 0x7f43a8100e20 2024-09-12T01:50:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.637+0000 7f43afb2a640 1 -- 172.21.15.70:0/2113218771 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f43900a2c10 msgr2=0x7f43900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.637+0000 7f43afb2a640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f43900a2c10 0x7f43900a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f43a80fe710 tx=0x7f439c00b390 comp rx=0 tx=0).stop 2024-09-12T01:50:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.637+0000 7f43afb2a640 1 -- 172.21.15.70:0/2113218771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100e20 msgr2=0x7f43a80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.637+0000 7f43afb2a640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100e20 0x7f43a80fcc80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f43a000b4a0 tx=0x7f43a000b960 comp rx=0 tx=0).stop 2024-09-12T01:50:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.637+0000 7f43afb2a640 1 -- 172.21.15.70:0/2113218771 shutdown_connections 2024-09-12T01:50:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.637+0000 7f43afb2a640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f43900a2c10 0x7f43900a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.637+0000 7f43afb2a640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43a8102ef0 0x7f43a80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.637+0000 7f43afb2a640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f43a8102570 0x7f43a80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.637+0000 7f43afb2a640 1 --2- 172.21.15.70:0/2113218771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100e20 0x7f43a80fcc80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.637+0000 7f43afb2a640 1 -- 172.21.15.70:0/2113218771 >> 172.21.15.70:0/2113218771 conn(0x7f43a80fc7d0 msgr2=0x7f43a806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.637+0000 7f43afb2a640 1 -- 172.21.15.70:0/2113218771 shutdown_connections 2024-09-12T01:50:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:57.637+0000 7f43afb2a640 1 -- 172.21.15.70:0/2113218771 wait complete. 2024-09-12T01:50:58.900 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:58 smithi070 ceph-mon[31177]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T01:50:58.900 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:58 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2113218771' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T01:50:58.901 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:58 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/418154896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:50:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.900+0000 7fdf9da6e640 1 -- 172.21.15.70:0/3867582836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf98100d00 msgr2=0x7fdf98106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.900+0000 7fdf9da6e640 1 --2- 172.21.15.70:0/3867582836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf98100d00 0x7fdf98106840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009930 tx=0x7fdf8002a420 comp rx=0 tx=0).stop 2024-09-12T01:50:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.900+0000 7fdf9da6e640 1 -- 172.21.15.70:0/3867582836 shutdown_connections 2024-09-12T01:50:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.900+0000 7fdf9da6e640 1 --2- 172.21.15.70:0/3867582836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98106f50 0x7fdf9810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.900+0000 7fdf9da6e640 1 --2- 172.21.15.70:0/3867582836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf98100d00 0x7fdf98106840 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.900+0000 7fdf9da6e640 1 --2- 172.21.15.70:0/3867582836 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf98100350 0x7fdf98100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.900+0000 7fdf9da6e640 1 -- 172.21.15.70:0/3867582836 >> 172.21.15.70:0/3867582836 conn(0x7fdf98077210 msgr2=0x7fdf980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.900+0000 7fdf9da6e640 1 -- 172.21.15.70:0/3867582836 shutdown_connections 2024-09-12T01:50:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.900+0000 7fdf9da6e640 1 -- 172.21.15.70:0/3867582836 wait complete. 2024-09-12T01:50:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.901+0000 7fdf9da6e640 1 Processor -- start 2024-09-12T01:50:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.901+0000 7fdf9da6e640 1 -- start start 2024-09-12T01:50:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.901+0000 7fdf9da6e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf98100350 0x7fdf98198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.901+0000 7fdf9da6e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf98100d00 0x7fdf98198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.901+0000 7fdf9da6e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98106f50 0x7fdf9819cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.901+0000 7fdf9da6e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdf981121a0 con 0x7fdf98100350 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.901+0000 7fdf9da6e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98112020 con 0x7fdf98106f50 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.901+0000 7fdf9da6e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98112320 con 0x7fdf98100d00 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.901+0000 7fdf977fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf98100350 0x7fdf98198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf977fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf98100350 0x7fdf98198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35976/0 (socket says 172.21.15.70:35976) 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf977fe640 1 -- 172.21.15.70:0/4112616180 learned_addr learned my addr 172.21.15.70:0/4112616180 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf8ffff640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf98100d00 0x7fdf98198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf97fff640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98106f50 0x7fdf9819cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf977fe640 1 -- 172.21.15.70:0/4112616180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf98100d00 msgr2=0x7fdf98198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf977fe640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf98100d00 0x7fdf98198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf977fe640 1 -- 172.21.15.70:0/4112616180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98106f50 msgr2=0x7fdf9819cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf977fe640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98106f50 0x7fdf9819cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf977fe640 1 -- 172.21.15.70:0/4112616180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9819d6b0 con 0x7fdf98100350 2024-09-12T01:50:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf97fff640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98106f50 0x7fdf9819cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:50:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf977fe640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf98100350 0x7fdf98198700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800b4a0 tx=0x7fdf8800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf957fa640 1 -- 172.21.15.70:0/4112616180 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88014070 con 0x7fdf98100350 2024-09-12T01:50:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf957fa640 1 -- 172.21.15.70:0/4112616180 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdf88010b10 con 0x7fdf98100350 2024-09-12T01:50:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf9da6e640 1 -- 172.21.15.70:0/4112616180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9819d9a0 con 0x7fdf98100350 2024-09-12T01:50:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf957fa640 1 -- 172.21.15.70:0/4112616180 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88017d60 con 0x7fdf98100350 2024-09-12T01:50:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.902+0000 7fdf9da6e640 1 -- 172.21.15.70:0/4112616180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf98101200 con 0x7fdf98100350 2024-09-12T01:50:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.903+0000 7fdf9da6e640 1 -- 172.21.15.70:0/4112616180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf981007b0 con 0x7fdf98100350 2024-09-12T01:50:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.905+0000 7fdf957fa640 1 -- 172.21.15.70:0/4112616180 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdf88017070 con 0x7fdf98100350 2024-09-12T01:50:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.905+0000 7fdf957fa640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdf840a2c10 0x7fdf840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.906+0000 7fdf8ffff640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdf840a2c10 0x7fdf840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.906+0000 7fdf957fa640 1 -- 172.21.15.70:0/4112616180 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fdf880ce580 con 0x7fdf98100350 2024-09-12T01:50:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.906+0000 7fdf8ffff640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdf840a2c10 0x7fdf840a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdf80006010 tx=0x7fdf80000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:58.910+0000 7fdf957fa640 1 -- 172.21.15.70:0/4112616180 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf8809b490 con 0x7fdf98100350 2024-09-12T01:50:58.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:58 smithi191 ceph-mon[35770]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T01:50:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:58 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2113218771' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T01:50:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:58 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/418154896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:50:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:58 smithi152 ceph-mon[35055]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T01:50:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:58 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2113218771' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T01:50:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:58 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/418154896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:50:59.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.087+0000 7fdf9da6e640 1 -- 172.21.15.70:0/4112616180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fdf98199a60 con 0x7fdf98100350 2024-09-12T01:50:59.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.087+0000 7fdf957fa640 1 -- 172.21.15.70:0/4112616180 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fdf8809ad90 con 0x7fdf98100350 2024-09-12T01:50:59.087 INFO:teuthology.orchestra.run.smithi070.stdout:322122547225 2024-09-12T01:50:59.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.089+0000 7fdf9da6e640 1 -- 172.21.15.70:0/4112616180 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdf840a2c10 msgr2=0x7fdf840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:59.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.089+0000 7fdf9da6e640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdf840a2c10 0x7fdf840a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdf80006010 tx=0x7fdf80000bc0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.089+0000 7fdf9da6e640 1 -- 172.21.15.70:0/4112616180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf98100350 msgr2=0x7fdf98198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:59.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.089+0000 7fdf9da6e640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf98100350 0x7fdf98198700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800b4a0 tx=0x7fdf8800b960 comp rx=0 tx=0).stop 2024-09-12T01:50:59.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.089+0000 7fdf9da6e640 1 -- 172.21.15.70:0/4112616180 shutdown_connections 2024-09-12T01:50:59.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.089+0000 7fdf9da6e640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdf840a2c10 0x7fdf840a50d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.089+0000 7fdf9da6e640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf98106f50 0x7fdf9819cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.089+0000 7fdf9da6e640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf98100d00 0x7fdf98198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.089+0000 7fdf9da6e640 1 --2- 172.21.15.70:0/4112616180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf98100350 0x7fdf98198700 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.089+0000 7fdf9da6e640 1 -- 172.21.15.70:0/4112616180 >> 172.21.15.70:0/4112616180 conn(0x7fdf98077210 msgr2=0x7fdf981052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:59.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.089+0000 7fdf9da6e640 1 -- 172.21.15.70:0/4112616180 shutdown_connections 2024-09-12T01:50:59.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.089+0000 7fdf9da6e640 1 -- 172.21.15.70:0/4112616180 wait complete. 2024-09-12T01:50:59.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.103+0000 7fbb41e1f640 1 -- 172.21.15.70:0/3394114089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb3c105de0 msgr2=0x7fbb3c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.103+0000 7fbb41e1f640 1 --2- 172.21.15.70:0/3394114089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb3c105de0 0x7fbb3c10d960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009ca0 tx=0x7fbb3402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.103+0000 7fbb41e1f640 1 -- 172.21.15.70:0/3394114089 shutdown_connections 2024-09-12T01:50:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.103+0000 7fbb41e1f640 1 --2- 172.21.15.70:0/3394114089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb3c105de0 0x7fbb3c10d960 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.103+0000 7fbb41e1f640 1 --2- 172.21.15.70:0/3394114089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb3c101e20 0x7fbb3c1056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.103+0000 7fbb41e1f640 1 --2- 172.21.15.70:0/3394114089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb3c101470 0x7fbb3c101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.103+0000 7fbb41e1f640 1 -- 172.21.15.70:0/3394114089 >> 172.21.15.70:0/3394114089 conn(0x7fbb3c077230 msgr2=0x7fbb3c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.103+0000 7fbb41e1f640 1 -- 172.21.15.70:0/3394114089 shutdown_connections 2024-09-12T01:50:59.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.103+0000 7fbb41e1f640 1 -- 172.21.15.70:0/3394114089 wait complete. 2024-09-12T01:50:59.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.103+0000 7fbb41e1f640 1 Processor -- start 2024-09-12T01:50:59.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb41e1f640 1 -- start start 2024-09-12T01:50:59.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb41e1f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb3c101470 0x7fbb3c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:59.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb41e1f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb3c101e20 0x7fbb3c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:59.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb41e1f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb3c105de0 0x7fbb3c1a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb41e1f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c110f60 con 0x7fbb3c101e20 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb41e1f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c110de0 con 0x7fbb3c101470 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb41e1f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3c1110e0 con 0x7fbb3c105de0 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb3affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb3c101e20 0x7fbb3c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb3affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb3c101e20 0x7fbb3c199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36000/0 (socket says 172.21.15.70:36000) 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb3affd640 1 -- 172.21.15.70:0/969517682 learned_addr learned my addr 172.21.15.70:0/969517682 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb3b7fe640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb3c101470 0x7fbb3c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb3bfff640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb3c105de0 0x7fbb3c1a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb3affd640 1 -- 172.21.15.70:0/969517682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb3c105de0 msgr2=0x7fbb3c1a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb3affd640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb3c105de0 0x7fbb3c1a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb3affd640 1 -- 172.21.15.70:0/969517682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb3c101470 msgr2=0x7fbb3c1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb3affd640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb3c101470 0x7fbb3c1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.104+0000 7fbb3affd640 1 -- 172.21.15.70:0/969517682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3c1a48b0 con 0x7fbb3c101e20 2024-09-12T01:50:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.105+0000 7fbb3affd640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb3c101e20 0x7fbb3c199830 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000d950 tx=0x7fbb3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.105+0000 7fbb38ff9640 1 -- 172.21.15.70:0/969517682 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30017070 con 0x7fbb3c101e20 2024-09-12T01:50:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.105+0000 7fbb38ff9640 1 -- 172.21.15.70:0/969517682 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb30009c30 con 0x7fbb3c101e20 2024-09-12T01:50:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.105+0000 7fbb38ff9640 1 -- 172.21.15.70:0/969517682 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000f740 con 0x7fbb3c101e20 2024-09-12T01:50:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.105+0000 7fbb41e1f640 1 -- 172.21.15.70:0/969517682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3c1a4a80 con 0x7fbb3c101e20 2024-09-12T01:50:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.105+0000 7fbb41e1f640 1 -- 172.21.15.70:0/969517682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3c1a4f40 con 0x7fbb3c101e20 2024-09-12T01:50:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.106+0000 7fbb41e1f640 1 -- 172.21.15.70:0/969517682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb3c101850 con 0x7fbb3c101e20 2024-09-12T01:50:59.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.107+0000 7fbb38ff9640 1 -- 172.21.15.70:0/969517682 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbb30010a80 con 0x7fbb3c101e20 2024-09-12T01:50:59.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.108+0000 7fbb38ff9640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb240a2c10 0x7fbb240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:59.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.108+0000 7fbb3b7fe640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb240a2c10 0x7fbb240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:59.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.108+0000 7fbb38ff9640 1 -- 172.21.15.70:0/969517682 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbb300ced90 con 0x7fbb3c101e20 2024-09-12T01:50:59.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.109+0000 7fbb3b7fe640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb240a2c10 0x7fbb240a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0058c0 tx=0x7fbb2c00a250 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:59.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.111+0000 7fbb38ff9640 1 -- 172.21.15.70:0/969517682 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb30009de0 con 0x7fbb3c101e20 2024-09-12T01:50:59.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.284+0000 7fbb41e1f640 1 -- 172.21.15.70:0/969517682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbb3c1006f0 con 0x7fbb3c101e20 2024-09-12T01:50:59.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.284+0000 7fbb38ff9640 1 -- 172.21.15.70:0/969517682 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbb3009bb50 con 0x7fbb3c101e20 2024-09-12T01:50:59.285 INFO:teuthology.orchestra.run.smithi070.stdout:158913790005 2024-09-12T01:50:59.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.286+0000 7fbb41e1f640 1 -- 172.21.15.70:0/969517682 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb240a2c10 msgr2=0x7fbb240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:59.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.286+0000 7fbb41e1f640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb240a2c10 0x7fbb240a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0058c0 tx=0x7fbb2c00a250 comp rx=0 tx=0).stop 2024-09-12T01:50:59.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.286+0000 7fbb41e1f640 1 -- 172.21.15.70:0/969517682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb3c101e20 msgr2=0x7fbb3c199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:59.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.286+0000 7fbb41e1f640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb3c101e20 0x7fbb3c199830 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000d950 tx=0x7fbb3000de10 comp rx=0 tx=0).stop 2024-09-12T01:50:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.286+0000 7fbb41e1f640 1 -- 172.21.15.70:0/969517682 shutdown_connections 2024-09-12T01:50:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.286+0000 7fbb41e1f640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb240a2c10 0x7fbb240a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.286+0000 7fbb41e1f640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb3c105de0 0x7fbb3c1a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.286+0000 7fbb41e1f640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb3c101e20 0x7fbb3c199830 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.286+0000 7fbb41e1f640 1 --2- 172.21.15.70:0/969517682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb3c101470 0x7fbb3c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.286+0000 7fbb41e1f640 1 -- 172.21.15.70:0/969517682 >> 172.21.15.70:0/969517682 conn(0x7fbb3c077230 msgr2=0x7fbb3c104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.287+0000 7fbb41e1f640 1 -- 172.21.15.70:0/969517682 shutdown_connections 2024-09-12T01:50:59.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:50:59.287+0000 7fbb41e1f640 1 -- 172.21.15.70:0/969517682 wait complete. 2024-09-12T01:50:59.373 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528366 got 193273528369 for osd.6 2024-09-12T01:50:59.373 DEBUG:teuthology.parallel:result is None 2024-09-12T01:50:59.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:59 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/4112616180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T01:50:59.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:50:59 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/969517682' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:50:59.943 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:59 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/4112616180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T01:50:59.943 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:50:59 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/969517682' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:50:59.970 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790003 got 158913790005 for osd.5 2024-09-12T01:50:59.970 DEBUG:teuthology.parallel:result is None 2024-09-12T01:51:00.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:59 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/4112616180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T01:51:00.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:50:59 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/969517682' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:51:00.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.452+0000 7f84401e7640 1 -- 172.21.15.70:0/1532230321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8438106a80 msgr2=0x7f8438106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:00.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.452+0000 7f84401e7640 1 --2- 172.21.15.70:0/1532230321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8438106a80 0x7f8438106e60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8434009930 tx=0x7f843402a420 comp rx=0 tx=0).stop 2024-09-12T01:51:00.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.452+0000 7f84401e7640 1 -- 172.21.15.70:0/1532230321 shutdown_connections 2024-09-12T01:51:00.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.452+0000 7f84401e7640 1 --2- 172.21.15.70:0/1532230321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8438101420 0x7f843810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:00.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.452+0000 7f84401e7640 1 --2- 172.21.15.70:0/1532230321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8438100a80 0x7f8438100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:00.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.452+0000 7f84401e7640 1 --2- 172.21.15.70:0/1532230321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8438106a80 0x7f8438106e60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:00.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.452+0000 7f84401e7640 1 -- 172.21.15.70:0/1532230321 >> 172.21.15.70:0/1532230321 conn(0x7f84380fc7a0 msgr2=0x7f84380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:00.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.452+0000 7f84401e7640 1 -- 172.21.15.70:0/1532230321 shutdown_connections 2024-09-12T01:51:00.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.452+0000 7f84401e7640 1 -- 172.21.15.70:0/1532230321 wait complete. 2024-09-12T01:51:00.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.453+0000 7f84401e7640 1 Processor -- start 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.453+0000 7f84401e7640 1 -- start start 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.453+0000 7f84401e7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8438100a80 0x7f84381984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.453+0000 7f84401e7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8438101420 0x7f8438198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.453+0000 7f84401e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8438106a80 0x7f843819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.453+0000 7f84401e7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8438110fe0 con 0x7f8438106a80 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.453+0000 7f84401e7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8438110e60 con 0x7f8438100a80 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.453+0000 7f84401e7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8438111160 con 0x7f8438101420 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.453+0000 7f843e784640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8438106a80 0x7f843819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.453+0000 7f843e784640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8438106a80 0x7f843819cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34062/0 (socket says 172.21.15.70:34062) 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f843e784640 1 -- 172.21.15.70:0/138610721 learned_addr learned my addr 172.21.15.70:0/138610721 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f843d782640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8438101420 0x7f8438198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f843df83640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8438100a80 0x7f84381984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f843e784640 1 -- 172.21.15.70:0/138610721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8438101420 msgr2=0x7f8438198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f843e784640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8438101420 0x7f8438198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f843e784640 1 -- 172.21.15.70:0/138610721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8438100a80 msgr2=0x7f84381984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f843e784640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8438100a80 0x7f84381984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f843e784640 1 -- 172.21.15.70:0/138610721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843819d480 con 0x7f8438106a80 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f843e784640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8438106a80 0x7f843819cda0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f843000b970 tx=0x7f843000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f842effd640 1 -- 172.21.15.70:0/138610721 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8430019070 con 0x7f8438106a80 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f84401e7640 1 -- 172.21.15.70:0/138610721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843819d770 con 0x7f8438106a80 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f842effd640 1 -- 172.21.15.70:0/138610721 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f843000cb40 con 0x7f8438106a80 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f842effd640 1 -- 172.21.15.70:0/138610721 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84300076e0 con 0x7f8438106a80 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.454+0000 7f84401e7640 1 -- 172.21.15.70:0/138610721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84381a5050 con 0x7f8438106a80 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.455+0000 7f84401e7640 1 -- 172.21.15.70:0/138610721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8438100ee0 con 0x7f8438106a80 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.456+0000 7f842effd640 1 -- 172.21.15.70:0/138610721 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f843001c070 con 0x7f8438106a80 2024-09-12T01:51:00.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.457+0000 7f842effd640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84240a2c10 0x7f84240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:00.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.457+0000 7f843df83640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84240a2c10 0x7f84240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:00.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.457+0000 7f842effd640 1 -- 172.21.15.70:0/138610721 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f84300ce6e0 con 0x7f8438106a80 2024-09-12T01:51:00.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.457+0000 7f843df83640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84240a2c10 0x7f84240a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8434006010 tx=0x7f8434000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:00.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.461+0000 7f842effd640 1 -- 172.21.15.70:0/138610721 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f843009b5f0 con 0x7f8438106a80 2024-09-12T01:51:00.479 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:00.479 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:00.479 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:00.651 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:00 smithi070 ceph-mon[31177]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:00.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.652+0000 7f84401e7640 1 -- 172.21.15.70:0/138610721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f84381a5280 con 0x7f8438106a80 2024-09-12T01:51:00.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.652+0000 7f842effd640 1 -- 172.21.15.70:0/138610721 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f843009aef0 con 0x7f8438106a80 2024-09-12T01:51:00.653 INFO:teuthology.orchestra.run.smithi070.stdout:210453397548 2024-09-12T01:51:00.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.654+0000 7f84401e7640 1 -- 172.21.15.70:0/138610721 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84240a2c10 msgr2=0x7f84240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:00.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.654+0000 7f84401e7640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84240a2c10 0x7f84240a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8434006010 tx=0x7f8434000bc0 comp rx=0 tx=0).stop 2024-09-12T01:51:00.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.654+0000 7f84401e7640 1 -- 172.21.15.70:0/138610721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8438106a80 msgr2=0x7f843819cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:00.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.654+0000 7f84401e7640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8438106a80 0x7f843819cda0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f843000b970 tx=0x7f843000be30 comp rx=0 tx=0).stop 2024-09-12T01:51:00.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.654+0000 7f84401e7640 1 -- 172.21.15.70:0/138610721 shutdown_connections 2024-09-12T01:51:00.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.654+0000 7f84401e7640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84240a2c10 0x7f84240a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:00.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.654+0000 7f84401e7640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8438106a80 0x7f843819cda0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:00.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.654+0000 7f84401e7640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8438101420 0x7f8438198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:00.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.654+0000 7f84401e7640 1 --2- 172.21.15.70:0/138610721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8438100a80 0x7f84381984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:00.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.654+0000 7f84401e7640 1 -- 172.21.15.70:0/138610721 >> 172.21.15.70:0/138610721 conn(0x7f84380fc7a0 msgr2=0x7f84380fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:00.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.654+0000 7f84401e7640 1 -- 172.21.15.70:0/138610721 shutdown_connections 2024-09-12T01:51:00.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:00.654+0000 7f84401e7640 1 -- 172.21.15.70:0/138610721 wait complete. 2024-09-12T01:51:00.914 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:00 smithi152 ceph-mon[35055]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:00.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:00 smithi191 ceph-mon[35770]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:00.946 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953529 got 137438953531 for osd.4 2024-09-12T01:51:00.946 DEBUG:teuthology.parallel:result is None 2024-09-12T01:51:01.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.067+0000 7f2a8e706640 1 -- 172.21.15.70:0/2177955056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a88101420 msgr2=0x7f2a8810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:01.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.067+0000 7f2a8e706640 1 --2- 172.21.15.70:0/2177955056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a88101420 0x7f2a8810d950 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009cd0 tx=0x7f2a8002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:51:01.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.067+0000 7f2a8e706640 1 -- 172.21.15.70:0/2177955056 shutdown_connections 2024-09-12T01:51:01.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.067+0000 7f2a8e706640 1 --2- 172.21.15.70:0/2177955056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a88101420 0x7f2a8810d950 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.067+0000 7f2a8e706640 1 --2- 172.21.15.70:0/2177955056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a88100a80 0x7f2a88100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.067+0000 7f2a8e706640 1 --2- 172.21.15.70:0/2177955056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a88106a80 0x7f2a88106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.067+0000 7f2a8e706640 1 -- 172.21.15.70:0/2177955056 >> 172.21.15.70:0/2177955056 conn(0x7f2a880fc7a0 msgr2=0x7f2a880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.067+0000 7f2a8e706640 1 -- 172.21.15.70:0/2177955056 shutdown_connections 2024-09-12T01:51:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.067+0000 7f2a8e706640 1 -- 172.21.15.70:0/2177955056 wait complete. 2024-09-12T01:51:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.067+0000 7f2a8e706640 1 Processor -- start 2024-09-12T01:51:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.067+0000 7f2a8e706640 1 -- start start 2024-09-12T01:51:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a8e706640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a88100a80 0x7f2a88197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a8e706640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a88101420 0x7f2a88197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a8e706640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a88106a80 0x7f2a8819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a8e706640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88110fa0 con 0x7f2a88100a80 2024-09-12T01:51:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a8e706640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88110e20 con 0x7f2a88101420 2024-09-12T01:51:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a8e706640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88111120 con 0x7f2a88106a80 2024-09-12T01:51:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a88100a80 0x7f2a88197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a88100a80 0x7f2a88197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34088/0 (socket says 172.21.15.70:34088) 2024-09-12T01:51:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a87fff640 1 -- 172.21.15.70:0/2800256393 learned_addr learned my addr 172.21.15.70:0/2800256393 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a8cca3640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a88106a80 0x7f2a8819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a877fe640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a88101420 0x7f2a88197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a87fff640 1 -- 172.21.15.70:0/2800256393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a88106a80 msgr2=0x7f2a8819bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a87fff640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a88106a80 0x7f2a8819bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a87fff640 1 -- 172.21.15.70:0/2800256393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a88101420 msgr2=0x7f2a88197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a87fff640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a88101420 0x7f2a88197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:01.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a87fff640 1 -- 172.21.15.70:0/2800256393 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8819c3d0 con 0x7f2a88100a80 2024-09-12T01:51:01.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a877fe640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a88101420 0x7f2a88197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:01.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.068+0000 7f2a87fff640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a88100a80 0x7f2a88197420 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800c970 tx=0x7f2a7800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:01.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.069+0000 7f2a857fa640 1 -- 172.21.15.70:0/2800256393 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78007bb0 con 0x7f2a88100a80 2024-09-12T01:51:01.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.069+0000 7f2a857fa640 1 -- 172.21.15.70:0/2800256393 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a78007d50 con 0x7f2a88100a80 2024-09-12T01:51:01.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.069+0000 7f2a8e706640 1 -- 172.21.15.70:0/2800256393 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8819c6c0 con 0x7f2a88100a80 2024-09-12T01:51:01.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.069+0000 7f2a857fa640 1 -- 172.21.15.70:0/2800256393 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7800f4b0 con 0x7f2a88100a80 2024-09-12T01:51:01.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.069+0000 7f2a8e706640 1 -- 172.21.15.70:0/2800256393 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a881a3fa0 con 0x7f2a88100a80 2024-09-12T01:51:01.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.070+0000 7f2a8e706640 1 -- 172.21.15.70:0/2800256393 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a88100ee0 con 0x7f2a88100a80 2024-09-12T01:51:01.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.071+0000 7f2a857fa640 1 -- 172.21.15.70:0/2800256393 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2a780046c0 con 0x7f2a88100a80 2024-09-12T01:51:01.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.072+0000 7f2a857fa640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2a740a2c10 0x7f2a740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:01.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.072+0000 7f2a877fe640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2a740a2c10 0x7f2a740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:01.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.072+0000 7f2a857fa640 1 -- 172.21.15.70:0/2800256393 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2a780cef50 con 0x7f2a88100a80 2024-09-12T01:51:01.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.072+0000 7f2a877fe640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2a740a2c10 0x7f2a740a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2a880fecc0 tx=0x7f2a70005ec0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:01.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.076+0000 7f2a857fa640 1 -- 172.21.15.70:0/2800256393 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a78014030 con 0x7f2a88100a80 2024-09-12T01:51:01.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.252+0000 7f2a8e706640 1 -- 172.21.15.70:0/2800256393 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2a88198780 con 0x7f2a88100a80 2024-09-12T01:51:01.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.252+0000 7f2a857fa640 1 -- 172.21.15.70:0/2800256393 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2a7809bd50 con 0x7f2a88100a80 2024-09-12T01:51:01.252 INFO:teuthology.orchestra.run.smithi070.stdout:34359738446 2024-09-12T01:51:01.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.254+0000 7f2a8e706640 1 -- 172.21.15.70:0/2800256393 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2a740a2c10 msgr2=0x7f2a740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:01.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.254+0000 7f2a8e706640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2a740a2c10 0x7f2a740a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2a880fecc0 tx=0x7f2a70005ec0 comp rx=0 tx=0).stop 2024-09-12T01:51:01.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.254+0000 7f2a8e706640 1 -- 172.21.15.70:0/2800256393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a88100a80 msgr2=0x7f2a88197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:01.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.254+0000 7f2a8e706640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a88100a80 0x7f2a88197420 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800c970 tx=0x7f2a7800ce30 comp rx=0 tx=0).stop 2024-09-12T01:51:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.254+0000 7f2a8e706640 1 -- 172.21.15.70:0/2800256393 shutdown_connections 2024-09-12T01:51:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.254+0000 7f2a8e706640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2a740a2c10 0x7f2a740a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.254+0000 7f2a8e706640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a88106a80 0x7f2a8819bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.254+0000 7f2a8e706640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a88101420 0x7f2a88197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.254+0000 7f2a8e706640 1 --2- 172.21.15.70:0/2800256393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a88100a80 0x7f2a88197420 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.254+0000 7f2a8e706640 1 -- 172.21.15.70:0/2800256393 >> 172.21.15.70:0/2800256393 conn(0x7f2a880fc7a0 msgr2=0x7f2a880fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.254+0000 7f2a8e706640 1 -- 172.21.15.70:0/2800256393 shutdown_connections 2024-09-12T01:51:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:01.255+0000 7f2a8e706640 1 -- 172.21.15.70:0/2800256393 wait complete. 2024-09-12T01:51:01.886 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:01 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/138610721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T01:51:01.887 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:01 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2800256393' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:51:01.912 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547222 got 322122547225 for osd.11 2024-09-12T01:51:01.913 DEBUG:teuthology.parallel:result is None 2024-09-12T01:51:01.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:01 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/138610721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T01:51:01.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:01 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2800256393' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:51:02.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:01 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/138610721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T01:51:02.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:01 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2800256393' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:51:02.805 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:02 smithi070 ceph-mon[31177]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:02.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:02 smithi191 ceph-mon[35770]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:03.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:02 smithi152 ceph-mon[35055]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:03.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.484+0000 7f62463dc640 1 -- 172.21.15.70:0/818672220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6240102790 msgr2=0x7f62401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:03.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.484+0000 7f62463dc640 1 --2- 172.21.15.70:0/818672220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6240102790 0x7f62401067e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6234009900 tx=0x7f623402a410 comp rx=0 tx=0).stop 2024-09-12T01:51:03.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.484+0000 7f62463dc640 1 -- 172.21.15.70:0/818672220 shutdown_connections 2024-09-12T01:51:03.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.484+0000 7f62463dc640 1 --2- 172.21.15.70:0/818672220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6240106f10 0x7f624010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.484+0000 7f62463dc640 1 --2- 172.21.15.70:0/818672220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6240102790 0x7f62401067e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.484+0000 7f62463dc640 1 --2- 172.21.15.70:0/818672220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6240101de0 0x7f62401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.484+0000 7f62463dc640 1 -- 172.21.15.70:0/818672220 >> 172.21.15.70:0/818672220 conn(0x7f62400fd8c0 msgr2=0x7f62400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.484+0000 7f62463dc640 1 -- 172.21.15.70:0/818672220 shutdown_connections 2024-09-12T01:51:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.484+0000 7f62463dc640 1 -- 172.21.15.70:0/818672220 wait complete. 2024-09-12T01:51:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.485+0000 7f62463dc640 1 Processor -- start 2024-09-12T01:51:03.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.485+0000 7f62463dc640 1 -- start start 2024-09-12T01:51:03.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f62463dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6240101de0 0x7f62401985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:03.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f62463dc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6240102790 0x7f6240198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:03.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f62463dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6240106f10 0x7f624019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:03.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f62463dc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f62401120d0 con 0x7f6240106f10 2024-09-12T01:51:03.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f62463dc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6240111f50 con 0x7f6240101de0 2024-09-12T01:51:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f62463dc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6240112250 con 0x7f6240102790 2024-09-12T01:51:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f6244979640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6240106f10 0x7f624019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f6244979640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6240106f10 0x7f624019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34118/0 (socket says 172.21.15.70:34118) 2024-09-12T01:51:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f6244979640 1 -- 172.21.15.70:0/496376446 learned_addr learned my addr 172.21.15.70:0/496376446 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f623f7fe640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6240102790 0x7f6240198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f623ffff640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6240101de0 0x7f62401985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f6244979640 1 -- 172.21.15.70:0/496376446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6240102790 msgr2=0x7f6240198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f6244979640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6240102790 0x7f6240198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f6244979640 1 -- 172.21.15.70:0/496376446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6240101de0 msgr2=0x7f62401985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f6244979640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6240101de0 0x7f62401985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f6244979640 1 -- 172.21.15.70:0/496376446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624019d560 con 0x7f6240106f10 2024-09-12T01:51:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f6244979640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6240106f10 0x7f624019ce80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f623800cad0 tx=0x7f623800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f623d7fa640 1 -- 172.21.15.70:0/496376446 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623800ae20 con 0x7f6240106f10 2024-09-12T01:51:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f623d7fa640 1 -- 172.21.15.70:0/496376446 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6238004b20 con 0x7f6240106f10 2024-09-12T01:51:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f623d7fa640 1 -- 172.21.15.70:0/496376446 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623800f780 con 0x7f6240106f10 2024-09-12T01:51:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f62463dc640 1 -- 172.21.15.70:0/496376446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624019d850 con 0x7f6240106f10 2024-09-12T01:51:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.486+0000 7f62463dc640 1 -- 172.21.15.70:0/496376446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62401a5130 con 0x7f6240106f10 2024-09-12T01:51:03.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.488+0000 7f62463dc640 1 -- 172.21.15.70:0/496376446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62401021c0 con 0x7f6240106f10 2024-09-12T01:51:03.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.489+0000 7f623d7fa640 1 -- 172.21.15.70:0/496376446 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6238004cd0 con 0x7f6240106f10 2024-09-12T01:51:03.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.489+0000 7f623d7fa640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62280a2c10 0x7f62280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:03.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.489+0000 7f623ffff640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62280a2c10 0x7f62280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:03.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.490+0000 7f623d7fa640 1 -- 172.21.15.70:0/496376446 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f62380cf1e0 con 0x7f6240106f10 2024-09-12T01:51:03.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.490+0000 7f623ffff640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62280a2c10 0x7f62280a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6230009890 tx=0x7f6230008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:03.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.494+0000 7f623d7fa640 1 -- 172.21.15.70:0/496376446 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6238014030 con 0x7f6240106f10 2024-09-12T01:51:03.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.680+0000 7f62463dc640 1 -- 172.21.15.70:0/496376446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f624010a0f0 con 0x7f6240106f10 2024-09-12T01:51:03.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.703+0000 7f623d7fa640 1 -- 172.21.15.70:0/496376446 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f623809bfe0 con 0x7f6240106f10 2024-09-12T01:51:03.703 INFO:teuthology.orchestra.run.smithi070.stdout:240518168615 2024-09-12T01:51:03.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.705+0000 7f62463dc640 1 -- 172.21.15.70:0/496376446 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62280a2c10 msgr2=0x7f62280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:03.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.705+0000 7f62463dc640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62280a2c10 0x7f62280a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6230009890 tx=0x7f6230008040 comp rx=0 tx=0).stop 2024-09-12T01:51:03.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.705+0000 7f62463dc640 1 -- 172.21.15.70:0/496376446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6240106f10 msgr2=0x7f624019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:03.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.705+0000 7f62463dc640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6240106f10 0x7f624019ce80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f623800cad0 tx=0x7f623800cf90 comp rx=0 tx=0).stop 2024-09-12T01:51:03.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.705+0000 7f62463dc640 1 -- 172.21.15.70:0/496376446 shutdown_connections 2024-09-12T01:51:03.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.705+0000 7f62463dc640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f62280a2c10 0x7f62280a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.705+0000 7f62463dc640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6240106f10 0x7f624019ce80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.705+0000 7f62463dc640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6240102790 0x7f6240198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.705+0000 7f62463dc640 1 --2- 172.21.15.70:0/496376446 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6240101de0 0x7f62401985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.705+0000 7f62463dc640 1 -- 172.21.15.70:0/496376446 >> 172.21.15.70:0/496376446 conn(0x7f62400fd8c0 msgr2=0x7f62400feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:03.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.705+0000 7f62463dc640 1 -- 172.21.15.70:0/496376446 shutdown_connections 2024-09-12T01:51:03.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.705+0000 7f62463dc640 1 -- 172.21.15.70:0/496376446 wait complete. 2024-09-12T01:51:03.727 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:03 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1222987220' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T01:51:03.727 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:03 smithi070 ceph-mon[31177]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:03.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.808+0000 7ff6360e9640 1 -- 172.21.15.70:0/3512349819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff630106a80 msgr2=0x7ff630106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.808+0000 7ff6360e9640 1 --2- 172.21.15.70:0/3512349819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff630106a80 0x7ff630106e60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff620009930 tx=0x7ff62002a420 comp rx=0 tx=0).stop 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.808+0000 7ff6360e9640 1 -- 172.21.15.70:0/3512349819 shutdown_connections 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.808+0000 7ff6360e9640 1 --2- 172.21.15.70:0/3512349819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff630101420 0x7ff63010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.808+0000 7ff6360e9640 1 --2- 172.21.15.70:0/3512349819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff630100a80 0x7ff630100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.808+0000 7ff6360e9640 1 --2- 172.21.15.70:0/3512349819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff630106a80 0x7ff630106e60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.808+0000 7ff6360e9640 1 -- 172.21.15.70:0/3512349819 >> 172.21.15.70:0/3512349819 conn(0x7ff6300fc7a0 msgr2=0x7ff6300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.808+0000 7ff6360e9640 1 -- 172.21.15.70:0/3512349819 shutdown_connections 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.808+0000 7ff6360e9640 1 -- 172.21.15.70:0/3512349819 wait complete. 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.809+0000 7ff6360e9640 1 Processor -- start 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.809+0000 7ff6360e9640 1 -- start start 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.809+0000 7ff6360e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff630100a80 0x7ff6300fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.809+0000 7ff6360e9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff630101420 0x7ff6300fd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.809+0000 7ff6360e9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff630106a80 0x7ff6300fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.809+0000 7ff6360e9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff630110f60 con 0x7ff630100a80 2024-09-12T01:51:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.809+0000 7ff6360e9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff630110de0 con 0x7ff630101420 2024-09-12T01:51:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.809+0000 7ff6360e9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301110e0 con 0x7ff630106a80 2024-09-12T01:51:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.809+0000 7ff62f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff630100a80 0x7ff6300fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.809+0000 7ff62f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff630100a80 0x7ff6300fcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34148/0 (socket says 172.21.15.70:34148) 2024-09-12T01:51:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.809+0000 7ff62f7fe640 1 -- 172.21.15.70:0/2867971062 learned_addr learned my addr 172.21.15.70:0/2867971062 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff62effd640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff630101420 0x7ff6300fd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff62ffff640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff630106a80 0x7ff6300fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff62f7fe640 1 -- 172.21.15.70:0/2867971062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff630106a80 msgr2=0x7ff6300fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff62f7fe640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff630106a80 0x7ff6300fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff62f7fe640 1 -- 172.21.15.70:0/2867971062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff630101420 msgr2=0x7ff6300fd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff62f7fe640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff630101420 0x7ff6300fd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff62f7fe640 1 -- 172.21.15.70:0/2867971062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6301a68f0 con 0x7ff630100a80 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff62ffff640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff630106a80 0x7ff6300fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff62f7fe640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff630100a80 0x7ff6300fcca0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff620009a50 tx=0x7ff620004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff62cff9640 1 -- 172.21.15.70:0/2867971062 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62003f030 con 0x7ff630100a80 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff62cff9640 1 -- 172.21.15.70:0/2867971062 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff620003af0 con 0x7ff630100a80 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff6360e9640 1 -- 172.21.15.70:0/2867971062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6301a6b80 con 0x7ff630100a80 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff62cff9640 1 -- 172.21.15.70:0/2867971062 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620035070 con 0x7ff630100a80 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.810+0000 7ff6360e9640 1 -- 172.21.15.70:0/2867971062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6301a7060 con 0x7ff630100a80 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.811+0000 7ff6360e9640 1 -- 172.21.15.70:0/2867971062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff630100ee0 con 0x7ff630100a80 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.812+0000 7ff62cff9640 1 -- 172.21.15.70:0/2867971062 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff620042030 con 0x7ff630100a80 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.813+0000 7ff62cff9640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff6180a2c10 0x7ff6180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.813+0000 7ff62effd640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff6180a2c10 0x7ff6180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.813+0000 7ff62cff9640 1 -- 172.21.15.70:0/2867971062 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff6200efab0 con 0x7ff630100a80 2024-09-12T01:51:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.813+0000 7ff62effd640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff6180a2c10 0x7ff6180a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff6300fe730 tx=0x7ff62400a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:03.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.817+0000 7ff62cff9640 1 -- 172.21.15.70:0/2867971062 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6200bc870 con 0x7ff630100a80 2024-09-12T01:51:03.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:03 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1222987220' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T01:51:03.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:03 smithi191 ceph-mon[35770]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:03.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.988+0000 7ff6360e9640 1 -- 172.21.15.70:0/2867971062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff630109a70 con 0x7ff630100a80 2024-09-12T01:51:03.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.989+0000 7ff62cff9640 1 -- 172.21.15.70:0/2867971062 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff6200bc170 con 0x7ff630100a80 2024-09-12T01:51:03.989 INFO:teuthology.orchestra.run.smithi070.stdout:55834574922 2024-09-12T01:51:03.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.991+0000 7ff6360e9640 1 -- 172.21.15.70:0/2867971062 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff6180a2c10 msgr2=0x7ff6180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:03.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.991+0000 7ff6360e9640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff6180a2c10 0x7ff6180a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff6300fe730 tx=0x7ff62400a2d0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.991+0000 7ff6360e9640 1 -- 172.21.15.70:0/2867971062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff630100a80 msgr2=0x7ff6300fcca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:03.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.991+0000 7ff6360e9640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff630100a80 0x7ff6300fcca0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff620009a50 tx=0x7ff620004270 comp rx=0 tx=0).stop 2024-09-12T01:51:03.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.991+0000 7ff6360e9640 1 -- 172.21.15.70:0/2867971062 shutdown_connections 2024-09-12T01:51:03.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.991+0000 7ff6360e9640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff6180a2c10 0x7ff6180a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.991+0000 7ff6360e9640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff630106a80 0x7ff6300fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.991+0000 7ff6360e9640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff630101420 0x7ff6300fd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.991+0000 7ff6360e9640 1 --2- 172.21.15.70:0/2867971062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff630100a80 0x7ff6300fcca0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:03.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.991+0000 7ff6360e9640 1 -- 172.21.15.70:0/2867971062 >> 172.21.15.70:0/2867971062 conn(0x7ff6300fc7a0 msgr2=0x7ff63006a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:03.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.991+0000 7ff6360e9640 1 -- 172.21.15.70:0/2867971062 shutdown_connections 2024-09-12T01:51:03.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:03.991+0000 7ff6360e9640 1 -- 172.21.15.70:0/2867971062 wait complete. 2024-09-12T01:51:04.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:03 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1222987220' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T01:51:04.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:03 smithi152 ceph-mon[35055]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:04.738 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397545 got 210453397548 for osd.7 2024-09-12T01:51:04.739 DEBUG:teuthology.parallel:result is None 2024-09-12T01:51:04.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.805+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1622827258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55d4106a80 msgr2=0x7f55d4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:04.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.805+0000 7f55dbe8d640 1 --2- 172.21.15.70:0/1622827258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55d4106a80 0x7f55d4106e60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009cd0 tx=0x7f55c402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:51:04.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.805+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1622827258 shutdown_connections 2024-09-12T01:51:04.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.805+0000 7f55dbe8d640 1 --2- 172.21.15.70:0/1622827258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55d4101420 0x7f55d410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:04.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.805+0000 7f55dbe8d640 1 --2- 172.21.15.70:0/1622827258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55d4100a80 0x7f55d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:04.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.805+0000 7f55dbe8d640 1 --2- 172.21.15.70:0/1622827258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55d4106a80 0x7f55d4106e60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:04.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.805+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1622827258 >> 172.21.15.70:0/1622827258 conn(0x7f55d40fc7a0 msgr2=0x7f55d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:04.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.805+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1622827258 shutdown_connections 2024-09-12T01:51:04.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.805+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1622827258 wait complete. 2024-09-12T01:51:04.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55dbe8d640 1 Processor -- start 2024-09-12T01:51:04.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55dbe8d640 1 -- start start 2024-09-12T01:51:04.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55dbe8d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55d4100a80 0x7f55d41984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:04.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55dbe8d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55d4101420 0x7f55d4198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:04.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55dbe8d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55d4106a80 0x7f55d419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:04.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55dbe8d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55d4110fe0 con 0x7f55d4100a80 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55dbe8d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f55d4110e60 con 0x7f55d4106a80 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55dbe8d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f55d4111160 con 0x7f55d4101420 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55d9c29640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55d4100a80 0x7f55d41984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55d9c29640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55d4100a80 0x7f55d41984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34098/0 (socket says 172.21.15.70:34098) 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55d9c29640 1 -- 172.21.15.70:0/1222987220 learned_addr learned my addr 172.21.15.70:0/1222987220 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55d9428640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55d4101420 0x7f55d4198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55da42a640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55d4106a80 0x7f55d419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55d9c29640 1 -- 172.21.15.70:0/1222987220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55d4101420 msgr2=0x7f55d4198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55d9c29640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55d4101420 0x7f55d4198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55d9c29640 1 -- 172.21.15.70:0/1222987220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55d4106a80 msgr2=0x7f55d419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.806+0000 7f55d9c29640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55d4106a80 0x7f55d419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.807+0000 7f55d9c29640 1 -- 172.21.15.70:0/1222987220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d419d4a0 con 0x7f55d4100a80 2024-09-12T01:51:04.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.807+0000 7f55da42a640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55d4106a80 0x7f55d419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:04.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.807+0000 7f55d9c29640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55d4100a80 0x7f55d41984f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f55c402ae00 tx=0x7f55c4032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:04.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.807+0000 7f55d2ffd640 1 -- 172.21.15.70:0/1222987220 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c4004240 con 0x7f55d4100a80 2024-09-12T01:51:04.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.807+0000 7f55d2ffd640 1 -- 172.21.15.70:0/1222987220 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f55c40305a0 con 0x7f55d4100a80 2024-09-12T01:51:04.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.807+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1222987220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d419d730 con 0x7f55d4100a80 2024-09-12T01:51:04.856 INFO:teuthology.orchestra.run.smithi070.stdout:292057776158 2024-09-12T01:51:04.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.807+0000 7f55d2ffd640 1 -- 172.21.15.70:0/1222987220 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c40466e0 con 0x7f55d4100a80 2024-09-12T01:51:04.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.807+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1222987220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d41a5070 con 0x7f55d4100a80 2024-09-12T01:51:04.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.808+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1222987220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d4100ee0 con 0x7f55d4100a80 2024-09-12T01:51:04.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.809+0000 7f55d2ffd640 1 -- 172.21.15.70:0/1222987220 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f55c4030b00 con 0x7f55d4100a80 2024-09-12T01:51:04.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.810+0000 7f55d2ffd640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f55bc0a2c90 0x7f55bc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:04.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.810+0000 7f55d9428640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f55bc0a2c90 0x7f55bc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:04.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.810+0000 7f55d2ffd640 1 -- 172.21.15.70:0/1222987220 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f55c402e030 con 0x7f55d4100a80 2024-09-12T01:51:04.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.811+0000 7f55d9428640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f55bc0a2c90 0x7f55bc0a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f55c8005e10 tx=0x7f55c8005da0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:04.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.814+0000 7f55d2ffd640 1 -- 172.21.15.70:0/1222987220 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55c404b060 con 0x7f55d4100a80 2024-09-12T01:51:04.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.988+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1222987220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f55d41a5240 con 0x7f55d4100a80 2024-09-12T01:51:04.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.988+0000 7f55d2ffd640 1 -- 172.21.15.70:0/1222987220 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f55c40b7e20 con 0x7f55d4100a80 2024-09-12T01:51:04.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.990+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1222987220 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f55bc0a2c90 msgr2=0x7f55bc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:04.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.990+0000 7f55dbe8d640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f55bc0a2c90 0x7f55bc0a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f55c8005e10 tx=0x7f55c8005da0 comp rx=0 tx=0).stop 2024-09-12T01:51:04.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.990+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1222987220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55d4100a80 msgr2=0x7f55d41984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:04.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.990+0000 7f55dbe8d640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55d4100a80 0x7f55d41984f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f55c402ae00 tx=0x7f55c4032c00 comp rx=0 tx=0).stop 2024-09-12T01:51:04.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.990+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1222987220 shutdown_connections 2024-09-12T01:51:04.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.990+0000 7f55dbe8d640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f55bc0a2c90 0x7f55bc0a5150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:04.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.990+0000 7f55dbe8d640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f55d4106a80 0x7f55d419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:04.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.990+0000 7f55dbe8d640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55d4101420 0x7f55d4198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:04.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.990+0000 7f55dbe8d640 1 --2- 172.21.15.70:0/1222987220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55d4100a80 0x7f55d41984f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:04.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.990+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1222987220 >> 172.21.15.70:0/1222987220 conn(0x7f55d40fc7a0 msgr2=0x7f55d40fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:04.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.990+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1222987220 shutdown_connections 2024-09-12T01:51:04.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:02.990+0000 7f55dbe8d640 1 -- 172.21.15.70:0/1222987220 wait complete. 2024-09-12T01:51:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:04 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/496376446' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T01:51:04.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:04 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2867971062' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:51:05.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:04 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/496376446' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T01:51:05.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:04 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2867971062' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:51:05.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:04 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/496376446' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T01:51:05.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:04 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2867971062' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:51:05.446 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776156 got 292057776158 for osd.10 2024-09-12T01:51:05.446 DEBUG:teuthology.parallel:result is None 2024-09-12T01:51:05.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:05 smithi070 ceph-mon[31177]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:51:05.912 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738443 got 34359738446 for osd.0 2024-09-12T01:51:05.913 DEBUG:teuthology.parallel:result is None 2024-09-12T01:51:05.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:05 smithi191 ceph-mon[35770]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:51:06.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:05 smithi152 ceph-mon[35055]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:51:06.230 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574922 for osd.1 2024-09-12T01:51:06.231 DEBUG:teuthology.parallel:result is None 2024-09-12T01:51:06.684 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168612 got 240518168615 for osd.8 2024-09-12T01:51:06.685 DEBUG:teuthology.parallel:result is None 2024-09-12T01:51:06.685 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T01:51:06.685 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:51:06.973 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:07.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.479+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/2956127169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe98102ef0 msgr2=0x7fbe9810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:07.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.479+0000 7fbe9cf7b640 1 --2- 172.21.15.70:0/2956127169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe98102ef0 0x7fbe9810da40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009ca0 tx=0x7fbe9002a950 comp rx=0 tx=0).stop 2024-09-12T01:51:07.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.479+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/2956127169 shutdown_connections 2024-09-12T01:51:07.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.479+0000 7fbe9cf7b640 1 --2- 172.21.15.70:0/2956127169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe98102ef0 0x7fbe9810da40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:07.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.479+0000 7fbe9cf7b640 1 --2- 172.21.15.70:0/2956127169 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe98102570 0x7fbe981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:07.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.479+0000 7fbe9cf7b640 1 --2- 172.21.15.70:0/2956127169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe98100e20 0x7fbe98101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:07.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.479+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/2956127169 >> 172.21.15.70:0/2956127169 conn(0x7fbe980fc7d0 msgr2=0x7fbe980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:07.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.479+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/2956127169 shutdown_connections 2024-09-12T01:51:07.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.479+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/2956127169 wait complete. 2024-09-12T01:51:07.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe9cf7b640 1 Processor -- start 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe9cf7b640 1 -- start start 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe9cf7b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe98100e20 0x7fbe981985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe9cf7b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe98102570 0x7fbe98198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe9cf7b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe98102ef0 0x7fbe9819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe9cf7b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe981110e0 con 0x7fbe98102ef0 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe9cf7b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbe98110f60 con 0x7fbe98100e20 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe9cf7b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbe98111260 con 0x7fbe98102570 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe96d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe98102ef0 0x7fbe9819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe96d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe98102ef0 0x7fbe9819ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34154/0 (socket says 172.21.15.70:34154) 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe96d9d640 1 -- 172.21.15.70:0/1963814908 learned_addr learned my addr 172.21.15.70:0/1963814908 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe8ffff640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe98102570 0x7fbe98198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe9659c640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe98100e20 0x7fbe981985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:07.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe96d9d640 1 -- 172.21.15.70:0/1963814908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe98102570 msgr2=0x7fbe98198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe96d9d640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe98102570 0x7fbe98198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe96d9d640 1 -- 172.21.15.70:0/1963814908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe98100e20 msgr2=0x7fbe981985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.480+0000 7fbe96d9d640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe98100e20 0x7fbe981985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.481+0000 7fbe96d9d640 1 -- 172.21.15.70:0/1963814908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9819d560 con 0x7fbe98102ef0 2024-09-12T01:51:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.481+0000 7fbe96d9d640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe98102ef0 0x7fbe9819ce80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbe90005cc0 tx=0x7fbe9002f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.481+0000 7fbe8f7fe640 1 -- 172.21.15.70:0/1963814908 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90034040 con 0x7fbe98102ef0 2024-09-12T01:51:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.481+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/1963814908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9819d7f0 con 0x7fbe98102ef0 2024-09-12T01:51:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.481+0000 7fbe8f7fe640 1 -- 172.21.15.70:0/1963814908 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe90030940 con 0x7fbe98102ef0 2024-09-12T01:51:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.481+0000 7fbe8f7fe640 1 -- 172.21.15.70:0/1963814908 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90045480 con 0x7fbe98102ef0 2024-09-12T01:51:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.481+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/1963814908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe981a5130 con 0x7fbe98102ef0 2024-09-12T01:51:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.482+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/1963814908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe981021b0 con 0x7fbe98102ef0 2024-09-12T01:51:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.484+0000 7fbe8f7fe640 1 -- 172.21.15.70:0/1963814908 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbe90037020 con 0x7fbe98102ef0 2024-09-12T01:51:07.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.485+0000 7fbe8f7fe640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbe840a2c10 0x7fbe840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:07.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.485+0000 7fbe9659c640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbe840a2c10 0x7fbe840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:07.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.485+0000 7fbe8f7fe640 1 -- 172.21.15.70:0/1963814908 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbe900f01c0 con 0x7fbe98102ef0 2024-09-12T01:51:07.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.485+0000 7fbe9659c640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbe840a2c10 0x7fbe840a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbe88005d00 tx=0x7fbe88005c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:07.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.487+0000 7fbe8f7fe640 1 -- 172.21.15.70:0/1963814908 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe900bd090 con 0x7fbe98102ef0 2024-09-12T01:51:07.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.659+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/1963814908 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe98062630 con 0x7fbe840a2c10 2024-09-12T01:51:07.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.668+0000 7fbe8f7fe640 1 -- 172.21.15.70:0/1963814908 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258776 (secure 0 0 0) 0x7fbe98062630 con 0x7fbe840a2c10 2024-09-12T01:51:07.671 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:07.672 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:51:07.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.672+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/1963814908 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbe840a2c10 msgr2=0x7fbe840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:07.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.672+0000 7fbe9cf7b640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbe840a2c10 0x7fbe840a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbe88005d00 tx=0x7fbe88005c50 comp rx=0 tx=0).stop 2024-09-12T01:51:07.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.672+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/1963814908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe98102ef0 msgr2=0x7fbe9819ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:07.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.672+0000 7fbe9cf7b640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe98102ef0 0x7fbe9819ce80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbe90005cc0 tx=0x7fbe9002f790 comp rx=0 tx=0).stop 2024-09-12T01:51:07.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.672+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/1963814908 shutdown_connections 2024-09-12T01:51:07.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.672+0000 7fbe9cf7b640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbe840a2c10 0x7fbe840a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:07.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.672+0000 7fbe9cf7b640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe98102ef0 0x7fbe9819ce80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:07.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.672+0000 7fbe9cf7b640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe98102570 0x7fbe98198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:07.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.672+0000 7fbe9cf7b640 1 --2- 172.21.15.70:0/1963814908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe98100e20 0x7fbe981985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:07.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.672+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/1963814908 >> 172.21.15.70:0/1963814908 conn(0x7fbe980fc7d0 msgr2=0x7fbe9806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:07.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.672+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/1963814908 shutdown_connections 2024-09-12T01:51:07.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:07.672+0000 7fbe9cf7b640 1 -- 172.21.15.70:0/1963814908 wait complete. 2024-09-12T01:51:08.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:51:08.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:51:08.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:08.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:08.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:08 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:51:08.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:08 smithi152 ceph-mon[35055]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-09-12T01:51:08.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:51:08.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:51:08.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:08.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:08.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:08 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:51:08.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:08 smithi070 ceph-mon[31177]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-09-12T01:51:08.301 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-12T01:51:07.488909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660513,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":723,"num_read_kb":485,"num_write":429,"num_write_kb":3079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1231128,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366344,"kb_used_data":12888,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575480,"statfs":{"total":1151940427776,"available":1151565291520,"internally_reserved":0,"allocated":13197312,"data_stored":7227603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002862"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681555+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:50:22.681555+0000","last_peered":"2024-09-12T01:50:22.681555+0000","last_clean":"2024-09-12T01:50:22.681555+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:50:22.681555+0000","last_undegraded":"2024-09-12T01:50:22.681555+0000","last_fullsized":"2024-09-12T01:50:22.681555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610122+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:50:22.610122+0000","last_peered":"2024-09-12T01:50:22.610122+0000","last_clean":"2024-09-12T01:50:22.610122+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:50:22.610122+0000","last_undegraded":"2024-09-12T01:50:22.610122+0000","last_fullsized":"2024-09-12T01:50:22.610122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610144+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:50:22.610144+0000","last_peered":"2024-09-12T01:50:22.610144+0000","last_clean":"2024-09-12T01:50:22.610144+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:50:22.610144+0000","last_undegraded":"2024-09-12T01:50:22.610144+0000","last_fullsized":"2024-09-12T01:50:22.610144+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.682256+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:50:22.682256+0000","last_peered":"2024-09-12T01:50:22.682256+0000","last_clean":"2024-09-12T01:50:22.682256+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:50:22.682256+0000","last_undegraded":"2024-09-12T01:50:22.682256+0000","last_fullsized":"2024-09-12T01:50:22.682256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611131+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:50:22.611131+0000","last_peered":"2024-09-12T01:50:22.611131+0000","last_clean":"2024-09-12T01:50:22.611131+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:50:22.611131+0000","last_undegraded":"2024-09-12T01:50:22.611131+0000","last_fullsized":"2024-09-12T01:50:22.611131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614193+0000","last_change":"2024-09-12T01:50:22.614193+0000","last_active":"2024-09-12T01:50:22.614193+0000","last_peered":"2024-09-12T01:50:22.614193+0000","last_clean":"2024-09-12T01:50:22.614193+0000","last_became_active":"2024-09-12T01:50:22.613816+0000","last_became_peered":"2024-09-12T01:50:22.613816+0000","last_unstale":"2024-09-12T01:50:22.614193+0000","last_undegraded":"2024-09-12T01:50:22.614193+0000","last_fullsized":"2024-09-12T01:50:22.614193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:29.504176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612817+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:50:22.612817+0000","last_peered":"2024-09-12T01:50:22.612817+0000","last_clean":"2024-09-12T01:50:22.612817+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:50:22.612817+0000","last_undegraded":"2024-09-12T01:50:22.612817+0000","last_fullsized":"2024-09-12T01:50:22.612817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613485+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:50:22.613485+0000","last_peered":"2024-09-12T01:50:22.613485+0000","last_clean":"2024-09-12T01:50:22.613485+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:50:22.613485+0000","last_undegraded":"2024-09-12T01:50:22.613485+0000","last_fullsized":"2024-09-12T01:50:22.613485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611663+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:50:22.611663+0000","last_peered":"2024-09-12T01:50:22.611663+0000","last_clean":"2024-09-12T01:50:22.611663+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:50:22.611663+0000","last_undegraded":"2024-09-12T01:50:22.611663+0000","last_fullsized":"2024-09-12T01:50:22.611663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610750+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:50:22.610750+0000","last_peered":"2024-09-12T01:50:22.610750+0000","last_clean":"2024-09-12T01:50:22.610750+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:50:22.610750+0000","last_undegraded":"2024-09-12T01:50:22.610750+0000","last_fullsized":"2024-09-12T01:50:22.610750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613460+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:50:22.613460+0000","last_peered":"2024-09-12T01:50:22.613460+0000","last_clean":"2024-09-12T01:50:22.613460+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:50:22.613460+0000","last_undegraded":"2024-09-12T01:50:22.613460+0000","last_fullsized":"2024-09-12T01:50:22.613460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.682287+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:50:22.682287+0000","last_peered":"2024-09-12T01:50:22.682287+0000","last_clean":"2024-09-12T01:50:22.682287+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:50:22.682287+0000","last_undegraded":"2024-09-12T01:50:22.682287+0000","last_fullsized":"2024-09-12T01:50:22.682287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614251+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:50:22.614251+0000","last_peered":"2024-09-12T01:50:22.614251+0000","last_clean":"2024-09-12T01:50:22.614251+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:50:22.614251+0000","last_undegraded":"2024-09-12T01:50:22.614251+0000","last_fullsized":"2024-09-12T01:50:22.614251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610012+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:50:22.610012+0000","last_peered":"2024-09-12T01:50:22.610012+0000","last_clean":"2024-09-12T01:50:22.610012+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:50:22.610012+0000","last_undegraded":"2024-09-12T01:50:22.610012+0000","last_fullsized":"2024-09-12T01:50:22.610012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.609996+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:50:22.609996+0000","last_peered":"2024-09-12T01:50:22.609996+0000","last_clean":"2024-09-12T01:50:22.609996+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:50:22.609996+0000","last_undegraded":"2024-09-12T01:50:22.609996+0000","last_fullsized":"2024-09-12T01:50:22.609996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610813+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:50:22.610813+0000","last_peered":"2024-09-12T01:50:22.610813+0000","last_clean":"2024-09-12T01:50:22.610813+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:50:22.610813+0000","last_undegraded":"2024-09-12T01:50:22.610813+0000","last_fullsized":"2024-09-12T01:50:22.610813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681621+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:50:22.681621+0000","last_peered":"2024-09-12T01:50:22.681621+0000","last_clean":"2024-09-12T01:50:22.681621+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:50:22.681621+0000","last_undegraded":"2024-09-12T01:50:22.681621+0000","last_fullsized":"2024-09-12T01:50:22.681621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.608515+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:50:22.608515+0000","last_peered":"2024-09-12T01:50:22.608515+0000","last_clean":"2024-09-12T01:50:22.608515+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:50:22.608515+0000","last_undegraded":"2024-09-12T01:50:22.608515+0000","last_fullsized":"2024-09-12T01:50:22.608515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612632+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:50:22.612632+0000","last_peered":"2024-09-12T01:50:22.612632+0000","last_clean":"2024-09-12T01:50:22.612632+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:50:22.612632+0000","last_undegraded":"2024-09-12T01:50:22.612632+0000","last_fullsized":"2024-09-12T01:50:22.612632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681171+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:50:22.681171+0000","last_peered":"2024-09-12T01:50:22.681171+0000","last_clean":"2024-09-12T01:50:22.681171+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:50:22.681171+0000","last_undegraded":"2024-09-12T01:50:22.681171+0000","last_fullsized":"2024-09-12T01:50:22.681171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614316+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:50:22.614316+0000","last_peered":"2024-09-12T01:50:22.614316+0000","last_clean":"2024-09-12T01:50:22.614316+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:50:22.614316+0000","last_undegraded":"2024-09-12T01:50:22.614316+0000","last_fullsized":"2024-09-12T01:50:22.614316+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611147+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:50:22.611147+0000","last_peered":"2024-09-12T01:50:22.611147+0000","last_clean":"2024-09-12T01:50:22.611147+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:50:22.611147+0000","last_undegraded":"2024-09-12T01:50:22.611147+0000","last_fullsized":"2024-09-12T01:50:22.611147+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613661+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:50:22.613661+0000","last_peered":"2024-09-12T01:50:22.613661+0000","last_clean":"2024-09-12T01:50:22.613661+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:50:22.613661+0000","last_undegraded":"2024-09-12T01:50:22.613661+0000","last_fullsized":"2024-09-12T01:50:22.613661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.628919+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:50:22.628919+0000","last_peered":"2024-09-12T01:50:22.628919+0000","last_clean":"2024-09-12T01:50:22.628919+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:50:22.628919+0000","last_undegraded":"2024-09-12T01:50:22.628919+0000","last_fullsized":"2024-09-12T01:50:22.628919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614394+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:50:22.614394+0000","last_peered":"2024-09-12T01:50:22.614394+0000","last_clean":"2024-09-12T01:50:22.614394+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:50:22.614394+0000","last_undegraded":"2024-09-12T01:50:22.614394+0000","last_fullsized":"2024-09-12T01:50:22.614394+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612637+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:50:22.612637+0000","last_peered":"2024-09-12T01:50:22.612637+0000","last_clean":"2024-09-12T01:50:22.612637+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:50:22.612637+0000","last_undegraded":"2024-09-12T01:50:22.612637+0000","last_fullsized":"2024-09-12T01:50:22.612637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681201+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:50:22.681201+0000","last_peered":"2024-09-12T01:50:22.681201+0000","last_clean":"2024-09-12T01:50:22.681201+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:50:22.681201+0000","last_undegraded":"2024-09-12T01:50:22.681201+0000","last_fullsized":"2024-09-12T01:50:22.681201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613758+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:50:22.613758+0000","last_peered":"2024-09-12T01:50:22.613758+0000","last_clean":"2024-09-12T01:50:22.613758+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:50:22.613758+0000","last_undegraded":"2024-09-12T01:50:22.613758+0000","last_fullsized":"2024-09-12T01:50:22.613758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610182+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:50:22.610182+0000","last_peered":"2024-09-12T01:50:22.610182+0000","last_clean":"2024-09-12T01:50:22.610182+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:50:22.610182+0000","last_undegraded":"2024-09-12T01:50:22.610182+0000","last_fullsized":"2024-09-12T01:50:22.610182+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611958+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:50:22.611958+0000","last_peered":"2024-09-12T01:50:22.611958+0000","last_clean":"2024-09-12T01:50:22.611958+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:50:22.611958+0000","last_undegraded":"2024-09-12T01:50:22.611958+0000","last_fullsized":"2024-09-12T01:50:22.611958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611944+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:50:22.611944+0000","last_peered":"2024-09-12T01:50:22.611944+0000","last_clean":"2024-09-12T01:50:22.611944+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:50:22.611944+0000","last_undegraded":"2024-09-12T01:50:22.611944+0000","last_fullsized":"2024-09-12T01:50:22.611944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.680947+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:50:22.680947+0000","last_peered":"2024-09-12T01:50:22.680947+0000","last_clean":"2024-09-12T01:50:22.680947+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:50:22.680947+0000","last_undegraded":"2024-09-12T01:50:22.680947+0000","last_fullsized":"2024-09-12T01:50:22.680947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611008+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:50:22.611008+0000","last_peered":"2024-09-12T01:50:22.611008+0000","last_clean":"2024-09-12T01:50:22.611008+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:50:22.611008+0000","last_undegraded":"2024-09-12T01:50:22.611008+0000","last_fullsized":"2024-09-12T01:50:22.611008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:03.461710+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:51:03.461710+0000","last_peered":"2024-09-12T01:51:03.461710+0000","last_clean":"2024-09-12T01:51:03.461710+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:51:03.461710+0000","last_undegraded":"2024-09-12T01:51:03.461710+0000","last_fullsized":"2024-09-12T01:51:03.461710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629134+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:50:22.629134+0000","last_peered":"2024-09-12T01:50:22.629134+0000","last_clean":"2024-09-12T01:50:22.629134+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:50:22.629134+0000","last_undegraded":"2024-09-12T01:50:22.629134+0000","last_fullsized":"2024-09-12T01:50:22.629134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.688704+0000","last_change":"2024-09-12T01:50:22.688704+0000","last_active":"2024-09-12T01:50:22.688704+0000","last_peered":"2024-09-12T01:50:22.688704+0000","last_clean":"2024-09-12T01:50:22.688704+0000","last_became_active":"2024-09-12T01:50:22.682640+0000","last_became_peered":"2024-09-12T01:50:22.682640+0000","last_unstale":"2024-09-12T01:50:22.688704+0000","last_undegraded":"2024-09-12T01:50:22.688704+0000","last_fullsized":"2024-09-12T01:50:22.688704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.731438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614069+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:22.614069+0000","last_peered":"2024-09-12T01:50:22.614069+0000","last_clean":"2024-09-12T01:50:22.614069+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:22.614069+0000","last_undegraded":"2024-09-12T01:50:22.614069+0000","last_fullsized":"2024-09-12T01:50:22.614069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613533+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:50:22.613533+0000","last_peered":"2024-09-12T01:50:22.613533+0000","last_clean":"2024-09-12T01:50:22.613533+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:50:22.613533+0000","last_undegraded":"2024-09-12T01:50:22.613533+0000","last_fullsized":"2024-09-12T01:50:22.613533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629145+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:22.629145+0000","last_peered":"2024-09-12T01:50:22.629145+0000","last_clean":"2024-09-12T01:50:22.629145+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:22.629145+0000","last_undegraded":"2024-09-12T01:50:22.629145+0000","last_fullsized":"2024-09-12T01:50:22.629145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.608239+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:50:22.608239+0000","last_peered":"2024-09-12T01:50:22.608239+0000","last_clean":"2024-09-12T01:50:22.608239+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:50:22.608239+0000","last_undegraded":"2024-09-12T01:50:22.608239+0000","last_fullsized":"2024-09-12T01:50:22.608239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":140,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:05.464017+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:51:05.464017+0000","last_peered":"2024-09-12T01:51:05.464017+0000","last_clean":"2024-09-12T01:51:05.464017+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:51:05.464017+0000","last_undegraded":"2024-09-12T01:51:05.464017+0000","last_fullsized":"2024-09-12T01:51:05.464017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611544+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:50:22.611544+0000","last_peered":"2024-09-12T01:50:22.611544+0000","last_clean":"2024-09-12T01:50:22.611544+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:50:22.611544+0000","last_undegraded":"2024-09-12T01:50:22.611544+0000","last_fullsized":"2024-09-12T01:50:22.611544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613318+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:22.613318+0000","last_peered":"2024-09-12T01:50:22.613318+0000","last_clean":"2024-09-12T01:50:22.613318+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:22.613318+0000","last_undegraded":"2024-09-12T01:50:22.613318+0000","last_fullsized":"2024-09-12T01:50:22.613318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.630618+0000","last_change":"2024-09-12T01:50:22.630618+0000","last_active":"2024-09-12T01:50:22.630618+0000","last_peered":"2024-09-12T01:50:22.630618+0000","last_clean":"2024-09-12T01:50:22.630618+0000","last_became_active":"2024-09-12T01:50:22.630327+0000","last_became_peered":"2024-09-12T01:50:22.630327+0000","last_unstale":"2024-09-12T01:50:22.630618+0000","last_undegraded":"2024-09-12T01:50:22.630618+0000","last_fullsized":"2024-09-12T01:50:22.630618+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.647257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629439+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:22.629439+0000","last_peered":"2024-09-12T01:50:22.629439+0000","last_clean":"2024-09-12T01:50:22.629439+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:22.629439+0000","last_undegraded":"2024-09-12T01:50:22.629439+0000","last_fullsized":"2024-09-12T01:50:22.629439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611367+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:50:22.611367+0000","last_peered":"2024-09-12T01:50:22.611367+0000","last_clean":"2024-09-12T01:50:22.611367+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:50:22.611367+0000","last_undegraded":"2024-09-12T01:50:22.611367+0000","last_fullsized":"2024-09-12T01:50:22.611367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":196,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:04.747877+0000","last_change":"2024-09-12T01:50:22.696674+0000","last_active":"2024-09-12T01:51:04.747877+0000","last_peered":"2024-09-12T01:51:04.747877+0000","last_clean":"2024-09-12T01:51:04.747877+0000","last_became_active":"2024-09-12T01:50:22.683417+0000","last_became_peered":"2024-09-12T01:50:22.683417+0000","last_unstale":"2024-09-12T01:51:04.747877+0000","last_undegraded":"2024-09-12T01:51:04.747877+0000","last_fullsized":"2024-09-12T01:51:04.747877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:35.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62310,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":115,"num_read_kb":118,"num_write":35,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":49603,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611363+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:50:22.611363+0000","last_peered":"2024-09-12T01:50:22.611363+0000","last_clean":"2024-09-12T01:50:22.611363+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:50:22.611363+0000","last_undegraded":"2024-09-12T01:50:22.611363+0000","last_fullsized":"2024-09-12T01:50:22.611363+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612213+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:22.612213+0000","last_peered":"2024-09-12T01:50:22.612213+0000","last_clean":"2024-09-12T01:50:22.612213+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:22.612213+0000","last_undegraded":"2024-09-12T01:50:22.612213+0000","last_fullsized":"2024-09-12T01:50:22.612213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613776+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:50:22.613776+0000","last_peered":"2024-09-12T01:50:22.613776+0000","last_clean":"2024-09-12T01:50:22.613776+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:50:22.613776+0000","last_undegraded":"2024-09-12T01:50:22.613776+0000","last_fullsized":"2024-09-12T01:50:22.613776+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629035+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:22.629035+0000","last_peered":"2024-09-12T01:50:22.629035+0000","last_clean":"2024-09-12T01:50:22.629035+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:22.629035+0000","last_undegraded":"2024-09-12T01:50:22.629035+0000","last_fullsized":"2024-09-12T01:50:22.629035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.616527+0000","last_change":"2024-09-12T01:50:22.616527+0000","last_active":"2024-09-12T01:50:22.616527+0000","last_peered":"2024-09-12T01:50:22.616527+0000","last_clean":"2024-09-12T01:50:22.616527+0000","last_became_active":"2024-09-12T01:50:22.616150+0000","last_became_peered":"2024-09-12T01:50:22.616150+0000","last_unstale":"2024-09-12T01:50:22.616527+0000","last_undegraded":"2024-09-12T01:50:22.616527+0000","last_fullsized":"2024-09-12T01:50:22.616527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:58.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:05.463888+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:51:05.463888+0000","last_peered":"2024-09-12T01:51:05.463888+0000","last_clean":"2024-09-12T01:51:05.463888+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:51:05.463888+0000","last_undegraded":"2024-09-12T01:51:05.463888+0000","last_fullsized":"2024-09-12T01:51:05.463888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":61,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612514+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:50:22.612514+0000","last_peered":"2024-09-12T01:50:22.612514+0000","last_clean":"2024-09-12T01:50:22.612514+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:50:22.612514+0000","last_undegraded":"2024-09-12T01:50:22.612514+0000","last_fullsized":"2024-09-12T01:50:22.612514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610857+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:22.610857+0000","last_peered":"2024-09-12T01:50:22.610857+0000","last_clean":"2024-09-12T01:50:22.610857+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:22.610857+0000","last_undegraded":"2024-09-12T01:50:22.610857+0000","last_fullsized":"2024-09-12T01:50:22.610857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629097+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:50:22.629097+0000","last_peered":"2024-09-12T01:50:22.629097+0000","last_clean":"2024-09-12T01:50:22.629097+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:50:22.629097+0000","last_undegraded":"2024-09-12T01:50:22.629097+0000","last_fullsized":"2024-09-12T01:50:22.629097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611513+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:22.611513+0000","last_peered":"2024-09-12T01:50:22.611513+0000","last_clean":"2024-09-12T01:50:22.611513+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:22.611513+0000","last_undegraded":"2024-09-12T01:50:22.611513+0000","last_fullsized":"2024-09-12T01:50:22.611513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681162+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:50:22.681162+0000","last_peered":"2024-09-12T01:50:22.681162+0000","last_clean":"2024-09-12T01:50:22.681162+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:50:22.681162+0000","last_undegraded":"2024-09-12T01:50:22.681162+0000","last_fullsized":"2024-09-12T01:50:22.681162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613947+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:22.613947+0000","last_peered":"2024-09-12T01:50:22.613947+0000","last_clean":"2024-09-12T01:50:22.613947+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:22.613947+0000","last_undegraded":"2024-09-12T01:50:22.613947+0000","last_fullsized":"2024-09-12T01:50:22.613947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612841+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:50:22.612841+0000","last_peered":"2024-09-12T01:50:22.612841+0000","last_clean":"2024-09-12T01:50:22.612841+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:50:22.612841+0000","last_undegraded":"2024-09-12T01:50:22.612841+0000","last_fullsized":"2024-09-12T01:50:22.612841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629587+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:22.629587+0000","last_peered":"2024-09-12T01:50:22.629587+0000","last_clean":"2024-09-12T01:50:22.629587+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:22.629587+0000","last_undegraded":"2024-09-12T01:50:22.629587+0000","last_fullsized":"2024-09-12T01:50:22.629587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613199+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:50:22.613199+0000","last_peered":"2024-09-12T01:50:22.613199+0000","last_clean":"2024-09-12T01:50:22.613199+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:50:22.613199+0000","last_undegraded":"2024-09-12T01:50:22.613199+0000","last_fullsized":"2024-09-12T01:50:22.613199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'6","reported_seq":86,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:02.461825+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:51:02.461825+0000","last_peered":"2024-09-12T01:51:02.461825+0000","last_clean":"2024-09-12T01:51:02.461825+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:51:02.461825+0000","last_undegraded":"2024-09-12T01:51:02.461825+0000","last_fullsized":"2024-09-12T01:51:02.461825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613509+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:50:22.613509+0000","last_peered":"2024-09-12T01:50:22.613509+0000","last_clean":"2024-09-12T01:50:22.613509+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:50:22.613509+0000","last_undegraded":"2024-09-12T01:50:22.613509+0000","last_fullsized":"2024-09-12T01:50:22.613509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612676+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:50:22.612676+0000","last_peered":"2024-09-12T01:50:22.612676+0000","last_clean":"2024-09-12T01:50:22.612676+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:50:22.612676+0000","last_undegraded":"2024-09-12T01:50:22.612676+0000","last_fullsized":"2024-09-12T01:50:22.612676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681903+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:22.681903+0000","last_peered":"2024-09-12T01:50:22.681903+0000","last_clean":"2024-09-12T01:50:22.681903+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:22.681903+0000","last_undegraded":"2024-09-12T01:50:22.681903+0000","last_fullsized":"2024-09-12T01:50:22.681903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613887+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:50:22.613887+0000","last_peered":"2024-09-12T01:50:22.613887+0000","last_clean":"2024-09-12T01:50:22.613887+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:50:22.613887+0000","last_undegraded":"2024-09-12T01:50:22.613887+0000","last_fullsized":"2024-09-12T01:50:22.613887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612642+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:22.612642+0000","last_peered":"2024-09-12T01:50:22.612642+0000","last_clean":"2024-09-12T01:50:22.612642+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:22.612642+0000","last_undegraded":"2024-09-12T01:50:22.612642+0000","last_fullsized":"2024-09-12T01:50:22.612642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613899+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:50:22.613899+0000","last_peered":"2024-09-12T01:50:22.613899+0000","last_clean":"2024-09-12T01:50:22.613899+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:50:22.613899+0000","last_undegraded":"2024-09-12T01:50:22.613899+0000","last_fullsized":"2024-09-12T01:50:22.613899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:03.460200+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:51:03.460200+0000","last_peered":"2024-09-12T01:51:03.460200+0000","last_clean":"2024-09-12T01:51:03.460200+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:51:03.460200+0000","last_undegraded":"2024-09-12T01:51:03.460200+0000","last_fullsized":"2024-09-12T01:51:03.460200+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.682963+0000","last_change":"2024-09-12T01:50:22.682963+0000","last_active":"2024-09-12T01:50:22.682963+0000","last_peered":"2024-09-12T01:50:22.682963+0000","last_clean":"2024-09-12T01:50:22.682963+0000","last_became_active":"2024-09-12T01:50:22.682611+0000","last_became_peered":"2024-09-12T01:50:22.682611+0000","last_unstale":"2024-09-12T01:50:22.682963+0000","last_undegraded":"2024-09-12T01:50:22.682963+0000","last_fullsized":"2024-09-12T01:50:22.682963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:01.295098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'6","reported_seq":85,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:02.736520+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:51:02.736520+0000","last_peered":"2024-09-12T01:51:02.736520+0000","last_clean":"2024-09-12T01:51:02.736520+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:51:02.736520+0000","last_undegraded":"2024-09-12T01:51:02.736520+0000","last_fullsized":"2024-09-12T01:51:02.736520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610718+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:50:22.610718+0000","last_peered":"2024-09-12T01:50:22.610718+0000","last_clean":"2024-09-12T01:50:22.610718+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:50:22.610718+0000","last_undegraded":"2024-09-12T01:50:22.610718+0000","last_fullsized":"2024-09-12T01:50:22.610718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.683026+0000","last_change":"2024-09-12T01:50:22.683026+0000","last_active":"2024-09-12T01:50:22.683026+0000","last_peered":"2024-09-12T01:50:22.683026+0000","last_clean":"2024-09-12T01:50:22.683026+0000","last_became_active":"2024-09-12T01:50:22.682461+0000","last_became_peered":"2024-09-12T01:50:22.682461+0000","last_unstale":"2024-09-12T01:50:22.683026+0000","last_undegraded":"2024-09-12T01:50:22.683026+0000","last_fullsized":"2024-09-12T01:50:22.683026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.470081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.618050+0000","last_change":"2024-09-12T01:50:22.618050+0000","last_active":"2024-09-12T01:50:22.618050+0000","last_peered":"2024-09-12T01:50:22.618050+0000","last_clean":"2024-09-12T01:50:22.618050+0000","last_became_active":"2024-09-12T01:50:22.614871+0000","last_became_peered":"2024-09-12T01:50:22.614871+0000","last_unstale":"2024-09-12T01:50:22.618050+0000","last_undegraded":"2024-09-12T01:50:22.618050+0000","last_fullsized":"2024-09-12T01:50:22.618050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:47.652568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611446+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:22.611446+0000","last_peered":"2024-09-12T01:50:22.611446+0000","last_clean":"2024-09-12T01:50:22.611446+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:22.611446+0000","last_undegraded":"2024-09-12T01:50:22.611446+0000","last_fullsized":"2024-09-12T01:50:22.611446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613847+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:50:22.613847+0000","last_peered":"2024-09-12T01:50:22.613847+0000","last_clean":"2024-09-12T01:50:22.613847+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:50:22.613847+0000","last_undegraded":"2024-09-12T01:50:22.613847+0000","last_fullsized":"2024-09-12T01:50:22.613847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'14","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.608589+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:50:22.608589+0000","last_peered":"2024-09-12T01:50:22.608589+0000","last_clean":"2024-09-12T01:50:22.608589+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:50:22.608589+0000","last_undegraded":"2024-09-12T01:50:22.608589+0000","last_fullsized":"2024-09-12T01:50:22.608589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614482+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:50:22.614482+0000","last_peered":"2024-09-12T01:50:22.614482+0000","last_clean":"2024-09-12T01:50:22.614482+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:50:22.614482+0000","last_undegraded":"2024-09-12T01:50:22.614482+0000","last_fullsized":"2024-09-12T01:50:22.614482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681518+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:22.681518+0000","last_peered":"2024-09-12T01:50:22.681518+0000","last_clean":"2024-09-12T01:50:22.681518+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:22.681518+0000","last_undegraded":"2024-09-12T01:50:22.681518+0000","last_fullsized":"2024-09-12T01:50:22.681518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610152+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:50:22.610152+0000","last_peered":"2024-09-12T01:50:22.610152+0000","last_clean":"2024-09-12T01:50:22.610152+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:50:22.610152+0000","last_undegraded":"2024-09-12T01:50:22.610152+0000","last_fullsized":"2024-09-12T01:50:22.610152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611066+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:22.611066+0000","last_peered":"2024-09-12T01:50:22.611066+0000","last_clean":"2024-09-12T01:50:22.611066+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:22.611066+0000","last_undegraded":"2024-09-12T01:50:22.611066+0000","last_fullsized":"2024-09-12T01:50:22.611066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611019+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:50:22.611019+0000","last_peered":"2024-09-12T01:50:22.611019+0000","last_clean":"2024-09-12T01:50:22.611019+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:50:22.611019+0000","last_undegraded":"2024-09-12T01:50:22.611019+0000","last_fullsized":"2024-09-12T01:50:22.611019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613860+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:22.613860+0000","last_peered":"2024-09-12T01:50:22.613860+0000","last_clean":"2024-09-12T01:50:22.613860+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:22.613860+0000","last_undegraded":"2024-09-12T01:50:22.613860+0000","last_fullsized":"2024-09-12T01:50:22.613860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.680978+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:50:22.680978+0000","last_peered":"2024-09-12T01:50:22.680978+0000","last_clean":"2024-09-12T01:50:22.680978+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:50:22.680978+0000","last_undegraded":"2024-09-12T01:50:22.680978+0000","last_fullsized":"2024-09-12T01:50:22.680978+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612092+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:22.612092+0000","last_peered":"2024-09-12T01:50:22.612092+0000","last_clean":"2024-09-12T01:50:22.612092+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:22.612092+0000","last_undegraded":"2024-09-12T01:50:22.612092+0000","last_fullsized":"2024-09-12T01:50:22.612092+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613663+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:50:22.613663+0000","last_peered":"2024-09-12T01:50:22.613663+0000","last_clean":"2024-09-12T01:50:22.613663+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:50:22.613663+0000","last_undegraded":"2024-09-12T01:50:22.613663+0000","last_fullsized":"2024-09-12T01:50:22.613663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611281+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:22.611281+0000","last_peered":"2024-09-12T01:50:22.611281+0000","last_clean":"2024-09-12T01:50:22.611281+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:22.611281+0000","last_undegraded":"2024-09-12T01:50:22.611281+0000","last_fullsized":"2024-09-12T01:50:22.611281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612942+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:50:22.612942+0000","last_peered":"2024-09-12T01:50:22.612942+0000","last_clean":"2024-09-12T01:50:22.612942+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:50:22.612942+0000","last_undegraded":"2024-09-12T01:50:22.612942+0000","last_fullsized":"2024-09-12T01:50:22.612942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629449+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:50:22.629449+0000","last_peered":"2024-09-12T01:50:22.629449+0000","last_clean":"2024-09-12T01:50:22.629449+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:50:22.629449+0000","last_undegraded":"2024-09-12T01:50:22.629449+0000","last_fullsized":"2024-09-12T01:50:22.629449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611510+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:22.611510+0000","last_peered":"2024-09-12T01:50:22.611510+0000","last_clean":"2024-09-12T01:50:22.611510+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:22.611510+0000","last_undegraded":"2024-09-12T01:50:22.611510+0000","last_fullsized":"2024-09-12T01:50:22.611510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610811+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:50:22.610811+0000","last_peered":"2024-09-12T01:50:22.610811+0000","last_clean":"2024-09-12T01:50:22.610811+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:50:22.610811+0000","last_undegraded":"2024-09-12T01:50:22.610811+0000","last_fullsized":"2024-09-12T01:50:22.610811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611302+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:22.611302+0000","last_peered":"2024-09-12T01:50:22.611302+0000","last_clean":"2024-09-12T01:50:22.611302+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:22.611302+0000","last_undegraded":"2024-09-12T01:50:22.611302+0000","last_fullsized":"2024-09-12T01:50:22.611302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610330+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:50:22.610330+0000","last_peered":"2024-09-12T01:50:22.610330+0000","last_clean":"2024-09-12T01:50:22.610330+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:50:22.610330+0000","last_undegraded":"2024-09-12T01:50:22.610330+0000","last_fullsized":"2024-09-12T01:50:22.610330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614331+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:50:22.614331+0000","last_peered":"2024-09-12T01:50:22.614331+0000","last_clean":"2024-09-12T01:50:22.614331+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:50:22.614331+0000","last_undegraded":"2024-09-12T01:50:22.614331+0000","last_fullsized":"2024-09-12T01:50:22.614331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614167+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:50:22.614167+0000","last_peered":"2024-09-12T01:50:22.614167+0000","last_clean":"2024-09-12T01:50:22.614167+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:50:22.614167+0000","last_undegraded":"2024-09-12T01:50:22.614167+0000","last_fullsized":"2024-09-12T01:50:22.614167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":114,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:05.739954+0000","last_change":"2024-09-12T01:50:22.691988+0000","last_active":"2024-09-12T01:51:05.739954+0000","last_peered":"2024-09-12T01:51:05.739954+0000","last_clean":"2024-09-12T01:51:05.739954+0000","last_became_active":"2024-09-12T01:50:22.682676+0000","last_became_peered":"2024-09-12T01:50:22.682676+0000","last_unstale":"2024-09-12T01:51:05.739954+0000","last_undegraded":"2024-09-12T01:51:05.739954+0000","last_fullsized":"2024-09-12T01:51:05.739954+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:56.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69911,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":597,"num_read_kb":376,"num_write":246,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":50275,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547227,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":439429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776159,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32764,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712388,"statfs":{"total":95995035648,"available":95961485312,"internally_reserved":0,"allocated":1617920,"data_stored":1091703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":438411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168616,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1523712,"data_stored":1030913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528371,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":921600,"data_stored":438404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1544192,"data_stored":1030870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":500182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":437719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":439930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":501627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":942080,"data_stored":439743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:51:08.306 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:51:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:51:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:51:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:08 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:51:08.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:08 smithi191 ceph-mon[35770]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-09-12T01:51:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.039+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/3518204180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe04102d30 msgr2=0x7fbe04103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.039+0000 7fbe0b3e0640 1 --2- 172.21.15.70:0/3518204180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe04102d30 0x7fbe04103110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009cd0 tx=0x7fbdf402a910 comp rx=0 tx=0).stop 2024-09-12T01:51:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/3518204180 shutdown_connections 2024-09-12T01:51:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 --2- 172.21.15.70:0/3518204180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe041082a0 0x7fbe0410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 --2- 172.21.15.70:0/3518204180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe041036e0 0x7fbe04107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 --2- 172.21.15.70:0/3518204180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe04102d30 0x7fbe04103110 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/3518204180 >> 172.21.15.70:0/3518204180 conn(0x7fbe040fc7d0 msgr2=0x7fbe040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/3518204180 shutdown_connections 2024-09-12T01:51:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/3518204180 wait complete. 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 Processor -- start 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 -- start start 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe04102d30 0x7fbe041986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe041036e0 0x7fbe04198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe041082a0 0x7fbe0419cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe04112220 con 0x7fbe041082a0 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbe041120a0 con 0x7fbe041036e0 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.040+0000 7fbe0b3e0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbe041123a0 con 0x7fbe04102d30 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0997d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe041082a0 0x7fbe0419cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0997d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe041082a0 0x7fbe0419cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34160/0 (socket says 172.21.15.70:34160) 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0997d640 1 -- 172.21.15.70:0/951723403 learned_addr learned my addr 172.21.15.70:0/951723403 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0917c640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe04102d30 0x7fbe041986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0897b640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe041036e0 0x7fbe04198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0997d640 1 -- 172.21.15.70:0/951723403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe04102d30 msgr2=0x7fbe041986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0997d640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe04102d30 0x7fbe041986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0997d640 1 -- 172.21.15.70:0/951723403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe041036e0 msgr2=0x7fbe04198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0997d640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe041036e0 0x7fbe04198c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0997d640 1 -- 172.21.15.70:0/951723403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0419d690 con 0x7fbe041082a0 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0917c640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe04102d30 0x7fbe041986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0997d640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe041082a0 0x7fbe0419cfb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c970 tx=0x7fbdfc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe027fc640 1 -- 172.21.15.70:0/951723403 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc007bb0 con 0x7fbe041082a0 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe027fc640 1 -- 172.21.15.70:0/951723403 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbdfc007d50 con 0x7fbe041082a0 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/951723403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0419d980 con 0x7fbe041082a0 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe027fc640 1 -- 172.21.15.70:0/951723403 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc00f450 con 0x7fbe041082a0 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.041+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/951723403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe041a5260 con 0x7fbe041082a0 2024-09-12T01:51:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.042+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/951723403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe0406a850 con 0x7fbe041082a0 2024-09-12T01:51:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.043+0000 7fbe027fc640 1 -- 172.21.15.70:0/951723403 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbdfc005020 con 0x7fbe041082a0 2024-09-12T01:51:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.044+0000 7fbe027fc640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbdec0a2c90 0x7fbdec0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.044+0000 7fbe0917c640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbdec0a2c90 0x7fbdec0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.044+0000 7fbe027fc640 1 -- 172.21.15.70:0/951723403 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbdfc0ceef0 con 0x7fbe041082a0 2024-09-12T01:51:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.044+0000 7fbe0917c640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbdec0a2c90 0x7fbdec0a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4000f80 tx=0x7fbdf40098a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.048+0000 7fbe027fc640 1 -- 172.21.15.70:0/951723403 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbdfc014030 con 0x7fbe041082a0 2024-09-12T01:51:09.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.213+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/951723403 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe0410a320 con 0x7fbdec0a2c90 2024-09-12T01:51:09.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.222+0000 7fbe027fc640 1 -- 172.21.15.70:0/951723403 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258776 (secure 0 0 0) 0x7fbdf4036040 con 0x7fbdec0a2c90 2024-09-12T01:51:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:09.225 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:51:09.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.224+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/951723403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbdec0a2c90 msgr2=0x7fbdec0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:09.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.224+0000 7fbe0b3e0640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbdec0a2c90 0x7fbdec0a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4000f80 tx=0x7fbdf40098a0 comp rx=0 tx=0).stop 2024-09-12T01:51:09.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.224+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/951723403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe041082a0 msgr2=0x7fbe0419cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:09.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.224+0000 7fbe0b3e0640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe041082a0 0x7fbe0419cfb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c970 tx=0x7fbdfc00ce30 comp rx=0 tx=0).stop 2024-09-12T01:51:09.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.225+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/951723403 shutdown_connections 2024-09-12T01:51:09.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.225+0000 7fbe0b3e0640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbdec0a2c90 0x7fbdec0a5150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:09.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.225+0000 7fbe0b3e0640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe041082a0 0x7fbe0419cfb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:09.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.225+0000 7fbe0b3e0640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe041036e0 0x7fbe04198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:09.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.225+0000 7fbe0b3e0640 1 --2- 172.21.15.70:0/951723403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe04102d30 0x7fbe041986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:09.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.225+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/951723403 >> 172.21.15.70:0/951723403 conn(0x7fbe040fc7d0 msgr2=0x7fbe04105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:09.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.225+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/951723403 shutdown_connections 2024-09-12T01:51:09.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:09.225+0000 7fbe0b3e0640 1 -- 172.21.15.70:0/951723403 wait complete. 2024-09-12T01:51:09.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:09 smithi070 ceph-mon[31177]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:09.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:09 smithi191 ceph-mon[35770]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:09.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:09 smithi152 ceph-mon[35055]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:09.857 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-12T01:51:07.488909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660513,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":723,"num_read_kb":485,"num_write":429,"num_write_kb":3079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1231128,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366344,"kb_used_data":12888,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575480,"statfs":{"total":1151940427776,"available":1151565291520,"internally_reserved":0,"allocated":13197312,"data_stored":7227603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002862"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681555+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:50:22.681555+0000","last_peered":"2024-09-12T01:50:22.681555+0000","last_clean":"2024-09-12T01:50:22.681555+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:50:22.681555+0000","last_undegraded":"2024-09-12T01:50:22.681555+0000","last_fullsized":"2024-09-12T01:50:22.681555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610122+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:50:22.610122+0000","last_peered":"2024-09-12T01:50:22.610122+0000","last_clean":"2024-09-12T01:50:22.610122+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:50:22.610122+0000","last_undegraded":"2024-09-12T01:50:22.610122+0000","last_fullsized":"2024-09-12T01:50:22.610122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610144+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:50:22.610144+0000","last_peered":"2024-09-12T01:50:22.610144+0000","last_clean":"2024-09-12T01:50:22.610144+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:50:22.610144+0000","last_undegraded":"2024-09-12T01:50:22.610144+0000","last_fullsized":"2024-09-12T01:50:22.610144+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.682256+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:50:22.682256+0000","last_peered":"2024-09-12T01:50:22.682256+0000","last_clean":"2024-09-12T01:50:22.682256+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:50:22.682256+0000","last_undegraded":"2024-09-12T01:50:22.682256+0000","last_fullsized":"2024-09-12T01:50:22.682256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611131+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:50:22.611131+0000","last_peered":"2024-09-12T01:50:22.611131+0000","last_clean":"2024-09-12T01:50:22.611131+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:50:22.611131+0000","last_undegraded":"2024-09-12T01:50:22.611131+0000","last_fullsized":"2024-09-12T01:50:22.611131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614193+0000","last_change":"2024-09-12T01:50:22.614193+0000","last_active":"2024-09-12T01:50:22.614193+0000","last_peered":"2024-09-12T01:50:22.614193+0000","last_clean":"2024-09-12T01:50:22.614193+0000","last_became_active":"2024-09-12T01:50:22.613816+0000","last_became_peered":"2024-09-12T01:50:22.613816+0000","last_unstale":"2024-09-12T01:50:22.614193+0000","last_undegraded":"2024-09-12T01:50:22.614193+0000","last_fullsized":"2024-09-12T01:50:22.614193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:29.504176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612817+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:50:22.612817+0000","last_peered":"2024-09-12T01:50:22.612817+0000","last_clean":"2024-09-12T01:50:22.612817+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:50:22.612817+0000","last_undegraded":"2024-09-12T01:50:22.612817+0000","last_fullsized":"2024-09-12T01:50:22.612817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613485+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:50:22.613485+0000","last_peered":"2024-09-12T01:50:22.613485+0000","last_clean":"2024-09-12T01:50:22.613485+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:50:22.613485+0000","last_undegraded":"2024-09-12T01:50:22.613485+0000","last_fullsized":"2024-09-12T01:50:22.613485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611663+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:50:22.611663+0000","last_peered":"2024-09-12T01:50:22.611663+0000","last_clean":"2024-09-12T01:50:22.611663+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:50:22.611663+0000","last_undegraded":"2024-09-12T01:50:22.611663+0000","last_fullsized":"2024-09-12T01:50:22.611663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610750+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:50:22.610750+0000","last_peered":"2024-09-12T01:50:22.610750+0000","last_clean":"2024-09-12T01:50:22.610750+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:50:22.610750+0000","last_undegraded":"2024-09-12T01:50:22.610750+0000","last_fullsized":"2024-09-12T01:50:22.610750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613460+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:50:22.613460+0000","last_peered":"2024-09-12T01:50:22.613460+0000","last_clean":"2024-09-12T01:50:22.613460+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:50:22.613460+0000","last_undegraded":"2024-09-12T01:50:22.613460+0000","last_fullsized":"2024-09-12T01:50:22.613460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.682287+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:50:22.682287+0000","last_peered":"2024-09-12T01:50:22.682287+0000","last_clean":"2024-09-12T01:50:22.682287+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:50:22.682287+0000","last_undegraded":"2024-09-12T01:50:22.682287+0000","last_fullsized":"2024-09-12T01:50:22.682287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614251+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:50:22.614251+0000","last_peered":"2024-09-12T01:50:22.614251+0000","last_clean":"2024-09-12T01:50:22.614251+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:50:22.614251+0000","last_undegraded":"2024-09-12T01:50:22.614251+0000","last_fullsized":"2024-09-12T01:50:22.614251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610012+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:50:22.610012+0000","last_peered":"2024-09-12T01:50:22.610012+0000","last_clean":"2024-09-12T01:50:22.610012+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:50:22.610012+0000","last_undegraded":"2024-09-12T01:50:22.610012+0000","last_fullsized":"2024-09-12T01:50:22.610012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.609996+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:50:22.609996+0000","last_peered":"2024-09-12T01:50:22.609996+0000","last_clean":"2024-09-12T01:50:22.609996+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:50:22.609996+0000","last_undegraded":"2024-09-12T01:50:22.609996+0000","last_fullsized":"2024-09-12T01:50:22.609996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610813+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:50:22.610813+0000","last_peered":"2024-09-12T01:50:22.610813+0000","last_clean":"2024-09-12T01:50:22.610813+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:50:22.610813+0000","last_undegraded":"2024-09-12T01:50:22.610813+0000","last_fullsized":"2024-09-12T01:50:22.610813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681621+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:50:22.681621+0000","last_peered":"2024-09-12T01:50:22.681621+0000","last_clean":"2024-09-12T01:50:22.681621+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:50:22.681621+0000","last_undegraded":"2024-09-12T01:50:22.681621+0000","last_fullsized":"2024-09-12T01:50:22.681621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.608515+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:50:22.608515+0000","last_peered":"2024-09-12T01:50:22.608515+0000","last_clean":"2024-09-12T01:50:22.608515+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:50:22.608515+0000","last_undegraded":"2024-09-12T01:50:22.608515+0000","last_fullsized":"2024-09-12T01:50:22.608515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612632+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:50:22.612632+0000","last_peered":"2024-09-12T01:50:22.612632+0000","last_clean":"2024-09-12T01:50:22.612632+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:50:22.612632+0000","last_undegraded":"2024-09-12T01:50:22.612632+0000","last_fullsized":"2024-09-12T01:50:22.612632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681171+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:50:22.681171+0000","last_peered":"2024-09-12T01:50:22.681171+0000","last_clean":"2024-09-12T01:50:22.681171+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:50:22.681171+0000","last_undegraded":"2024-09-12T01:50:22.681171+0000","last_fullsized":"2024-09-12T01:50:22.681171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614316+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:50:22.614316+0000","last_peered":"2024-09-12T01:50:22.614316+0000","last_clean":"2024-09-12T01:50:22.614316+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:50:22.614316+0000","last_undegraded":"2024-09-12T01:50:22.614316+0000","last_fullsized":"2024-09-12T01:50:22.614316+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611147+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:50:22.611147+0000","last_peered":"2024-09-12T01:50:22.611147+0000","last_clean":"2024-09-12T01:50:22.611147+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:50:22.611147+0000","last_undegraded":"2024-09-12T01:50:22.611147+0000","last_fullsized":"2024-09-12T01:50:22.611147+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613661+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:50:22.613661+0000","last_peered":"2024-09-12T01:50:22.613661+0000","last_clean":"2024-09-12T01:50:22.613661+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:50:22.613661+0000","last_undegraded":"2024-09-12T01:50:22.613661+0000","last_fullsized":"2024-09-12T01:50:22.613661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.628919+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:50:22.628919+0000","last_peered":"2024-09-12T01:50:22.628919+0000","last_clean":"2024-09-12T01:50:22.628919+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:50:22.628919+0000","last_undegraded":"2024-09-12T01:50:22.628919+0000","last_fullsized":"2024-09-12T01:50:22.628919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614394+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:50:22.614394+0000","last_peered":"2024-09-12T01:50:22.614394+0000","last_clean":"2024-09-12T01:50:22.614394+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:50:22.614394+0000","last_undegraded":"2024-09-12T01:50:22.614394+0000","last_fullsized":"2024-09-12T01:50:22.614394+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612637+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:50:22.612637+0000","last_peered":"2024-09-12T01:50:22.612637+0000","last_clean":"2024-09-12T01:50:22.612637+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:50:22.612637+0000","last_undegraded":"2024-09-12T01:50:22.612637+0000","last_fullsized":"2024-09-12T01:50:22.612637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681201+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:50:22.681201+0000","last_peered":"2024-09-12T01:50:22.681201+0000","last_clean":"2024-09-12T01:50:22.681201+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:50:22.681201+0000","last_undegraded":"2024-09-12T01:50:22.681201+0000","last_fullsized":"2024-09-12T01:50:22.681201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613758+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:50:22.613758+0000","last_peered":"2024-09-12T01:50:22.613758+0000","last_clean":"2024-09-12T01:50:22.613758+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:50:22.613758+0000","last_undegraded":"2024-09-12T01:50:22.613758+0000","last_fullsized":"2024-09-12T01:50:22.613758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610182+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:50:22.610182+0000","last_peered":"2024-09-12T01:50:22.610182+0000","last_clean":"2024-09-12T01:50:22.610182+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:50:22.610182+0000","last_undegraded":"2024-09-12T01:50:22.610182+0000","last_fullsized":"2024-09-12T01:50:22.610182+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611958+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:50:22.611958+0000","last_peered":"2024-09-12T01:50:22.611958+0000","last_clean":"2024-09-12T01:50:22.611958+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:50:22.611958+0000","last_undegraded":"2024-09-12T01:50:22.611958+0000","last_fullsized":"2024-09-12T01:50:22.611958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611944+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:50:22.611944+0000","last_peered":"2024-09-12T01:50:22.611944+0000","last_clean":"2024-09-12T01:50:22.611944+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:50:22.611944+0000","last_undegraded":"2024-09-12T01:50:22.611944+0000","last_fullsized":"2024-09-12T01:50:22.611944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.680947+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:50:22.680947+0000","last_peered":"2024-09-12T01:50:22.680947+0000","last_clean":"2024-09-12T01:50:22.680947+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:50:22.680947+0000","last_undegraded":"2024-09-12T01:50:22.680947+0000","last_fullsized":"2024-09-12T01:50:22.680947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611008+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:50:22.611008+0000","last_peered":"2024-09-12T01:50:22.611008+0000","last_clean":"2024-09-12T01:50:22.611008+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:50:22.611008+0000","last_undegraded":"2024-09-12T01:50:22.611008+0000","last_fullsized":"2024-09-12T01:50:22.611008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:03.461710+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:51:03.461710+0000","last_peered":"2024-09-12T01:51:03.461710+0000","last_clean":"2024-09-12T01:51:03.461710+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:51:03.461710+0000","last_undegraded":"2024-09-12T01:51:03.461710+0000","last_fullsized":"2024-09-12T01:51:03.461710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629134+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:50:22.629134+0000","last_peered":"2024-09-12T01:50:22.629134+0000","last_clean":"2024-09-12T01:50:22.629134+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:50:22.629134+0000","last_undegraded":"2024-09-12T01:50:22.629134+0000","last_fullsized":"2024-09-12T01:50:22.629134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.688704+0000","last_change":"2024-09-12T01:50:22.688704+0000","last_active":"2024-09-12T01:50:22.688704+0000","last_peered":"2024-09-12T01:50:22.688704+0000","last_clean":"2024-09-12T01:50:22.688704+0000","last_became_active":"2024-09-12T01:50:22.682640+0000","last_became_peered":"2024-09-12T01:50:22.682640+0000","last_unstale":"2024-09-12T01:50:22.688704+0000","last_undegraded":"2024-09-12T01:50:22.688704+0000","last_fullsized":"2024-09-12T01:50:22.688704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.731438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614069+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:22.614069+0000","last_peered":"2024-09-12T01:50:22.614069+0000","last_clean":"2024-09-12T01:50:22.614069+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:22.614069+0000","last_undegraded":"2024-09-12T01:50:22.614069+0000","last_fullsized":"2024-09-12T01:50:22.614069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613533+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:50:22.613533+0000","last_peered":"2024-09-12T01:50:22.613533+0000","last_clean":"2024-09-12T01:50:22.613533+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:50:22.613533+0000","last_undegraded":"2024-09-12T01:50:22.613533+0000","last_fullsized":"2024-09-12T01:50:22.613533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629145+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:22.629145+0000","last_peered":"2024-09-12T01:50:22.629145+0000","last_clean":"2024-09-12T01:50:22.629145+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:22.629145+0000","last_undegraded":"2024-09-12T01:50:22.629145+0000","last_fullsized":"2024-09-12T01:50:22.629145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.608239+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:50:22.608239+0000","last_peered":"2024-09-12T01:50:22.608239+0000","last_clean":"2024-09-12T01:50:22.608239+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:50:22.608239+0000","last_undegraded":"2024-09-12T01:50:22.608239+0000","last_fullsized":"2024-09-12T01:50:22.608239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":140,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:05.464017+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:51:05.464017+0000","last_peered":"2024-09-12T01:51:05.464017+0000","last_clean":"2024-09-12T01:51:05.464017+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:51:05.464017+0000","last_undegraded":"2024-09-12T01:51:05.464017+0000","last_fullsized":"2024-09-12T01:51:05.464017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611544+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:50:22.611544+0000","last_peered":"2024-09-12T01:50:22.611544+0000","last_clean":"2024-09-12T01:50:22.611544+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:50:22.611544+0000","last_undegraded":"2024-09-12T01:50:22.611544+0000","last_fullsized":"2024-09-12T01:50:22.611544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613318+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:22.613318+0000","last_peered":"2024-09-12T01:50:22.613318+0000","last_clean":"2024-09-12T01:50:22.613318+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:22.613318+0000","last_undegraded":"2024-09-12T01:50:22.613318+0000","last_fullsized":"2024-09-12T01:50:22.613318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.630618+0000","last_change":"2024-09-12T01:50:22.630618+0000","last_active":"2024-09-12T01:50:22.630618+0000","last_peered":"2024-09-12T01:50:22.630618+0000","last_clean":"2024-09-12T01:50:22.630618+0000","last_became_active":"2024-09-12T01:50:22.630327+0000","last_became_peered":"2024-09-12T01:50:22.630327+0000","last_unstale":"2024-09-12T01:50:22.630618+0000","last_undegraded":"2024-09-12T01:50:22.630618+0000","last_fullsized":"2024-09-12T01:50:22.630618+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.647257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629439+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:22.629439+0000","last_peered":"2024-09-12T01:50:22.629439+0000","last_clean":"2024-09-12T01:50:22.629439+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:22.629439+0000","last_undegraded":"2024-09-12T01:50:22.629439+0000","last_fullsized":"2024-09-12T01:50:22.629439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611367+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:50:22.611367+0000","last_peered":"2024-09-12T01:50:22.611367+0000","last_clean":"2024-09-12T01:50:22.611367+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:50:22.611367+0000","last_undegraded":"2024-09-12T01:50:22.611367+0000","last_fullsized":"2024-09-12T01:50:22.611367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":196,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:04.747877+0000","last_change":"2024-09-12T01:50:22.696674+0000","last_active":"2024-09-12T01:51:04.747877+0000","last_peered":"2024-09-12T01:51:04.747877+0000","last_clean":"2024-09-12T01:51:04.747877+0000","last_became_active":"2024-09-12T01:50:22.683417+0000","last_became_peered":"2024-09-12T01:50:22.683417+0000","last_unstale":"2024-09-12T01:51:04.747877+0000","last_undegraded":"2024-09-12T01:51:04.747877+0000","last_fullsized":"2024-09-12T01:51:04.747877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:35.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62310,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":115,"num_read_kb":118,"num_write":35,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":49603,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611363+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:50:22.611363+0000","last_peered":"2024-09-12T01:50:22.611363+0000","last_clean":"2024-09-12T01:50:22.611363+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:50:22.611363+0000","last_undegraded":"2024-09-12T01:50:22.611363+0000","last_fullsized":"2024-09-12T01:50:22.611363+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612213+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:22.612213+0000","last_peered":"2024-09-12T01:50:22.612213+0000","last_clean":"2024-09-12T01:50:22.612213+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:22.612213+0000","last_undegraded":"2024-09-12T01:50:22.612213+0000","last_fullsized":"2024-09-12T01:50:22.612213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613776+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:50:22.613776+0000","last_peered":"2024-09-12T01:50:22.613776+0000","last_clean":"2024-09-12T01:50:22.613776+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:50:22.613776+0000","last_undegraded":"2024-09-12T01:50:22.613776+0000","last_fullsized":"2024-09-12T01:50:22.613776+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629035+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:22.629035+0000","last_peered":"2024-09-12T01:50:22.629035+0000","last_clean":"2024-09-12T01:50:22.629035+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:22.629035+0000","last_undegraded":"2024-09-12T01:50:22.629035+0000","last_fullsized":"2024-09-12T01:50:22.629035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.616527+0000","last_change":"2024-09-12T01:50:22.616527+0000","last_active":"2024-09-12T01:50:22.616527+0000","last_peered":"2024-09-12T01:50:22.616527+0000","last_clean":"2024-09-12T01:50:22.616527+0000","last_became_active":"2024-09-12T01:50:22.616150+0000","last_became_peered":"2024-09-12T01:50:22.616150+0000","last_unstale":"2024-09-12T01:50:22.616527+0000","last_undegraded":"2024-09-12T01:50:22.616527+0000","last_fullsized":"2024-09-12T01:50:22.616527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:58.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:05.463888+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:51:05.463888+0000","last_peered":"2024-09-12T01:51:05.463888+0000","last_clean":"2024-09-12T01:51:05.463888+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:51:05.463888+0000","last_undegraded":"2024-09-12T01:51:05.463888+0000","last_fullsized":"2024-09-12T01:51:05.463888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":61,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612514+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:50:22.612514+0000","last_peered":"2024-09-12T01:50:22.612514+0000","last_clean":"2024-09-12T01:50:22.612514+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:50:22.612514+0000","last_undegraded":"2024-09-12T01:50:22.612514+0000","last_fullsized":"2024-09-12T01:50:22.612514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610857+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:22.610857+0000","last_peered":"2024-09-12T01:50:22.610857+0000","last_clean":"2024-09-12T01:50:22.610857+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:22.610857+0000","last_undegraded":"2024-09-12T01:50:22.610857+0000","last_fullsized":"2024-09-12T01:50:22.610857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629097+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:50:22.629097+0000","last_peered":"2024-09-12T01:50:22.629097+0000","last_clean":"2024-09-12T01:50:22.629097+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:50:22.629097+0000","last_undegraded":"2024-09-12T01:50:22.629097+0000","last_fullsized":"2024-09-12T01:50:22.629097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611513+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:22.611513+0000","last_peered":"2024-09-12T01:50:22.611513+0000","last_clean":"2024-09-12T01:50:22.611513+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:22.611513+0000","last_undegraded":"2024-09-12T01:50:22.611513+0000","last_fullsized":"2024-09-12T01:50:22.611513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681162+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:50:22.681162+0000","last_peered":"2024-09-12T01:50:22.681162+0000","last_clean":"2024-09-12T01:50:22.681162+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:50:22.681162+0000","last_undegraded":"2024-09-12T01:50:22.681162+0000","last_fullsized":"2024-09-12T01:50:22.681162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613947+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:22.613947+0000","last_peered":"2024-09-12T01:50:22.613947+0000","last_clean":"2024-09-12T01:50:22.613947+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:22.613947+0000","last_undegraded":"2024-09-12T01:50:22.613947+0000","last_fullsized":"2024-09-12T01:50:22.613947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612841+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:50:22.612841+0000","last_peered":"2024-09-12T01:50:22.612841+0000","last_clean":"2024-09-12T01:50:22.612841+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:50:22.612841+0000","last_undegraded":"2024-09-12T01:50:22.612841+0000","last_fullsized":"2024-09-12T01:50:22.612841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629587+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:22.629587+0000","last_peered":"2024-09-12T01:50:22.629587+0000","last_clean":"2024-09-12T01:50:22.629587+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:22.629587+0000","last_undegraded":"2024-09-12T01:50:22.629587+0000","last_fullsized":"2024-09-12T01:50:22.629587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613199+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:50:22.613199+0000","last_peered":"2024-09-12T01:50:22.613199+0000","last_clean":"2024-09-12T01:50:22.613199+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:50:22.613199+0000","last_undegraded":"2024-09-12T01:50:22.613199+0000","last_fullsized":"2024-09-12T01:50:22.613199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'6","reported_seq":86,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:02.461825+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:51:02.461825+0000","last_peered":"2024-09-12T01:51:02.461825+0000","last_clean":"2024-09-12T01:51:02.461825+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:51:02.461825+0000","last_undegraded":"2024-09-12T01:51:02.461825+0000","last_fullsized":"2024-09-12T01:51:02.461825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613509+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:50:22.613509+0000","last_peered":"2024-09-12T01:50:22.613509+0000","last_clean":"2024-09-12T01:50:22.613509+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:50:22.613509+0000","last_undegraded":"2024-09-12T01:50:22.613509+0000","last_fullsized":"2024-09-12T01:50:22.613509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612676+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:50:22.612676+0000","last_peered":"2024-09-12T01:50:22.612676+0000","last_clean":"2024-09-12T01:50:22.612676+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:50:22.612676+0000","last_undegraded":"2024-09-12T01:50:22.612676+0000","last_fullsized":"2024-09-12T01:50:22.612676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681903+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:22.681903+0000","last_peered":"2024-09-12T01:50:22.681903+0000","last_clean":"2024-09-12T01:50:22.681903+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:22.681903+0000","last_undegraded":"2024-09-12T01:50:22.681903+0000","last_fullsized":"2024-09-12T01:50:22.681903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613887+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:50:22.613887+0000","last_peered":"2024-09-12T01:50:22.613887+0000","last_clean":"2024-09-12T01:50:22.613887+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:50:22.613887+0000","last_undegraded":"2024-09-12T01:50:22.613887+0000","last_fullsized":"2024-09-12T01:50:22.613887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612642+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:22.612642+0000","last_peered":"2024-09-12T01:50:22.612642+0000","last_clean":"2024-09-12T01:50:22.612642+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:22.612642+0000","last_undegraded":"2024-09-12T01:50:22.612642+0000","last_fullsized":"2024-09-12T01:50:22.612642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613899+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:50:22.613899+0000","last_peered":"2024-09-12T01:50:22.613899+0000","last_clean":"2024-09-12T01:50:22.613899+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:50:22.613899+0000","last_undegraded":"2024-09-12T01:50:22.613899+0000","last_fullsized":"2024-09-12T01:50:22.613899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:03.460200+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:51:03.460200+0000","last_peered":"2024-09-12T01:51:03.460200+0000","last_clean":"2024-09-12T01:51:03.460200+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:51:03.460200+0000","last_undegraded":"2024-09-12T01:51:03.460200+0000","last_fullsized":"2024-09-12T01:51:03.460200+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.682963+0000","last_change":"2024-09-12T01:50:22.682963+0000","last_active":"2024-09-12T01:50:22.682963+0000","last_peered":"2024-09-12T01:50:22.682963+0000","last_clean":"2024-09-12T01:50:22.682963+0000","last_became_active":"2024-09-12T01:50:22.682611+0000","last_became_peered":"2024-09-12T01:50:22.682611+0000","last_unstale":"2024-09-12T01:50:22.682963+0000","last_undegraded":"2024-09-12T01:50:22.682963+0000","last_fullsized":"2024-09-12T01:50:22.682963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:01.295098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"81'6","reported_seq":85,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:02.736520+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:51:02.736520+0000","last_peered":"2024-09-12T01:51:02.736520+0000","last_clean":"2024-09-12T01:51:02.736520+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:51:02.736520+0000","last_undegraded":"2024-09-12T01:51:02.736520+0000","last_fullsized":"2024-09-12T01:51:02.736520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610718+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:50:22.610718+0000","last_peered":"2024-09-12T01:50:22.610718+0000","last_clean":"2024-09-12T01:50:22.610718+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:50:22.610718+0000","last_undegraded":"2024-09-12T01:50:22.610718+0000","last_fullsized":"2024-09-12T01:50:22.610718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.683026+0000","last_change":"2024-09-12T01:50:22.683026+0000","last_active":"2024-09-12T01:50:22.683026+0000","last_peered":"2024-09-12T01:50:22.683026+0000","last_clean":"2024-09-12T01:50:22.683026+0000","last_became_active":"2024-09-12T01:50:22.682461+0000","last_became_peered":"2024-09-12T01:50:22.682461+0000","last_unstale":"2024-09-12T01:50:22.683026+0000","last_undegraded":"2024-09-12T01:50:22.683026+0000","last_fullsized":"2024-09-12T01:50:22.683026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.470081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.618050+0000","last_change":"2024-09-12T01:50:22.618050+0000","last_active":"2024-09-12T01:50:22.618050+0000","last_peered":"2024-09-12T01:50:22.618050+0000","last_clean":"2024-09-12T01:50:22.618050+0000","last_became_active":"2024-09-12T01:50:22.614871+0000","last_became_peered":"2024-09-12T01:50:22.614871+0000","last_unstale":"2024-09-12T01:50:22.618050+0000","last_undegraded":"2024-09-12T01:50:22.618050+0000","last_fullsized":"2024-09-12T01:50:22.618050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:47.652568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611446+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:22.611446+0000","last_peered":"2024-09-12T01:50:22.611446+0000","last_clean":"2024-09-12T01:50:22.611446+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:22.611446+0000","last_undegraded":"2024-09-12T01:50:22.611446+0000","last_fullsized":"2024-09-12T01:50:22.611446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613847+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:50:22.613847+0000","last_peered":"2024-09-12T01:50:22.613847+0000","last_clean":"2024-09-12T01:50:22.613847+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:50:22.613847+0000","last_undegraded":"2024-09-12T01:50:22.613847+0000","last_fullsized":"2024-09-12T01:50:22.613847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'14","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.608589+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:50:22.608589+0000","last_peered":"2024-09-12T01:50:22.608589+0000","last_clean":"2024-09-12T01:50:22.608589+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:50:22.608589+0000","last_undegraded":"2024-09-12T01:50:22.608589+0000","last_fullsized":"2024-09-12T01:50:22.608589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614482+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:50:22.614482+0000","last_peered":"2024-09-12T01:50:22.614482+0000","last_clean":"2024-09-12T01:50:22.614482+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:50:22.614482+0000","last_undegraded":"2024-09-12T01:50:22.614482+0000","last_fullsized":"2024-09-12T01:50:22.614482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681518+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:22.681518+0000","last_peered":"2024-09-12T01:50:22.681518+0000","last_clean":"2024-09-12T01:50:22.681518+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:22.681518+0000","last_undegraded":"2024-09-12T01:50:22.681518+0000","last_fullsized":"2024-09-12T01:50:22.681518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610152+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:50:22.610152+0000","last_peered":"2024-09-12T01:50:22.610152+0000","last_clean":"2024-09-12T01:50:22.610152+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:50:22.610152+0000","last_undegraded":"2024-09-12T01:50:22.610152+0000","last_fullsized":"2024-09-12T01:50:22.610152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611066+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:22.611066+0000","last_peered":"2024-09-12T01:50:22.611066+0000","last_clean":"2024-09-12T01:50:22.611066+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:22.611066+0000","last_undegraded":"2024-09-12T01:50:22.611066+0000","last_fullsized":"2024-09-12T01:50:22.611066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611019+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:50:22.611019+0000","last_peered":"2024-09-12T01:50:22.611019+0000","last_clean":"2024-09-12T01:50:22.611019+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:50:22.611019+0000","last_undegraded":"2024-09-12T01:50:22.611019+0000","last_fullsized":"2024-09-12T01:50:22.611019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613860+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:22.613860+0000","last_peered":"2024-09-12T01:50:22.613860+0000","last_clean":"2024-09-12T01:50:22.613860+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:22.613860+0000","last_undegraded":"2024-09-12T01:50:22.613860+0000","last_fullsized":"2024-09-12T01:50:22.613860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.680978+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:50:22.680978+0000","last_peered":"2024-09-12T01:50:22.680978+0000","last_clean":"2024-09-12T01:50:22.680978+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:50:22.680978+0000","last_undegraded":"2024-09-12T01:50:22.680978+0000","last_fullsized":"2024-09-12T01:50:22.680978+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612092+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:22.612092+0000","last_peered":"2024-09-12T01:50:22.612092+0000","last_clean":"2024-09-12T01:50:22.612092+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:22.612092+0000","last_undegraded":"2024-09-12T01:50:22.612092+0000","last_fullsized":"2024-09-12T01:50:22.612092+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613663+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:50:22.613663+0000","last_peered":"2024-09-12T01:50:22.613663+0000","last_clean":"2024-09-12T01:50:22.613663+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:50:22.613663+0000","last_undegraded":"2024-09-12T01:50:22.613663+0000","last_fullsized":"2024-09-12T01:50:22.613663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611281+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:22.611281+0000","last_peered":"2024-09-12T01:50:22.611281+0000","last_clean":"2024-09-12T01:50:22.611281+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:22.611281+0000","last_undegraded":"2024-09-12T01:50:22.611281+0000","last_fullsized":"2024-09-12T01:50:22.611281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612942+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:50:22.612942+0000","last_peered":"2024-09-12T01:50:22.612942+0000","last_clean":"2024-09-12T01:50:22.612942+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:50:22.612942+0000","last_undegraded":"2024-09-12T01:50:22.612942+0000","last_fullsized":"2024-09-12T01:50:22.612942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629449+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:50:22.629449+0000","last_peered":"2024-09-12T01:50:22.629449+0000","last_clean":"2024-09-12T01:50:22.629449+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:50:22.629449+0000","last_undegraded":"2024-09-12T01:50:22.629449+0000","last_fullsized":"2024-09-12T01:50:22.629449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611510+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:22.611510+0000","last_peered":"2024-09-12T01:50:22.611510+0000","last_clean":"2024-09-12T01:50:22.611510+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:22.611510+0000","last_undegraded":"2024-09-12T01:50:22.611510+0000","last_fullsized":"2024-09-12T01:50:22.611510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610811+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:50:22.610811+0000","last_peered":"2024-09-12T01:50:22.610811+0000","last_clean":"2024-09-12T01:50:22.610811+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:50:22.610811+0000","last_undegraded":"2024-09-12T01:50:22.610811+0000","last_fullsized":"2024-09-12T01:50:22.610811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611302+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:22.611302+0000","last_peered":"2024-09-12T01:50:22.611302+0000","last_clean":"2024-09-12T01:50:22.611302+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:22.611302+0000","last_undegraded":"2024-09-12T01:50:22.611302+0000","last_fullsized":"2024-09-12T01:50:22.611302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610330+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:50:22.610330+0000","last_peered":"2024-09-12T01:50:22.610330+0000","last_clean":"2024-09-12T01:50:22.610330+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:50:22.610330+0000","last_undegraded":"2024-09-12T01:50:22.610330+0000","last_fullsized":"2024-09-12T01:50:22.610330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614331+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:50:22.614331+0000","last_peered":"2024-09-12T01:50:22.614331+0000","last_clean":"2024-09-12T01:50:22.614331+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:50:22.614331+0000","last_undegraded":"2024-09-12T01:50:22.614331+0000","last_fullsized":"2024-09-12T01:50:22.614331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614167+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:50:22.614167+0000","last_peered":"2024-09-12T01:50:22.614167+0000","last_clean":"2024-09-12T01:50:22.614167+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:50:22.614167+0000","last_undegraded":"2024-09-12T01:50:22.614167+0000","last_fullsized":"2024-09-12T01:50:22.614167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":114,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:05.739954+0000","last_change":"2024-09-12T01:50:22.691988+0000","last_active":"2024-09-12T01:51:05.739954+0000","last_peered":"2024-09-12T01:51:05.739954+0000","last_clean":"2024-09-12T01:51:05.739954+0000","last_became_active":"2024-09-12T01:50:22.682676+0000","last_became_peered":"2024-09-12T01:50:22.682676+0000","last_unstale":"2024-09-12T01:51:05.739954+0000","last_undegraded":"2024-09-12T01:51:05.739954+0000","last_fullsized":"2024-09-12T01:51:05.739954+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:56.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69911,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":597,"num_read_kb":376,"num_write":246,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":50275,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547227,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":439429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776159,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32764,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712388,"statfs":{"total":95995035648,"available":95961485312,"internally_reserved":0,"allocated":1617920,"data_stored":1091703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":438411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168616,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1523712,"data_stored":1030913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528371,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":921600,"data_stored":438404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1544192,"data_stored":1030870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":500182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":437719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":439930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":501627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":942080,"data_stored":439743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:51:09.862 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T01:51:09.862 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T01:51:09.862 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T01:51:09.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T01:51:10.112 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:10.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:10 smithi070 ceph-mon[31177]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:10.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:10 smithi070 ceph-mon[31177]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:10.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.563+0000 7fa48a59e640 1 -- 172.21.15.70:0/199375258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa484106f10 msgr2=0x7fa48410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:10.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.563+0000 7fa48a59e640 1 --2- 172.21.15.70:0/199375258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa484106f10 0x7fa48410ea90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009ca0 tx=0x7fa47c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:51:10.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.563+0000 7fa48a59e640 1 -- 172.21.15.70:0/199375258 shutdown_connections 2024-09-12T01:51:10.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.563+0000 7fa48a59e640 1 --2- 172.21.15.70:0/199375258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa484106f10 0x7fa48410ea90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:10.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.563+0000 7fa48a59e640 1 --2- 172.21.15.70:0/199375258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa484102790 0x7fa4841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:10.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.563+0000 7fa48a59e640 1 --2- 172.21.15.70:0/199375258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa484101de0 0x7fa4841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:10.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.563+0000 7fa48a59e640 1 -- 172.21.15.70:0/199375258 >> 172.21.15.70:0/199375258 conn(0x7fa4840fd8c0 msgr2=0x7fa4840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:10.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.563+0000 7fa48a59e640 1 -- 172.21.15.70:0/199375258 shutdown_connections 2024-09-12T01:51:10.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.563+0000 7fa48a59e640 1 -- 172.21.15.70:0/199375258 wait complete. 2024-09-12T01:51:10.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa48a59e640 1 Processor -- start 2024-09-12T01:51:10.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa48a59e640 1 -- start start 2024-09-12T01:51:10.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa48a59e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa484101de0 0x7fa4841a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:10.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa48a59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa484102790 0x7fa4841a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:10.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa48a59e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa484106f10 0x7fa48419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:10.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa48a59e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa484112120 con 0x7fa484102790 2024-09-12T01:51:10.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa48a59e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa484111fa0 con 0x7fa484106f10 2024-09-12T01:51:10.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa48a59e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa4841122a0 con 0x7fa484101de0 2024-09-12T01:51:10.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa47bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa484102790 0x7fa4841a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:10.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa47bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa484102790 0x7fa4841a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49128/0 (socket says 172.21.15.70:49128) 2024-09-12T01:51:10.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa47bfff640 1 -- 172.21.15.70:0/2750456829 learned_addr learned my addr 172.21.15.70:0/2750456829 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:10.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa488b3b640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa484106f10 0x7fa48419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:10.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa483fff640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa484101de0 0x7fa4841a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa47bfff640 1 -- 172.21.15.70:0/2750456829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa484101de0 msgr2=0x7fa4841a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.564+0000 7fa47bfff640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa484101de0 0x7fa4841a0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.565+0000 7fa47bfff640 1 -- 172.21.15.70:0/2750456829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa484106f10 msgr2=0x7fa48419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.565+0000 7fa47bfff640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa484106f10 0x7fa48419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.565+0000 7fa47bfff640 1 -- 172.21.15.70:0/2750456829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48419aeb0 con 0x7fa484102790 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.565+0000 7fa488b3b640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa484106f10 0x7fa48419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.565+0000 7fa47bfff640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa484102790 0x7fa4841a0a60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00b4a0 tx=0x7fa46c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.565+0000 7fa481ffb640 1 -- 172.21.15.70:0/2750456829 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c014070 con 0x7fa484102790 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.565+0000 7fa481ffb640 1 -- 172.21.15.70:0/2750456829 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa46c010b10 con 0x7fa484102790 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.565+0000 7fa48a59e640 1 -- 172.21.15.70:0/2750456829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48419b1a0 con 0x7fa484102790 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.565+0000 7fa481ffb640 1 -- 172.21.15.70:0/2750456829 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c017d60 con 0x7fa484102790 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.565+0000 7fa48a59e640 1 -- 172.21.15.70:0/2750456829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4841a7340 con 0x7fa484102790 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.566+0000 7fa48a59e640 1 -- 172.21.15.70:0/2750456829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4841021c0 con 0x7fa484102790 2024-09-12T01:51:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.567+0000 7fa481ffb640 1 -- 172.21.15.70:0/2750456829 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa46c017070 con 0x7fa484102790 2024-09-12T01:51:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.567+0000 7fa481ffb640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa4700a2c10 0x7fa4700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.568+0000 7fa483fff640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa4700a2c10 0x7fa4700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.568+0000 7fa481ffb640 1 -- 172.21.15.70:0/2750456829 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa46c0ce580 con 0x7fa484102790 2024-09-12T01:51:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.568+0000 7fa483fff640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa4700a2c10 0x7fa4700a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa4740058c0 tx=0x7fa47400a4c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.572+0000 7fa481ffb640 1 -- 172.21.15.70:0/2750456829 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa46c09b490 con 0x7fa484102790 2024-09-12T01:51:10.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:10 smithi191 ceph-mon[35770]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:10.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:10 smithi191 ceph-mon[35770]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:10.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:10 smithi152 ceph-mon[35055]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:10.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:10 smithi152 ceph-mon[35055]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:10.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.777+0000 7fa48a59e640 1 -- 172.21.15.70:0/2750456829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa4841a7570 con 0x7fa484102790 2024-09-12T01:51:10.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.777+0000 7fa481ffb640 1 -- 172.21.15.70:0/2750456829 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa46c09ad90 con 0x7fa484102790 2024-09-12T01:51:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:10.777 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T01:51:10.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.779+0000 7fa48a59e640 1 -- 172.21.15.70:0/2750456829 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa4700a2c10 msgr2=0x7fa4700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:10.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.779+0000 7fa48a59e640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa4700a2c10 0x7fa4700a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa4740058c0 tx=0x7fa47400a4c0 comp rx=0 tx=0).stop 2024-09-12T01:51:10.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.779+0000 7fa48a59e640 1 -- 172.21.15.70:0/2750456829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa484102790 msgr2=0x7fa4841a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:10.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.779+0000 7fa48a59e640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa484102790 0x7fa4841a0a60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa46c00b4a0 tx=0x7fa46c00b960 comp rx=0 tx=0).stop 2024-09-12T01:51:10.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.779+0000 7fa48a59e640 1 -- 172.21.15.70:0/2750456829 shutdown_connections 2024-09-12T01:51:10.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.779+0000 7fa48a59e640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa4700a2c10 0x7fa4700a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:10.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.779+0000 7fa48a59e640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa484106f10 0x7fa48419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:10.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.779+0000 7fa48a59e640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa484102790 0x7fa4841a0a60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:10.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.779+0000 7fa48a59e640 1 --2- 172.21.15.70:0/2750456829 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa484101de0 0x7fa4841a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:10.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.779+0000 7fa48a59e640 1 -- 172.21.15.70:0/2750456829 >> 172.21.15.70:0/2750456829 conn(0x7fa4840fd8c0 msgr2=0x7fa4840fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:10.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.779+0000 7fa48a59e640 1 -- 172.21.15.70:0/2750456829 shutdown_connections 2024-09-12T01:51:10.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:10.779+0000 7fa48a59e640 1 -- 172.21.15.70:0/2750456829 wait complete. 2024-09-12T01:51:11.376 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T01:51:11.376 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:51:11.629 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:11.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:11 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2750456829' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:51:11.740 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:11 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2750456829' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:51:11.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:11 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2750456829' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:51:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.078+0000 7ff0f800f640 1 -- 172.21.15.70:0/3502476911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f0100b30 msgr2=0x7ff0f0100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.078+0000 7ff0f800f640 1 --2- 172.21.15.70:0/3502476911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f0100b30 0x7ff0f0100f10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009900 tx=0x7ff0ec02a470 comp rx=0 tx=0).stop 2024-09-12T01:51:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.078+0000 7ff0f800f640 1 -- 172.21.15.70:0/3502476911 shutdown_connections 2024-09-12T01:51:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.078+0000 7ff0f800f640 1 --2- 172.21.15.70:0/3502476911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0105f40 0x7ff0f01063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.078+0000 7ff0f800f640 1 --2- 172.21.15.70:0/3502476911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0f0101450 0x7ff0f0105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.078+0000 7ff0f800f640 1 --2- 172.21.15.70:0/3502476911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f0100b30 0x7ff0f0100f10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.078+0000 7ff0f800f640 1 -- 172.21.15.70:0/3502476911 >> 172.21.15.70:0/3502476911 conn(0x7ff0f00fc7a0 msgr2=0x7ff0f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.078+0000 7ff0f800f640 1 -- 172.21.15.70:0/3502476911 shutdown_connections 2024-09-12T01:51:12.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.078+0000 7ff0f800f640 1 -- 172.21.15.70:0/3502476911 wait complete. 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f800f640 1 Processor -- start 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f800f640 1 -- start start 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f800f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f0100b30 0x7ff0f01a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f800f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0101450 0x7ff0f01a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f800f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0f0105f40 0x7ff0f019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f800f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0118700 con 0x7ff0f0100b30 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f800f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0118580 con 0x7ff0f0101450 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f800f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0118880 con 0x7ff0f0105f40 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f5dab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f0100b30 0x7ff0f01a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f5dab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f0100b30 0x7ff0f01a47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49146/0 (socket says 172.21.15.70:49146) 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f5dab640 1 -- 172.21.15.70:0/3232309009 learned_addr learned my addr 172.21.15.70:0/3232309009 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f55aa640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0101450 0x7ff0f01a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:12.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f5dab640 1 -- 172.21.15.70:0/3232309009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0f0105f40 msgr2=0x7ff0f019e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f5dab640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0f0105f40 0x7ff0f019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f5dab640 1 -- 172.21.15.70:0/3232309009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0101450 msgr2=0x7ff0f01a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f5dab640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0101450 0x7ff0f01a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f5dab640 1 -- 172.21.15.70:0/3232309009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f019f0c0 con 0x7ff0f0100b30 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f55aa640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0101450 0x7ff0f01a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0f5dab640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f0100b30 0x7ff0f01a47d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec006010 tx=0x7ff0ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0e6ffd640 1 -- 172.21.15.70:0/3232309009 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec03f030 con 0x7ff0f0100b30 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0e6ffd640 1 -- 172.21.15.70:0/3232309009 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0ec003d00 con 0x7ff0f0100b30 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.079+0000 7ff0e6ffd640 1 -- 172.21.15.70:0/3232309009 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec035070 con 0x7ff0f0100b30 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.080+0000 7ff0f800f640 1 -- 172.21.15.70:0/3232309009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f019f350 con 0x7ff0f0100b30 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.080+0000 7ff0f800f640 1 -- 172.21.15.70:0/3232309009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f01ab6a0 con 0x7ff0f0100b30 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.081+0000 7ff0f800f640 1 -- 172.21.15.70:0/3232309009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f006b070 con 0x7ff0f0100b30 2024-09-12T01:51:12.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.082+0000 7ff0e6ffd640 1 -- 172.21.15.70:0/3232309009 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff0ec042030 con 0x7ff0f0100b30 2024-09-12T01:51:12.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.083+0000 7ff0e6ffd640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff0dc0a2c10 0x7ff0dc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:12.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.083+0000 7ff0f55aa640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff0dc0a2c10 0x7ff0dc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:12.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.083+0000 7ff0e6ffd640 1 -- 172.21.15.70:0/3232309009 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff0ec0efe70 con 0x7ff0f0100b30 2024-09-12T01:51:12.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.083+0000 7ff0f55aa640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff0dc0a2c10 0x7ff0dc0a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00ffd30 tx=0x7ff0e0008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:12.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.086+0000 7ff0e6ffd640 1 -- 172.21.15.70:0/3232309009 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0ec0bcc70 con 0x7ff0f0100b30 2024-09-12T01:51:12.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.287+0000 7ff0f800f640 1 -- 172.21.15.70:0/3232309009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0f0105920 con 0x7ff0f0100b30 2024-09-12T01:51:12.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.287+0000 7ff0e6ffd640 1 -- 172.21.15.70:0/3232309009 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7ff0ec0dc070 con 0x7ff0f0100b30 2024-09-12T01:51:12.287 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:12.288 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-12T01:50:09:375588+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:50:09.375567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:51:12.288 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-12T01:51:12.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.289+0000 7ff0f800f640 1 -- 172.21.15.70:0/3232309009 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff0dc0a2c10 msgr2=0x7ff0dc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.289+0000 7ff0f800f640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff0dc0a2c10 0x7ff0dc0a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00ffd30 tx=0x7ff0e0008040 comp rx=0 tx=0).stop 2024-09-12T01:51:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.289+0000 7ff0f800f640 1 -- 172.21.15.70:0/3232309009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f0100b30 msgr2=0x7ff0f01a47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.289+0000 7ff0f800f640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f0100b30 0x7ff0f01a47d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec006010 tx=0x7ff0ec0042f0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.289+0000 7ff0f800f640 1 -- 172.21.15.70:0/3232309009 shutdown_connections 2024-09-12T01:51:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.289+0000 7ff0f800f640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff0dc0a2c10 0x7ff0dc0a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.289+0000 7ff0f800f640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0f0105f40 0x7ff0f019e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.290+0000 7ff0f800f640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0f0101450 0x7ff0f01a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.290+0000 7ff0f800f640 1 --2- 172.21.15.70:0/3232309009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f0100b30 0x7ff0f01a47d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.290+0000 7ff0f800f640 1 -- 172.21.15.70:0/3232309009 >> 172.21.15.70:0/3232309009 conn(0x7ff0f00fc7a0 msgr2=0x7ff0f01038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.290+0000 7ff0f800f640 1 -- 172.21.15.70:0/3232309009 shutdown_connections 2024-09-12T01:51:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:12.290+0000 7ff0f800f640 1 -- 172.21.15.70:0/3232309009 wait complete. 2024-09-12T01:51:12.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:12 smithi191 ceph-mon[35770]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:12.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:12 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3232309009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:12.742 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:12 smithi070 ceph-mon[31177]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:12.742 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:12 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3232309009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:12 smithi152 ceph-mon[35055]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:12 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3232309009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:12.872 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:51:13.117 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:13.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.586+0000 7fed3ac62640 1 -- 172.21.15.70:0/1659331329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed34112640 msgr2=0x7fed34112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.586+0000 7fed3ac62640 1 --2- 172.21.15.70:0/1659331329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed34112640 0x7fed34112a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fed24009900 tx=0x7fed2402a410 comp rx=0 tx=0).stop 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.586+0000 7fed3ac62640 1 -- 172.21.15.70:0/1659331329 shutdown_connections 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.586+0000 7fed3ac62640 1 --2- 172.21.15.70:0/1659331329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed3410cf30 0x7fed34119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.586+0000 7fed3ac62640 1 --2- 172.21.15.70:0/1659331329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed3410c590 0x7fed3410c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.586+0000 7fed3ac62640 1 --2- 172.21.15.70:0/1659331329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed34112640 0x7fed34112a20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.586+0000 7fed3ac62640 1 -- 172.21.15.70:0/1659331329 >> 172.21.15.70:0/1659331329 conn(0x7fed3406cdc0 msgr2=0x7fed3406d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.586+0000 7fed3ac62640 1 -- 172.21.15.70:0/1659331329 shutdown_connections 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.587+0000 7fed3ac62640 1 -- 172.21.15.70:0/1659331329 wait complete. 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.587+0000 7fed3ac62640 1 Processor -- start 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.587+0000 7fed3ac62640 1 -- start start 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.587+0000 7fed3ac62640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed3410c590 0x7fed341a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.587+0000 7fed3ac62640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed3410cf30 0x7fed341a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:13.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.587+0000 7fed3ac62640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed34112640 0x7fed341a7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.587+0000 7fed3ac62640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fed3411cac0 con 0x7fed3410cf30 2024-09-12T01:51:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.587+0000 7fed3ac62640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fed3411c940 con 0x7fed34112640 2024-09-12T01:51:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.587+0000 7fed3ac62640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fed3411cc40 con 0x7fed3410c590 2024-09-12T01:51:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.587+0000 7fed33fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed3410cf30 0x7fed341a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.587+0000 7fed33fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed3410cf30 0x7fed341a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49158/0 (socket says 172.21.15.70:49158) 2024-09-12T01:51:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.587+0000 7fed33fff640 1 -- 172.21.15.70:0/2074784970 learned_addr learned my addr 172.21.15.70:0/2074784970 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.588+0000 7fed389fe640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed3410c590 0x7fed341a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.588+0000 7fed33fff640 1 -- 172.21.15.70:0/2074784970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed3410c590 msgr2=0x7fed341a2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.588+0000 7fed33fff640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed3410c590 0x7fed341a2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.588+0000 7fed33fff640 1 -- 172.21.15.70:0/2074784970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed34112640 msgr2=0x7fed341a7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.588+0000 7fed33fff640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed34112640 0x7fed341a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.588+0000 7fed33fff640 1 -- 172.21.15.70:0/2074784970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed341a7e30 con 0x7fed3410cf30 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.588+0000 7fed33fff640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed3410cf30 0x7fed341a33c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fed2800c890 tx=0x7fed2800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.588+0000 7fed31ffb640 1 -- 172.21.15.70:0/2074784970 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28004220 con 0x7fed3410cf30 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.588+0000 7fed3ac62640 1 -- 172.21.15.70:0/2074784970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed341a8120 con 0x7fed3410cf30 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.588+0000 7fed31ffb640 1 -- 172.21.15.70:0/2074784970 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed280043c0 con 0x7fed3410cf30 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.588+0000 7fed31ffb640 1 -- 172.21.15.70:0/2074784970 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28004b10 con 0x7fed3410cf30 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.588+0000 7fed3ac62640 1 -- 172.21.15.70:0/2074784970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed341afa00 con 0x7fed3410cf30 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.589+0000 7fed3ac62640 1 -- 172.21.15.70:0/2074784970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3410c9f0 con 0x7fed3410cf30 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.590+0000 7fed31ffb640 1 -- 172.21.15.70:0/2074784970 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fed280051b0 con 0x7fed3410cf30 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.591+0000 7fed31ffb640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fed1c0a2c10 0x7fed1c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.591+0000 7fed389fe640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fed1c0a2c10 0x7fed1c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.591+0000 7fed31ffb640 1 -- 172.21.15.70:0/2074784970 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fed280cf300 con 0x7fed3410cf30 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.591+0000 7fed389fe640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fed1c0a2c10 0x7fed1c0a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fed24006010 tx=0x7fed24000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.595+0000 7fed31ffb640 1 -- 172.21.15.70:0/2074784970 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed28014030 con 0x7fed3410cf30 2024-09-12T01:51:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.799+0000 7fed3ac62640 1 -- 172.21.15.70:0/2074784970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed341afd30 con 0x7fed3410cf30 2024-09-12T01:51:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.800+0000 7fed31ffb640 1 -- 172.21.15.70:0/2074784970 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7fed2809c100 con 0x7fed3410cf30 2024-09-12T01:51:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:13.800 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-12T01:50:09:375588+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:50:09.375567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:51:13.801 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-12T01:51:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.802+0000 7fed3ac62640 1 -- 172.21.15.70:0/2074784970 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fed1c0a2c10 msgr2=0x7fed1c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.802+0000 7fed3ac62640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fed1c0a2c10 0x7fed1c0a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fed24006010 tx=0x7fed24000bc0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.802+0000 7fed3ac62640 1 -- 172.21.15.70:0/2074784970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed3410cf30 msgr2=0x7fed341a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.802+0000 7fed3ac62640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed3410cf30 0x7fed341a33c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fed2800c890 tx=0x7fed2800cd50 comp rx=0 tx=0).stop 2024-09-12T01:51:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.802+0000 7fed3ac62640 1 -- 172.21.15.70:0/2074784970 shutdown_connections 2024-09-12T01:51:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.802+0000 7fed3ac62640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fed1c0a2c10 0x7fed1c0a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.802+0000 7fed3ac62640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed34112640 0x7fed341a7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.802+0000 7fed3ac62640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed3410cf30 0x7fed341a33c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.802+0000 7fed3ac62640 1 --2- 172.21.15.70:0/2074784970 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed3410c590 0x7fed341a2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:13.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.802+0000 7fed3ac62640 1 -- 172.21.15.70:0/2074784970 >> 172.21.15.70:0/2074784970 conn(0x7fed3406cdc0 msgr2=0x7fed3410ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:13.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.803+0000 7fed3ac62640 1 -- 172.21.15.70:0/2074784970 shutdown_connections 2024-09-12T01:51:13.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:13.803+0000 7fed3ac62640 1 -- 172.21.15.70:0/2074784970 wait complete. 2024-09-12T01:51:14.356 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:51:14.601 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:14.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:14 smithi070 ceph-mon[31177]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:14.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:14 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2074784970' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:14.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:14 smithi191 ceph-mon[35770]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:14.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:14 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2074784970' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:15.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:14 smithi152 ceph-mon[35055]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:15.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:14 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2074784970' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:15.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.059+0000 7ff6ff345640 1 -- 172.21.15.70:0/257335274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6f8101380 msgr2=0x7ff6f810dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:15.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.059+0000 7ff6ff345640 1 --2- 172.21.15.70:0/257335274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6f8101380 0x7ff6f810dfb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009900 tx=0x7ff6e802a410 comp rx=0 tx=0).stop 2024-09-12T01:51:15.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 -- 172.21.15.70:0/257335274 shutdown_connections 2024-09-12T01:51:15.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 --2- 172.21.15.70:0/257335274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6f810e4f0 0x7ff6f8110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 --2- 172.21.15.70:0/257335274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6f8101380 0x7ff6f810dfb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 --2- 172.21.15.70:0/257335274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6f81009d0 0x7ff6f8100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 -- 172.21.15.70:0/257335274 >> 172.21.15.70:0/257335274 conn(0x7ff6f80fc7d0 msgr2=0x7ff6f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:15.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 -- 172.21.15.70:0/257335274 shutdown_connections 2024-09-12T01:51:15.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 -- 172.21.15.70:0/257335274 wait complete. 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 Processor -- start 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 -- start start 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6f81009d0 0x7ff6f81a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6f8101380 0x7ff6f81a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6f810e4f0 0x7ff6f819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.060+0000 7ff6ff345640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f8114400 con 0x7ff6f8101380 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6ff345640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f8114280 con 0x7ff6f810e4f0 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6ff345640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f8114580 con 0x7ff6f81009d0 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6fc8e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6f8101380 0x7ff6f81a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6fc8e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6f8101380 0x7ff6f81a0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49176/0 (socket says 172.21.15.70:49176) 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6fc8e0640 1 -- 172.21.15.70:0/3913722934 learned_addr learned my addr 172.21.15.70:0/3913722934 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6fd0e1640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6f81009d0 0x7ff6f81a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6fd8e2640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6f810e4f0 0x7ff6f819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6fc8e0640 1 -- 172.21.15.70:0/3913722934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6f81009d0 msgr2=0x7ff6f81a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6fc8e0640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6f81009d0 0x7ff6f81a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6fc8e0640 1 -- 172.21.15.70:0/3913722934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6f810e4f0 msgr2=0x7ff6f819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6fc8e0640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6f810e4f0 0x7ff6f819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6fc8e0640 1 -- 172.21.15.70:0/3913722934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f819ad40 con 0x7ff6f8101380 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6fd8e2640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6f810e4f0 0x7ff6f819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6fc8e0640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6f8101380 0x7ff6f81a0990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8006010 tx=0x7ff6e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6ee7fc640 1 -- 172.21.15.70:0/3913722934 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e803f030 con 0x7ff6f8101380 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6ff345640 1 -- 172.21.15.70:0/3913722934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f819afd0 con 0x7ff6f8101380 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6ee7fc640 1 -- 172.21.15.70:0/3913722934 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6e8003d00 con 0x7ff6f8101380 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6ff345640 1 -- 172.21.15.70:0/3913722934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f81a7320 con 0x7ff6f8101380 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.061+0000 7ff6ee7fc640 1 -- 172.21.15.70:0/3913722934 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8035070 con 0x7ff6f8101380 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.062+0000 7ff6ff345640 1 -- 172.21.15.70:0/3913722934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f8100db0 con 0x7ff6f8101380 2024-09-12T01:51:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.064+0000 7ff6ee7fc640 1 -- 172.21.15.70:0/3913722934 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff6e8042030 con 0x7ff6f8101380 2024-09-12T01:51:15.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.064+0000 7ff6ee7fc640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff6e40a2c10 0x7ff6e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:15.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.064+0000 7ff6fd0e1640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff6e40a2c10 0x7ff6e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:15.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.064+0000 7ff6ee7fc640 1 -- 172.21.15.70:0/3913722934 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff6e80f0100 con 0x7ff6f8101380 2024-09-12T01:51:15.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.065+0000 7ff6fd0e1640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff6e40a2c10 0x7ff6e40a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4005e10 tx=0x7ff6f4005da0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:15.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.068+0000 7ff6ee7fc640 1 -- 172.21.15.70:0/3913722934 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6e8049020 con 0x7ff6f8101380 2024-09-12T01:51:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.234+0000 7ff6ff345640 1 -- 172.21.15.70:0/3913722934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6f81a7550 con 0x7ff6f8101380 2024-09-12T01:51:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.236+0000 7ff6ee7fc640 1 -- 172.21.15.70:0/3913722934 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22713 (secure 0 0 0) 0x7ff6e80bcf00 con 0x7ff6f8101380 2024-09-12T01:51:15.236 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:15.236 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:50:22.600430+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:49:54.140097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:49:56.005187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:51:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.238+0000 7ff6ff345640 1 -- 172.21.15.70:0/3913722934 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff6e40a2c10 msgr2=0x7ff6e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.238+0000 7ff6ff345640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff6e40a2c10 0x7ff6e40a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4005e10 tx=0x7ff6f4005da0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.238+0000 7ff6ff345640 1 -- 172.21.15.70:0/3913722934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6f8101380 msgr2=0x7ff6f81a0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.238+0000 7ff6ff345640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6f8101380 0x7ff6f81a0990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8006010 tx=0x7ff6e80042f0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.238+0000 7ff6ff345640 1 -- 172.21.15.70:0/3913722934 shutdown_connections 2024-09-12T01:51:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.238+0000 7ff6ff345640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff6e40a2c10 0x7ff6e40a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.238+0000 7ff6ff345640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6f810e4f0 0x7ff6f819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.238+0000 7ff6ff345640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6f8101380 0x7ff6f81a0990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.238+0000 7ff6ff345640 1 --2- 172.21.15.70:0/3913722934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6f81009d0 0x7ff6f81a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.238+0000 7ff6ff345640 1 -- 172.21.15.70:0/3913722934 >> 172.21.15.70:0/3913722934 conn(0x7ff6f80fc7d0 msgr2=0x7ff6f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.238+0000 7ff6ff345640 1 -- 172.21.15.70:0/3913722934 shutdown_connections 2024-09-12T01:51:15.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:15.238+0000 7ff6ff345640 1 -- 172.21.15.70:0/3913722934 wait complete. 2024-09-12T01:51:15.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:15 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3913722934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:51:15.903 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:51:15.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:15 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3913722934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:51:16.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:15 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3913722934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:51:16.144 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:16.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.599+0000 7ffa6f08a640 1 -- 172.21.15.70:0/2843567731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa68101de0 msgr2=0x7ffa681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.599+0000 7ffa6f08a640 1 --2- 172.21.15.70:0/2843567731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa68101de0 0x7ffa681021c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009ca0 tx=0x7ffa6402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.599+0000 7ffa6f08a640 1 -- 172.21.15.70:0/2843567731 shutdown_connections 2024-09-12T01:51:16.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.599+0000 7ffa6f08a640 1 --2- 172.21.15.70:0/2843567731 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa68106f10 0x7ffa6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.599+0000 7ffa6f08a640 1 --2- 172.21.15.70:0/2843567731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa68102790 0x7ffa681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.599+0000 7ffa6f08a640 1 --2- 172.21.15.70:0/2843567731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa68101de0 0x7ffa681021c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.599+0000 7ffa6f08a640 1 -- 172.21.15.70:0/2843567731 >> 172.21.15.70:0/2843567731 conn(0x7ffa680fd8c0 msgr2=0x7ffa680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:16.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.599+0000 7ffa6f08a640 1 -- 172.21.15.70:0/2843567731 shutdown_connections 2024-09-12T01:51:16.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.599+0000 7ffa6f08a640 1 -- 172.21.15.70:0/2843567731 wait complete. 2024-09-12T01:51:16.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.600+0000 7ffa6f08a640 1 Processor -- start 2024-09-12T01:51:16.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.600+0000 7ffa6f08a640 1 -- start start 2024-09-12T01:51:16.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.600+0000 7ffa6f08a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa68101de0 0x7ffa68198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.600+0000 7ffa6f08a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa68102790 0x7ffa68198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.600+0000 7ffa6f08a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa68106f10 0x7ffa6819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.600+0000 7ffa6f08a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa68112150 con 0x7ffa68106f10 2024-09-12T01:51:16.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.600+0000 7ffa6f08a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffa68111fd0 con 0x7ffa68102790 2024-09-12T01:51:16.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.600+0000 7ffa6f08a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ffa681122d0 con 0x7ffa68101de0 2024-09-12T01:51:16.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.600+0000 7ffa6d627640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa68106f10 0x7ffa6819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa6d627640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa68106f10 0x7ffa6819cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49190/0 (socket says 172.21.15.70:49190) 2024-09-12T01:51:16.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa6d627640 1 -- 172.21.15.70:0/1805944912 learned_addr learned my addr 172.21.15.70:0/1805944912 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:16.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa6ce26640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa68101de0 0x7ffa68198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa5ffff640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa68102790 0x7ffa68198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa6d627640 1 -- 172.21.15.70:0/1805944912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa68101de0 msgr2=0x7ffa68198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa6d627640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa68101de0 0x7ffa68198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa6d627640 1 -- 172.21.15.70:0/1805944912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa68102790 msgr2=0x7ffa68198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa6d627640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa68102790 0x7ffa68198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa6d627640 1 -- 172.21.15.70:0/1805944912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6819d620 con 0x7ffa68106f10 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa6ce26640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa68101de0 0x7ffa68198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa6d627640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa68106f10 0x7ffa6819cf40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009fd0 tx=0x7ffa6000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa5dffb640 1 -- 172.21.15.70:0/1805944912 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60011830 con 0x7ffa68106f10 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa6f08a640 1 -- 172.21.15.70:0/1805944912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6819d910 con 0x7ffa68106f10 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa5dffb640 1 -- 172.21.15.70:0/1805944912 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffa60016070 con 0x7ffa68106f10 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa5dffb640 1 -- 172.21.15.70:0/1805944912 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000f2e0 con 0x7ffa68106f10 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.601+0000 7ffa6f08a640 1 -- 172.21.15.70:0/1805944912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa681a51f0 con 0x7ffa68106f10 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.602+0000 7ffa6f08a640 1 -- 172.21.15.70:0/1805944912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa68102240 con 0x7ffa68106f10 2024-09-12T01:51:16.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.603+0000 7ffa5dffb640 1 -- 172.21.15.70:0/1805944912 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffa6001b460 con 0x7ffa68106f10 2024-09-12T01:51:16.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.604+0000 7ffa5dffb640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffa500a2c10 0x7ffa500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.604+0000 7ffa6ce26640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffa500a2c10 0x7ffa500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.604+0000 7ffa5dffb640 1 -- 172.21.15.70:0/1805944912 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ffa600ce7a0 con 0x7ffa68106f10 2024-09-12T01:51:16.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.605+0000 7ffa6ce26640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffa500a2c10 0x7ffa500a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009a60 tx=0x7ffa6402f3a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:16.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.608+0000 7ffa5dffb640 1 -- 172.21.15.70:0/1805944912 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa6009b6b0 con 0x7ffa68106f10 2024-09-12T01:51:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.807+0000 7ffa6f08a640 1 -- 172.21.15.70:0/1805944912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa68109b60 con 0x7ffa68106f10 2024-09-12T01:51:16.808 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:16 smithi070 ceph-mon[31177]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.808+0000 7ffa5dffb640 1 -- 172.21.15.70:0/1805944912 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7ffa6009afb0 con 0x7ffa68106f10 2024-09-12T01:51:16.809 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:16.809 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-12T01:50:09:375588+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:50:09.375567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:51:16.809 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-12T01:51:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.811+0000 7ffa6f08a640 1 -- 172.21.15.70:0/1805944912 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffa500a2c10 msgr2=0x7ffa500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.811+0000 7ffa6f08a640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffa500a2c10 0x7ffa500a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009a60 tx=0x7ffa6402f3a0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.811+0000 7ffa6f08a640 1 -- 172.21.15.70:0/1805944912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa68106f10 msgr2=0x7ffa6819cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.811+0000 7ffa6f08a640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa68106f10 0x7ffa6819cf40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009fd0 tx=0x7ffa6000b8e0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.811+0000 7ffa6f08a640 1 -- 172.21.15.70:0/1805944912 shutdown_connections 2024-09-12T01:51:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.811+0000 7ffa6f08a640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ffa500a2c10 0x7ffa500a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.811+0000 7ffa6f08a640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa68106f10 0x7ffa6819cf40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.811+0000 7ffa6f08a640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa68102790 0x7ffa68198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.811+0000 7ffa6f08a640 1 --2- 172.21.15.70:0/1805944912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffa68101de0 0x7ffa68198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.811+0000 7ffa6f08a640 1 -- 172.21.15.70:0/1805944912 >> 172.21.15.70:0/1805944912 conn(0x7ffa680fd8c0 msgr2=0x7ffa680fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.811+0000 7ffa6f08a640 1 -- 172.21.15.70:0/1805944912 shutdown_connections 2024-09-12T01:51:16.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:16.811+0000 7ffa6f08a640 1 -- 172.21.15.70:0/1805944912 wait complete. 2024-09-12T01:51:16.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:16 smithi191 ceph-mon[35770]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:17.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:16 smithi152 ceph-mon[35055]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:17.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T01:49:57.864263+0000', 'modified': '2024-09-12T01:50:09.375567+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24452, 'mds_1': 24445, 'mds_2': 24437, 'mds_3': 24433, 'mds_4': 24427}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14637': {'gid': 14637, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6839/3076923681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 3076923681}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 3076923681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14649': {'gid': 14649, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6841/3509291516', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6840', 'nonce': 3509291516}, {'type': 'v1', 'addr': '172.21.15.70:6841', 'nonce': 3509291516}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6833/2100585386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 2100585386}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 2100585386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6833/1019939610', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 1019939610}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 1019939610}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6835/2743921312', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 2743921312}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 2743921312}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.191:6835/97556731', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 97556731}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 97556731}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24433': {'gid': 24433, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.191:6837/1473295002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 1473295002}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 1473295002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.152:6837/3978171312', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 3978171312}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 3978171312}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.191:6839/1679121869', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 1679121869}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 1679121869}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24452': {'gid': 24452, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.152:6839/3057936512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6838', 'nonce': 3057936512}, {'type': 'v1', 'addr': '172.21.15.152:6839', 'nonce': 3057936512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24452, 'qdb_cluster': [24452, 24445, 24437, 24433, 24427]} 2024-09-12T01:51:17.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T01:51:17.387 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-12T01:51:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:17.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:17 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1805944912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:17.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:17 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1805944912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:18.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:17 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1805944912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:18.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.065+0000 7f7ece43f640 1 -- 172.21.15.70:0/2480403549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ec810c170 msgr2=0x7f7ec810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:18.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.065+0000 7f7ece43f640 1 --2- 172.21.15.70:0/2480403549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ec810c170 0x7f7ec810e610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009ca0 tx=0x7f7ec002a950 comp rx=0 tx=0).stop 2024-09-12T01:51:18.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.065+0000 7f7ece43f640 1 -- 172.21.15.70:0/2480403549 shutdown_connections 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.065+0000 7f7ece43f640 1 --2- 172.21.15.70:0/2480403549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ec810c170 0x7f7ec810e610 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.065+0000 7f7ece43f640 1 --2- 172.21.15.70:0/2480403549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ec8103660 0x7f7ec810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.065+0000 7f7ece43f640 1 --2- 172.21.15.70:0/2480403549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec8102d40 0x7f7ec8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.065+0000 7f7ece43f640 1 -- 172.21.15.70:0/2480403549 >> 172.21.15.70:0/2480403549 conn(0x7f7ec80fc7a0 msgr2=0x7f7ec80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.065+0000 7f7ece43f640 1 -- 172.21.15.70:0/2480403549 shutdown_connections 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.065+0000 7f7ece43f640 1 -- 172.21.15.70:0/2480403549 wait complete. 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ece43f640 1 Processor -- start 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ece43f640 1 -- start start 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ece43f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ec8102d40 0x7f7ec81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ece43f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec8103660 0x7f7ec8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ece43f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ec810c170 0x7f7ec8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ece43f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec81120f0 con 0x7f7ec8102d40 2024-09-12T01:51:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ece43f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec8111f70 con 0x7f7ec8103660 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ece43f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec8112270 con 0x7f7ec810c170 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ec7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ec8102d40 0x7f7ec81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ec7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ec8102d40 0x7f7ec81009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49208/0 (socket says 172.21.15.70:49208) 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ec7fff640 1 -- 172.21.15.70:0/2801689301 learned_addr learned my addr 172.21.15.70:0/2801689301 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ec77fe640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec8103660 0x7f7ec8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ec7fff640 1 -- 172.21.15.70:0/2801689301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ec810c170 msgr2=0x7f7ec8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ec7fff640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ec810c170 0x7f7ec8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ec7fff640 1 -- 172.21.15.70:0/2801689301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec8103660 msgr2=0x7f7ec8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ec7fff640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec8103660 0x7f7ec8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.066+0000 7f7ec7fff640 1 -- 172.21.15.70:0/2801689301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec81a69d0 con 0x7f7ec8102d40 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.067+0000 7f7ec7fff640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ec8102d40 0x7f7ec81009a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800b4a0 tx=0x7f7eb800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.067+0000 7f7ec57fa640 1 -- 172.21.15.70:0/2801689301 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8014070 con 0x7f7ec8102d40 2024-09-12T01:51:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.067+0000 7f7ece43f640 1 -- 172.21.15.70:0/2801689301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec81a6cc0 con 0x7f7ec8102d40 2024-09-12T01:51:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.067+0000 7f7ec57fa640 1 -- 172.21.15.70:0/2801689301 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7eb8010b10 con 0x7f7ec8102d40 2024-09-12T01:51:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.067+0000 7f7ec57fa640 1 -- 172.21.15.70:0/2801689301 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8017d60 con 0x7f7ec8102d40 2024-09-12T01:51:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.067+0000 7f7ece43f640 1 -- 172.21.15.70:0/2801689301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec81a71b0 con 0x7f7ec8102d40 2024-09-12T01:51:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.069+0000 7f7ec57fa640 1 -- 172.21.15.70:0/2801689301 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7eb8017070 con 0x7f7ec8102d40 2024-09-12T01:51:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.069+0000 7f7ed0818740 1 Processor -- start 2024-09-12T01:51:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.070+0000 7f7ed0818740 1 -- start start 2024-09-12T01:51:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.070+0000 7f7ec57fa640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7eb00a2c90 0x7f7eb00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.070+0000 7f7ed0818740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3527091e0 0x55f3527095c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.070+0000 7f7ed0818740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 0x55f352713e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.070+0000 7f7ed0818740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527143c0 0x55f3527167b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.070+0000 7f7ed0818740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f352667090 con 0x55f352709b00 2024-09-12T01:51:18.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.070+0000 7f7ed0818740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f35260ea70 con 0x55f3527091e0 2024-09-12T01:51:18.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.070+0000 7f7ed0818740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f352663050 con 0x55f3527143c0 2024-09-12T01:51:18.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.070+0000 7f7ecc9dc640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7eb00a2c90 0x7f7eb00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.070+0000 7f7ec57fa640 1 -- 172.21.15.70:0/2801689301 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7eb80ce530 con 0x7f7ec8102d40 2024-09-12T01:51:18.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7ec77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 0x55f352713e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7ec77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 0x55f352713e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49218/0 (socket says 172.21.15.70:49218) 2024-09-12T01:51:18.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7ec77fe640 1 -- 172.21.15.70:0/1086319470 learned_addr learned my addr 172.21.15.70:0/1086319470 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:18.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7ec7fff640 1 --2- 172.21.15.70:0/1086319470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3527091e0 0x55f3527095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7ec77fe640 1 -- 172.21.15.70:0/1086319470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527143c0 msgr2=0x55f3527167b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:18.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7ec77fe640 1 --2- 172.21.15.70:0/1086319470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527143c0 0x55f3527167b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7ec77fe640 1 -- 172.21.15.70:0/1086319470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3527091e0 msgr2=0x55f3527095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7ec77fe640 1 --2- 172.21.15.70:0/1086319470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3527091e0 0x55f3527095c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7ec77fe640 1 -- 172.21.15.70:0/1086319470 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f35261b130 con 0x55f352709b00 2024-09-12T01:51:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7ecc9dc640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7eb00a2c90 0x7f7eb00a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7ec002ae70 tx=0x7f7ec00098e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7ec77fe640 1 --2- 172.21.15.70:0/1086319470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 0x55f352713e80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00cb30 tx=0x7f7ebc00e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3644237d8ddc35bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7eae7fc640 1 -- 172.21.15.70:0/1086319470 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc014070 con 0x55f352709b00 2024-09-12T01:51:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7eae7fc640 1 -- 172.21.15.70:0/1086319470 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ebc019960 con 0x55f352709b00 2024-09-12T01:51:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.071+0000 7f7eae7fc640 1 -- 172.21.15.70:0/1086319470 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc010a90 con 0x55f352709b00 2024-09-12T01:51:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.072+0000 7f7ed0818740 1 -- 172.21.15.70:0/1086319470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 msgr2=0x55f352713e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.072+0000 7f7ed0818740 1 --2- 172.21.15.70:0/1086319470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 0x55f352713e80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00cb30 tx=0x7f7ebc00e350 comp rx=0 tx=0).stop 2024-09-12T01:51:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.072+0000 7f7ed0818740 1 -- 172.21.15.70:0/1086319470 shutdown_connections 2024-09-12T01:51:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.072+0000 7f7ed0818740 1 --2- 172.21.15.70:0/1086319470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527143c0 0x55f3527167b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.072+0000 7f7ed0818740 1 --2- 172.21.15.70:0/1086319470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 0x55f352713e80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.072+0000 7f7ed0818740 1 --2- 172.21.15.70:0/1086319470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3527091e0 0x55f3527095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.072+0000 7f7ed0818740 1 -- 172.21.15.70:0/1086319470 >> 172.21.15.70:0/1086319470 conn(0x55f352705770 msgr2=0x55f352705b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.072+0000 7f7ed0818740 1 -- 172.21.15.70:0/1086319470 shutdown_connections 2024-09-12T01:51:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.072+0000 7f7ed0818740 1 -- 172.21.15.70:0/1086319470 wait complete. 2024-09-12T01:51:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.072+0000 7f7ed0818740 1 -- start start 2024-09-12T01:51:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ed0818740 1 Processor -- start 2024-09-12T01:51:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ed0818740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 0x55f352713c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ed0818740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f352709b00 0x55f352710fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ed0818740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 0x55f352711500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ed0818740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f352716f90 con 0x55f3527143c0 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ed0818740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f352621f20 con 0x55f352709b00 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ed0818740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f352717110 con 0x55f3527091e0 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ed0818740 10 client.0 _ll_register_callbacks cb 0x55f3525eb030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ecc9dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 0x55f352711500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ecc9dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 0x55f352711500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49224/0 (socket says 172.21.15.70:49224) 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ecc9dc640 1 -- 172.21.15.70:0/3827564086 learned_addr learned my addr 172.21.15.70:0/3827564086 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ec77fe640 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f352709b00 0x55f352710fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ec7fff640 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 0x55f352713c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ecc9dc640 1 -- 172.21.15.70:0/3827564086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 msgr2=0x55f352713c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ecc9dc640 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 0x55f352713c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ecc9dc640 1 -- 172.21.15.70:0/3827564086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f352709b00 msgr2=0x55f352710fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ecc9dc640 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f352709b00 0x55f352710fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ecc9dc640 1 -- 172.21.15.70:0/3827564086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3523d82b0 con 0x55f3527143c0 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.073+0000 7f7ec7fff640 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 0x55f352713c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.074+0000 7f7ecc9dc640 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 0x55f352711500 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009430 tx=0x7f7ec00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a394ff02893d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.074+0000 7f7ea77fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.074+0000 7f7ea77fe640 1 -- 172.21.15.70:0/3827564086 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec004c070 con 0x55f3527143c0 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.074+0000 7f7ed0818740 1 -- 172.21.15.70:0/3827564086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ebc019960 con 0x55f3527143c0 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.074+0000 7f7ea77fe640 1 -- 172.21.15.70:0/3827564086 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7ec0004240 con 0x55f3527143c0 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.074+0000 7f7ea77fe640 1 -- 172.21.15.70:0/3827564086 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7ec0058050 con 0x55f3527143c0 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.074+0000 7f7ed0818740 10 client.15033 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.074+0000 7f7ed0818740 1 -- 172.21.15.70:0/3827564086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f3527228e0 con 0x55f3527143c0 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.074+0000 7f7ea77fe640 1 -- 172.21.15.70:0/3827564086 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ebc019960 con 0x55f3527143c0 2024-09-12T01:51:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.074+0000 7f7ea77fe640 1 -- 172.21.15.70:0/3827564086 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7ec0030440 con 0x55f3527143c0 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.074+0000 7f7ed0818740 10 client.15033 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.074+0000 7f7ed0818740 10 client.15033 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.075+0000 7f7ed0818740 20 client.15033 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.075+0000 7f7ed0818740 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55f352724f40 0x55f3527263b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.075+0000 7f7ed0818740 4 client.15033 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.075+0000 7f7ed0818740 1 -- 172.21.15.70:0/3827564086 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f352674600 con 0x55f352724f40 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.075+0000 7f7ec7fff640 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55f352724f40 0x55f3527263b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.075+0000 7f7ea77fe640 10 client.15033 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.075+0000 7f7ec7fff640 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55f352724f40 0x55f3527263b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bb0c72e1f065a862 server_cookie=e8aa969e0c662477 in_seq=0 out_seq=0 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ea77fe640 1 -- 172.21.15.70:0/3827564086 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f352674600 con 0x55f352724f40 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ea77fe640 10 client.15033 handle_command_reply: tid=0 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ed0818740 1 client.15033 shutdown 2024-09-12T01:51:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ed0818740 1 -- 172.21.15.70:0/3827564086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 msgr2=0x55f352711500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ed0818740 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 0x55f352711500 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009430 tx=0x7f7ec00095c0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ed0818740 1 -- 172.21.15.70:0/3827564086 shutdown_connections 2024-09-12T01:51:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ed0818740 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55f352724f40 0x55f3527263b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ed0818740 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 0x55f352711500 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ed0818740 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f352709b00 0x55f352710fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ed0818740 1 --2- 172.21.15.70:0/3827564086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 0x55f352713c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ea77fe640 0 client.15033 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:51:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ed0818740 1 -- 172.21.15.70:0/3827564086 >> 172.21.15.70:0/3827564086 conn(0x55f352705770 msgr2=0x55f35270b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ed0818740 1 -- 172.21.15.70:0/3827564086 shutdown_connections 2024-09-12T01:51:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.076+0000 7f7ed0818740 1 -- 172.21.15.70:0/3827564086 wait complete. 2024-09-12T01:51:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.077+0000 7f7ed0818740 20 client.15033 trim_cache size 0 max 16384 2024-09-12T01:51:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ed0818740 1 Processor -- start 2024-09-12T01:51:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ed0818740 1 -- start start 2024-09-12T01:51:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ed0818740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 0x55f352724f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ed0818740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 0x55f352710f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ed0818740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3527143c0 0x55f3527114c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ed0818740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f3527246f0 con 0x55f352709b00 2024-09-12T01:51:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ed0818740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f352724dc0 con 0x55f3527143c0 2024-09-12T01:51:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ed0818740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f352725490 con 0x55f3527091e0 2024-09-12T01:51:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ec77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 0x55f352710f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ec77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 0x55f352710f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49226/0 (socket says 172.21.15.70:49226) 2024-09-12T01:51:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ec77fe640 1 -- 172.21.15.70:0/766445509 learned_addr learned my addr 172.21.15.70:0/766445509 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ec77fe640 1 -- 172.21.15.70:0/766445509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 msgr2=0x55f352724f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ec77fe640 1 --2- 172.21.15.70:0/766445509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 0x55f352724f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ec77fe640 1 -- 172.21.15.70:0/766445509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3527143c0 msgr2=0x55f3527114c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ecc9dc640 1 --2- 172.21.15.70:0/766445509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3527143c0 0x55f3527114c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ec77fe640 1 --2- 172.21.15.70:0/766445509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3527143c0 0x55f3527114c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ec77fe640 1 -- 172.21.15.70:0/766445509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f352706900 con 0x55f352709b00 2024-09-12T01:51:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.094+0000 7f7ecc9dc640 1 --2- 172.21.15.70:0/766445509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3527143c0 0x55f3527114c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7ec77fe640 1 --2- 172.21.15.70:0/766445509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 0x55f352710f80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00e850 tx=0x7f7ebc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b49e4d513777efd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7eadffb640 1 -- 172.21.15.70:0/766445509 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc014050 con 0x55f352709b00 2024-09-12T01:51:18.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7eadffb640 1 -- 172.21.15.70:0/766445509 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ebc01f040 con 0x55f352709b00 2024-09-12T01:51:18.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7eadffb640 1 -- 172.21.15.70:0/766445509 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc004e10 con 0x55f352709b00 2024-09-12T01:51:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7ed0818740 1 -- 172.21.15.70:0/766445509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 msgr2=0x55f352710f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7ed0818740 1 --2- 172.21.15.70:0/766445509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 0x55f352710f80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00e850 tx=0x7f7ebc00c7e0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7ed0818740 1 -- 172.21.15.70:0/766445509 shutdown_connections 2024-09-12T01:51:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7ed0818740 1 --2- 172.21.15.70:0/766445509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f3527143c0 0x55f3527114c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7ed0818740 1 --2- 172.21.15.70:0/766445509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f352709b00 0x55f352710f80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7ed0818740 1 --2- 172.21.15.70:0/766445509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 0x55f352724f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7ed0818740 1 -- 172.21.15.70:0/766445509 >> 172.21.15.70:0/766445509 conn(0x55f352705770 msgr2=0x55f352705b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7ed0818740 1 -- 172.21.15.70:0/766445509 shutdown_connections 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.095+0000 7f7ed0818740 1 -- 172.21.15.70:0/766445509 wait complete. 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.096+0000 7f7ed0818740 1 -- start start 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.096+0000 7f7ed0818740 1 Processor -- start 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.096+0000 7f7ed0818740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 0x55f352729530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.096+0000 7f7ed0818740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f352709b00 0x55f352729a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.096+0000 7f7ed0818740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 0x55f352729fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.096+0000 7f7ed0818740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f352726230 con 0x55f3527143c0 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.096+0000 7f7ed0818740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f352725b60 con 0x55f352709b00 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.096+0000 7f7ed0818740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f352726900 con 0x55f3527091e0 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.096+0000 7f7ed0818740 10 client.0 _ll_register_callbacks cb 0x7f7ec0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.096+0000 7f7ecc9dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 0x55f352729fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.096+0000 7f7ecc9dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 0x55f352729fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49236/0 (socket says 172.21.15.70:49236) 2024-09-12T01:51:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.096+0000 7f7ecc9dc640 1 -- 172.21.15.70:0/561933326 learned_addr learned my addr 172.21.15.70:0/561933326 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ec7fff640 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 0x55f352729530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ec77fe640 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f352709b00 0x55f352729a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ecc9dc640 1 -- 172.21.15.70:0/561933326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 msgr2=0x55f352729530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ecc9dc640 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 0x55f352729530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ecc9dc640 1 -- 172.21.15.70:0/561933326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f352709b00 msgr2=0x55f352729a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ecc9dc640 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f352709b00 0x55f352729a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ecc9dc640 1 -- 172.21.15.70:0/561933326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f35278d740 con 0x55f3527143c0 2024-09-12T01:51:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ec77fe640 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f352709b00 0x55f352729a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ecc9dc640 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 0x55f352729fb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009970 tx=0x7f7ec0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e289ceb680a0dec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ea77fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:18.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ea77fe640 1 -- 172.21.15.70:0/561933326 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0061060 con 0x55f3527143c0 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ea77fe640 1 -- 172.21.15.70:0/561933326 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7ec0004130 con 0x55f3527143c0 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ed0818740 1 -- 172.21.15.70:0/561933326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ebc01f040 con 0x55f3527143c0 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ea77fe640 1 -- 172.21.15.70:0/561933326 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7ec004c070 con 0x55f3527143c0 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ed0818740 10 client.15039 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ed0818740 1 -- 172.21.15.70:0/561933326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f35278ea10 con 0x55f3527143c0 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.097+0000 7f7ea77fe640 1 -- 172.21.15.70:0/561933326 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ebc01f040 con 0x55f3527143c0 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ea77fe640 1 -- 172.21.15.70:0/561933326 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7ec0066070 con 0x55f3527143c0 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ed0818740 10 client.15039 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ed0818740 10 client.15039 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ed0818740 20 client.15039 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ed0818740 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55f352793600 0x55f352792310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ed0818740 4 client.15039 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:51:18.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ed0818740 1 -- 172.21.15.70:0/561933326 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "status"}) -- 0x55f35266eb10 con 0x55f352793600 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ec7fff640 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55f352793600 0x55f352792310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ec7fff640 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55f352793600 0x55f352792310 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=da7fab7efdad0053 server_cookie=c47dd9a032c1224a in_seq=0 out_seq=0 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ea77fe640 10 client.15039 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ea77fe640 1 -- 172.21.15.70:0/561933326 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f35266eb10 con 0x55f352793600 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ea77fe640 10 client.15039 handle_command_reply: tid=0 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.098+0000 7f7ed0818740 1 client.15039 shutdown 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ed0818740 1 -- 172.21.15.70:0/561933326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 msgr2=0x55f352729fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ed0818740 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 0x55f352729fb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009970 tx=0x7f7ec0004ab0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ed0818740 1 -- 172.21.15.70:0/561933326 shutdown_connections 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ed0818740 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55f352793600 0x55f352792310 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ed0818740 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3527143c0 0x55f352729fb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ed0818740 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f352709b00 0x55f352729a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ed0818740 1 --2- 172.21.15.70:0/561933326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f3527091e0 0x55f352729530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ed0818740 1 -- 172.21.15.70:0/561933326 >> 172.21.15.70:0/561933326 conn(0x55f352705770 msgr2=0x55f352710f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ea77fe640 0 client.15039 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:51:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ed0818740 1 -- 172.21.15.70:0/561933326 shutdown_connections 2024-09-12T01:51:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ed0818740 1 -- 172.21.15.70:0/561933326 wait complete. 2024-09-12T01:51:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ed0818740 20 client.15039 trim_cache size 0 max 16384 2024-09-12T01:51:18.109 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:51:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:51:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 4, 2024-09-12T01:51:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24427, 2024-09-12T01:51:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:51:18.109 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:51:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:51:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 69.728074668000005, 2024-09-12T01:51:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-12T01:51:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:51:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T01:51:18.110 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 106.343389554 2024-09-12T01:51:18.110 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:51:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ece43f640 1 -- 172.21.15.70:0/2801689301 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7eb00a2c90 msgr2=0x7f7eb00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ece43f640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7eb00a2c90 0x7f7eb00a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7ec002ae70 tx=0x7f7ec00098e0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ece43f640 1 -- 172.21.15.70:0/2801689301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ec8102d40 msgr2=0x7f7ec81009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ece43f640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ec8102d40 0x7f7ec81009a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800b4a0 tx=0x7f7eb800b960 comp rx=0 tx=0).stop 2024-09-12T01:51:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ece43f640 1 -- 172.21.15.70:0/2801689301 shutdown_connections 2024-09-12T01:51:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.099+0000 7f7ece43f640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7eb00a2c90 0x7f7eb00a5150 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.100+0000 7f7ece43f640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ec810c170 0x7f7ec8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.100+0000 7f7ece43f640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ec8103660 0x7f7ec8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.100+0000 7f7ece43f640 1 --2- 172.21.15.70:0/2801689301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ec8102d40 0x7f7ec81009a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.100+0000 7f7ece43f640 1 -- 172.21.15.70:0/2801689301 >> 172.21.15.70:0/2801689301 conn(0x7f7ec80fc7a0 msgr2=0x7f7ec80fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.100+0000 7f7ece43f640 1 -- 172.21.15.70:0/2801689301 shutdown_connections 2024-09-12T01:51:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:18.100+0000 7f7ece43f640 1 -- 172.21.15.70:0/2801689301 wait complete. 2024-09-12T01:51:18.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:18 smithi070 ceph-mon[31177]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T01:51:18.733 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T01:51:18.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:18 smithi191 ceph-mon[35770]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T01:51:18.977 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:19.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:18 smithi152 ceph-mon[35055]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T01:51:19.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.449+0000 7f386d89a640 1 -- 172.21.15.70:0/3741100659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3868102d50 msgr2=0x7f3868103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:19.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.449+0000 7f386d89a640 1 --2- 172.21.15.70:0/3741100659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3868102d50 0x7f3868103130 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3858009ca0 tx=0x7f385802a950 comp rx=0 tx=0).stop 2024-09-12T01:51:19.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.449+0000 7f386d89a640 1 -- 172.21.15.70:0/3741100659 shutdown_connections 2024-09-12T01:51:19.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.449+0000 7f386d89a640 1 --2- 172.21.15.70:0/3741100659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f386810c180 0x7f386810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.449+0000 7f386d89a640 1 --2- 172.21.15.70:0/3741100659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3868103670 0x7f386810bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.449+0000 7f386d89a640 1 --2- 172.21.15.70:0/3741100659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3868102d50 0x7f3868103130 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.449+0000 7f386d89a640 1 -- 172.21.15.70:0/3741100659 >> 172.21.15.70:0/3741100659 conn(0x7f38680fc7d0 msgr2=0x7f38680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:19.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.450+0000 7f386d89a640 1 -- 172.21.15.70:0/3741100659 shutdown_connections 2024-09-12T01:51:19.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.450+0000 7f386d89a640 1 -- 172.21.15.70:0/3741100659 wait complete. 2024-09-12T01:51:19.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.450+0000 7f386d89a640 1 Processor -- start 2024-09-12T01:51:19.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.450+0000 7f386d89a640 1 -- start start 2024-09-12T01:51:19.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f386d89a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3868102d50 0x7f3868198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f386d89a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3868103670 0x7f3868198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f386d89a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386810c180 0x7f386819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f386d89a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f38681120a0 con 0x7f386810c180 2024-09-12T01:51:19.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f386d89a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3868111f20 con 0x7f3868103670 2024-09-12T01:51:19.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f386d89a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3868112220 con 0x7f3868102d50 2024-09-12T01:51:19.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f38677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386810c180 0x7f386819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f38677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386810c180 0x7f386819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49244/0 (socket says 172.21.15.70:49244) 2024-09-12T01:51:19.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f38677fe640 1 -- 172.21.15.70:0/1590173565 learned_addr learned my addr 172.21.15.70:0/1590173565 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:19.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f38667fc640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3868103670 0x7f3868198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f3866ffd640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3868102d50 0x7f3868198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f38677fe640 1 -- 172.21.15.70:0/1590173565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3868102d50 msgr2=0x7f3868198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:19.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f38677fe640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3868102d50 0x7f3868198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f38677fe640 1 -- 172.21.15.70:0/1590173565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3868103670 msgr2=0x7f3868198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:19.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f38677fe640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3868103670 0x7f3868198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f38677fe640 1 -- 172.21.15.70:0/1590173565 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386819d530 con 0x7f386810c180 2024-09-12T01:51:19.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f3866ffd640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3868102d50 0x7f3868198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:19.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f38667fc640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3868103670 0x7f3868198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:19.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f38677fe640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386810c180 0x7f386819ce50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f386000c970 tx=0x7f386000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:19.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f386c898640 1 -- 172.21.15.70:0/1590173565 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860007bb0 con 0x7f386810c180 2024-09-12T01:51:19.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f386c898640 1 -- 172.21.15.70:0/1590173565 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3860007d50 con 0x7f386810c180 2024-09-12T01:51:19.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f386d89a640 1 -- 172.21.15.70:0/1590173565 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386819d820 con 0x7f386810c180 2024-09-12T01:51:19.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f386c898640 1 -- 172.21.15.70:0/1590173565 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386000f450 con 0x7f386810c180 2024-09-12T01:51:19.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.451+0000 7f386d89a640 1 -- 172.21.15.70:0/1590173565 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38681a5100 con 0x7f386810c180 2024-09-12T01:51:19.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.454+0000 7f386c898640 1 -- 172.21.15.70:0/1590173565 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3860005020 con 0x7f386810c180 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.454+0000 7f386fc73740 1 Processor -- start 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.454+0000 7f386fc73740 1 -- start start 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.454+0000 7f386fc73740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742fea890 0x559742feac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.454+0000 7f386fc73740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742feb1b0 0x559742ff9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.454+0000 7f386fc73740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 0x559742ffc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.454+0000 7f386fc73740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559742f51090 con 0x559742ff9fc0 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.454+0000 7f386fc73740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559742ef8a70 con 0x559742feb1b0 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.454+0000 7f386fc73740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559742f4d050 con 0x559742fea890 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.454+0000 7f386c898640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f38540a2c10 0x7f38540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f38667fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 0x559742ffc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f38667fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 0x559742ffc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49258/0 (socket says 172.21.15.70:49258) 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f38667fc640 1 -- 172.21.15.70:0/457228704 learned_addr learned my addr 172.21.15.70:0/457228704 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:19.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f38677fe640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f38540a2c10 0x7f38540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f38667fc640 1 --2- 172.21.15.70:0/457228704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742fea890 0x559742feac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f3866ffd640 1 --2- 172.21.15.70:0/457228704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742feb1b0 0x559742ff9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f38667fc640 1 -- 172.21.15.70:0/457228704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742fea890 msgr2=0x559742feac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f38667fc640 1 --2- 172.21.15.70:0/457228704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742fea890 0x559742feac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f38667fc640 1 -- 172.21.15.70:0/457228704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742feb1b0 msgr2=0x559742ff9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f38667fc640 1 --2- 172.21.15.70:0/457228704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742feb1b0 0x559742ff9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f38667fc640 1 -- 172.21.15.70:0/457228704 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559742f05130 con 0x559742ff9fc0 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f386c898640 1 -- 172.21.15.70:0/1590173565 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f38600cef50 con 0x7f386810c180 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f3866ffd640 1 --2- 172.21.15.70:0/457228704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742feb1b0 0x559742ff9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f38667fc640 1 --2- 172.21.15.70:0/457228704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 0x559742ffc3b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f385000bf90 tx=0x7f385000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcd18f57d0f35a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f38677fe640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f38540a2c10 0x7f38540a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3860097a60 tx=0x7f3860095f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f385dffb640 1 -- 172.21.15.70:0/457228704 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850018030 con 0x559742ff9fc0 2024-09-12T01:51:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f385dffb640 1 -- 172.21.15.70:0/457228704 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3850005020 con 0x559742ff9fc0 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.455+0000 7f385dffb640 1 -- 172.21.15.70:0/457228704 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850004bc0 con 0x559742ff9fc0 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.456+0000 7f386fc73740 1 -- 172.21.15.70:0/457228704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 msgr2=0x559742ffc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.456+0000 7f386fc73740 1 --2- 172.21.15.70:0/457228704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 0x559742ffc3b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f385000bf90 tx=0x7f385000b650 comp rx=0 tx=0).stop 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.456+0000 7f386fc73740 1 -- 172.21.15.70:0/457228704 shutdown_connections 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.456+0000 7f386fc73740 1 --2- 172.21.15.70:0/457228704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 0x559742ffc3b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.456+0000 7f386fc73740 1 --2- 172.21.15.70:0/457228704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742feb1b0 0x559742ff9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.456+0000 7f386fc73740 1 --2- 172.21.15.70:0/457228704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742fea890 0x559742feac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.456+0000 7f386fc73740 1 -- 172.21.15.70:0/457228704 >> 172.21.15.70:0/457228704 conn(0x559742fe6f60 msgr2=0x559742fe7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.456+0000 7f386fc73740 1 -- 172.21.15.70:0/457228704 shutdown_connections 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.456+0000 7f386fc73740 1 -- 172.21.15.70:0/457228704 wait complete. 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.456+0000 7f386fc73740 1 -- start start 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f386fc73740 1 Processor -- start 2024-09-12T01:51:19.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f386fc73740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742fea890 0x559742ff97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f386fc73740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742feb1b0 0x559742ff6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f386fc73740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 0x559742ff7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f386fc73740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559742ffcb90 con 0x559742ff9fc0 2024-09-12T01:51:19.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f386fc73740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559742f0bf20 con 0x559742fea890 2024-09-12T01:51:19.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f386fc73740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559742ffcd10 con 0x559742feb1b0 2024-09-12T01:51:19.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f386fc73740 10 client.0 _ll_register_callbacks cb 0x559742ed5030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:19.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f38667fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 0x559742ff7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f38667fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 0x559742ff7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49264/0 (socket says 172.21.15.70:49264) 2024-09-12T01:51:19.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f38667fc640 1 -- 172.21.15.70:0/3511536992 learned_addr learned my addr 172.21.15.70:0/3511536992 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:19.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f3866ffd640 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742feb1b0 0x559742ff6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f38667fc640 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742fea890 0x559742ff97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f38667fc640 1 -- 172.21.15.70:0/3511536992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742feb1b0 msgr2=0x559742ff6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f38667fc640 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742feb1b0 0x559742ff6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f38667fc640 1 -- 172.21.15.70:0/3511536992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742fea890 msgr2=0x559742ff97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f38667fc640 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742fea890 0x559742ff97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.457+0000 7f38667fc640 1 -- 172.21.15.70:0/3511536992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559742cc22b0 con 0x559742ff9fc0 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f38667fc640 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 0x559742ff7070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3850004610 tx=0x7f3850004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35756c0e8a75079 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f3846ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f3846ffd640 1 -- 172.21.15.70:0/3511536992 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850020030 con 0x559742ff9fc0 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f386fc73740 1 -- 172.21.15.70:0/3511536992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3850005020 con 0x559742ff9fc0 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f3846ffd640 1 -- 172.21.15.70:0/3511536992 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3850005350 con 0x559742ff9fc0 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f3846ffd640 1 -- 172.21.15.70:0/3511536992 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3850018070 con 0x559742ff9fc0 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f386fc73740 10 client.15051 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f386fc73740 1 -- 172.21.15.70:0/3511536992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559743008480 con 0x559742ff9fc0 2024-09-12T01:51:19.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f3846ffd640 1 -- 172.21.15.70:0/3511536992 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3850005020 con 0x559742ff9fc0 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f3846ffd640 1 -- 172.21.15.70:0/3511536992 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3850010bb0 con 0x559742ff9fc0 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f386fc73740 10 client.15051 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f386fc73740 10 client.15051 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f386fc73740 20 client.15051 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f386fc73740 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55974300a7b0 0x55974300bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f386fc73740 4 client.15051 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.458+0000 7f386fc73740 1 -- 172.21.15.70:0/3511536992 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559742f5e600 con 0x55974300a7b0 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.459+0000 7f3866ffd640 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55974300a7b0 0x55974300bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.459+0000 7f3846ffd640 10 client.15051 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.459+0000 7f3866ffd640 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55974300a7b0 0x55974300bc20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a53d8ed4c3e4bd9c server_cookie=20f2414afd70e5c6 in_seq=0 out_seq=0 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f3846ffd640 1 -- 172.21.15.70:0/3511536992 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559742f5e600 con 0x55974300a7b0 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f3846ffd640 10 client.15051 handle_command_reply: tid=0 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f386fc73740 1 client.15051 shutdown 2024-09-12T01:51:19.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f386fc73740 1 -- 172.21.15.70:0/3511536992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 msgr2=0x559742ff7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:19.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f386fc73740 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 0x559742ff7070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3850004610 tx=0x7f3850004550 comp rx=0 tx=0).stop 2024-09-12T01:51:19.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f386fc73740 1 -- 172.21.15.70:0/3511536992 shutdown_connections 2024-09-12T01:51:19.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f386fc73740 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55974300a7b0 0x55974300bc20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f386fc73740 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742ff9fc0 0x559742ff7070 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f386fc73740 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742feb1b0 0x559742ff6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f386fc73740 1 --2- 172.21.15.70:0/3511536992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742fea890 0x559742ff97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f386fc73740 1 -- 172.21.15.70:0/3511536992 >> 172.21.15.70:0/3511536992 conn(0x559742fe6f60 msgr2=0x559742feccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:19.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f3846ffd640 0 client.15051 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:51:19.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f386fc73740 1 -- 172.21.15.70:0/3511536992 shutdown_connections 2024-09-12T01:51:19.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.460+0000 7f386fc73740 1 -- 172.21.15.70:0/3511536992 wait complete. 2024-09-12T01:51:19.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.461+0000 7f386fc73740 20 client.15051 trim_cache size 0 max 16384 2024-09-12T01:51:19.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.478+0000 7f386fc73740 1 Processor -- start 2024-09-12T01:51:19.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.478+0000 7f386fc73740 1 -- start start 2024-09-12T01:51:19.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.478+0000 7f386fc73740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742fea890 0x55974300bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.478+0000 7f386fc73740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 0x55974300b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.478+0000 7f386fc73740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742ff9fc0 0x55974300a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.478+0000 7f386fc73740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559743009f60 con 0x559742feb1b0 2024-09-12T01:51:19.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.478+0000 7f386fc73740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55974300a630 con 0x559742fea890 2024-09-12T01:51:19.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.478+0000 7f386fc73740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55974300ad00 con 0x559742ff9fc0 2024-09-12T01:51:19.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.478+0000 7f3866ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 0x55974300b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.478+0000 7f3866ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 0x55974300b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49268/0 (socket says 172.21.15.70:49268) 2024-09-12T01:51:19.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.478+0000 7f3866ffd640 1 -- 172.21.15.70:0/2506993078 learned_addr learned my addr 172.21.15.70:0/2506993078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:19.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.479+0000 7f38667fc640 1 --2- 172.21.15.70:0/2506993078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742fea890 0x55974300bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.479+0000 7f3866ffd640 1 -- 172.21.15.70:0/2506993078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742ff9fc0 msgr2=0x55974300a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:19.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.479+0000 7f3866ffd640 1 --2- 172.21.15.70:0/2506993078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742ff9fc0 0x55974300a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.479+0000 7f3866ffd640 1 -- 172.21.15.70:0/2506993078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742fea890 msgr2=0x55974300bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:19.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.479+0000 7f3866ffd640 1 --2- 172.21.15.70:0/2506993078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742fea890 0x55974300bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.479+0000 7f3866ffd640 1 -- 172.21.15.70:0/2506993078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559742fe6d70 con 0x559742feb1b0 2024-09-12T01:51:19.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.479+0000 7f3866ffd640 1 --2- 172.21.15.70:0/2506993078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 0x55974300b550 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3858009ca0 tx=0x7f385802fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefd46b030653f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:19.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.479+0000 7f385d7fa640 1 -- 172.21.15.70:0/2506993078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858034040 con 0x559742feb1b0 2024-09-12T01:51:19.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.479+0000 7f385d7fa640 1 -- 172.21.15.70:0/2506993078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f385802f5a0 con 0x559742feb1b0 2024-09-12T01:51:19.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.479+0000 7f385d7fa640 1 -- 172.21.15.70:0/2506993078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858004620 con 0x559742feb1b0 2024-09-12T01:51:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.479+0000 7f386fc73740 1 -- 172.21.15.70:0/2506993078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 msgr2=0x55974300b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 --2- 172.21.15.70:0/2506993078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 0x55974300b550 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3858009ca0 tx=0x7f385802fea0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 -- 172.21.15.70:0/2506993078 shutdown_connections 2024-09-12T01:51:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 --2- 172.21.15.70:0/2506993078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742ff9fc0 0x55974300a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 --2- 172.21.15.70:0/2506993078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 0x55974300b550 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 --2- 172.21.15.70:0/2506993078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742fea890 0x55974300bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 -- 172.21.15.70:0/2506993078 >> 172.21.15.70:0/2506993078 conn(0x559742fe6f60 msgr2=0x559742fe7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 -- 172.21.15.70:0/2506993078 shutdown_connections 2024-09-12T01:51:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 -- 172.21.15.70:0/2506993078 wait complete. 2024-09-12T01:51:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 -- start start 2024-09-12T01:51:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 Processor -- start 2024-09-12T01:51:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742fea890 0x559742ff4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 0x559742ff2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742ff9fc0 0x559742ff3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55974300baa0 con 0x559742feb1b0 2024-09-12T01:51:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55974300b3d0 con 0x559742ff9fc0 2024-09-12T01:51:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55974300c170 con 0x559742fea890 2024-09-12T01:51:19.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.480+0000 7f386fc73740 10 client.0 _ll_register_callbacks cb 0x7f3850012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:19.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3866ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 0x559742ff2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3866ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 0x559742ff2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49284/0 (socket says 172.21.15.70:49284) 2024-09-12T01:51:19.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3866ffd640 1 -- 172.21.15.70:0/281856213 learned_addr learned my addr 172.21.15.70:0/281856213 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:19.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f38667fc640 1 --2- 172.21.15.70:0/281856213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742fea890 0x559742ff4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3866ffd640 1 -- 172.21.15.70:0/281856213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742fea890 msgr2=0x559742ff4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:19.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3866ffd640 1 --2- 172.21.15.70:0/281856213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742fea890 0x559742ff4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3866ffd640 1 -- 172.21.15.70:0/281856213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742ff9fc0 msgr2=0x559742ff3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:19.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3866ffd640 1 --2- 172.21.15.70:0/281856213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742ff9fc0 0x559742ff3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3866ffd640 1 -- 172.21.15.70:0/281856213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559743012e70 con 0x559742feb1b0 2024-09-12T01:51:19.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3866ffd640 1 --2- 172.21.15.70:0/281856213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 0x559742ff2da0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3858009bf0 tx=0x7f3858005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29d4b0a7ee0c487 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:19.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3846ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3846ffd640 1 -- 172.21.15.70:0/281856213 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858034040 con 0x559742feb1b0 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f386fc73740 1 -- 172.21.15.70:0/281856213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f385802f5a0 con 0x559742feb1b0 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3846ffd640 1 -- 172.21.15.70:0/281856213 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f385802f750 con 0x559742feb1b0 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3846ffd640 1 -- 172.21.15.70:0/281856213 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3858003970 con 0x559742feb1b0 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f386fc73740 10 client.15057 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f386fc73740 1 -- 172.21.15.70:0/281856213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559743014170 con 0x559742feb1b0 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.481+0000 7f3846ffd640 1 -- 172.21.15.70:0/281856213 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f385802f5a0 con 0x559742feb1b0 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.482+0000 7f3846ffd640 1 -- 172.21.15.70:0/281856213 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f385804e070 con 0x559742feb1b0 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.482+0000 7f386fc73740 10 client.15057 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.482+0000 7f386fc73740 10 client.15057 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.482+0000 7f386fc73740 20 client.15057 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.482+0000 7f386fc73740 1 --2- 172.21.15.70:0/281856213 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x559743078900 0x559743077610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.482+0000 7f386fc73740 4 client.15057 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:51:19.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.482+0000 7f386fc73740 1 -- 172.21.15.70:0/281856213 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "status"}) -- 0x559742f58b10 con 0x559743078900 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.482+0000 7f38667fc640 1 --2- 172.21.15.70:0/281856213 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x559743078900 0x559743077610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.482+0000 7f3846ffd640 10 client.15057 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.482+0000 7f38667fc640 1 --2- 172.21.15.70:0/281856213 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x559743078900 0x559743077610 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=56a750c5aab40ab8 server_cookie=3771613a8b87c694 in_seq=0 out_seq=0 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f3846ffd640 1 -- 172.21.15.70:0/281856213 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559742f58b10 con 0x559743078900 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f3846ffd640 10 client.15057 handle_command_reply: tid=0 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f386fc73740 1 client.15057 shutdown 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f386fc73740 1 -- 172.21.15.70:0/281856213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 msgr2=0x559742ff2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f386fc73740 1 --2- 172.21.15.70:0/281856213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 0x559742ff2da0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3858009bf0 tx=0x7f3858005fa0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f386fc73740 1 -- 172.21.15.70:0/281856213 shutdown_connections 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f386fc73740 1 --2- 172.21.15.70:0/281856213 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x559743078900 0x559743077610 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f386fc73740 1 --2- 172.21.15.70:0/281856213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559742ff9fc0 0x559742ff3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f386fc73740 1 --2- 172.21.15.70:0/281856213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559742feb1b0 0x559742ff2da0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f3846ffd640 0 client.15057 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:51:19.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f386fc73740 1 --2- 172.21.15.70:0/281856213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559742fea890 0x559742ff4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f386fc73740 1 -- 172.21.15.70:0/281856213 >> 172.21.15.70:0/281856213 conn(0x559742fe6f60 msgr2=0x559742fe7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:19.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f386fc73740 1 -- 172.21.15.70:0/281856213 shutdown_connections 2024-09-12T01:51:19.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f386fc73740 1 -- 172.21.15.70:0/281856213 wait complete. 2024-09-12T01:51:19.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.483+0000 7f386fc73740 20 client.15057 trim_cache size 0 max 16384 2024-09-12T01:51:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:51:19.489 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:51:19.489 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 3, 2024-09-12T01:51:19.489 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24433, 2024-09-12T01:51:19.490 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:51:19.490 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:51:19.490 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:51:19.490 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 72.120755032999995, 2024-09-12T01:51:19.490 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-12T01:51:19.490 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:51:19.490 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T01:51:19.490 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 105.30964273799999 2024-09-12T01:51:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:51:19.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.484+0000 7f386d89a640 1 -- 172.21.15.70:0/1590173565 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f38540a2c10 msgr2=0x7f38540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:19.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.484+0000 7f386d89a640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f38540a2c10 0x7f38540a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3860097a60 tx=0x7f3860095f90 comp rx=0 tx=0).stop 2024-09-12T01:51:19.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.484+0000 7f386d89a640 1 -- 172.21.15.70:0/1590173565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386810c180 msgr2=0x7f386819ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:19.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.484+0000 7f386d89a640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386810c180 0x7f386819ce50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f386000c970 tx=0x7f386000ce30 comp rx=0 tx=0).stop 2024-09-12T01:51:19.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.484+0000 7f386d89a640 1 -- 172.21.15.70:0/1590173565 shutdown_connections 2024-09-12T01:51:19.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.484+0000 7f386d89a640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f38540a2c10 0x7f38540a50d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.484+0000 7f386d89a640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386810c180 0x7f386819ce50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.484+0000 7f386d89a640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3868103670 0x7f3868198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.484+0000 7f386d89a640 1 --2- 172.21.15.70:0/1590173565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3868102d50 0x7f3868198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:19.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.484+0000 7f386d89a640 1 -- 172.21.15.70:0/1590173565 >> 172.21.15.70:0/1590173565 conn(0x7f38680fc7d0 msgr2=0x7f38680fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:19.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.484+0000 7f386d89a640 1 -- 172.21.15.70:0/1590173565 shutdown_connections 2024-09-12T01:51:19.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:19.484+0000 7f386d89a640 1 -- 172.21.15.70:0/1590173565 wait complete. 2024-09-12T01:51:20.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T01:51:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:20.851 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:20 smithi070 ceph-mon[31177]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:20.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.931+0000 7fca9254f640 1 -- 172.21.15.70:0/2518762035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca8c100a80 msgr2=0x7fca8c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.931+0000 7fca9254f640 1 --2- 172.21.15.70:0/2518762035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca8c100a80 0x7fca8c100ee0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fca74009930 tx=0x7fca7402a420 comp rx=0 tx=0).stop 2024-09-12T01:51:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.931+0000 7fca9254f640 1 -- 172.21.15.70:0/2518762035 shutdown_connections 2024-09-12T01:51:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.931+0000 7fca9254f640 1 --2- 172.21.15.70:0/2518762035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c101420 0x7fca8c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.931+0000 7fca9254f640 1 --2- 172.21.15.70:0/2518762035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca8c100a80 0x7fca8c100ee0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.931+0000 7fca9254f640 1 --2- 172.21.15.70:0/2518762035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca8c106a80 0x7fca8c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.931+0000 7fca9254f640 1 -- 172.21.15.70:0/2518762035 >> 172.21.15.70:0/2518762035 conn(0x7fca8c0fc7a0 msgr2=0x7fca8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.931+0000 7fca9254f640 1 -- 172.21.15.70:0/2518762035 shutdown_connections 2024-09-12T01:51:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.931+0000 7fca9254f640 1 -- 172.21.15.70:0/2518762035 wait complete. 2024-09-12T01:51:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca9254f640 1 Processor -- start 2024-09-12T01:51:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca9254f640 1 -- start start 2024-09-12T01:51:20.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca9254f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c100a80 0x7fca8c198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca9254f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca8c101420 0x7fca8c198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca9254f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca8c106a80 0x7fca8c19cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca9254f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c111060 con 0x7fca8c106a80 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca9254f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c110ee0 con 0x7fca8c100a80 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca9254f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c1111e0 con 0x7fca8c101420 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca90aec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca8c106a80 0x7fca8c19cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca90aec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca8c106a80 0x7fca8c19cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50394/0 (socket says 172.21.15.70:50394) 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca90aec640 1 -- 172.21.15.70:0/1025599360 learned_addr learned my addr 172.21.15.70:0/1025599360 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca8bfff640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c100a80 0x7fca8c198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca83fff640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca8c101420 0x7fca8c198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca90aec640 1 -- 172.21.15.70:0/1025599360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca8c101420 msgr2=0x7fca8c198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca90aec640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca8c101420 0x7fca8c198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca90aec640 1 -- 172.21.15.70:0/1025599360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c100a80 msgr2=0x7fca8c198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca90aec640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c100a80 0x7fca8c198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca90aec640 1 -- 172.21.15.70:0/1025599360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8c19d640 con 0x7fca8c106a80 2024-09-12T01:51:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.932+0000 7fca90aec640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca8c106a80 0x7fca8c19cf60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fca8400b970 tx=0x7fca8400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.933+0000 7fca89ffb640 1 -- 172.21.15.70:0/1025599360 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca84019070 con 0x7fca8c106a80 2024-09-12T01:51:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.933+0000 7fca9254f640 1 -- 172.21.15.70:0/1025599360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8c19d930 con 0x7fca8c106a80 2024-09-12T01:51:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.933+0000 7fca89ffb640 1 -- 172.21.15.70:0/1025599360 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca84014440 con 0x7fca8c106a80 2024-09-12T01:51:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.933+0000 7fca89ffb640 1 -- 172.21.15.70:0/1025599360 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca840075d0 con 0x7fca8c106a80 2024-09-12T01:51:20.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.933+0000 7fca9254f640 1 -- 172.21.15.70:0/1025599360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8c1a5210 con 0x7fca8c106a80 2024-09-12T01:51:20.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:20 smithi191 ceph-mon[35770]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:20.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.935+0000 7fca89ffb640 1 -- 172.21.15.70:0/1025599360 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fca8401c070 con 0x7fca8c106a80 2024-09-12T01:51:20.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.935+0000 7fca94928740 1 Processor -- start 2024-09-12T01:51:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca94928740 1 -- start start 2024-09-12T01:51:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca94928740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e9448d0 0x55fd3e944cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca94928740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 0x55fd3e953a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca94928740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e953fc0 0x55fd3e9563b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca94928740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd3e8ab090 con 0x55fd3e9451f0 2024-09-12T01:51:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca94928740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fd3e852a70 con 0x55fd3e9448d0 2024-09-12T01:51:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca94928740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fd3e8a7050 con 0x55fd3e953fc0 2024-09-12T01:51:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca8bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 0x55fd3e953a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca8bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 0x55fd3e953a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50402/0 (socket says 172.21.15.70:50402) 2024-09-12T01:51:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca8bfff640 1 -- 172.21.15.70:0/56127880 learned_addr learned my addr 172.21.15.70:0/56127880 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca83fff640 1 --2- 172.21.15.70:0/56127880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e9448d0 0x55fd3e944cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca8bfff640 1 -- 172.21.15.70:0/56127880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e953fc0 msgr2=0x55fd3e9563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca8bfff640 1 --2- 172.21.15.70:0/56127880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e953fc0 0x55fd3e9563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca8bfff640 1 -- 172.21.15.70:0/56127880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e9448d0 msgr2=0x55fd3e944cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca8bfff640 1 --2- 172.21.15.70:0/56127880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e9448d0 0x55fd3e944cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca8bfff640 1 -- 172.21.15.70:0/56127880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd3e85f130 con 0x55fd3e9451f0 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca89ffb640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca780a2c90 0x7fca780a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca8bfff640 1 --2- 172.21.15.70:0/56127880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 0x55fd3e953a80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009a70 tx=0x7fca7c009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37600eec299575c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.936+0000 7fca83fff640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca780a2c90 0x7fca780a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.937+0000 7fca89ffb640 1 -- 172.21.15.70:0/1025599360 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fca840ce690 con 0x7fca8c106a80 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.937+0000 7fca827fc640 1 -- 172.21.15.70:0/56127880 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c017070 con 0x55fd3e9451f0 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.937+0000 7fca827fc640 1 -- 172.21.15.70:0/56127880 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca7c013470 con 0x55fd3e9451f0 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.937+0000 7fca827fc640 1 -- 172.21.15.70:0/56127880 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0125f0 con 0x55fd3e9451f0 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.937+0000 7fca94928740 1 -- 172.21.15.70:0/56127880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 msgr2=0x55fd3e953a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:20.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.937+0000 7fca94928740 1 --2- 172.21.15.70:0/56127880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 0x55fd3e953a80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009a70 tx=0x7fca7c009f30 comp rx=0 tx=0).stop 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.937+0000 7fca83fff640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca780a2c90 0x7fca780a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fca74000c00 tx=0x7fca740058b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.938+0000 7fca94928740 1 -- 172.21.15.70:0/56127880 shutdown_connections 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.938+0000 7fca94928740 1 --2- 172.21.15.70:0/56127880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e953fc0 0x55fd3e9563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.938+0000 7fca94928740 1 --2- 172.21.15.70:0/56127880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 0x55fd3e953a80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.938+0000 7fca94928740 1 --2- 172.21.15.70:0/56127880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e9448d0 0x55fd3e944cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.938+0000 7fca94928740 1 -- 172.21.15.70:0/56127880 >> 172.21.15.70:0/56127880 conn(0x55fd3e940f60 msgr2=0x55fd3e941340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.938+0000 7fca94928740 1 -- 172.21.15.70:0/56127880 shutdown_connections 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.938+0000 7fca94928740 1 -- 172.21.15.70:0/56127880 wait complete. 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.938+0000 7fca94928740 1 -- start start 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.938+0000 7fca94928740 1 Processor -- start 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.938+0000 7fca94928740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9448d0 0x55fd3e953820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.938+0000 7fca94928740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e9451f0 0x55fd3e950bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.938+0000 7fca94928740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e953fc0 0x55fd3e951100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca94928740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd3e956bf0 con 0x55fd3e953fc0 2024-09-12T01:51:20.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca90aec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e953fc0 0x55fd3e951100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca90aec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e953fc0 0x55fd3e951100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50416/0 (socket says 172.21.15.70:50416) 2024-09-12T01:51:20.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca90aec640 1 -- 172.21.15.70:0/2305318438 learned_addr learned my addr 172.21.15.70:0/2305318438 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:20.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca94928740 1 -- 172.21.15.70:0/2305318438 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fd3e865f20 con 0x55fd3e9451f0 2024-09-12T01:51:20.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca94928740 1 -- 172.21.15.70:0/2305318438 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fd3e956d70 con 0x55fd3e9448d0 2024-09-12T01:51:20.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca8bfff640 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9448d0 0x55fd3e953820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca83fff640 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e9451f0 0x55fd3e950bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca94928740 10 client.0 _ll_register_callbacks cb 0x55fd3e82f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:20.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca90aec640 1 -- 172.21.15.70:0/2305318438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9448d0 msgr2=0x55fd3e953820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:20.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca90aec640 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9448d0 0x55fd3e953820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca90aec640 1 -- 172.21.15.70:0/2305318438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e9451f0 msgr2=0x55fd3e950bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca90aec640 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e9451f0 0x55fd3e950bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca90aec640 1 -- 172.21.15.70:0/2305318438 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd3e61c2b0 con 0x55fd3e953fc0 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca90aec640 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e953fc0 0x55fd3e951100 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fca8409ab60 tx=0x7fca8409af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359e7c471968fbd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca6b7fe640 1 -- 172.21.15.70:0/2305318438 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8409b0c0 con 0x55fd3e953fc0 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca6b7fe640 1 -- 172.21.15.70:0/2305318438 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fca8409b260 con 0x55fd3e953fc0 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.939+0000 7fca94928740 1 -- 172.21.15.70:0/2305318438 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca7c013470 con 0x55fd3e953fc0 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.940+0000 7fca6b7fe640 1 -- 172.21.15.70:0/2305318438 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fca840a3640 con 0x55fd3e953fc0 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.940+0000 7fca94928740 10 client.15069 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.940+0000 7fca94928740 1 -- 172.21.15.70:0/2305318438 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fd3e962590 con 0x55fd3e953fc0 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.940+0000 7fca6b7fe640 1 -- 172.21.15.70:0/2305318438 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca840a37e0 con 0x55fd3e953fc0 2024-09-12T01:51:20.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.940+0000 7fca6b7fe640 1 -- 172.21.15.70:0/2305318438 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fca84099d20 con 0x55fd3e953fc0 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.940+0000 7fca94928740 10 client.15069 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.940+0000 7fca94928740 10 client.15069 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.940+0000 7fca94928740 20 client.15069 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.940+0000 7fca94928740 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55fd3e964ba0 0x55fd3e966010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.940+0000 7fca94928740 4 client.15069 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.940+0000 7fca94928740 1 -- 172.21.15.70:0/2305318438 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fca7c013470 con 0x55fd3e964ba0 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.940+0000 7fca8bfff640 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55fd3e964ba0 0x55fd3e966010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.941+0000 7fca6b7fe640 10 client.15069 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.941+0000 7fca8bfff640 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55fd3e964ba0 0x55fd3e966010 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=71fd184f769b72a6 server_cookie=82d02409529d5753 in_seq=0 out_seq=0 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca6b7fe640 1 -- 172.21.15.70:0/2305318438 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fca7c013470 con 0x55fd3e964ba0 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca6b7fe640 10 client.15069 handle_command_reply: tid=0 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca94928740 1 client.15069 shutdown 2024-09-12T01:51:20.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca94928740 1 -- 172.21.15.70:0/2305318438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e953fc0 msgr2=0x55fd3e951100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca94928740 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e953fc0 0x55fd3e951100 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fca8409ab60 tx=0x7fca8409af20 comp rx=0 tx=0).stop 2024-09-12T01:51:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca94928740 1 -- 172.21.15.70:0/2305318438 shutdown_connections 2024-09-12T01:51:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca94928740 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55fd3e964ba0 0x55fd3e966010 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca94928740 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e953fc0 0x55fd3e951100 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca94928740 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e9451f0 0x55fd3e950bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca94928740 1 --2- 172.21.15.70:0/2305318438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9448d0 0x55fd3e953820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca6b7fe640 0 client.15069 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:51:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca94928740 1 -- 172.21.15.70:0/2305318438 >> 172.21.15.70:0/2305318438 conn(0x55fd3e940f60 msgr2=0x55fd3e946c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca94928740 1 -- 172.21.15.70:0/2305318438 shutdown_connections 2024-09-12T01:51:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca94928740 1 -- 172.21.15.70:0/2305318438 wait complete. 2024-09-12T01:51:20.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.942+0000 7fca94928740 20 client.15069 trim_cache size 0 max 16384 2024-09-12T01:51:20.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.959+0000 7fca94928740 1 Processor -- start 2024-09-12T01:51:20.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.959+0000 7fca94928740 1 -- start start 2024-09-12T01:51:20.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca94928740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9448d0 0x55fd3e9644d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca94928740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9451f0 0x55fd3e966010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca94928740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e953fc0 0x55fd3e9504a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca94928740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd3e964350 con 0x55fd3e9448d0 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca94928740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fd3e964a20 con 0x55fd3e953fc0 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca94928740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fd3e9650f0 con 0x55fd3e9451f0 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca8bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9448d0 0x55fd3e9644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca8bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9448d0 0x55fd3e9644d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50422/0 (socket says 172.21.15.70:50422) 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca8bfff640 1 -- 172.21.15.70:0/1804583703 learned_addr learned my addr 172.21.15.70:0/1804583703 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca8bfff640 1 -- 172.21.15.70:0/1804583703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9451f0 msgr2=0x55fd3e966010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca8bfff640 1 --2- 172.21.15.70:0/1804583703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9451f0 0x55fd3e966010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca8bfff640 1 -- 172.21.15.70:0/1804583703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e953fc0 msgr2=0x55fd3e9504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca8bfff640 1 --2- 172.21.15.70:0/1804583703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e953fc0 0x55fd3e9504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca8bfff640 1 -- 172.21.15.70:0/1804583703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd3e953b90 con 0x55fd3e9448d0 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca8bfff640 1 --2- 172.21.15.70:0/1804583703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9448d0 0x55fd3e9644d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0099c0 tx=0x7fca7c013c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a96ea7ce9d5c1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca81ffb640 1 -- 172.21.15.70:0/1804583703 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c017040 con 0x55fd3e9448d0 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca81ffb640 1 -- 172.21.15.70:0/1804583703 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca7c013970 con 0x55fd3e9448d0 2024-09-12T01:51:20.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.960+0000 7fca81ffb640 1 -- 172.21.15.70:0/1804583703 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c026880 con 0x55fd3e9448d0 2024-09-12T01:51:20.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.961+0000 7fca94928740 1 -- 172.21.15.70:0/1804583703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9448d0 msgr2=0x55fd3e9644d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:20.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.961+0000 7fca94928740 1 --2- 172.21.15.70:0/1804583703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9448d0 0x55fd3e9644d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0099c0 tx=0x7fca7c013c60 comp rx=0 tx=0).stop 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.961+0000 7fca94928740 1 -- 172.21.15.70:0/1804583703 shutdown_connections 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.961+0000 7fca94928740 1 --2- 172.21.15.70:0/1804583703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e953fc0 0x55fd3e9504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.961+0000 7fca94928740 1 --2- 172.21.15.70:0/1804583703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9451f0 0x55fd3e966010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.961+0000 7fca94928740 1 --2- 172.21.15.70:0/1804583703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9448d0 0x55fd3e9644d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.961+0000 7fca94928740 1 -- 172.21.15.70:0/1804583703 >> 172.21.15.70:0/1804583703 conn(0x55fd3e940f60 msgr2=0x55fd3e950b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.961+0000 7fca94928740 1 -- 172.21.15.70:0/1804583703 shutdown_connections 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.961+0000 7fca94928740 1 -- 172.21.15.70:0/1804583703 wait complete. 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.961+0000 7fca94928740 1 -- start start 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca94928740 1 Processor -- start 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca94928740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9448d0 0x55fd3e967210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca94928740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 0x55fd3e967750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca94928740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e953fc0 0x55fd3e967c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca94928740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd3e965e90 con 0x55fd3e9451f0 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca94928740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fd3e9657c0 con 0x55fd3e953fc0 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca94928740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fd3e966560 con 0x55fd3e9448d0 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca94928740 10 client.0 _ll_register_callbacks cb 0x7fca84097100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca83fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 0x55fd3e967750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca83fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 0x55fd3e967750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50432/0 (socket says 172.21.15.70:50432) 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca83fff640 1 -- 172.21.15.70:0/3768289723 learned_addr learned my addr 172.21.15.70:0/3768289723 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca90aec640 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e953fc0 0x55fd3e967c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca8bfff640 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9448d0 0x55fd3e967210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca83fff640 1 -- 172.21.15.70:0/3768289723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9448d0 msgr2=0x55fd3e967210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca83fff640 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9448d0 0x55fd3e967210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca83fff640 1 -- 172.21.15.70:0/3768289723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e953fc0 msgr2=0x55fd3e967c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca83fff640 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e953fc0 0x55fd3e967c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca83fff640 1 -- 172.21.15.70:0/3768289723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd3e9cd450 con 0x55fd3e9451f0 2024-09-12T01:51:20.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca90aec640 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e953fc0 0x55fd3e967c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca83fff640 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 0x55fd3e967750 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fca74005ec0 tx=0x7fca74009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffffbfcfdf35b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.962+0000 7fca6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca6b7fe640 1 -- 172.21.15.70:0/3768289723 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74035040 con 0x55fd3e9451f0 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca6b7fe640 1 -- 172.21.15.70:0/3768289723 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fca74003b80 con 0x55fd3e9451f0 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca94928740 1 -- 172.21.15.70:0/3768289723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca7c013970 con 0x55fd3e9451f0 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca6b7fe640 1 -- 172.21.15.70:0/3768289723 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fca74003d80 con 0x55fd3e9451f0 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca94928740 10 client.15075 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca94928740 1 -- 172.21.15.70:0/3768289723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fd3e9ce6f0 con 0x55fd3e9451f0 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca6b7fe640 1 -- 172.21.15.70:0/3768289723 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca7c013970 con 0x55fd3e9451f0 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca6b7fe640 1 -- 172.21.15.70:0/3768289723 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fca7403a040 con 0x55fd3e9451f0 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca94928740 10 client.15075 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca94928740 10 client.15075 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca94928740 20 client.15075 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:20.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca94928740 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55fd3e9d32f0 0x55fd3e9d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca94928740 4 client.15075 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.963+0000 7fca94928740 1 -- 172.21.15.70:0/3768289723 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "status"}) -- 0x55fd3e8b8600 con 0x55fd3e9d32f0 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca8bfff640 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55fd3e9d32f0 0x55fd3e9d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca8bfff640 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55fd3e9d32f0 0x55fd3e9d2000 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8f85110e946e305 server_cookie=126e45dac19f96dd in_seq=0 out_seq=0 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca6b7fe640 10 client.15075 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca6b7fe640 1 -- 172.21.15.70:0/3768289723 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55fd3e8b8600 con 0x55fd3e9d32f0 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca6b7fe640 10 client.15075 handle_command_reply: tid=0 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca94928740 1 client.15075 shutdown 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca94928740 1 -- 172.21.15.70:0/3768289723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 msgr2=0x55fd3e967750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca94928740 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 0x55fd3e967750 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fca74005ec0 tx=0x7fca74009650 comp rx=0 tx=0).stop 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca94928740 1 -- 172.21.15.70:0/3768289723 shutdown_connections 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca94928740 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55fd3e9d32f0 0x55fd3e9d2000 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca94928740 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd3e953fc0 0x55fd3e967c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca94928740 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3e9451f0 0x55fd3e967750 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca94928740 1 --2- 172.21.15.70:0/3768289723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd3e9448d0 0x55fd3e967210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca94928740 1 -- 172.21.15.70:0/3768289723 >> 172.21.15.70:0/3768289723 conn(0x55fd3e940f60 msgr2=0x55fd3e94ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:20.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.964+0000 7fca6b7fe640 0 client.15075 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:51:20.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca94928740 1 -- 172.21.15.70:0/3768289723 shutdown_connections 2024-09-12T01:51:20.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca94928740 1 -- 172.21.15.70:0/3768289723 wait complete. 2024-09-12T01:51:20.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca94928740 20 client.15075 trim_cache size 0 max 16384 2024-09-12T01:51:20.970 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:51:20.970 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:51:20.970 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-09-12T01:51:20.970 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24437, 2024-09-12T01:51:20.971 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:51:20.971 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:51:20.971 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:51:20.971 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 74.610006417999998, 2024-09-12T01:51:20.971 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-12T01:51:20.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:51:20.971 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T01:51:20.971 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 104.340449788 2024-09-12T01:51:20.971 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:51:20.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca9254f640 1 -- 172.21.15.70:0/1025599360 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca780a2c90 msgr2=0x7fca780a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:20.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca9254f640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca780a2c90 0x7fca780a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fca74000c00 tx=0x7fca740058b0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca9254f640 1 -- 172.21.15.70:0/1025599360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca8c106a80 msgr2=0x7fca8c19cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:20.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca9254f640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca8c106a80 0x7fca8c19cf60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fca8400b970 tx=0x7fca8400bd70 comp rx=0 tx=0).stop 2024-09-12T01:51:20.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca9254f640 1 -- 172.21.15.70:0/1025599360 shutdown_connections 2024-09-12T01:51:20.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca9254f640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca780a2c90 0x7fca780a5150 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca9254f640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca8c106a80 0x7fca8c19cf60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca9254f640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca8c101420 0x7fca8c198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca9254f640 1 --2- 172.21.15.70:0/1025599360 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca8c100a80 0x7fca8c198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:20.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca9254f640 1 -- 172.21.15.70:0/1025599360 >> 172.21.15.70:0/1025599360 conn(0x7fca8c0fc7a0 msgr2=0x7fca8c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:20.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca9254f640 1 -- 172.21.15.70:0/1025599360 shutdown_connections 2024-09-12T01:51:20.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:20.965+0000 7fca9254f640 1 -- 172.21.15.70:0/1025599360 wait complete. 2024-09-12T01:51:21.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:20 smithi152 ceph-mon[35055]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:21.732 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T01:51:21.984 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.463+0000 7f0ace5f6640 1 -- 172.21.15.70:0/2423098051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac8102d30 msgr2=0x7f0ac8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.463+0000 7f0ace5f6640 1 --2- 172.21.15.70:0/2423098051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac8102d30 0x7f0ac8103110 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009930 tx=0x7f0ab802a420 comp rx=0 tx=0).stop 2024-09-12T01:51:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.463+0000 7f0ace5f6640 1 -- 172.21.15.70:0/2423098051 shutdown_connections 2024-09-12T01:51:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.463+0000 7f0ace5f6640 1 --2- 172.21.15.70:0/2423098051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ac81082a0 0x7f0ac810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.463+0000 7f0ace5f6640 1 --2- 172.21.15.70:0/2423098051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ac81036e0 0x7f0ac8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.463+0000 7f0ace5f6640 1 --2- 172.21.15.70:0/2423098051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac8102d30 0x7f0ac8103110 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.463+0000 7f0ace5f6640 1 -- 172.21.15.70:0/2423098051 >> 172.21.15.70:0/2423098051 conn(0x7f0ac80fc7d0 msgr2=0x7f0ac80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.463+0000 7f0ace5f6640 1 -- 172.21.15.70:0/2423098051 shutdown_connections 2024-09-12T01:51:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.463+0000 7f0ace5f6640 1 -- 172.21.15.70:0/2423098051 wait complete. 2024-09-12T01:51:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.464+0000 7f0ace5f6640 1 Processor -- start 2024-09-12T01:51:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.464+0000 7f0ace5f6640 1 -- start start 2024-09-12T01:51:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.464+0000 7f0ace5f6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ac8102d30 0x7f0ac8198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.464+0000 7f0ace5f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac81036e0 0x7f0ac8198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.464+0000 7f0ace5f6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ac81082a0 0x7f0ac819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.464+0000 7f0ace5f6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac81121c0 con 0x7f0ac81036e0 2024-09-12T01:51:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.464+0000 7f0ace5f6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8112040 con 0x7f0ac81082a0 2024-09-12T01:51:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.464+0000 7f0ace5f6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8112340 con 0x7f0ac8102d30 2024-09-12T01:51:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.464+0000 7f0ac77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac81036e0 0x7f0ac8198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.464+0000 7f0ac77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac81036e0 0x7f0ac8198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50450/0 (socket says 172.21.15.70:50450) 2024-09-12T01:51:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.464+0000 7f0ac77fe640 1 -- 172.21.15.70:0/433646153 learned_addr learned my addr 172.21.15.70:0/433646153 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.464+0000 7f0accb93640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ac81082a0 0x7f0ac819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.465+0000 7f0ac7fff640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ac8102d30 0x7f0ac8198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.465+0000 7f0ac77fe640 1 -- 172.21.15.70:0/433646153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ac8102d30 msgr2=0x7f0ac8198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.465+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ac8102d30 0x7f0ac8198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.465+0000 7f0ac77fe640 1 -- 172.21.15.70:0/433646153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ac81082a0 msgr2=0x7f0ac819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.465+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ac81082a0 0x7f0ac819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.465+0000 7f0ac77fe640 1 -- 172.21.15.70:0/433646153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac819d5b0 con 0x7f0ac81036e0 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.465+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac81036e0 0x7f0ac8198b40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00d740 tx=0x7f0abc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.465+0000 7f0ac57fa640 1 -- 172.21.15.70:0/433646153 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc017070 con 0x7f0ac81036e0 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.465+0000 7f0ac57fa640 1 -- 172.21.15.70:0/433646153 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0abc00de50 con 0x7f0ac81036e0 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.465+0000 7f0ace5f6640 1 -- 172.21.15.70:0/433646153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac819d8a0 con 0x7f0ac81036e0 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.465+0000 7f0ac57fa640 1 -- 172.21.15.70:0/433646153 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00f740 con 0x7f0ac81036e0 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.465+0000 7f0ace5f6640 1 -- 172.21.15.70:0/433646153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac81a5180 con 0x7f0ac81036e0 2024-09-12T01:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.467+0000 7f0ac57fa640 1 -- 172.21.15.70:0/433646153 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0abc01a070 con 0x7f0ac81036e0 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.467+0000 7f0ad09cf740 1 Processor -- start 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ad09cf740 1 -- start start 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ad09cf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b30259d0 0x5630b3025db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ad09cf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b3030670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ad09cf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b3030bb0 0x5630b3032fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ad09cf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5630b2f8c090 con 0x5630b30262f0 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ad09cf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5630b2f33a70 con 0x5630b3030bb0 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ad09cf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5630b2f88050 con 0x5630b30259d0 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b3030670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b3030670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50460/0 (socket says 172.21.15.70:50460) 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ac7fff640 1 -- 172.21.15.70:0/1918417567 learned_addr learned my addr 172.21.15.70:0/1918417567 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0accb93640 1 --2- 172.21.15.70:0/1918417567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b30259d0 0x5630b3025db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/1918417567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b3030bb0 0x5630b3032fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ac7fff640 1 -- 172.21.15.70:0/1918417567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b30259d0 msgr2=0x5630b3025db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:22.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ac7fff640 1 --2- 172.21.15.70:0/1918417567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b30259d0 0x5630b3025db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ac7fff640 1 -- 172.21.15.70:0/1918417567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b3030bb0 msgr2=0x5630b3032fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:22.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ac7fff640 1 --2- 172.21.15.70:0/1918417567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b3030bb0 0x5630b3032fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ac7fff640 1 -- 172.21.15.70:0/1918417567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b2f40130 con 0x5630b30262f0 2024-09-12T01:51:22.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/1918417567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b3030bb0 0x5630b3032fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:22.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.468+0000 7f0ac57fa640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0ab00a2b80 0x7f0ab00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.469+0000 7f0ac7fff640 1 --2- 172.21.15.70:0/1918417567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b3030670 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009930 tx=0x7f0ab8032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e7c231015d8f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:22.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.469+0000 7f0accb93640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0ab00a2b80 0x7f0ab00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.469+0000 7f0ac57fa640 1 -- 172.21.15.70:0/433646153 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f0abc0cea90 con 0x7f0ac81036e0 2024-09-12T01:51:22.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.469+0000 7f0aae7fc640 1 -- 172.21.15.70:0/1918417567 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab803f070 con 0x5630b30262f0 2024-09-12T01:51:22.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.469+0000 7f0aae7fc640 1 -- 172.21.15.70:0/1918417567 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ab8032e20 con 0x5630b30262f0 2024-09-12T01:51:22.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.469+0000 7f0aae7fc640 1 -- 172.21.15.70:0/1918417567 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8035070 con 0x5630b30262f0 2024-09-12T01:51:22.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.470+0000 7f0ad09cf740 1 -- 172.21.15.70:0/1918417567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 msgr2=0x5630b3030670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:22.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.470+0000 7f0accb93640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0ab00a2b80 0x7f0ab00a5040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0007f00 tx=0x7f0ac0007520 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:22.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.470+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/1918417567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b3030670 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009930 tx=0x7f0ab8032d30 comp rx=0 tx=0).stop 2024-09-12T01:51:22.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.470+0000 7f0ad09cf740 1 -- 172.21.15.70:0/1918417567 shutdown_connections 2024-09-12T01:51:22.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.470+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/1918417567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b3030bb0 0x5630b3032fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.470+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/1918417567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b3030670 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.470+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/1918417567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b30259d0 0x5630b3025db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.470+0000 7f0ad09cf740 1 -- 172.21.15.70:0/1918417567 >> 172.21.15.70:0/1918417567 conn(0x5630b3021f60 msgr2=0x5630b3022340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:22.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.470+0000 7f0ad09cf740 1 -- 172.21.15.70:0/1918417567 shutdown_connections 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.470+0000 7f0ad09cf740 1 -- 172.21.15.70:0/1918417567 wait complete. 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.470+0000 7f0ad09cf740 1 -- start start 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.470+0000 7f0ad09cf740 1 Processor -- start 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ad09cf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b30259d0 0x5630b3030440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ad09cf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b302d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ad09cf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b3030bb0 0x5630b302dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ad09cf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5630b3033780 con 0x5630b30262f0 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ad09cf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5630b2f46f20 con 0x5630b3030bb0 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ad09cf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5630b3033900 con 0x5630b30259d0 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ad09cf740 10 client.0 _ll_register_callbacks cb 0x5630b2f10030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ac77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b302d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ac77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b302d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50476/0 (socket says 172.21.15.70:50476) 2024-09-12T01:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ac77fe640 1 -- 172.21.15.70:0/561767823 learned_addr learned my addr 172.21.15.70:0/561767823 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:22.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0accb93640 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b3030bb0 0x5630b302dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ac7fff640 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b30259d0 0x5630b3030440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ac77fe640 1 -- 172.21.15.70:0/561767823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b30259d0 msgr2=0x5630b3030440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:22.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b30259d0 0x5630b3030440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ac77fe640 1 -- 172.21.15.70:0/561767823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b3030bb0 msgr2=0x5630b302dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:22.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b3030bb0 0x5630b302dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ac77fe640 1 -- 172.21.15.70:0/561767823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630b2cfd2b0 con 0x5630b30262f0 2024-09-12T01:51:22.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b302d790 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0abc097c80 tx=0x7f0abc09b2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00e35552969b1f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:22.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0aa77fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:22.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.471+0000 7f0aa77fe640 1 -- 172.21.15.70:0/561767823 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc021050 con 0x5630b30262f0 2024-09-12T01:51:22.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0aa77fe640 1 -- 172.21.15.70:0/561767823 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f0abc097920 con 0x5630b30262f0 2024-09-12T01:51:22.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0ad09cf740 1 -- 172.21.15.70:0/561767823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ab8032e20 con 0x5630b30262f0 2024-09-12T01:51:22.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0aa77fe640 1 -- 172.21.15.70:0/561767823 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0abc0a3a90 con 0x5630b30262f0 2024-09-12T01:51:22.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0ad09cf740 10 client.15087 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:22.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0ad09cf740 1 -- 172.21.15.70:0/561767823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5630b303f000 con 0x5630b30262f0 2024-09-12T01:51:22.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0aa77fe640 1 -- 172.21.15.70:0/561767823 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ab8032e20 con 0x5630b30262f0 2024-09-12T01:51:22.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0aa77fe640 1 -- 172.21.15.70:0/561767823 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0abc09f150 con 0x5630b30262f0 2024-09-12T01:51:22.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0ad09cf740 10 client.15087 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:22.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0ad09cf740 10 client.15087 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:51:22.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0ad09cf740 20 client.15087 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:22.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x5630b3041600 0x5630b3042a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0ad09cf740 4 client.15087 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:51:22.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0ad09cf740 1 -- 172.21.15.70:0/561767823 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630b2f99600 con 0x5630b3041600 2024-09-12T01:51:22.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.472+0000 7f0ac7fff640 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x5630b3041600 0x5630b3042a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.473+0000 7f0aa77fe640 10 client.15087 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.473+0000 7f0ac7fff640 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x5630b3041600 0x5630b3042a70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c548678f13ef7730 server_cookie=a1655ced85e06d6 in_seq=0 out_seq=0 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0aa77fe640 1 -- 172.21.15.70:0/561767823 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630b2f99600 con 0x5630b3041600 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0aa77fe640 10 client.15087 handle_command_reply: tid=0 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0ad09cf740 1 client.15087 shutdown 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0ad09cf740 1 -- 172.21.15.70:0/561767823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 msgr2=0x5630b302d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b302d790 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0abc097c80 tx=0x7f0abc09b2b0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0ad09cf740 1 -- 172.21.15.70:0/561767823 shutdown_connections 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x5630b3041600 0x5630b3042a70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b3030bb0 0x5630b302dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b302d790 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0aa77fe640 0 client.15087 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:51:22.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/561767823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b30259d0 0x5630b3030440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0ad09cf740 1 -- 172.21.15.70:0/561767823 >> 172.21.15.70:0/561767823 conn(0x5630b3021f60 msgr2=0x5630b3027c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:22.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0ad09cf740 1 -- 172.21.15.70:0/561767823 shutdown_connections 2024-09-12T01:51:22.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0ad09cf740 1 -- 172.21.15.70:0/561767823 wait complete. 2024-09-12T01:51:22.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.474+0000 7f0ad09cf740 20 client.15087 trim_cache size 0 max 16384 2024-09-12T01:51:22.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.492+0000 7f0ad09cf740 1 Processor -- start 2024-09-12T01:51:22.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.492+0000 7f0ad09cf740 1 -- start start 2024-09-12T01:51:22.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ad09cf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b30259d0 0x5630b303d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ad09cf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b302d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ad09cf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b3030bb0 0x5630b302c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ad09cf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5630b3040db0 con 0x5630b30262f0 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ad09cf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5630b3041480 con 0x5630b30259d0 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ad09cf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5630b3041b50 con 0x5630b3030bb0 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ac77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b302d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0accb93640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b3030bb0 0x5630b302c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ac77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b302d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50492/0 (socket says 172.21.15.70:50492) 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0accb93640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b3030bb0 0x5630b302c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:50228/0 (socket says 172.21.15.70:50228) 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ac77fe640 1 -- 172.21.15.70:0/683421401 learned_addr learned my addr 172.21.15.70:0/683421401 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ac7fff640 1 --2- 172.21.15.70:0/683421401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b30259d0 0x5630b303d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ac77fe640 1 -- 172.21.15.70:0/683421401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b3030bb0 msgr2=0x5630b302c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/683421401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b3030bb0 0x5630b302c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ac77fe640 1 -- 172.21.15.70:0/683421401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b30259d0 msgr2=0x5630b303d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/683421401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b30259d0 0x5630b303d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ac77fe640 1 -- 172.21.15.70:0/683421401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b302e550 con 0x5630b30262f0 2024-09-12T01:51:22.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/683421401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b302d050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0abc097710 tx=0x7f0abc0b4370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f37b656486ac33e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:22.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0aadffb640 1 -- 172.21.15.70:0/683421401 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc021070 con 0x5630b30262f0 2024-09-12T01:51:22.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.493+0000 7f0aadffb640 1 -- 172.21.15.70:0/683421401 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0abc097920 con 0x5630b30262f0 2024-09-12T01:51:22.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.494+0000 7f0aadffb640 1 -- 172.21.15.70:0/683421401 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0bb310 con 0x5630b30262f0 2024-09-12T01:51:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.494+0000 7f0ad09cf740 1 -- 172.21.15.70:0/683421401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 msgr2=0x5630b302d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.494+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/683421401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b302d050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0abc097710 tx=0x7f0abc0b4370 comp rx=0 tx=0).stop 2024-09-12T01:51:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.494+0000 7f0ad09cf740 1 -- 172.21.15.70:0/683421401 shutdown_connections 2024-09-12T01:51:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.494+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/683421401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b3030bb0 0x5630b302c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.494+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/683421401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30262f0 0x5630b302d050 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.494+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/683421401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b30259d0 0x5630b303d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.494+0000 7f0ad09cf740 1 -- 172.21.15.70:0/683421401 >> 172.21.15.70:0/683421401 conn(0x5630b3021f60 msgr2=0x5630b3022340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.494+0000 7f0ad09cf740 1 -- 172.21.15.70:0/683421401 shutdown_connections 2024-09-12T01:51:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.494+0000 7f0ad09cf740 1 -- 172.21.15.70:0/683421401 wait complete. 2024-09-12T01:51:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0ad09cf740 1 -- start start 2024-09-12T01:51:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0ad09cf740 1 Processor -- start 2024-09-12T01:51:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0ad09cf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30259d0 0x5630b3046370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0ad09cf740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b30262f0 0x5630b30468b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0ad09cf740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b3030bb0 0x5630b30a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0ad09cf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5630b30428f0 con 0x5630b30259d0 2024-09-12T01:51:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0ad09cf740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5630b3042220 con 0x5630b30262f0 2024-09-12T01:51:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0ad09cf740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5630b3042fc0 con 0x5630b3030bb0 2024-09-12T01:51:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0ad09cf740 10 client.0 _ll_register_callbacks cb 0x7f0abc097550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30259d0 0x5630b3046370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0ac7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30259d0 0x5630b3046370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50494/0 (socket says 172.21.15.70:50494) 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0ac7fff640 1 -- 172.21.15.70:0/781585427 learned_addr learned my addr 172.21.15.70:0/781585427 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.495+0000 7f0accb93640 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b3030bb0 0x5630b30a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b30262f0 0x5630b30468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0ac7fff640 1 -- 172.21.15.70:0/781585427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b3030bb0 msgr2=0x5630b30a3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0ac7fff640 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b3030bb0 0x5630b30a3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0ac7fff640 1 -- 172.21.15.70:0/781585427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b30262f0 msgr2=0x5630b30468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0ac7fff640 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b30262f0 0x5630b30468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0ac7fff640 1 -- 172.21.15.70:0/781585427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630b30a4380 con 0x5630b30259d0 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0ac7fff640 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30259d0 0x5630b3046370 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8005400 tx=0x7f0ab8005430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecca15b3dbaf5cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0aa77fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0aa77fe640 1 -- 172.21.15.70:0/781585427 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab803f040 con 0x5630b30259d0 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0aa77fe640 1 -- 172.21.15.70:0/781585427 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f0ab8031840 con 0x5630b30259d0 2024-09-12T01:51:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0ad09cf740 1 -- 172.21.15.70:0/781585427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0abc097920 con 0x5630b30259d0 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0aa77fe640 1 -- 172.21.15.70:0/781585427 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ab8035040 con 0x5630b30259d0 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0ad09cf740 10 client.15093 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0ad09cf740 1 -- 172.21.15.70:0/781585427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5630b30ab6f0 con 0x5630b30259d0 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.496+0000 7f0aa77fe640 1 -- 172.21.15.70:0/781585427 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0abc097920 con 0x5630b30259d0 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.497+0000 7f0aa77fe640 1 -- 172.21.15.70:0/781585427 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0ab8003c90 con 0x5630b30259d0 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.497+0000 7f0ad09cf740 10 client.15093 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.497+0000 7f0ad09cf740 10 client.15093 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.497+0000 7f0ad09cf740 20 client.15093 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.497+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x5630b30afe30 0x5630b30aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.497+0000 7f0ad09cf740 4 client.15093 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.497+0000 7f0ad09cf740 1 -- 172.21.15.70:0/781585427 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "status"}) -- 0x5630b2f93b10 con 0x5630b30afe30 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.497+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x5630b30afe30 0x5630b30aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.497+0000 7f0ac77fe640 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x5630b30afe30 0x5630b30aeb40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=de7cb39e9ff9bdab server_cookie=3d89e0cb57e3dfbf in_seq=0 out_seq=0 2024-09-12T01:51:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.497+0000 7f0aa77fe640 10 client.15093 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:51:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0aa77fe640 1 -- 172.21.15.70:0/781585427 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5630b2f93b10 con 0x5630b30afe30 2024-09-12T01:51:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0aa77fe640 10 client.15093 handle_command_reply: tid=0 2024-09-12T01:51:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0ad09cf740 1 client.15093 shutdown 2024-09-12T01:51:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0ad09cf740 1 -- 172.21.15.70:0/781585427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30259d0 msgr2=0x5630b3046370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30259d0 0x5630b3046370 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8005400 tx=0x7f0ab8005430 comp rx=0 tx=0).stop 2024-09-12T01:51:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0ad09cf740 1 -- 172.21.15.70:0/781585427 shutdown_connections 2024-09-12T01:51:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x5630b30afe30 0x5630b30aeb40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5630b3030bb0 0x5630b30a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5630b30262f0 0x5630b30468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0ad09cf740 1 --2- 172.21.15.70:0/781585427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630b30259d0 0x5630b3046370 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0aa77fe640 0 client.15093 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:51:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0ad09cf740 1 -- 172.21.15.70:0/781585427 >> 172.21.15.70:0/781585427 conn(0x5630b3021f60 msgr2=0x5630b302cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0ad09cf740 1 -- 172.21.15.70:0/781585427 shutdown_connections 2024-09-12T01:51:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0ad09cf740 1 -- 172.21.15.70:0/781585427 wait complete. 2024-09-12T01:51:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.498+0000 7f0ad09cf740 20 client.15093 trim_cache size 0 max 16384 2024-09-12T01:51:22.505 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:51:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:51:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-09-12T01:51:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24445, 2024-09-12T01:51:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:51:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:51:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:51:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 77.148768122999996, 2024-09-12T01:51:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-12T01:51:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:51:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T01:51:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 103.459461733 2024-09-12T01:51:22.507 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:51:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.499+0000 7f0ace5f6640 1 -- 172.21.15.70:0/433646153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0ab00a2b80 msgr2=0x7f0ab00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.499+0000 7f0ace5f6640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0ab00a2b80 0x7f0ab00a5040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0007f00 tx=0x7f0ac0007520 comp rx=0 tx=0).stop 2024-09-12T01:51:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.499+0000 7f0ace5f6640 1 -- 172.21.15.70:0/433646153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac81036e0 msgr2=0x7f0ac8198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.499+0000 7f0ace5f6640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac81036e0 0x7f0ac8198b40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00d740 tx=0x7f0abc00dc00 comp rx=0 tx=0).stop 2024-09-12T01:51:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.499+0000 7f0ace5f6640 1 -- 172.21.15.70:0/433646153 shutdown_connections 2024-09-12T01:51:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.499+0000 7f0ace5f6640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0ab00a2b80 0x7f0ab00a5040 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.499+0000 7f0ace5f6640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ac81082a0 0x7f0ac819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.499+0000 7f0ace5f6640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac81036e0 0x7f0ac8198b40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.499+0000 7f0ace5f6640 1 --2- 172.21.15.70:0/433646153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ac8102d30 0x7f0ac8198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:22.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.499+0000 7f0ace5f6640 1 -- 172.21.15.70:0/433646153 >> 172.21.15.70:0/433646153 conn(0x7f0ac80fc7d0 msgr2=0x7f0ac8105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:22.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.499+0000 7f0ace5f6640 1 -- 172.21.15.70:0/433646153 shutdown_connections 2024-09-12T01:51:22.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:22.499+0000 7f0ace5f6640 1 -- 172.21.15.70:0/433646153 wait complete. 2024-09-12T01:51:22.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:22 smithi070 ceph-mon[31177]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:22.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:22 smithi070 ceph-mon[31177]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T01:51:22.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:22 smithi191 ceph-mon[35770]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:22 smithi191 ceph-mon[35770]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T01:51:23.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:22 smithi152 ceph-mon[35055]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:23.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:22 smithi152 ceph-mon[35055]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T01:51:23.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T01:51:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:23.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.967+0000 7f76ad5ea640 1 -- 172.21.15.70:0/3133369598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76a8102570 msgr2=0x7f76a81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:23.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.967+0000 7f76ad5ea640 1 --2- 172.21.15.70:0/3133369598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76a8102570 0x7f76a81029b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f769c009900 tx=0x7f769c02a480 comp rx=0 tx=0).stop 2024-09-12T01:51:23.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.968+0000 7f76ad5ea640 1 -- 172.21.15.70:0/3133369598 shutdown_connections 2024-09-12T01:51:23.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.968+0000 7f76ad5ea640 1 --2- 172.21.15.70:0/3133369598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76a8102ef0 0x7f76a810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:23.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.968+0000 7f76ad5ea640 1 --2- 172.21.15.70:0/3133369598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76a8102570 0x7f76a81029b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:23.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.968+0000 7f76ad5ea640 1 --2- 172.21.15.70:0/3133369598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8100e20 0x7f76a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:23.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.968+0000 7f76ad5ea640 1 -- 172.21.15.70:0/3133369598 >> 172.21.15.70:0/3133369598 conn(0x7f76a80fc7d0 msgr2=0x7f76a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:23.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.968+0000 7f76ad5ea640 1 -- 172.21.15.70:0/3133369598 shutdown_connections 2024-09-12T01:51:23.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.968+0000 7f76ad5ea640 1 -- 172.21.15.70:0/3133369598 wait complete. 2024-09-12T01:51:23.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.968+0000 7f76ad5ea640 1 Processor -- start 2024-09-12T01:51:23.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.968+0000 7f76ad5ea640 1 -- start start 2024-09-12T01:51:23.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76ad5ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76a8100e20 0x7f76a81985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:23.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76ad5ea640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76a8102570 0x7f76a8198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:23.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76ad5ea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8102ef0 0x7f76a819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:23.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76ad5ea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f76a8111070 con 0x7f76a8100e20 2024-09-12T01:51:23.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76ad5ea640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f76a8110ef0 con 0x7f76a8102ef0 2024-09-12T01:51:23.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76ad5ea640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f76a81111f0 con 0x7f76a8102570 2024-09-12T01:51:23.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76a8100e20 0x7f76a81985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:23.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76a8100e20 0x7f76a81985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50506/0 (socket says 172.21.15.70:50506) 2024-09-12T01:51:23.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a6ffd640 1 -- 172.21.15.70:0/1305818598 learned_addr learned my addr 172.21.15.70:0/1305818598 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:23.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a77fe640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8102ef0 0x7f76a819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:23.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a67fc640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76a8102570 0x7f76a8198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:23.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a6ffd640 1 -- 172.21.15.70:0/1305818598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76a8102570 msgr2=0x7f76a8198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:23.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76a8102570 0x7f76a8198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:23.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a6ffd640 1 -- 172.21.15.70:0/1305818598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8102ef0 msgr2=0x7f76a819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8102ef0 0x7f76a819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a6ffd640 1 -- 172.21.15.70:0/1305818598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a819d570 con 0x7f76a8100e20 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a67fc640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76a8102570 0x7f76a8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a77fe640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8102ef0 0x7f76a819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76a8100e20 0x7f76a81985c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f769800d950 tx=0x7f769800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f768ffff640 1 -- 172.21.15.70:0/1305818598 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7698017070 con 0x7f76a8100e20 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76ad5ea640 1 -- 172.21.15.70:0/1305818598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a819d860 con 0x7f76a8100e20 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f768ffff640 1 -- 172.21.15.70:0/1305818598 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7698009c30 con 0x7f76a8100e20 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f768ffff640 1 -- 172.21.15.70:0/1305818598 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769800f740 con 0x7f76a8100e20 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.969+0000 7f76ad5ea640 1 -- 172.21.15.70:0/1305818598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a81a5140 con 0x7f76a8100e20 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.971+0000 7f768ffff640 1 -- 172.21.15.70:0/1305818598 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7698010a80 con 0x7f76a8100e20 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76af9c3740 1 Processor -- start 2024-09-12T01:51:24.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76af9c3740 1 -- start start 2024-09-12T01:51:24.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76af9c3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017e88b0 0x5612017e8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76af9c3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 0x5612017f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76af9c3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017f7fc0 0x5612017fa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76af9c3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56120174f090 con 0x5612017e91d0 2024-09-12T01:51:24.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76af9c3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5612016f6a70 con 0x5612017f7fc0 2024-09-12T01:51:24.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76af9c3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56120174b050 con 0x5612017e88b0 2024-09-12T01:51:24.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f768ffff640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f76900a2b80 0x7f76900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 0x5612017f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 0x5612017f7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50520/0 (socket says 172.21.15.70:50520) 2024-09-12T01:51:24.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76a6ffd640 1 -- 172.21.15.70:0/2851563611 learned_addr learned my addr 172.21.15.70:0/2851563611 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:24.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76a77fe640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f76900a2b80 0x7f76900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76a77fe640 1 --2- 172.21.15.70:0/2851563611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017e88b0 0x5612017e8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76a67fc640 1 --2- 172.21.15.70:0/2851563611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017f7fc0 0x5612017fa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f768ffff640 1 -- 172.21.15.70:0/1305818598 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f76980cf0b0 con 0x7f76a8100e20 2024-09-12T01:51:24.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76a6ffd640 1 -- 172.21.15.70:0/2851563611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017e88b0 msgr2=0x5612017e8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:24.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/2851563611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017e88b0 0x5612017e8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76a6ffd640 1 -- 172.21.15.70:0/2851563611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017f7fc0 msgr2=0x5612017fa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:24.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.972+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/2851563611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017f7fc0 0x5612017fa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.973+0000 7f76a6ffd640 1 -- 172.21.15.70:0/2851563611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561201703130 con 0x5612017e91d0 2024-09-12T01:51:24.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.973+0000 7f76a77fe640 1 --2- 172.21.15.70:0/2851563611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017e88b0 0x5612017e8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:24.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.973+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/2851563611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 0x5612017f7a80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f76980a4050 tx=0x7f769801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128b5958ab0071c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:24.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.973+0000 7f768d7fa640 1 -- 172.21.15.70:0/2851563611 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7698020070 con 0x5612017e91d0 2024-09-12T01:51:24.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.973+0000 7f768d7fa640 1 -- 172.21.15.70:0/2851563611 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7698009de0 con 0x5612017e91d0 2024-09-12T01:51:24.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.973+0000 7f768d7fa640 1 -- 172.21.15.70:0/2851563611 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76980d10d0 con 0x5612017e91d0 2024-09-12T01:51:24.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.973+0000 7f76af9c3740 1 -- 172.21.15.70:0/2851563611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 msgr2=0x5612017f7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:24.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.973+0000 7f76a77fe640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f76900a2b80 0x7f76900a5040 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f76a0005c40 tx=0x7f76a0009510 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:24.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.973+0000 7f76af9c3740 1 --2- 172.21.15.70:0/2851563611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 0x5612017f7a80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f76980a4050 tx=0x7f769801e000 comp rx=0 tx=0).stop 2024-09-12T01:51:24.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 -- 172.21.15.70:0/2851563611 shutdown_connections 2024-09-12T01:51:24.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 --2- 172.21.15.70:0/2851563611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017f7fc0 0x5612017fa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 --2- 172.21.15.70:0/2851563611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 0x5612017f7a80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 --2- 172.21.15.70:0/2851563611 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017e88b0 0x5612017e8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 -- 172.21.15.70:0/2851563611 >> 172.21.15.70:0/2851563611 conn(0x5612017e4f60 msgr2=0x5612017e5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:24.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 -- 172.21.15.70:0/2851563611 shutdown_connections 2024-09-12T01:51:24.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 -- 172.21.15.70:0/2851563611 wait complete. 2024-09-12T01:51:24.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 -- start start 2024-09-12T01:51:24.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 Processor -- start 2024-09-12T01:51:24.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 0x5612017f7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017e91d0 0x5612017f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017f7fc0 0x5612017f5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5612017fab30 con 0x5612017e88b0 2024-09-12T01:51:24.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561201709f20 con 0x5612017f7fc0 2024-09-12T01:51:24.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5612017facb0 con 0x5612017e91d0 2024-09-12T01:51:24.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76af9c3740 10 client.0 _ll_register_callbacks cb 0x5612016d3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:24.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 0x5612017f7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 0x5612017f7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50524/0 (socket says 172.21.15.70:50524) 2024-09-12T01:51:24.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.974+0000 7f76a6ffd640 1 -- 172.21.15.70:0/3683380207 learned_addr learned my addr 172.21.15.70:0/3683380207 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:24.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f76a67fc640 1 --2- 172.21.15.70:0/3683380207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017e91d0 0x5612017f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f76a6ffd640 1 -- 172.21.15.70:0/3683380207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017e91d0 msgr2=0x5612017f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:24.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/3683380207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017e91d0 0x5612017f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f76a6ffd640 1 -- 172.21.15.70:0/3683380207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017f7fc0 msgr2=0x5612017f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:24.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/3683380207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017f7fc0 0x5612017f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f76a6ffd640 1 -- 172.21.15.70:0/3683380207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612014c02b0 con 0x5612017e88b0 2024-09-12T01:51:24.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/3683380207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 0x5612017f7820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7698097d70 tx=0x7f76980a4600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f19114a1119e9a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:24.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f768aff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:24.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f768aff5640 1 -- 172.21.15.70:0/3683380207 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76980b3020 con 0x5612017e88b0 2024-09-12T01:51:24.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f768aff5640 1 -- 172.21.15.70:0/3683380207 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f76980a42f0 con 0x5612017e88b0 2024-09-12T01:51:24.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f76af9c3740 1 -- 172.21.15.70:0/3683380207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7698009de0 con 0x5612017e88b0 2024-09-12T01:51:24.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f768aff5640 1 -- 172.21.15.70:0/3683380207 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7698060e60 con 0x5612017e88b0 2024-09-12T01:51:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f76af9c3740 10 client.15105 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f76af9c3740 1 -- 172.21.15.70:0/3683380207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561201806490 con 0x5612017e88b0 2024-09-12T01:51:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f768aff5640 1 -- 172.21.15.70:0/3683380207 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7698009de0 con 0x5612017e88b0 2024-09-12T01:51:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.975+0000 7f768aff5640 1 -- 172.21.15.70:0/3683380207 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f769809ad60 con 0x5612017e88b0 2024-09-12T01:51:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.976+0000 7f76af9c3740 10 client.15105 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.976+0000 7f76af9c3740 10 client.15105 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:51:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.976+0000 7f76af9c3740 20 client.15105 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.976+0000 7f76af9c3740 1 --2- 172.21.15.70:0/3683380207 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561201807f80 0x561201809a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.976+0000 7f76af9c3740 4 client.15105 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:51:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.976+0000 7f76af9c3740 1 -- 172.21.15.70:0/3683380207 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56120175c600 con 0x561201807f80 2024-09-12T01:51:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.976+0000 7f76a67fc640 1 --2- 172.21.15.70:0/3683380207 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561201807f80 0x561201809a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.976+0000 7f76a67fc640 1 --2- 172.21.15.70:0/3683380207 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561201807f80 0x561201809a70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3916c230a5f3f306 server_cookie=80cfd08313c79e8a in_seq=0 out_seq=0 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.976+0000 7f768aff5640 10 client.15105 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.977+0000 7f768aff5640 1 -- 172.21.15.70:0/3683380207 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56120175c600 con 0x561201807f80 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.977+0000 7f768aff5640 10 client.15105 handle_command_reply: tid=0 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.977+0000 7f76af9c3740 1 client.15105 shutdown 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.977+0000 7f76af9c3740 1 -- 172.21.15.70:0/3683380207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 msgr2=0x5612017f7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.977+0000 7f76af9c3740 1 --2- 172.21.15.70:0/3683380207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 0x5612017f7820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7698097d70 tx=0x7f76980a4600 comp rx=0 tx=0).stop 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.978+0000 7f76af9c3740 1 -- 172.21.15.70:0/3683380207 shutdown_connections 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.978+0000 7f76af9c3740 1 --2- 172.21.15.70:0/3683380207 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561201807f80 0x561201809a70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.978+0000 7f76af9c3740 1 --2- 172.21.15.70:0/3683380207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017f7fc0 0x5612017f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.978+0000 7f76af9c3740 1 --2- 172.21.15.70:0/3683380207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017e91d0 0x5612017f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.978+0000 7f768aff5640 0 client.15105 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.978+0000 7f76af9c3740 1 --2- 172.21.15.70:0/3683380207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 0x5612017f7820 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.978+0000 7f76af9c3740 1 -- 172.21.15.70:0/3683380207 >> 172.21.15.70:0/3683380207 conn(0x5612017e4f60 msgr2=0x5612017eacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:24.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.978+0000 7f76af9c3740 1 -- 172.21.15.70:0/3683380207 shutdown_connections 2024-09-12T01:51:24.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.978+0000 7f76af9c3740 1 -- 172.21.15.70:0/3683380207 wait complete. 2024-09-12T01:51:24.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.978+0000 7f76af9c3740 20 client.15105 trim_cache size 0 max 16384 2024-09-12T01:51:24.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.995+0000 7f76af9c3740 1 Processor -- start 2024-09-12T01:51:24.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.995+0000 7f76af9c3740 1 -- start start 2024-09-12T01:51:24.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.995+0000 7f76af9c3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 0x561201808600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.995+0000 7f76af9c3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017e91d0 0x561201808cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.995+0000 7f76af9c3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017f7fc0 0x561201811d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.995+0000 7f76af9c3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561201807e00 con 0x5612017e88b0 2024-09-12T01:51:24.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.995+0000 7f76af9c3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561201808480 con 0x5612017e91d0 2024-09-12T01:51:24.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.995+0000 7f76af9c3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561201808b50 con 0x5612017f7fc0 2024-09-12T01:51:24.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f76a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 0x561201808600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f76a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 0x561201808600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50526/0 (socket says 172.21.15.70:50526) 2024-09-12T01:51:24.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f76a6ffd640 1 -- 172.21.15.70:0/1595501654 learned_addr learned my addr 172.21.15.70:0/1595501654 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:24.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f76a67fc640 1 --2- 172.21.15.70:0/1595501654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017e91d0 0x561201808cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f76a6ffd640 1 -- 172.21.15.70:0/1595501654 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017f7fc0 msgr2=0x561201811d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:24.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/1595501654 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017f7fc0 0x561201811d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f76a6ffd640 1 -- 172.21.15.70:0/1595501654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017e91d0 msgr2=0x561201808cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:24.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/1595501654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017e91d0 0x561201808cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f76a6ffd640 1 -- 172.21.15.70:0/1595501654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612017faca0 con 0x5612017e88b0 2024-09-12T01:51:24.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/1595501654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 0x561201808600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f769809b0d0 tx=0x7f7698005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa423c851c36571 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:24.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f768cff9640 1 -- 172.21.15.70:0/1595501654 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76980b3070 con 0x5612017e88b0 2024-09-12T01:51:24.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f768cff9640 1 -- 172.21.15.70:0/1595501654 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7698009de0 con 0x5612017e88b0 2024-09-12T01:51:24.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.996+0000 7f768cff9640 1 -- 172.21.15.70:0/1595501654 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7698020050 con 0x5612017e88b0 2024-09-12T01:51:24.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.997+0000 7f76af9c3740 1 -- 172.21.15.70:0/1595501654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 msgr2=0x561201808600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:24.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.997+0000 7f76af9c3740 1 --2- 172.21.15.70:0/1595501654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 0x561201808600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f769809b0d0 tx=0x7f7698005880 comp rx=0 tx=0).stop 2024-09-12T01:51:24.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.997+0000 7f76af9c3740 1 -- 172.21.15.70:0/1595501654 shutdown_connections 2024-09-12T01:51:24.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.997+0000 7f76af9c3740 1 --2- 172.21.15.70:0/1595501654 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017f7fc0 0x561201811d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.997+0000 7f76af9c3740 1 --2- 172.21.15.70:0/1595501654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017e91d0 0x561201808cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.997+0000 7f76af9c3740 1 --2- 172.21.15.70:0/1595501654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e88b0 0x561201808600 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.997+0000 7f76af9c3740 1 -- 172.21.15.70:0/1595501654 >> 172.21.15.70:0/1595501654 conn(0x5612017e4f60 msgr2=0x5612017f0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:24.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.997+0000 7f76af9c3740 1 -- 172.21.15.70:0/1595501654 shutdown_connections 2024-09-12T01:51:24.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.997+0000 7f76af9c3740 1 -- 172.21.15.70:0/1595501654 wait complete. 2024-09-12T01:51:24.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.997+0000 7f76af9c3740 1 -- start start 2024-09-12T01:51:24.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.997+0000 7f76af9c3740 1 Processor -- start 2024-09-12T01:51:24.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76af9c3740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017e88b0 0x56120180cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76af9c3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 0x56120180d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76af9c3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017f7fc0 0x561201870d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76af9c3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5612018098f0 con 0x5612017e91d0 2024-09-12T01:51:24.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76af9c3740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561201809220 con 0x5612017e88b0 2024-09-12T01:51:24.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76af9c3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561201809fc0 con 0x5612017f7fc0 2024-09-12T01:51:24.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76af9c3740 10 client.0 _ll_register_callbacks cb 0x7f7698004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:24.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76a67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 0x56120180d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76a67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 0x56120180d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50532/0 (socket says 172.21.15.70:50532) 2024-09-12T01:51:24.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76a67fc640 1 -- 172.21.15.70:0/3816776824 learned_addr learned my addr 172.21.15.70:0/3816776824 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:24.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017e88b0 0x56120180cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76a77fe640 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017f7fc0 0x561201870d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76a67fc640 1 -- 172.21.15.70:0/3816776824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017f7fc0 msgr2=0x561201870d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:24.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76a67fc640 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017f7fc0 0x561201870d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76a67fc640 1 -- 172.21.15.70:0/3816776824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017e88b0 msgr2=0x56120180cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:24.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76a67fc640 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017e88b0 0x56120180cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76a67fc640 1 -- 172.21.15.70:0/3816776824 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561201871240 con 0x5612017e91d0 2024-09-12T01:51:24.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017e88b0 0x56120180cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:24.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76a67fc640 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 0x56120180d450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f769c009230 tx=0x7f769c032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd2542d55e0f30d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:24.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f768aff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:24.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f768aff5640 1 -- 172.21.15.70:0/3816776824 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c035040 con 0x5612017e91d0 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f768aff5640 1 -- 172.21.15.70:0/3816776824 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f769c005040 con 0x5612017e91d0 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76af9c3740 1 -- 172.21.15.70:0/3816776824 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7698009de0 con 0x5612017e91d0 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f768aff5640 1 -- 172.21.15.70:0/3816776824 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f769c005240 con 0x5612017e91d0 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76af9c3740 10 client.15111 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.998+0000 7f76af9c3740 1 -- 172.21.15.70:0/3816776824 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561201872400 con 0x5612017e91d0 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.999+0000 7f768aff5640 1 -- 172.21.15.70:0/3816776824 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7698009de0 con 0x5612017e91d0 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.999+0000 7f768aff5640 1 -- 172.21.15.70:0/3816776824 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f769c04e050 con 0x5612017e91d0 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.999+0000 7f76af9c3740 10 client.15111 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.999+0000 7f76af9c3740 10 client.15111 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.999+0000 7f76af9c3740 20 client.15111 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.999+0000 7f76af9c3740 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561201876f50 0x561201875c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.999+0000 7f76af9c3740 4 client.15111 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:51:24.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.999+0000 7f76af9c3740 1 -- 172.21.15.70:0/3816776824 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "status"}) -- 0x561201756b10 con 0x561201876f50 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.999+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561201876f50 0x561201875c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.999+0000 7f76a6ffd640 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561201876f50 0x561201875c60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59830d0eef91d5c0 server_cookie=b1bc53703f257386 in_seq=0 out_seq=0 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:23.999+0000 7f768aff5640 10 client.15111 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f768aff5640 1 -- 172.21.15.70:0/3816776824 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561201756b10 con 0x561201876f50 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f768aff5640 10 client.15111 handle_command_reply: tid=0 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76af9c3740 1 client.15111 shutdown 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76af9c3740 1 -- 172.21.15.70:0/3816776824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 msgr2=0x56120180d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76af9c3740 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 0x56120180d450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f769c009230 tx=0x7f769c032f90 comp rx=0 tx=0).stop 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76af9c3740 1 -- 172.21.15.70:0/3816776824 shutdown_connections 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76af9c3740 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561201876f50 0x561201875c60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76af9c3740 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5612017f7fc0 0x561201870d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76af9c3740 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612017e91d0 0x56120180d450 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76af9c3740 1 --2- 172.21.15.70:0/3816776824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5612017e88b0 0x56120180cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76af9c3740 1 -- 172.21.15.70:0/3816776824 >> 172.21.15.70:0/3816776824 conn(0x5612017e4f60 msgr2=0x5612017e37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:24.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f768aff5640 0 client.15111 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:51:24.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76af9c3740 1 -- 172.21.15.70:0/3816776824 shutdown_connections 2024-09-12T01:51:24.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76af9c3740 1 -- 172.21.15.70:0/3816776824 wait complete. 2024-09-12T01:51:24.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76af9c3740 20 client.15111 trim_cache size 0 max 16384 2024-09-12T01:51:24.019 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:51:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:51:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-12T01:51:24.019 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24452, 2024-09-12T01:51:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:51:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:51:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:51:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 85.687476594000003, 2024-09-12T01:51:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-12T01:51:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:51:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T01:51:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 96.404214311000004 2024-09-12T01:51:24.020 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:51:24.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76ad5ea640 1 -- 172.21.15.70:0/1305818598 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f76900a2b80 msgr2=0x7f76900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:24.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76ad5ea640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f76900a2b80 0x7f76900a5040 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f76a0005c40 tx=0x7f76a0009510 comp rx=0 tx=0).stop 2024-09-12T01:51:24.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76ad5ea640 1 -- 172.21.15.70:0/1305818598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76a8100e20 msgr2=0x7f76a81985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:24.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.000+0000 7f76ad5ea640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76a8100e20 0x7f76a81985c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f769800d950 tx=0x7f769800de10 comp rx=0 tx=0).stop 2024-09-12T01:51:24.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.001+0000 7f76ad5ea640 1 -- 172.21.15.70:0/1305818598 shutdown_connections 2024-09-12T01:51:24.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.001+0000 7f76ad5ea640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f76900a2b80 0x7f76900a5040 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.001+0000 7f76ad5ea640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76a8102ef0 0x7f76a819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.001+0000 7f76ad5ea640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76a8102570 0x7f76a8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.001+0000 7f76ad5ea640 1 --2- 172.21.15.70:0/1305818598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76a8100e20 0x7f76a81985c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:24.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.001+0000 7f76ad5ea640 1 -- 172.21.15.70:0/1305818598 >> 172.21.15.70:0/1305818598 conn(0x7f76a80fc7d0 msgr2=0x7f76a806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:24.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.001+0000 7f76ad5ea640 1 -- 172.21.15.70:0/1305818598 shutdown_connections 2024-09-12T01:51:24.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:24.001+0000 7f76ad5ea640 1 -- 172.21.15.70:0/1305818598 wait complete. 2024-09-12T01:51:24.694 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T01:51:24.694 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:51:24.705 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:51:24.705 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T01:51:24.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:24 smithi191 ceph-mon[35770]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T01:51:24.950 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:25.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:24 smithi152 ceph-mon[35055]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T01:51:25.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:24 smithi070 ceph-mon[31177]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T01:51:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.361+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2173960330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2b4100ad0 msgr2=0x7fa2b4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.361+0000 7fa2bb7ac640 1 --2- 172.21.15.70:0/2173960330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2b4100ad0 0x7fa2b4100ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009900 tx=0x7fa2a402a410 comp rx=0 tx=0).stop 2024-09-12T01:51:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.361+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2173960330 shutdown_connections 2024-09-12T01:51:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.361+0000 7fa2bb7ac640 1 --2- 172.21.15.70:0/2173960330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b4102690 0x7fa2b4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.361+0000 7fa2bb7ac640 1 --2- 172.21.15.70:0/2173960330 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2b4101cd0 0x7fa2b4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.361+0000 7fa2bb7ac640 1 --2- 172.21.15.70:0/2173960330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2b4100ad0 0x7fa2b4100ed0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.361+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2173960330 >> 172.21.15.70:0/2173960330 conn(0x7fa2b40fc280 msgr2=0x7fa2b40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.361+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2173960330 shutdown_connections 2024-09-12T01:51:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.361+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2173960330 wait complete. 2024-09-12T01:51:25.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.361+0000 7fa2bb7ac640 1 Processor -- start 2024-09-12T01:51:25.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2bb7ac640 1 -- start start 2024-09-12T01:51:25.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2bb7ac640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2b4100ad0 0x7fa2b406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:25.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2bb7ac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2b4101cd0 0x7fa2b419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:25.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2bb7ac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b4102690 0x7fa2b419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:25.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2bb7ac640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b410c910 con 0x7fa2b4101cd0 2024-09-12T01:51:25.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2bb7ac640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b410c790 con 0x7fa2b4102690 2024-09-12T01:51:25.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2bb7ac640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b410ca90 con 0x7fa2b4100ad0 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2b8d47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2b4101cd0 0x7fa2b419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2b8d47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2b4101cd0 0x7fa2b419cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50552/0 (socket says 172.21.15.70:50552) 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2b8d47640 1 -- 172.21.15.70:0/2742792356 learned_addr learned my addr 172.21.15.70:0/2742792356 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2b9548640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2b4100ad0 0x7fa2b406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2b8d47640 1 -- 172.21.15.70:0/2742792356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2b4100ad0 msgr2=0x7fa2b406aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2b8d47640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2b4100ad0 0x7fa2b406aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2b8d47640 1 -- 172.21.15.70:0/2742792356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b4102690 msgr2=0x7fa2b419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2b8d47640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b4102690 0x7fa2b419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2b8d47640 1 -- 172.21.15.70:0/2742792356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b419fd20 con 0x7fa2b4101cd0 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2b8d47640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2b4101cd0 0x7fa2b419cdf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa2b000d770 tx=0x7fa2b000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2aa7fc640 1 -- 172.21.15.70:0/2742792356 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0017070 con 0x7fa2b4101cd0 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2aa7fc640 1 -- 172.21.15.70:0/2742792356 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa2b0005520 con 0x7fa2b4101cd0 2024-09-12T01:51:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2742792356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b419ffb0 con 0x7fa2b4101cd0 2024-09-12T01:51:25.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.362+0000 7fa2aa7fc640 1 -- 172.21.15.70:0/2742792356 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0010460 con 0x7fa2b4101cd0 2024-09-12T01:51:25.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.363+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2742792356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b41a0490 con 0x7fa2b4101cd0 2024-09-12T01:51:25.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.364+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2742792356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b4107ea0 con 0x7fa2b4101cd0 2024-09-12T01:51:25.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.365+0000 7fa2aa7fc640 1 -- 172.21.15.70:0/2742792356 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa2b0004ea0 con 0x7fa2b4101cd0 2024-09-12T01:51:25.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.365+0000 7fa2aa7fc640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa2a00a2b80 0x7fa2a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:25.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.365+0000 7fa2b9548640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa2a00a2b80 0x7fa2a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:25.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.366+0000 7fa2aa7fc640 1 -- 172.21.15.70:0/2742792356 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa2b00cec40 con 0x7fa2b4101cd0 2024-09-12T01:51:25.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.366+0000 7fa2b9548640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa2a00a2b80 0x7fa2a00a5040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40316a0 tx=0x7fa2a4000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:25.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.370+0000 7fa2aa7fc640 1 -- 172.21.15.70:0/2742792356 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2b009bba0 con 0x7fa2b4101cd0 2024-09-12T01:51:25.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.555+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2742792356 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fa2b4062630 con 0x7fa2a00a2b80 2024-09-12T01:51:25.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.556+0000 7fa2aa7fc640 1 -- 172.21.15.70:0/2742792356 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fa2b4062630 con 0x7fa2a00a2b80 2024-09-12T01:51:25.556 INFO:teuthology.orchestra.run.smithi070.stdout:Backend: cephadm 2024-09-12T01:51:25.557 INFO:teuthology.orchestra.run.smithi070.stdout:Available: Yes 2024-09-12T01:51:25.557 INFO:teuthology.orchestra.run.smithi070.stdout:Paused: No 2024-09-12T01:51:25.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.558+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2742792356 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa2a00a2b80 msgr2=0x7fa2a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:25.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.558+0000 7fa2bb7ac640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa2a00a2b80 0x7fa2a00a5040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40316a0 tx=0x7fa2a4000bc0 comp rx=0 tx=0).stop 2024-09-12T01:51:25.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.558+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2742792356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2b4101cd0 msgr2=0x7fa2b419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:25.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.558+0000 7fa2bb7ac640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2b4101cd0 0x7fa2b419cdf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa2b000d770 tx=0x7fa2b000dc30 comp rx=0 tx=0).stop 2024-09-12T01:51:25.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.558+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2742792356 shutdown_connections 2024-09-12T01:51:25.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.558+0000 7fa2bb7ac640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa2a00a2b80 0x7fa2a00a5040 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:25.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.558+0000 7fa2bb7ac640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b4102690 0x7fa2b419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:25.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.558+0000 7fa2bb7ac640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2b4101cd0 0x7fa2b419cdf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:25.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.558+0000 7fa2bb7ac640 1 --2- 172.21.15.70:0/2742792356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2b4100ad0 0x7fa2b406aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:25.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.558+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2742792356 >> 172.21.15.70:0/2742792356 conn(0x7fa2b40fc280 msgr2=0x7fa2b4105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:25.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.559+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2742792356 shutdown_connections 2024-09-12T01:51:25.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:25.559+0000 7fa2bb7ac640 1 -- 172.21.15.70:0/2742792356 wait complete. 2024-09-12T01:51:26.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T01:51:26.393 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:26.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:26 smithi070 ceph-mon[31177]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-12T01:51:26.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:26 smithi070 ceph-mon[31177]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.847+0000 7f385a070640 1 -- 172.21.15.70:0/1215145013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3854074b40 msgr2=0x7f3854074fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.847+0000 7f385a070640 1 --2- 172.21.15.70:0/1215145013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3854074b40 0x7f3854074fa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3848009900 tx=0x7f384802a410 comp rx=0 tx=0).stop 2024-09-12T01:51:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.848+0000 7f385a070640 1 -- 172.21.15.70:0/1215145013 shutdown_connections 2024-09-12T01:51:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.848+0000 7f385a070640 1 --2- 172.21.15.70:0/1215145013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3854109a70 0x7f385410bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.848+0000 7f385a070640 1 --2- 172.21.15.70:0/1215145013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3854074b40 0x7f3854074fa0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.848+0000 7f385a070640 1 --2- 172.21.15.70:0/1215145013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38540761a0 0x7f3854074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.848+0000 7f385a070640 1 -- 172.21.15.70:0/1215145013 >> 172.21.15.70:0/1215145013 conn(0x7f38540fd3b0 msgr2=0x7f38540ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.848+0000 7f385a070640 1 -- 172.21.15.70:0/1215145013 shutdown_connections 2024-09-12T01:51:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.848+0000 7f385a070640 1 -- 172.21.15.70:0/1215145013 wait complete. 2024-09-12T01:51:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.848+0000 7f385a070640 1 Processor -- start 2024-09-12T01:51:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.848+0000 7f385a070640 1 -- start start 2024-09-12T01:51:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.848+0000 7f385a070640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3854074b40 0x7f385419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.848+0000 7f385a070640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38540761a0 0x7f385419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f385a070640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3854109a70 0x7f38541a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f385a070640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f385410fbb0 con 0x7f38540761a0 2024-09-12T01:51:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f385a070640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f385410fa30 con 0x7f3854074b40 2024-09-12T01:51:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f385a070640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f385410fd30 con 0x7f3854109a70 2024-09-12T01:51:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f3852ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38540761a0 0x7f385419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f3852ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38540761a0 0x7f385419a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50570/0 (socket says 172.21.15.70:50570) 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f3852ffd640 1 -- 172.21.15.70:0/1181850870 learned_addr learned my addr 172.21.15.70:0/1181850870 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f3853fff640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3854109a70 0x7f38541a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f38537fe640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3854074b40 0x7f385419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f3852ffd640 1 -- 172.21.15.70:0/1181850870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3854109a70 msgr2=0x7f38541a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f3852ffd640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3854109a70 0x7f38541a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f3852ffd640 1 -- 172.21.15.70:0/1181850870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3854074b40 msgr2=0x7f385419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f3852ffd640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3854074b40 0x7f385419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f3852ffd640 1 -- 172.21.15.70:0/1181850870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38541a1de0 con 0x7f38540761a0 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f3852ffd640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38540761a0 0x7f385419a6f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3848009a20 tx=0x7f3848004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f3850ff9640 1 -- 172.21.15.70:0/1181850870 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384803f030 con 0x7f38540761a0 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f385a070640 1 -- 172.21.15.70:0/1181850870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38541a2070 con 0x7f38540761a0 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.849+0000 7f3850ff9640 1 -- 172.21.15.70:0/1181850870 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3848003d00 con 0x7f38540761a0 2024-09-12T01:51:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.850+0000 7f385a070640 1 -- 172.21.15.70:0/1181850870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38541a25a0 con 0x7f38540761a0 2024-09-12T01:51:26.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.850+0000 7f3850ff9640 1 -- 172.21.15.70:0/1181850870 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848049060 con 0x7f38540761a0 2024-09-12T01:51:26.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.851+0000 7f385a070640 1 -- 172.21.15.70:0/1181850870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3854108880 con 0x7f38540761a0 2024-09-12T01:51:26.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.851+0000 7f3850ff9640 1 -- 172.21.15.70:0/1181850870 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3848042030 con 0x7f38540761a0 2024-09-12T01:51:26.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.852+0000 7f3850ff9640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f383c0a2bb0 0x7f383c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:26.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.852+0000 7f38537fe640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f383c0a2bb0 0x7f383c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:26.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.853+0000 7f3850ff9640 1 -- 172.21.15.70:0/1181850870 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f38480efa70 con 0x7f38540761a0 2024-09-12T01:51:26.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.853+0000 7f38537fe640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f383c0a2bb0 0x7f383c0a5070 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3844005fd0 tx=0x7f3844005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:26.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:26.857+0000 7f3850ff9640 1 -- 172.21.15.70:0/1181850870 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f38480bc9d0 con 0x7f38540761a0 2024-09-12T01:51:26.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:26 smithi191 ceph-mon[35770]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-12T01:51:26.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:26 smithi191 ceph-mon[35770]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:27.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:26 smithi152 ceph-mon[35055]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-12T01:51:27.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:26 smithi152 ceph-mon[35055]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:27.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.030+0000 7f385a070640 1 -- 172.21.15.70:0/1181850870 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3854062630 con 0x7f383c0a2bb0 2024-09-12T01:51:27.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.042+0000 7f3850ff9640 1 -- 172.21.15.70:0/1181850870 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f3854062630 con 0x7f383c0a2bb0 2024-09-12T01:51:27.042 INFO:teuthology.orchestra.run.smithi070.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:51:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:mds.a smithi070 running (102s) 20s ago 101s 15.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 40ba78fa839c 2024-09-12T01:51:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:mds.b smithi152 running (99s) 33s ago 99s 25.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 fe19a7587df0 2024-09-12T01:51:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:mds.c smithi191 running (113s) 33s ago 112s 20.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 67d5c27f25c6 2024-09-12T01:51:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:mds.d smithi070 running (2m) 20s ago 119s 15.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 88ed23c9454f 2024-09-12T01:51:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:mds.e smithi152 running (117s) 33s ago 117s 20.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 a9649aa59989 2024-09-12T01:51:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:mds.f smithi191 running (115s) 33s ago 115s 17.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 afaa17d49462 2024-09-12T01:51:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:mds.g smithi070 running (105s) 20s ago 105s 16.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 a64769e3ebcb 2024-09-12T01:51:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:mds.h smithi152 running (110s) 33s ago 110s 19.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 7ac0545caa72 2024-09-12T01:51:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:mds.i smithi191 running (108s) 33s ago 107s 17.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 1c863ba550a4 2024-09-12T01:51:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:mds.j smithi070 running (2m) 20s ago 2m 15.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 0321d2084389 2024-09-12T01:51:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:mds.k smithi152 running (2m) 33s ago 2m 15.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 56d78402e3e0 2024-09-12T01:51:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:mds.l smithi191 running (2m) 33s ago 2m 19.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 cadebaaa594d 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.x smithi070 *:9283,8765 running (8m) 20s ago 8m 509M - 19.1.1-298-gb53b6d3e 54467abc55f8 d7b907f8f257 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.y smithi152 *:8443,8765 running (7m) 33s ago 7m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 fbb0fe756767 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.z smithi191 *:8443,8765 running (7m) 33s ago 7m 443M - 19.1.1-298-gb53b6d3e 54467abc55f8 b867e3395aeb 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a smithi070 running (8m) 20s ago 8m 48.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 88b95e97367a 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b smithi152 running (7m) 33s ago 7m 40.9M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2113509adab 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c smithi191 running (7m) 33s ago 7m 40.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 b63bfce1942a 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 smithi070 running (6m) 20s ago 6m 55.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 9e26145734a7 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 smithi152 running (6m) 33s ago 6m 58.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 7009d45db28a 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 smithi191 running (6m) 33s ago 6m 60.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 7586d7940e7d 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 smithi070 running (5m) 20s ago 5m 48.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 1c33780e9e12 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 smithi152 running (5m) 33s ago 5m 44.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 7fd0e7adac47 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 smithi191 running (4m) 33s ago 4m 48.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 734b3075299e 2024-09-12T01:51:27.044 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 smithi070 running (4m) 20s ago 4m 54.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 7410b1c77cfb 2024-09-12T01:51:27.045 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 smithi152 running (4m) 33s ago 4m 47.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 ccc59aa7a32b 2024-09-12T01:51:27.045 INFO:teuthology.orchestra.run.smithi070.stdout:osd.8 smithi191 running (3m) 33s ago 3m 46.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 ef547b349123 2024-09-12T01:51:27.045 INFO:teuthology.orchestra.run.smithi070.stdout:osd.9 smithi070 running (3m) 20s ago 3m 44.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 bb42edc9693b 2024-09-12T01:51:27.045 INFO:teuthology.orchestra.run.smithi070.stdout:osd.10 smithi152 running (2m) 33s ago 2m 55.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 0a266905d0cb 2024-09-12T01:51:27.045 INFO:teuthology.orchestra.run.smithi070.stdout:osd.11 smithi191 running (2m) 33s ago 2m 44.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 68b0974bae61 2024-09-12T01:51:27.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.044+0000 7f385a070640 1 -- 172.21.15.70:0/1181850870 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f383c0a2bb0 msgr2=0x7f383c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.044+0000 7f385a070640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f383c0a2bb0 0x7f383c0a5070 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3844005fd0 tx=0x7f3844005850 comp rx=0 tx=0).stop 2024-09-12T01:51:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.044+0000 7f385a070640 1 -- 172.21.15.70:0/1181850870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38540761a0 msgr2=0x7f385419a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.044+0000 7f385a070640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38540761a0 0x7f385419a6f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3848009a20 tx=0x7f3848004430 comp rx=0 tx=0).stop 2024-09-12T01:51:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.044+0000 7f385a070640 1 -- 172.21.15.70:0/1181850870 shutdown_connections 2024-09-12T01:51:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.045+0000 7f385a070640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f383c0a2bb0 0x7f383c0a5070 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.045+0000 7f385a070640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3854109a70 0x7f38541a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.045+0000 7f385a070640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38540761a0 0x7f385419a6f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.045+0000 7f385a070640 1 --2- 172.21.15.70:0/1181850870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3854074b40 0x7f385419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.045+0000 7f385a070640 1 -- 172.21.15.70:0/1181850870 >> 172.21.15.70:0/1181850870 conn(0x7f38540fd3b0 msgr2=0x7f3854105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.045+0000 7f385a070640 1 -- 172.21.15.70:0/1181850870 shutdown_connections 2024-09-12T01:51:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:27.045+0000 7f385a070640 1 -- 172.21.15.70:0/1181850870 wait complete. 2024-09-12T01:51:27.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T01:51:27.959 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:28.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.412+0000 7fa6e013c640 1 -- 172.21.15.70:0/1849724189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d8102e00 msgr2=0x7fa6d8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:28.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.412+0000 7fa6e013c640 1 --2- 172.21.15.70:0/1849724189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d8102e00 0x7fa6d8103280 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009ca0 tx=0x7fa6cc02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:51:28.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.412+0000 7fa6e013c640 1 -- 172.21.15.70:0/1849724189 shutdown_connections 2024-09-12T01:51:28.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.412+0000 7fa6e013c640 1 --2- 172.21.15.70:0/1849724189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6d81037c0 0x7fa6d810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:28.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.412+0000 7fa6e013c640 1 --2- 172.21.15.70:0/1849724189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d8102e00 0x7fa6d8103280 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.412+0000 7fa6e013c640 1 --2- 172.21.15.70:0/1849724189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d8101c00 0x7fa6d8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.412+0000 7fa6e013c640 1 -- 172.21.15.70:0/1849724189 >> 172.21.15.70:0/1849724189 conn(0x7fa6d80fd390 msgr2=0x7fa6d80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.412+0000 7fa6e013c640 1 -- 172.21.15.70:0/1849724189 shutdown_connections 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6e013c640 1 -- 172.21.15.70:0/1849724189 wait complete. 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6e013c640 1 Processor -- start 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6e013c640 1 -- start start 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6e013c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d8101c00 0x7fa6d8197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6e013c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6d8102e00 0x7fa6d81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6e013c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d81037c0 0x7fa6d819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6e013c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d810d9c0 con 0x7fa6d8101c00 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6e013c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d810d840 con 0x7fa6d81037c0 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6e013c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d810db40 con 0x7fa6d8102e00 2024-09-12T01:51:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6dded8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d8101c00 0x7fa6d8197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6dded8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d8101c00 0x7fa6d8197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50586/0 (socket says 172.21.15.70:50586) 2024-09-12T01:51:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6dded8640 1 -- 172.21.15.70:0/4190581870 learned_addr learned my addr 172.21.15.70:0/4190581870 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.413+0000 7fa6dd6d7640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6d8102e00 0x7fa6d81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6de6d9640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d81037c0 0x7fa6d819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6dded8640 1 -- 172.21.15.70:0/4190581870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6d8102e00 msgr2=0x7fa6d81984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6dded8640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6d8102e00 0x7fa6d81984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6dded8640 1 -- 172.21.15.70:0/4190581870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d81037c0 msgr2=0x7fa6d819f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6dded8640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d81037c0 0x7fa6d819f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6dded8640 1 -- 172.21.15.70:0/4190581870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d819fbc0 con 0x7fa6d8101c00 2024-09-12T01:51:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6de6d9640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d81037c0 0x7fa6d819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6dded8640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d8101c00 0x7fa6d8197f90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c970 tx=0x7fa6c800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6d6ffd640 1 -- 172.21.15.70:0/4190581870 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8007c10 con 0x7fa6d8101c00 2024-09-12T01:51:28.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6e013c640 1 -- 172.21.15.70:0/4190581870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d819feb0 con 0x7fa6d8101c00 2024-09-12T01:51:28.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6d6ffd640 1 -- 172.21.15.70:0/4190581870 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa6c8007db0 con 0x7fa6d8101c00 2024-09-12T01:51:28.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6d6ffd640 1 -- 172.21.15.70:0/4190581870 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800fa40 con 0x7fa6d8101c00 2024-09-12T01:51:28.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.414+0000 7fa6e013c640 1 -- 172.21.15.70:0/4190581870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d81a0300 con 0x7fa6d8101c00 2024-09-12T01:51:28.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.415+0000 7fa6e013c640 1 -- 172.21.15.70:0/4190581870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d8108f30 con 0x7fa6d8101c00 2024-09-12T01:51:28.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.416+0000 7fa6d6ffd640 1 -- 172.21.15.70:0/4190581870 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa6c800fbe0 con 0x7fa6d8101c00 2024-09-12T01:51:28.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.417+0000 7fa6d6ffd640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa6c00a2bb0 0x7fa6c00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:28.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.417+0000 7fa6dd6d7640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa6c00a2bb0 0x7fa6c00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:28.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.417+0000 7fa6d6ffd640 1 -- 172.21.15.70:0/4190581870 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa6c80cf420 con 0x7fa6d8101c00 2024-09-12T01:51:28.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.417+0000 7fa6dd6d7640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa6c00a2bb0 0x7fa6c00a5070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc006010 tx=0x7fa6cc009360 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:28.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.421+0000 7fa6d6ffd640 1 -- 172.21.15.70:0/4190581870 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6c809c410 con 0x7fa6d8101c00 2024-09-12T01:51:28.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.596+0000 7fa6e013c640 1 -- 172.21.15.70:0/4190581870 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa6d8062630 con 0x7fa6c00a2bb0 2024-09-12T01:51:28.596 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:28 smithi070 ceph-mon[31177]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:28.597 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:28 smithi070 ceph-mon[31177]: pgmap v316: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-12T01:51:28.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.602+0000 7fa6d6ffd640 1 -- 172.21.15.70:0/4190581870 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fa6d8062630 con 0x7fa6c00a2bb0 2024-09-12T01:51:28.602 INFO:teuthology.orchestra.run.smithi070.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T01:51:28.602 INFO:teuthology.orchestra.run.smithi070.stdout:mds.all 12/12 35s ago 2m smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi152=b;smithi152=e;smithi152=h;smithi152=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-09-12T01:51:28.602 INFO:teuthology.orchestra.run.smithi070.stdout:mgr 3/3 35s ago 7m smithi070=x;smithi152=y;smithi191=z;count:3 2024-09-12T01:51:28.602 INFO:teuthology.orchestra.run.smithi070.stdout:mon 3/3 35s ago 7m smithi070:172.21.15.70=a;smithi152:172.21.15.152=b;smithi191:172.21.15.191=c;count:3 2024-09-12T01:51:28.602 INFO:teuthology.orchestra.run.smithi070.stdout:osd 12 35s ago - 2024-09-12T01:51:28.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.604+0000 7fa6e013c640 1 -- 172.21.15.70:0/4190581870 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa6c00a2bb0 msgr2=0x7fa6c00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:28.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.604+0000 7fa6e013c640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa6c00a2bb0 0x7fa6c00a5070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc006010 tx=0x7fa6cc009360 comp rx=0 tx=0).stop 2024-09-12T01:51:28.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.604+0000 7fa6e013c640 1 -- 172.21.15.70:0/4190581870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d8101c00 msgr2=0x7fa6d8197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:28.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.604+0000 7fa6e013c640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d8101c00 0x7fa6d8197f90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c970 tx=0x7fa6c800ce30 comp rx=0 tx=0).stop 2024-09-12T01:51:28.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.604+0000 7fa6e013c640 1 -- 172.21.15.70:0/4190581870 shutdown_connections 2024-09-12T01:51:28.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.604+0000 7fa6e013c640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa6c00a2bb0 0x7fa6c00a5070 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:28.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.604+0000 7fa6e013c640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d81037c0 0x7fa6d819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:28.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.604+0000 7fa6e013c640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6d8102e00 0x7fa6d81984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:28.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.604+0000 7fa6e013c640 1 --2- 172.21.15.70:0/4190581870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d8101c00 0x7fa6d8197f90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:28.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.604+0000 7fa6e013c640 1 -- 172.21.15.70:0/4190581870 >> 172.21.15.70:0/4190581870 conn(0x7fa6d80fd390 msgr2=0x7fa6d8106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:28.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.604+0000 7fa6e013c640 1 -- 172.21.15.70:0/4190581870 shutdown_connections 2024-09-12T01:51:28.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:28.604+0000 7fa6e013c640 1 -- 172.21.15.70:0/4190581870 wait complete. 2024-09-12T01:51:28.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:28 smithi191 ceph-mon[35770]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:28.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:28 smithi191 ceph-mon[35770]: pgmap v316: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-12T01:51:29.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:28 smithi152 ceph-mon[35055]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:29.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:28 smithi152 ceph-mon[35055]: pgmap v316: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-12T01:51:29.213 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T01:51:29.458 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:29.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:29 smithi070 ceph-mon[31177]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:29.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.885+0000 7fc83a8b5640 1 -- 172.21.15.70:0/3768180643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc834101cd0 msgr2=0x7fc834102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:29.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.885+0000 7fc83a8b5640 1 --2- 172.21.15.70:0/3768180643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc834101cd0 0x7fc834102150 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc828009900 tx=0x7fc82802a410 comp rx=0 tx=0).stop 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.885+0000 7fc83a8b5640 1 -- 172.21.15.70:0/3768180643 shutdown_connections 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.885+0000 7fc83a8b5640 1 --2- 172.21.15.70:0/3768180643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc834102690 0x7fc834108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.885+0000 7fc83a8b5640 1 --2- 172.21.15.70:0/3768180643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc834101cd0 0x7fc834102150 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.885+0000 7fc83a8b5640 1 --2- 172.21.15.70:0/3768180643 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc834100ad0 0x7fc834100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.885+0000 7fc83a8b5640 1 -- 172.21.15.70:0/3768180643 >> 172.21.15.70:0/3768180643 conn(0x7fc8340fc280 msgr2=0x7fc8340fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.886+0000 7fc83a8b5640 1 -- 172.21.15.70:0/3768180643 shutdown_connections 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.886+0000 7fc83a8b5640 1 -- 172.21.15.70:0/3768180643 wait complete. 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.886+0000 7fc83a8b5640 1 Processor -- start 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.886+0000 7fc83a8b5640 1 -- start start 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc83a8b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc834100ad0 0x7fc834198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc83a8b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc834101cd0 0x7fc834198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc83a8b5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc834102690 0x7fc83419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:29.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc83a8b5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc83410c910 con 0x7fc834101cd0 2024-09-12T01:51:29.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc83a8b5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc83410c790 con 0x7fc834100ad0 2024-09-12T01:51:29.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc83a8b5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc83410ca90 con 0x7fc834102690 2024-09-12T01:51:29.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc8337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc834101cd0 0x7fc834198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:29.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc8337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc834101cd0 0x7fc834198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50612/0 (socket says 172.21.15.70:50612) 2024-09-12T01:51:29.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc8337fe640 1 -- 172.21.15.70:0/2683523301 learned_addr learned my addr 172.21.15.70:0/2683523301 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:29.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc838e52640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc834102690 0x7fc83419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:29.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc833fff640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc834100ad0 0x7fc834198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:29.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc8337fe640 1 -- 172.21.15.70:0/2683523301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc834102690 msgr2=0x7fc83419f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:29.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc8337fe640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc834102690 0x7fc83419f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:29.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc8337fe640 1 -- 172.21.15.70:0/2683523301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc834100ad0 msgr2=0x7fc834198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:29.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc8337fe640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc834100ad0 0x7fc834198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:29.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc8337fe640 1 -- 172.21.15.70:0/2683523301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc834102ef0 con 0x7fc834101cd0 2024-09-12T01:51:29.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc8337fe640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc834101cd0 0x7fc834198660 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc8280315e0 tx=0x7fc828004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:29.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc8317fa640 1 -- 172.21.15.70:0/2683523301 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82803f030 con 0x7fc834101cd0 2024-09-12T01:51:29.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc8317fa640 1 -- 172.21.15.70:0/2683523301 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc828003d00 con 0x7fc834101cd0 2024-09-12T01:51:29.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc83a8b5640 1 -- 172.21.15.70:0/2683523301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc834103180 con 0x7fc834101cd0 2024-09-12T01:51:29.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.887+0000 7fc8317fa640 1 -- 172.21.15.70:0/2683523301 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828035070 con 0x7fc834101cd0 2024-09-12T01:51:29.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.888+0000 7fc83a8b5640 1 -- 172.21.15.70:0/2683523301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8341036b0 con 0x7fc834101cd0 2024-09-12T01:51:29.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.888+0000 7fc83a8b5640 1 -- 172.21.15.70:0/2683523301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc834103910 con 0x7fc834101cd0 2024-09-12T01:51:29.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.890+0000 7fc8317fa640 1 -- 172.21.15.70:0/2683523301 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc828042030 con 0x7fc834101cd0 2024-09-12T01:51:29.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.890+0000 7fc8317fa640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc81c0a2c30 0x7fc81c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:29.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.890+0000 7fc833fff640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc81c0a2c30 0x7fc81c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:29.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.890+0000 7fc8317fa640 1 -- 172.21.15.70:0/2683523301 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc8280ef640 con 0x7fc834101cd0 2024-09-12T01:51:29.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.891+0000 7fc833fff640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc81c0a2c30 0x7fc81c0a50f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc834101b30 tx=0x7fc824008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:29.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:29.894+0000 7fc8317fa640 1 -- 172.21.15.70:0/2683523301 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc8280bc5a0 con 0x7fc834101cd0 2024-09-12T01:51:29.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:29 smithi191 ceph-mon[35770]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:30.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:29 smithi152 ceph-mon[35055]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:30.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.069+0000 7fc83a8b5640 1 -- 172.21.15.70:0/2683523301 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fc83406a710 con 0x7fc81c0a2c30 2024-09-12T01:51:30.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.070+0000 7fc8317fa640 1 -- 172.21.15.70:0/2683523301 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fc83406a710 con 0x7fc81c0a2c30 2024-09-12T01:51:30.070 INFO:teuthology.orchestra.run.smithi070.stdout:HOST ADDR LABELS STATUS 2024-09-12T01:51:30.070 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070 172.21.15.70 2024-09-12T01:51:30.070 INFO:teuthology.orchestra.run.smithi070.stdout:smithi152 172.21.15.152 2024-09-12T01:51:30.070 INFO:teuthology.orchestra.run.smithi070.stdout:smithi191 172.21.15.191 2024-09-12T01:51:30.070 INFO:teuthology.orchestra.run.smithi070.stdout:3 hosts in cluster 2024-09-12T01:51:30.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.072+0000 7fc83a8b5640 1 -- 172.21.15.70:0/2683523301 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc81c0a2c30 msgr2=0x7fc81c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:30.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.072+0000 7fc83a8b5640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc81c0a2c30 0x7fc81c0a50f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc834101b30 tx=0x7fc824008040 comp rx=0 tx=0).stop 2024-09-12T01:51:30.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.072+0000 7fc83a8b5640 1 -- 172.21.15.70:0/2683523301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc834101cd0 msgr2=0x7fc834198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.072+0000 7fc83a8b5640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc834101cd0 0x7fc834198660 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc8280315e0 tx=0x7fc828004430 comp rx=0 tx=0).stop 2024-09-12T01:51:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.072+0000 7fc83a8b5640 1 -- 172.21.15.70:0/2683523301 shutdown_connections 2024-09-12T01:51:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.072+0000 7fc83a8b5640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fc81c0a2c30 0x7fc81c0a50f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.072+0000 7fc83a8b5640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc834102690 0x7fc83419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.072+0000 7fc83a8b5640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc834101cd0 0x7fc834198660 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.072+0000 7fc83a8b5640 1 --2- 172.21.15.70:0/2683523301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc834100ad0 0x7fc834198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.072+0000 7fc83a8b5640 1 -- 172.21.15.70:0/2683523301 >> 172.21.15.70:0/2683523301 conn(0x7fc8340fc280 msgr2=0x7fc83406a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.072+0000 7fc83a8b5640 1 -- 172.21.15.70:0/2683523301 shutdown_connections 2024-09-12T01:51:30.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:30.072+0000 7fc83a8b5640 1 -- 172.21.15.70:0/2683523301 wait complete. 2024-09-12T01:51:30.694 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:30 smithi070 ceph-mon[31177]: pgmap v317: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T01:51:30.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T01:51:30.913 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:30 smithi152 ceph-mon[35055]: pgmap v317: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T01:51:30.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:30 smithi191 ceph-mon[35770]: pgmap v317: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T01:51:30.965 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:31.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 -- 172.21.15.70:0/2715859804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca941026c0 msgr2=0x7fca94108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:31.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 --2- 172.21.15.70:0/2715859804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca941026c0 0x7fca94108f50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009ca0 tx=0x7fca8c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:51:31.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 -- 172.21.15.70:0/2715859804 shutdown_connections 2024-09-12T01:51:31.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 --2- 172.21.15.70:0/2715859804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca941026c0 0x7fca94108f50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:31.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 --2- 172.21.15.70:0/2715859804 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca94101d00 0x7fca94102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:31.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 --2- 172.21.15.70:0/2715859804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca94100b00 0x7fca94100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:31.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 -- 172.21.15.70:0/2715859804 >> 172.21.15.70:0/2715859804 conn(0x7fca940fc270 msgr2=0x7fca940fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:31.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 -- 172.21.15.70:0/2715859804 shutdown_connections 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 -- 172.21.15.70:0/2715859804 wait complete. 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 Processor -- start 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 -- start start 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca94100b00 0x7fca94104a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca94101d00 0x7fca941030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca941026c0 0x7fca94103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca9410c8c0 con 0x7fca94101d00 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fca9410c740 con 0x7fca94100b00 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.397+0000 7fca99386640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fca9410ca40 con 0x7fca941026c0 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca8bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca94101d00 0x7fca941030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca8bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca94101d00 0x7fca941030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55174/0 (socket says 172.21.15.70:55174) 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca8bfff640 1 -- 172.21.15.70:0/1941067442 learned_addr learned my addr 172.21.15.70:0/1941067442 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:31.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca937fe640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca941026c0 0x7fca94103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:31.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca92ffd640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca94100b00 0x7fca94104a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:31.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca8bfff640 1 -- 172.21.15.70:0/1941067442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca941026c0 msgr2=0x7fca94103620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:31.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca8bfff640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca941026c0 0x7fca94103620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:31.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca8bfff640 1 -- 172.21.15.70:0/1941067442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca94100b00 msgr2=0x7fca94104a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:31.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca8bfff640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca94100b00 0x7fca94104a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:31.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca8bfff640 1 -- 172.21.15.70:0/1941067442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca94103e40 con 0x7fca94101d00 2024-09-12T01:51:31.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca8bfff640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca94101d00 0x7fca941030e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00d770 tx=0x7fca7c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:31.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca90ff9640 1 -- 172.21.15.70:0/1941067442 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c017070 con 0x7fca94101d00 2024-09-12T01:51:31.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca99386640 1 -- 172.21.15.70:0/1941067442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca941a2080 con 0x7fca94101d00 2024-09-12T01:51:31.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca90ff9640 1 -- 172.21.15.70:0/1941067442 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca7c005520 con 0x7fca94101d00 2024-09-12T01:51:31.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca99386640 1 -- 172.21.15.70:0/1941067442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca941a25c0 con 0x7fca94101d00 2024-09-12T01:51:31.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.398+0000 7fca90ff9640 1 -- 172.21.15.70:0/1941067442 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c010460 con 0x7fca94101d00 2024-09-12T01:51:31.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.399+0000 7fca99386640 1 -- 172.21.15.70:0/1941067442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca941a2870 con 0x7fca94101d00 2024-09-12T01:51:31.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.401+0000 7fca90ff9640 1 -- 172.21.15.70:0/1941067442 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fca7c004ea0 con 0x7fca94101d00 2024-09-12T01:51:31.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.402+0000 7fca90ff9640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca800a2c00 0x7fca800a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:31.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.402+0000 7fca92ffd640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca800a2c00 0x7fca800a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:31.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.402+0000 7fca90ff9640 1 -- 172.21.15.70:0/1941067442 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fca7c0ceee0 con 0x7fca94101d00 2024-09-12T01:51:31.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.402+0000 7fca92ffd640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca800a2c00 0x7fca800a50c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca840058c0 tx=0x7fca84005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:31.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.405+0000 7fca90ff9640 1 -- 172.21.15.70:0/1941067442 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca7c09bec0 con 0x7fca94101d00 2024-09-12T01:51:31.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.579+0000 7fca99386640 1 -- 172.21.15.70:0/1941067442 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fca940fe470 con 0x7fca800a2c00 2024-09-12T01:51:31.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.580+0000 7fca90ff9640 1 -- 172.21.15.70:0/1941067442 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fca940fe470 con 0x7fca800a2c00 2024-09-12T01:51:31.580 INFO:teuthology.orchestra.run.smithi070.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T01:51:31.580 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513002P480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-12T01:51:31.580 INFO:teuthology.orchestra.run.smithi070.stdout:smithi152 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JT400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T01:51:31.580 INFO:teuthology.orchestra.run.smithi070.stdout:smithi191 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303008M400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T01:51:31.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.582+0000 7fca99386640 1 -- 172.21.15.70:0/1941067442 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca800a2c00 msgr2=0x7fca800a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:31.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.582+0000 7fca99386640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca800a2c00 0x7fca800a50c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca840058c0 tx=0x7fca84005850 comp rx=0 tx=0).stop 2024-09-12T01:51:31.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.582+0000 7fca99386640 1 -- 172.21.15.70:0/1941067442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca94101d00 msgr2=0x7fca941030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:31.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.582+0000 7fca99386640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca94101d00 0x7fca941030e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fca7c00d770 tx=0x7fca7c00dc30 comp rx=0 tx=0).stop 2024-09-12T01:51:31.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.582+0000 7fca99386640 1 -- 172.21.15.70:0/1941067442 shutdown_connections 2024-09-12T01:51:31.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.582+0000 7fca99386640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca800a2c00 0x7fca800a50c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:31.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.582+0000 7fca99386640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca941026c0 0x7fca94103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:31.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.582+0000 7fca99386640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca94101d00 0x7fca941030e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:31.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.582+0000 7fca99386640 1 --2- 172.21.15.70:0/1941067442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca94100b00 0x7fca94104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:31.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.582+0000 7fca99386640 1 -- 172.21.15.70:0/1941067442 >> 172.21.15.70:0/1941067442 conn(0x7fca940fc270 msgr2=0x7fca940fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:31.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.582+0000 7fca99386640 1 -- 172.21.15.70:0/1941067442 shutdown_connections 2024-09-12T01:51:31.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:31.582+0000 7fca99386640 1 -- 172.21.15.70:0/1941067442 wait complete. 2024-09-12T01:51:31.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:31 smithi070 ceph-mon[31177]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:31.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:31 smithi191 ceph-mon[35770]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:32.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:31 smithi152 ceph-mon[35055]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:32.272 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:51:32.281 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:51:32.281 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T01:51:32.527 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:32.753 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:32 smithi070 ceph-mon[31177]: pgmap v318: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-12T01:51:32.753 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:32 smithi070 ceph-mon[31177]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:32.839 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:32 smithi191 ceph-mon[35770]: pgmap v318: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-12T01:51:32.839 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:32 smithi191 ceph-mon[35770]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:32.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.978+0000 7fa28767d640 1 -- 172.21.15.70:0/369515367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa280100ad0 msgr2=0x7fa280100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:32.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.978+0000 7fa28767d640 1 --2- 172.21.15.70:0/369515367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa280100ad0 0x7fa280100ed0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa270009900 tx=0x7fa27002a410 comp rx=0 tx=0).stop 2024-09-12T01:51:32.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.978+0000 7fa28767d640 1 -- 172.21.15.70:0/369515367 shutdown_connections 2024-09-12T01:51:32.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.978+0000 7fa28767d640 1 --2- 172.21.15.70:0/369515367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa280102690 0x7fa280108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:32.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.978+0000 7fa28767d640 1 --2- 172.21.15.70:0/369515367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa280101cd0 0x7fa280102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.978+0000 7fa28767d640 1 --2- 172.21.15.70:0/369515367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa280100ad0 0x7fa280100ed0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.978+0000 7fa28767d640 1 -- 172.21.15.70:0/369515367 >> 172.21.15.70:0/369515367 conn(0x7fa2800fc280 msgr2=0x7fa2800fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.978+0000 7fa28767d640 1 -- 172.21.15.70:0/369515367 shutdown_connections 2024-09-12T01:51:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.978+0000 7fa28767d640 1 -- 172.21.15.70:0/369515367 wait complete. 2024-09-12T01:51:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.978+0000 7fa28767d640 1 Processor -- start 2024-09-12T01:51:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.978+0000 7fa28767d640 1 -- start start 2024-09-12T01:51:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa28767d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa280100ad0 0x7fa28006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa28767d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa280101cd0 0x7fa28019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa28767d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa280102690 0x7fa28019f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa28767d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa28010c890 con 0x7fa280100ad0 2024-09-12T01:51:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa28767d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa28010c710 con 0x7fa280101cd0 2024-09-12T01:51:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa28767d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa28010ca10 con 0x7fa280102690 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa285419640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa280100ad0 0x7fa28006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa285419640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa280100ad0 0x7fa28006aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55198/0 (socket says 172.21.15.70:55198) 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa285419640 1 -- 172.21.15.70:0/391799012 learned_addr learned my addr 172.21.15.70:0/391799012 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa284c18640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa280101cd0 0x7fa28019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa285c1a640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa280102690 0x7fa28019f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa285419640 1 -- 172.21.15.70:0/391799012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa280102690 msgr2=0x7fa28019f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa285419640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa280102690 0x7fa28019f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa285419640 1 -- 172.21.15.70:0/391799012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa280101cd0 msgr2=0x7fa28019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa285419640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa280101cd0 0x7fa28019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa285419640 1 -- 172.21.15.70:0/391799012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28019fc80 con 0x7fa280100ad0 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa285c1a640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa280102690 0x7fa28019f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa285419640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa280100ad0 0x7fa28006aad0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa270009230 tx=0x7fa270004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa2767fc640 1 -- 172.21.15.70:0/391799012 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27003f030 con 0x7fa280100ad0 2024-09-12T01:51:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa2767fc640 1 -- 172.21.15.70:0/391799012 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa270003d00 con 0x7fa280100ad0 2024-09-12T01:51:32.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa28767d640 1 -- 172.21.15.70:0/391799012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28019feb0 con 0x7fa280100ad0 2024-09-12T01:51:32.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa2767fc640 1 -- 172.21.15.70:0/391799012 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270035070 con 0x7fa280100ad0 2024-09-12T01:51:32.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.979+0000 7fa28767d640 1 -- 172.21.15.70:0/391799012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2801a0310 con 0x7fa280100ad0 2024-09-12T01:51:32.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.980+0000 7fa28767d640 1 -- 172.21.15.70:0/391799012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa280107f20 con 0x7fa280100ad0 2024-09-12T01:51:32.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.982+0000 7fa2767fc640 1 -- 172.21.15.70:0/391799012 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa270042030 con 0x7fa280100ad0 2024-09-12T01:51:32.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.982+0000 7fa2767fc640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa26c0a2c00 0x7fa26c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:32.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.982+0000 7fa284c18640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa26c0a2c00 0x7fa26c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:32.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.982+0000 7fa2767fc640 1 -- 172.21.15.70:0/391799012 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa2700efae0 con 0x7fa280100ad0 2024-09-12T01:51:32.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.983+0000 7fa284c18640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa26c0a2c00 0x7fa26c0a50c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa28006b050 tx=0x7fa27c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:32.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:32.985+0000 7fa2767fc640 1 -- 172.21.15.70:0/391799012 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2700bca40 con 0x7fa280100ad0 2024-09-12T01:51:33.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:32 smithi152 ceph-mon[35055]: pgmap v318: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-12T01:51:33.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:32 smithi152 ceph-mon[35055]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:33.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.194+0000 7fa28767d640 1 -- 172.21.15.70:0/391799012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa28002d7c0 con 0x7fa280100ad0 2024-09-12T01:51:33.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.194+0000 7fa2767fc640 1 -- 172.21.15.70:0/391799012 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3132 (secure 0 0 0) 0x7fa2700bc340 con 0x7fa280100ad0 2024-09-12T01:51:33.195 INFO:teuthology.orchestra.run.smithi070.stdout:e27 2024-09-12T01:51:33.195 INFO:teuthology.orchestra.run.smithi070.stdout:btime 2024-09-12T01:50:09:375588+0000 2024-09-12T01:51:33.195 INFO:teuthology.orchestra.run.smithi070.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:51:33.195 INFO:teuthology.orchestra.run.smithi070.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:51:33.195 INFO:teuthology.orchestra.run.smithi070.stdout:legacy client fscid: 1 2024-09-12T01:51:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:33.195 INFO:teuthology.orchestra.run.smithi070.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:51:33.195 INFO:teuthology.orchestra.run.smithi070.stdout:fs_name cephfs 2024-09-12T01:51:33.195 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 27 2024-09-12T01:51:33.195 INFO:teuthology.orchestra.run.smithi070.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T01:51:33.195 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-12T01:49:57.864263+0000 2024-09-12T01:51:33.195 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-09-12T01:50:09.375567+0000 2024-09-12T01:51:33.196 INFO:teuthology.orchestra.run.smithi070.stdout:tableserver 0 2024-09-12T01:51:33.196 INFO:teuthology.orchestra.run.smithi070.stdout:root 0 2024-09-12T01:51:33.196 INFO:teuthology.orchestra.run.smithi070.stdout:session_timeout 300 2024-09-12T01:51:33.196 INFO:teuthology.orchestra.run.smithi070.stdout:session_autoclose 300 2024-09-12T01:51:33.196 INFO:teuthology.orchestra.run.smithi070.stdout:max_file_size 1099511627776 2024-09-12T01:51:33.196 INFO:teuthology.orchestra.run.smithi070.stdout:max_xattr_size 65536 2024-09-12T01:51:33.196 INFO:teuthology.orchestra.run.smithi070.stdout:required_client_features {} 2024-09-12T01:51:33.196 INFO:teuthology.orchestra.run.smithi070.stdout:last_failure 0 2024-09-12T01:51:33.196 INFO:teuthology.orchestra.run.smithi070.stdout:last_failure_osd_epoch 0 2024-09-12T01:51:33.196 INFO:teuthology.orchestra.run.smithi070.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:51:33.196 INFO:teuthology.orchestra.run.smithi070.stdout:max_mds 5 2024-09-12T01:51:33.196 INFO:teuthology.orchestra.run.smithi070.stdout:in 0,1,2,3,4 2024-09-12T01:51:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:up {0=24452,1=24445,2=24437,3=24433,4=24427} 2024-09-12T01:51:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:failed 2024-09-12T01:51:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:damaged 2024-09-12T01:51:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:stopped 2024-09-12T01:51:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:data_pools [3] 2024-09-12T01:51:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:metadata_pool 2 2024-09-12T01:51:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:inline_data disabled 2024-09-12T01:51:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:balancer 2024-09-12T01:51:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:bal_rank_mask -1 2024-09-12T01:51:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:standby_count_wanted 0 2024-09-12T01:51:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:qdb_cluster leader: 24452 members: 24452,24445,24437,24433,24427 2024-09-12T01:51:33.197 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b{0:24452} state up:active seq 4 addr [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:51:33.198 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.e{0:24416} state up:standby-replay seq 1 addr [v2:172.21.15.152:6834/2743921312,v1:172.21.15.152:6835/2743921312] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:51:33.198 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.i{1:24445} state up:active seq 8 addr [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:51:33.198 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.l{1:24394} state up:standby-replay seq 1 addr [v2:172.21.15.191:6832/1019939610,v1:172.21.15.191:6833/1019939610] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:51:33.198 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.h{2:24437} state up:active seq 9 addr [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:51:33.198 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.k{2:24392} state up:standby-replay seq 1 addr [v2:172.21.15.152:6832/2100585386,v1:172.21.15.152:6833/2100585386] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:51:33.199 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c{3:24433} state up:active seq 10 addr [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:51:33.199 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a{3:14649} state up:standby-replay seq 1 addr [v2:172.21.15.70:6840/3509291516,v1:172.21.15.70:6841/3509291516] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:51:33.199 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.f{4:24427} state up:active seq 11 addr [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:51:33.199 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.g{4:14637} state up:standby-replay seq 1 addr [v2:172.21.15.70:6838/3076923681,v1:172.21.15.70:6839/3076923681] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:51:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:33.199 INFO:teuthology.orchestra.run.smithi070.stdout:Standby daemons: 2024-09-12T01:51:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:33.199 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.j{-1:14571} state up:standby seq 1 addr [v2:172.21.15.70:6834/158611905,v1:172.21.15.70:6835/158611905] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:51:33.199 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.d{-1:14583} state up:standby seq 1 addr [v2:172.21.15.70:6836/2540092631,v1:172.21.15.70:6837/2540092631] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:51:33.200 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-12T01:51:33.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.197+0000 7fa28767d640 1 -- 172.21.15.70:0/391799012 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa26c0a2c00 msgr2=0x7fa26c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:33.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.197+0000 7fa28767d640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa26c0a2c00 0x7fa26c0a50c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa28006b050 tx=0x7fa27c00a2d0 comp rx=0 tx=0).stop 2024-09-12T01:51:33.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.197+0000 7fa28767d640 1 -- 172.21.15.70:0/391799012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa280100ad0 msgr2=0x7fa28006aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:33.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.197+0000 7fa28767d640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa280100ad0 0x7fa28006aad0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa270009230 tx=0x7fa270004430 comp rx=0 tx=0).stop 2024-09-12T01:51:33.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.197+0000 7fa28767d640 1 -- 172.21.15.70:0/391799012 shutdown_connections 2024-09-12T01:51:33.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.197+0000 7fa28767d640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa26c0a2c00 0x7fa26c0a50c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:33.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.197+0000 7fa28767d640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa280102690 0x7fa28019f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:33.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.197+0000 7fa28767d640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa280101cd0 0x7fa28019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:33.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.197+0000 7fa28767d640 1 --2- 172.21.15.70:0/391799012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa280100ad0 0x7fa28006aad0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:33.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.197+0000 7fa28767d640 1 -- 172.21.15.70:0/391799012 >> 172.21.15.70:0/391799012 conn(0x7fa2800fc280 msgr2=0x7fa2801050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:33.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.197+0000 7fa28767d640 1 -- 172.21.15.70:0/391799012 shutdown_connections 2024-09-12T01:51:33.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:33.197+0000 7fa28767d640 1 -- 172.21.15.70:0/391799012 wait complete. 2024-09-12T01:51:33.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T01:51:33.852 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:33 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/391799012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:51:33.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:33 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/391799012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:51:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:33 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/391799012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:51:34.072 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:34.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.586+0000 7f0e7664c640 1 -- 172.21.15.70:0/1362590947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e701026d0 msgr2=0x7f0e70108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:34.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.586+0000 7f0e7664c640 1 --2- 172.21.15.70:0/1362590947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e701026d0 0x7f0e70108f60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009ca0 tx=0x7f0e6802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.586+0000 7f0e7664c640 1 -- 172.21.15.70:0/1362590947 shutdown_connections 2024-09-12T01:51:34.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.586+0000 7f0e7664c640 1 --2- 172.21.15.70:0/1362590947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e701026d0 0x7f0e70108f60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.586+0000 7f0e7664c640 1 --2- 172.21.15.70:0/1362590947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e70101d10 0x7f0e70102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.586+0000 7f0e7664c640 1 --2- 172.21.15.70:0/1362590947 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70100b10 0x7f0e70100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.586+0000 7f0e7664c640 1 -- 172.21.15.70:0/1362590947 >> 172.21.15.70:0/1362590947 conn(0x7f0e700fc2a0 msgr2=0x7f0e700fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.586+0000 7f0e7664c640 1 -- 172.21.15.70:0/1362590947 shutdown_connections 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.586+0000 7f0e7664c640 1 -- 172.21.15.70:0/1362590947 wait complete. 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e7664c640 1 Processor -- start 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e7664c640 1 -- start start 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e7664c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70100b10 0x7f0e70197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e7664c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e70101d10 0x7f0e701984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e7664c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e701026d0 0x7f0e7019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e7664c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7010c950 con 0x7f0e70101d10 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e7664c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7010c7d0 con 0x7f0e701026d0 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e7664c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7010cad0 con 0x7f0e70100b10 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e70101d10 0x7f0e701984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e70101d10 0x7f0e701984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55204/0 (socket says 172.21.15.70:55204) 2024-09-12T01:51:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e6f7fe640 1 -- 172.21.15.70:0/1514193428 learned_addr learned my addr 172.21.15.70:0/1514193428 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e74be9640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e701026d0 0x7f0e7019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e6f7fe640 1 -- 172.21.15.70:0/1514193428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70100b10 msgr2=0x7f0e70197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e6ffff640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70100b10 0x7f0e70197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e6f7fe640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70100b10 0x7f0e70197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e6f7fe640 1 -- 172.21.15.70:0/1514193428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e701026d0 msgr2=0x7f0e7019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e6f7fe640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e701026d0 0x7f0e7019f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e6f7fe640 1 -- 172.21.15.70:0/1514193428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e7019fba0 con 0x7f0e70101d10 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e6ffff640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70100b10 0x7f0e70197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.587+0000 7f0e74be9640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e701026d0 0x7f0e7019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.588+0000 7f0e6f7fe640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e70101d10 0x7f0e701984b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c920 tx=0x7f0e6400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.588+0000 7f0e6d7fa640 1 -- 172.21.15.70:0/1514193428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64007c70 con 0x7f0e70101d10 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.588+0000 7f0e7664c640 1 -- 172.21.15.70:0/1514193428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e7019fe90 con 0x7f0e70101d10 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.588+0000 7f0e6d7fa640 1 -- 172.21.15.70:0/1514193428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0e64007e10 con 0x7f0e70101d10 2024-09-12T01:51:34.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.588+0000 7f0e6d7fa640 1 -- 172.21.15.70:0/1514193428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64018940 con 0x7f0e70101d10 2024-09-12T01:51:34.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.588+0000 7f0e7664c640 1 -- 172.21.15.70:0/1514193428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e701a0410 con 0x7f0e70101d10 2024-09-12T01:51:34.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.589+0000 7f0e7664c640 1 -- 172.21.15.70:0/1514193428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e701a06a0 con 0x7f0e70101d10 2024-09-12T01:51:34.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.590+0000 7f0e6d7fa640 1 -- 172.21.15.70:0/1514193428 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0e64018ae0 con 0x7f0e70101d10 2024-09-12T01:51:34.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.591+0000 7f0e6d7fa640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0e580a2bb0 0x7f0e580a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:34.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.591+0000 7f0e6ffff640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0e580a2bb0 0x7f0e580a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:34.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.591+0000 7f0e6d7fa640 1 -- 172.21.15.70:0/1514193428 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f0e640cf1a0 con 0x7f0e70101d10 2024-09-12T01:51:34.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.591+0000 7f0e6ffff640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0e580a2bb0 0x7f0e580a5070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0e60006fd0 tx=0x7f0e60008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:34.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.595+0000 7f0e6d7fa640 1 -- 172.21.15.70:0/1514193428 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e64014030 con 0x7f0e70101d10 2024-09-12T01:51:34.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.764+0000 7f0e7664c640 1 -- 172.21.15.70:0/1514193428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f0e701088f0 con 0x7f0e70101d10 2024-09-12T01:51:34.765 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:34 smithi070 ceph-mon[31177]: pgmap v319: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-12T01:51:34.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.765+0000 7f0e6d7fa640 1 -- 172.21.15.70:0/1514193428 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v83) ==== 56+0+5307 (secure 0 0 0) 0x7f0e6400de20 con 0x7f0e70101d10 2024-09-12T01:51:34.765 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 83 2024-09-12T01:51:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:51:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-12T01:42:34.901771+0000 2024-09-12T01:51:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-09-12T01:50:22.600430+0000 2024-09-12T01:51:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T01:51:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:crush_version 26 2024-09-12T01:51:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:full_ratio 0.95 2024-09-12T01:51:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:backfillfull_ratio 0.9 2024-09-12T01:51:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:nearfull_ratio 0.85 2024-09-12T01:51:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:require_min_compat_client luminous 2024-09-12T01:51:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:min_compat_client luminous 2024-09-12T01:51:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:require_osd_release squid 2024-09-12T01:51:34.766 INFO:teuthology.orchestra.run.smithi070.stdout:stretch_mode_enabled false 2024-09-12T01:51:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T01:51:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-12T01:51:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-12T01:51:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:max_osd 12 2024-09-12T01:51:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6802/4255694837,v1:172.21.15.70:6803/4255694837] [v2:172.21.15.70:6804/4255694837,v1:172.21.15.70:6805/4255694837] exists,up 2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8 2024-09-12T01:51:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 up in weight 1 up_from 13 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6800/3805912241,v1:172.21.15.152:6801/3805912241] [v2:172.21.15.152:6802/3805912241,v1:172.21.15.152:6803/3805912241] exists,up 77805875-8e33-446f-8ab1-c4304ce84ac9 2024-09-12T01:51:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 up in weight 1 up_from 18 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6800/3832730083,v1:172.21.15.191:6801/3832730083] [v2:172.21.15.191:6802/3832730083,v1:172.21.15.191:6803/3832730083] exists,up 87e4206e-8a05-4e9c-ac94-0d55652e9263 2024-09-12T01:51:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 up in weight 1 up_from 25 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6810/934346909,v1:172.21.15.70:6811/934346909] [v2:172.21.15.70:6812/934346909,v1:172.21.15.70:6813/934346909] exists,up e03f26a7-5373-473a-a56d-978c040682b3 2024-09-12T01:51:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 up in weight 1 up_from 32 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6808/2197110857,v1:172.21.15.152:6809/2197110857] [v2:172.21.15.152:6810/2197110857,v1:172.21.15.152:6811/2197110857] exists,up fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a 2024-09-12T01:51:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 up in weight 1 up_from 37 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6808/2424359422,v1:172.21.15.191:6809/2424359422] [v2:172.21.15.191:6810/2424359422,v1:172.21.15.191:6811/2424359422] exists,up 61d3e716-b2e4-4cd0-b90d-10c0d588e5bc 2024-09-12T01:51:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 up in weight 1 up_from 45 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6818/2771056283,v1:172.21.15.70:6819/2771056283] [v2:172.21.15.70:6820/2771056283,v1:172.21.15.70:6821/2771056283] exists,up 54b45119-c39b-4fc3-a1a5-3ed1d28646ca 2024-09-12T01:51:34.767 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 up in weight 1 up_from 49 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6816/33447312,v1:172.21.15.152:6817/33447312] [v2:172.21.15.152:6818/33447312,v1:172.21.15.152:6819/33447312] exists,up b0267631-52ff-4beb-80d8-70eb3fd0d237 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:osd.8 up in weight 1 up_from 56 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6816/1717172072,v1:172.21.15.191:6817/1717172072] [v2:172.21.15.191:6818/1717172072,v1:172.21.15.191:6819/1717172072] exists,up 8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:osd.9 up in weight 1 up_from 63 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6826/1622332043,v1:172.21.15.70:6827/1622332043] [v2:172.21.15.70:6828/1622332043,v1:172.21.15.70:6829/1622332043] exists,up 51b65e44-5204-4ce9-8626-3161eee23a6c 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:osd.10 up in weight 1 up_from 68 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6824/3382303437,v1:172.21.15.152:6825/3382303437] [v2:172.21.15.152:6826/3382303437,v1:172.21.15.152:6827/3382303437] exists,up 69fd537a-46d7-418a-9952-57c3e716456b 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:osd.11 up in weight 1 up_from 75 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6824/1166888530,v1:172.21.15.191:6825/1166888530] [v2:172.21.15.191:6826/1166888530,v1:172.21.15.191:6827/1166888530] exists,up c4d88a79-ce4f-45f6-aa34-8b9c66a953d5 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.4 [2,11] 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.14 [2,4] 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.1a [8,4] 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.1f [7,11] 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.0 [5,9] 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.5 [3,9] 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.13 [4,9] 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.17 [4,6] 2024-09-12T01:51:34.768 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.3a [4,8] 2024-09-12T01:51:34.769 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/2778664397 expires 2024-09-13T01:43:21.394738+0000 2024-09-12T01:51:34.769 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/745799282 expires 2024-09-13T01:43:21.394738+0000 2024-09-12T01:51:34.769 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/1352687155 expires 2024-09-13T01:43:21.394738+0000 2024-09-12T01:51:34.769 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/896141869 expires 2024-09-13T01:43:21.394738+0000 2024-09-12T01:51:34.769 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/1352687155 expires 2024-09-13T01:43:21.394738+0000 2024-09-12T01:51:34.769 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/687202663 expires 2024-09-13T01:42:58.411979+0000 2024-09-12T01:51:34.769 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/1934942517 expires 2024-09-13T01:42:58.411979+0000 2024-09-12T01:51:34.769 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/445870040 expires 2024-09-13T01:42:58.411979+0000 2024-09-12T01:51:34.769 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/1799979884 expires 2024-09-13T01:42:58.411979+0000 2024-09-12T01:51:34.769 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/1934942517 expires 2024-09-13T01:42:58.411979+0000 2024-09-12T01:51:34.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.768+0000 7f0e7664c640 1 -- 172.21.15.70:0/1514193428 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0e580a2bb0 msgr2=0x7f0e580a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:34.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.768+0000 7f0e7664c640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0e580a2bb0 0x7f0e580a5070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0e60006fd0 tx=0x7f0e60008040 comp rx=0 tx=0).stop 2024-09-12T01:51:34.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.768+0000 7f0e7664c640 1 -- 172.21.15.70:0/1514193428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e70101d10 msgr2=0x7f0e701984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:34.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.768+0000 7f0e7664c640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e70101d10 0x7f0e701984b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c920 tx=0x7f0e6400cde0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.768+0000 7f0e7664c640 1 -- 172.21.15.70:0/1514193428 shutdown_connections 2024-09-12T01:51:34.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.768+0000 7f0e7664c640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0e580a2bb0 0x7f0e580a5070 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.768+0000 7f0e7664c640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e701026d0 0x7f0e7019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.768+0000 7f0e7664c640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e70101d10 0x7f0e701984b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.768+0000 7f0e7664c640 1 --2- 172.21.15.70:0/1514193428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e70100b10 0x7f0e70197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:34.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.768+0000 7f0e7664c640 1 -- 172.21.15.70:0/1514193428 >> 172.21.15.70:0/1514193428 conn(0x7f0e700fc2a0 msgr2=0x7f0e700fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:34.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.768+0000 7f0e7664c640 1 -- 172.21.15.70:0/1514193428 shutdown_connections 2024-09-12T01:51:34.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:34.768+0000 7f0e7664c640 1 -- 172.21.15.70:0/1514193428 wait complete. 2024-09-12T01:51:34.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:34 smithi191 ceph-mon[35770]: pgmap v319: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-12T01:51:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:34 smithi152 ceph-mon[35055]: pgmap v319: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-12T01:51:35.449 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T01:51:35.460 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:51:35.738 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:35.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:35 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1514193428' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T01:51:35.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:35 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1514193428' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T01:51:36.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:35 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1514193428' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T01:51:36.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.187+0000 7faca9a38640 1 -- 172.21.15.70:0/441121874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faca4101410 msgr2=0x7faca410d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:36.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.187+0000 7faca9a38640 1 --2- 172.21.15.70:0/441121874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faca4101410 0x7faca410d940 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009cd0 tx=0x7fac9c02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:51:36.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.187+0000 7faca9a38640 1 -- 172.21.15.70:0/441121874 shutdown_connections 2024-09-12T01:51:36.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.187+0000 7faca9a38640 1 --2- 172.21.15.70:0/441121874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faca4101410 0x7faca410d940 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:36.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.187+0000 7faca9a38640 1 --2- 172.21.15.70:0/441121874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faca4100a70 0x7faca4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:36.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.187+0000 7faca9a38640 1 --2- 172.21.15.70:0/441121874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca4106a70 0x7faca4106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.187+0000 7faca9a38640 1 -- 172.21.15.70:0/441121874 >> 172.21.15.70:0/441121874 conn(0x7faca40fc790 msgr2=0x7faca40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.187+0000 7faca9a38640 1 -- 172.21.15.70:0/441121874 shutdown_connections 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.187+0000 7faca9a38640 1 -- 172.21.15.70:0/441121874 wait complete. 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.187+0000 7faca9a38640 1 Processor -- start 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca9a38640 1 -- start start 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca9a38640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca4100a70 0x7faca4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca9a38640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faca4101410 0x7faca4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca9a38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faca4106a70 0x7faca419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca9a38640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faca4110f90 con 0x7faca4106a70 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca9a38640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faca4110e10 con 0x7faca4101410 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca9a38640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faca4111110 con 0x7faca4100a70 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faca4106a70 0x7faca419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:36.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faca4106a70 0x7faca419cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55222/0 (socket says 172.21.15.70:55222) 2024-09-12T01:51:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca37fe640 1 -- 172.21.15.70:0/2999963840 learned_addr learned my addr 172.21.15.70:0/2999963840 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca2ffd640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca4100a70 0x7faca4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca27fc640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faca4101410 0x7faca4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca37fe640 1 -- 172.21.15.70:0/2999963840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca4100a70 msgr2=0x7faca4198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca37fe640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca4100a70 0x7faca4198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca37fe640 1 -- 172.21.15.70:0/2999963840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faca4101410 msgr2=0x7faca4198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca37fe640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faca4101410 0x7faca4198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca37fe640 1 -- 172.21.15.70:0/2999963840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca419d4c0 con 0x7faca4106a70 2024-09-12T01:51:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.188+0000 7faca37fe640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faca4106a70 0x7faca419cde0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fac9c006010 tx=0x7fac9c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.189+0000 7faca8a36640 1 -- 172.21.15.70:0/2999963840 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c004040 con 0x7faca4106a70 2024-09-12T01:51:36.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.189+0000 7faca8a36640 1 -- 172.21.15.70:0/2999963840 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fac9c0046e0 con 0x7faca4106a70 2024-09-12T01:51:36.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.189+0000 7faca9a38640 1 -- 172.21.15.70:0/2999963840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca419d750 con 0x7faca4106a70 2024-09-12T01:51:36.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.189+0000 7faca8a36640 1 -- 172.21.15.70:0/2999963840 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c046480 con 0x7faca4106a70 2024-09-12T01:51:36.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.189+0000 7faca9a38640 1 -- 172.21.15.70:0/2999963840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca41a5090 con 0x7faca4106a70 2024-09-12T01:51:36.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.190+0000 7faca9a38640 1 -- 172.21.15.70:0/2999963840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca4100ed0 con 0x7faca4106a70 2024-09-12T01:51:36.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.191+0000 7faca8a36640 1 -- 172.21.15.70:0/2999963840 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fac9c030630 con 0x7faca4106a70 2024-09-12T01:51:36.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.191+0000 7faca8a36640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fac8c0a2c00 0x7fac8c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:36.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.191+0000 7faca2ffd640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fac8c0a2c00 0x7fac8c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:36.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.192+0000 7faca8a36640 1 -- 172.21.15.70:0/2999963840 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fac9c02e030 con 0x7faca4106a70 2024-09-12T01:51:36.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.192+0000 7faca2ffd640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fac8c0a2c00 0x7fac8c0a50c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac94005fd0 tx=0x7fac9400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:36.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.195+0000 7faca8a36640 1 -- 172.21.15.70:0/2999963840 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac9c04b060 con 0x7faca4106a70 2024-09-12T01:51:36.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.396+0000 7faca9a38640 1 -- 172.21.15.70:0/2999963840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faca41a52f0 con 0x7faca4106a70 2024-09-12T01:51:36.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.396+0000 7faca8a36640 1 -- 172.21.15.70:0/2999963840 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7fac9c0bd670 con 0x7faca4106a70 2024-09-12T01:51:36.396 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:36.397 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-12T01:50:09:375588+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:50:09.375567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:51:36.397 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-12T01:51:36.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.399+0000 7faca9a38640 1 -- 172.21.15.70:0/2999963840 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fac8c0a2c00 msgr2=0x7fac8c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:36.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.399+0000 7faca9a38640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fac8c0a2c00 0x7fac8c0a50c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fac94005fd0 tx=0x7fac9400b390 comp rx=0 tx=0).stop 2024-09-12T01:51:36.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.399+0000 7faca9a38640 1 -- 172.21.15.70:0/2999963840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faca4106a70 msgr2=0x7faca419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:36.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.399+0000 7faca9a38640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faca4106a70 0x7faca419cde0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fac9c006010 tx=0x7fac9c003f10 comp rx=0 tx=0).stop 2024-09-12T01:51:36.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.399+0000 7faca9a38640 1 -- 172.21.15.70:0/2999963840 shutdown_connections 2024-09-12T01:51:36.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.399+0000 7faca9a38640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fac8c0a2c00 0x7fac8c0a50c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:36.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.399+0000 7faca9a38640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faca4106a70 0x7faca419cde0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:36.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.399+0000 7faca9a38640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faca4101410 0x7faca4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:36.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.399+0000 7faca9a38640 1 --2- 172.21.15.70:0/2999963840 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca4100a70 0x7faca4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:36.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.399+0000 7faca9a38640 1 -- 172.21.15.70:0/2999963840 >> 172.21.15.70:0/2999963840 conn(0x7faca40fc790 msgr2=0x7faca4104820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:36.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.399+0000 7faca9a38640 1 -- 172.21.15.70:0/2999963840 shutdown_connections 2024-09-12T01:51:36.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:36.399+0000 7faca9a38640 1 -- 172.21.15.70:0/2999963840 wait complete. 2024-09-12T01:51:36.702 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:36 smithi070 ceph-mon[31177]: pgmap v320: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-12T01:51:36.702 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:36 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2999963840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:36.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:36 smithi191 ceph-mon[35770]: pgmap v320: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-12T01:51:36.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:36 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2999963840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:36.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:51:37.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:36 smithi152 ceph-mon[35055]: pgmap v320: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-12T01:51:37.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:36 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2999963840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:37.210 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:37.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.621+0000 7f86ae5bf640 1 -- 172.21.15.70:0/3887348116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86a8100a80 msgr2=0x7f86a8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:37.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.621+0000 7f86ae5bf640 1 --2- 172.21.15.70:0/3887348116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86a8100a80 0x7f86a8100ee0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f869c009930 tx=0x7f869c02a420 comp rx=0 tx=0).stop 2024-09-12T01:51:37.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.621+0000 7f86ae5bf640 1 -- 172.21.15.70:0/3887348116 shutdown_connections 2024-09-12T01:51:37.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.621+0000 7f86ae5bf640 1 --2- 172.21.15.70:0/3887348116 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86a8101420 0x7f86a810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:37.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.621+0000 7f86ae5bf640 1 --2- 172.21.15.70:0/3887348116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86a8100a80 0x7f86a8100ee0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:37.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.621+0000 7f86ae5bf640 1 --2- 172.21.15.70:0/3887348116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86a8106a80 0x7f86a8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:37.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.621+0000 7f86ae5bf640 1 -- 172.21.15.70:0/3887348116 >> 172.21.15.70:0/3887348116 conn(0x7f86a80fc7a0 msgr2=0x7f86a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:37.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.621+0000 7f86ae5bf640 1 -- 172.21.15.70:0/3887348116 shutdown_connections 2024-09-12T01:51:37.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.622+0000 7f86ae5bf640 1 -- 172.21.15.70:0/3887348116 wait complete. 2024-09-12T01:51:37.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.622+0000 7f86ae5bf640 1 Processor -- start 2024-09-12T01:51:37.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.622+0000 7f86ae5bf640 1 -- start start 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86ae5bf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86a8100a80 0x7f86a8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86ae5bf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86a8101420 0x7f86a8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86ae5bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86a8106a80 0x7f86a819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86ae5bf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8110fb0 con 0x7f86a8106a80 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86ae5bf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8110e30 con 0x7f86a8101420 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86ae5bf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8111130 con 0x7f86a8100a80 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86acb5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86a8106a80 0x7f86a819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86a7fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86a8100a80 0x7f86a8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86acb5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86a8106a80 0x7f86a819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55244/0 (socket says 172.21.15.70:55244) 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86acb5c640 1 -- 172.21.15.70:0/206074455 learned_addr learned my addr 172.21.15.70:0/206074455 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86a77fe640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86a8101420 0x7f86a8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86acb5c640 1 -- 172.21.15.70:0/206074455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86a8100a80 msgr2=0x7f86a8198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:37.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86acb5c640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86a8100a80 0x7f86a8198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86acb5c640 1 -- 172.21.15.70:0/206074455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86a8101420 msgr2=0x7f86a8198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86acb5c640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86a8101420 0x7f86a8198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86acb5c640 1 -- 172.21.15.70:0/206074455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a819d4b0 con 0x7f86a8106a80 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.623+0000 7f86acb5c640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86a8106a80 0x7f86a819cdd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f86a000eaa0 tx=0x7f86a000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.624+0000 7f86a57fa640 1 -- 172.21.15.70:0/206074455 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0004d20 con 0x7f86a8106a80 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.624+0000 7f86ae5bf640 1 -- 172.21.15.70:0/206074455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a819d7a0 con 0x7f86a8106a80 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.624+0000 7f86a57fa640 1 -- 172.21.15.70:0/206074455 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86a0005020 con 0x7f86a8106a80 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.624+0000 7f86a57fa640 1 -- 172.21.15.70:0/206074455 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a00116b0 con 0x7f86a8106a80 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.624+0000 7f86ae5bf640 1 -- 172.21.15.70:0/206074455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a81a5080 con 0x7f86a8106a80 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.625+0000 7f86ae5bf640 1 -- 172.21.15.70:0/206074455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a8100ee0 con 0x7f86a8106a80 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.626+0000 7f86a57fa640 1 -- 172.21.15.70:0/206074455 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f86a00051d0 con 0x7f86a8106a80 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.626+0000 7f86a57fa640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86900a2c00 0x7f86900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:37.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.627+0000 7f86a7fff640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86900a2c00 0x7f86900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:37.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.627+0000 7f86a57fa640 1 -- 172.21.15.70:0/206074455 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f86a00cf1a0 con 0x7f86a8106a80 2024-09-12T01:51:37.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.627+0000 7f86a7fff640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86900a2c00 0x7f86900a50c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f869800ab60 tx=0x7f869800a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:37.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.631+0000 7f86a57fa640 1 -- 172.21.15.70:0/206074455 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f86a0016030 con 0x7f86a8106a80 2024-09-12T01:51:37.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.833+0000 7f86ae5bf640 1 -- 172.21.15.70:0/206074455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86a810a080 con 0x7f86a8106a80 2024-09-12T01:51:37.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.833+0000 7f86a57fa640 1 -- 172.21.15.70:0/206074455 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7f86a009c100 con 0x7f86a8106a80 2024-09-12T01:51:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:37.834 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-12T01:50:09:375588+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:50:09.375567+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:51:37.834 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-12T01:51:37.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.836+0000 7f86ae5bf640 1 -- 172.21.15.70:0/206074455 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86900a2c00 msgr2=0x7f86900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:37.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.836+0000 7f86ae5bf640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86900a2c00 0x7f86900a50c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f869800ab60 tx=0x7f869800a2d0 comp rx=0 tx=0).stop 2024-09-12T01:51:37.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.836+0000 7f86ae5bf640 1 -- 172.21.15.70:0/206074455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86a8106a80 msgr2=0x7f86a819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:37.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.836+0000 7f86ae5bf640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86a8106a80 0x7f86a819cdd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f86a000eaa0 tx=0x7f86a000eea0 comp rx=0 tx=0).stop 2024-09-12T01:51:37.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.836+0000 7f86ae5bf640 1 -- 172.21.15.70:0/206074455 shutdown_connections 2024-09-12T01:51:37.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.836+0000 7f86ae5bf640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86900a2c00 0x7f86900a50c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:37.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.836+0000 7f86ae5bf640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86a8106a80 0x7f86a819cdd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:37.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.836+0000 7f86ae5bf640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86a8101420 0x7f86a8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:37.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.836+0000 7f86ae5bf640 1 --2- 172.21.15.70:0/206074455 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86a8100a80 0x7f86a8198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:37.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.836+0000 7f86ae5bf640 1 -- 172.21.15.70:0/206074455 >> 172.21.15.70:0/206074455 conn(0x7f86a80fc7a0 msgr2=0x7f86a806a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:37.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.836+0000 7f86ae5bf640 1 -- 172.21.15.70:0/206074455 shutdown_connections 2024-09-12T01:51:37.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:37.836+0000 7f86ae5bf640 1 -- 172.21.15.70:0/206074455 wait complete. 2024-09-12T01:51:38.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:51:38.723 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:38.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:38 smithi070 ceph-mon[31177]: pgmap v321: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T01:51:38.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:38 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/206074455' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:38.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:38 smithi191 ceph-mon[35770]: pgmap v321: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T01:51:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:38 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/206074455' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:39.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:38 smithi152 ceph-mon[35055]: pgmap v321: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-12T01:51:39.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:38 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/206074455' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:39.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.215+0000 7f8e90866640 1 -- 172.21.15.70:0/1730248668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e8c102570 msgr2=0x7f8e8c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:39.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.215+0000 7f8e90866640 1 --2- 172.21.15.70:0/1730248668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e8c102570 0x7f8e8c1029b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009900 tx=0x7f8e8002a480 comp rx=0 tx=0).stop 2024-09-12T01:51:39.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.215+0000 7f8e90866640 1 -- 172.21.15.70:0/1730248668 shutdown_connections 2024-09-12T01:51:39.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.215+0000 7f8e90866640 1 --2- 172.21.15.70:0/1730248668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e8c102ef0 0x7f8e8c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:39.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.215+0000 7f8e90866640 1 --2- 172.21.15.70:0/1730248668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e8c102570 0x7f8e8c1029b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:39.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.215+0000 7f8e90866640 1 --2- 172.21.15.70:0/1730248668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e8c100e20 0x7f8e8c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:39.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.215+0000 7f8e90866640 1 -- 172.21.15.70:0/1730248668 >> 172.21.15.70:0/1730248668 conn(0x7f8e8c0fc7d0 msgr2=0x7f8e8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:39.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.215+0000 7f8e90866640 1 -- 172.21.15.70:0/1730248668 shutdown_connections 2024-09-12T01:51:39.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.215+0000 7f8e90866640 1 -- 172.21.15.70:0/1730248668 wait complete. 2024-09-12T01:51:39.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.216+0000 7f8e90866640 1 Processor -- start 2024-09-12T01:51:39.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.216+0000 7f8e90866640 1 -- start start 2024-09-12T01:51:39.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.216+0000 7f8e90866640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e8c100e20 0x7f8e8c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:39.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.216+0000 7f8e90866640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e8c102570 0x7f8e8c198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:39.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.216+0000 7f8e90866640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e8c102ef0 0x7f8e8c19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:39.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e90866640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c1110e0 con 0x7f8e8c100e20 2024-09-12T01:51:39.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e90866640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c110f60 con 0x7f8e8c102ef0 2024-09-12T01:51:39.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e90866640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c111260 con 0x7f8e8c102570 2024-09-12T01:51:39.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e8a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e8c100e20 0x7f8e8c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:39.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e8a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e8c100e20 0x7f8e8c198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55270/0 (socket says 172.21.15.70:55270) 2024-09-12T01:51:39.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e8a59c640 1 -- 172.21.15.70:0/3710927229 learned_addr learned my addr 172.21.15.70:0/3710927229 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:39.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e8ad9d640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e8c102ef0 0x7f8e8c19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:39.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e89d9b640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e8c102570 0x7f8e8c198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:39.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e8a59c640 1 -- 172.21.15.70:0/3710927229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e8c102570 msgr2=0x7f8e8c198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:39.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e8a59c640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e8c102570 0x7f8e8c198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:39.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e8a59c640 1 -- 172.21.15.70:0/3710927229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e8c102ef0 msgr2=0x7f8e8c19cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:39.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e8a59c640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e8c102ef0 0x7f8e8c19cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:39.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e8a59c640 1 -- 172.21.15.70:0/3710927229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c19d620 con 0x7f8e8c100e20 2024-09-12T01:51:39.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e8a59c640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e8c100e20 0x7f8e8c198670 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00b4a0 tx=0x7f8e7c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:39.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e7b7fe640 1 -- 172.21.15.70:0/3710927229 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c014070 con 0x7f8e8c100e20 2024-09-12T01:51:39.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e90866640 1 -- 172.21.15.70:0/3710927229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8c19d910 con 0x7f8e8c100e20 2024-09-12T01:51:39.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e7b7fe640 1 -- 172.21.15.70:0/3710927229 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8e7c010b10 con 0x7f8e8c100e20 2024-09-12T01:51:39.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e7b7fe640 1 -- 172.21.15.70:0/3710927229 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c017d60 con 0x7f8e8c100e20 2024-09-12T01:51:39.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.217+0000 7f8e90866640 1 -- 172.21.15.70:0/3710927229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8c1a51f0 con 0x7f8e8c100e20 2024-09-12T01:51:39.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.219+0000 7f8e90866640 1 -- 172.21.15.70:0/3710927229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8c101200 con 0x7f8e8c100e20 2024-09-12T01:51:39.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.220+0000 7f8e7b7fe640 1 -- 172.21.15.70:0/3710927229 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8e7c017070 con 0x7f8e8c100e20 2024-09-12T01:51:39.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.220+0000 7f8e7b7fe640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8e740a2b80 0x7f8e740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:39.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.220+0000 7f8e89d9b640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8e740a2b80 0x7f8e740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:39.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.220+0000 7f8e7b7fe640 1 -- 172.21.15.70:0/3710927229 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8e7c0ce3e0 con 0x7f8e8c100e20 2024-09-12T01:51:39.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.221+0000 7f8e89d9b640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8e740a2b80 0x7f8e740a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c105270 tx=0x7f8e800095f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:39.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.224+0000 7f8e7b7fe640 1 -- 172.21.15.70:0/3710927229 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e7c09b340 con 0x7f8e8c100e20 2024-09-12T01:51:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.398+0000 7f8e90866640 1 -- 172.21.15.70:0/3710927229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e8c10a0a0 con 0x7f8e8c100e20 2024-09-12T01:51:39.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.399+0000 7f8e7b7fe640 1 -- 172.21.15.70:0/3710927229 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22713 (secure 0 0 0) 0x7f8e7c09ac40 con 0x7f8e8c100e20 2024-09-12T01:51:39.399 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:39.400 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:50:22.600430+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:49:54.140097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:49:56.005187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:51:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.402+0000 7f8e90866640 1 -- 172.21.15.70:0/3710927229 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8e740a2b80 msgr2=0x7f8e740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.402+0000 7f8e90866640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8e740a2b80 0x7f8e740a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c105270 tx=0x7f8e800095f0 comp rx=0 tx=0).stop 2024-09-12T01:51:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.402+0000 7f8e90866640 1 -- 172.21.15.70:0/3710927229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e8c100e20 msgr2=0x7f8e8c198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.402+0000 7f8e90866640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e8c100e20 0x7f8e8c198670 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00b4a0 tx=0x7f8e7c00b960 comp rx=0 tx=0).stop 2024-09-12T01:51:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.402+0000 7f8e90866640 1 -- 172.21.15.70:0/3710927229 shutdown_connections 2024-09-12T01:51:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.402+0000 7f8e90866640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8e740a2b80 0x7f8e740a5040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.402+0000 7f8e90866640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e8c102ef0 0x7f8e8c19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.402+0000 7f8e90866640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e8c102570 0x7f8e8c198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.402+0000 7f8e90866640 1 --2- 172.21.15.70:0/3710927229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e8c100e20 0x7f8e8c198670 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.402+0000 7f8e90866640 1 -- 172.21.15.70:0/3710927229 >> 172.21.15.70:0/3710927229 conn(0x7f8e8c0fc7d0 msgr2=0x7f8e8c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.402+0000 7f8e90866640 1 -- 172.21.15.70:0/3710927229 shutdown_connections 2024-09-12T01:51:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:39.402+0000 7f8e90866640 1 -- 172.21.15.70:0/3710927229 wait complete. 2024-09-12T01:51:39.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:39 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3710927229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:51:39.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:39 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3710927229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:51:40.006 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T01:49:57.864263+0000', 'modified': '2024-09-12T01:50:09.375567+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24452, 'mds_1': 24445, 'mds_2': 24437, 'mds_3': 24433, 'mds_4': 24427}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14637': {'gid': 14637, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6839/3076923681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 3076923681}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 3076923681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14649': {'gid': 14649, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6841/3509291516', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6840', 'nonce': 3509291516}, {'type': 'v1', 'addr': '172.21.15.70:6841', 'nonce': 3509291516}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6833/2100585386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 2100585386}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 2100585386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6833/1019939610', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 1019939610}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 1019939610}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6835/2743921312', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 2743921312}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 2743921312}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.191:6835/97556731', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 97556731}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 97556731}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24433': {'gid': 24433, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.191:6837/1473295002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 1473295002}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 1473295002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.152:6837/3978171312', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 3978171312}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 3978171312}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.191:6839/1679121869', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 1679121869}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 1679121869}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24452': {'gid': 24452, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.152:6839/3057936512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6838', 'nonce': 3057936512}, {'type': 'v1', 'addr': '172.21.15.152:6839', 'nonce': 3057936512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24452, 'qdb_cluster': [24452, 24445, 24437, 24433, 24427]} 2024-09-12T01:51:40.006 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T01:51:40.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-12T01:51:40.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:39 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3710927229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:51:40.250 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:40.665 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:40 smithi070 ceph-mon[31177]: pgmap v322: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:40.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.745+0000 7fbfc249e640 1 -- 172.21.15.70:0/3555599251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfbc103700 msgr2=0x7fbfbc10bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:40.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.745+0000 7fbfc249e640 1 --2- 172.21.15.70:0/3555599251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfbc103700 0x7fbfbc10bbf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009900 tx=0x7fbfa402a480 comp rx=0 tx=0).stop 2024-09-12T01:51:40.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.745+0000 7fbfc249e640 1 -- 172.21.15.70:0/3555599251 shutdown_connections 2024-09-12T01:51:40.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.745+0000 7fbfc249e640 1 --2- 172.21.15.70:0/3555599251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfbc10c180 0x7fbfbc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.745+0000 7fbfc249e640 1 --2- 172.21.15.70:0/3555599251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfbc103700 0x7fbfbc10bbf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.745+0000 7fbfc249e640 1 --2- 172.21.15.70:0/3555599251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfbc102de0 0x7fbfbc1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.745+0000 7fbfc249e640 1 -- 172.21.15.70:0/3555599251 >> 172.21.15.70:0/3555599251 conn(0x7fbfbc0fc7a0 msgr2=0x7fbfbc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:40.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.745+0000 7fbfc249e640 1 -- 172.21.15.70:0/3555599251 shutdown_connections 2024-09-12T01:51:40.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.745+0000 7fbfc249e640 1 -- 172.21.15.70:0/3555599251 wait complete. 2024-09-12T01:51:40.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.746+0000 7fbfc249e640 1 Processor -- start 2024-09-12T01:51:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.746+0000 7fbfc249e640 1 -- start start 2024-09-12T01:51:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.746+0000 7fbfc249e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfbc102de0 0x7fbfbc1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.746+0000 7fbfc249e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfbc103700 0x7fbfbc198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.746+0000 7fbfc249e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfbc10c180 0x7fbfbc19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.746+0000 7fbfc249e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc112140 con 0x7fbfbc103700 2024-09-12T01:51:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.746+0000 7fbfc249e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc111fc0 con 0x7fbfbc102de0 2024-09-12T01:51:40.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.746+0000 7fbfc249e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc1122c0 con 0x7fbfbc10c180 2024-09-12T01:51:40.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.746+0000 7fbfb3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfbc103700 0x7fbfbc198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.746+0000 7fbfb3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfbc103700 0x7fbfbc198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36268/0 (socket says 172.21.15.70:36268) 2024-09-12T01:51:40.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.746+0000 7fbfb3fff640 1 -- 172.21.15.70:0/149892878 learned_addr learned my addr 172.21.15.70:0/149892878 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:40.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.746+0000 7fbfbbfff640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfbc102de0 0x7fbfbc1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.747+0000 7fbfb3fff640 1 -- 172.21.15.70:0/149892878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfbc10c180 msgr2=0x7fbfbc19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:40.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.747+0000 7fbfb3fff640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfbc10c180 0x7fbfbc19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.747+0000 7fbfb3fff640 1 -- 172.21.15.70:0/149892878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfbc102de0 msgr2=0x7fbfbc1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:40.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.747+0000 7fbfb3fff640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfbc102de0 0x7fbfbc1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.747+0000 7fbfb3fff640 1 -- 172.21.15.70:0/149892878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc19d550 con 0x7fbfbc103700 2024-09-12T01:51:40.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.747+0000 7fbfbbfff640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfbc102de0 0x7fbfbc1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:40.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.747+0000 7fbfb3fff640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfbc103700 0x7fbfbc198ae0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4006010 tx=0x7fbfa4032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:40.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.747+0000 7fbfb9ffb640 1 -- 172.21.15.70:0/149892878 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa403f030 con 0x7fbfbc103700 2024-09-12T01:51:40.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.747+0000 7fbfc249e640 1 -- 172.21.15.70:0/149892878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfbc19d7e0 con 0x7fbfbc103700 2024-09-12T01:51:40.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.747+0000 7fbfb9ffb640 1 -- 172.21.15.70:0/149892878 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbfa4003d00 con 0x7fbfbc103700 2024-09-12T01:51:40.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.747+0000 7fbfb9ffb640 1 -- 172.21.15.70:0/149892878 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4035070 con 0x7fbfbc103700 2024-09-12T01:51:40.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.747+0000 7fbfc249e640 1 -- 172.21.15.70:0/149892878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfbc1a5120 con 0x7fbfbc103700 2024-09-12T01:51:40.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.749+0000 7fbfb9ffb640 1 -- 172.21.15.70:0/149892878 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbfa4042030 con 0x7fbfbc103700 2024-09-12T01:51:40.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.749+0000 7fbfc4877740 1 Processor -- start 2024-09-12T01:51:40.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.749+0000 7fbfc4877740 1 -- start start 2024-09-12T01:51:40.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc4877740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 0x5556e59a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc4877740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a91f0 0x5556e59b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc4877740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59b7fc0 0x5556e59ba3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc4877740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5556e590f090 con 0x5556e59a88d0 2024-09-12T01:51:40.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc4877740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5556e58b6a70 con 0x5556e59b7fc0 2024-09-12T01:51:40.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc4877740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5556e590b050 con 0x5556e59a91f0 2024-09-12T01:51:40.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfb9ffb640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbfa80a2b80 0x7fbfa80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc0a3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 0x5556e59a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc0a3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 0x5556e59a8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36278/0 (socket says 172.21.15.70:36278) 2024-09-12T01:51:40.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc0a3b640 1 -- 172.21.15.70:0/1321190450 learned_addr learned my addr 172.21.15.70:0/1321190450 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:40.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc0a3b640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbfa80a2b80 0x7fbfa80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfbbfff640 1 --2- 172.21.15.70:0/1321190450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a91f0 0x5556e59b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfb3fff640 1 --2- 172.21.15.70:0/1321190450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59b7fc0 0x5556e59ba3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfb9ffb640 1 -- 172.21.15.70:0/149892878 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbfa40ef6f0 con 0x7fbfbc103700 2024-09-12T01:51:40.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc0a3b640 1 -- 172.21.15.70:0/1321190450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a91f0 msgr2=0x5556e59b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:40.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc0a3b640 1 --2- 172.21.15.70:0/1321190450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a91f0 0x5556e59b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc0a3b640 1 -- 172.21.15.70:0/1321190450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59b7fc0 msgr2=0x5556e59ba3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:40.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc0a3b640 1 --2- 172.21.15.70:0/1321190450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59b7fc0 0x5556e59ba3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc0a3b640 1 -- 172.21.15.70:0/1321190450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556e58c3130 con 0x5556e59a88d0 2024-09-12T01:51:40.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc0a3b640 1 --2- 172.21.15.70:0/1321190450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 0x5556e59a8cb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4013c50 tx=0x7fbfb4011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ffeb3a7d59a70c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:40.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.750+0000 7fbfc0a3b640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbfa80a2b80 0x7fbfa80a5040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4011c50 tx=0x7fbfb401a000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:40.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.751+0000 7fbfb27fc640 1 -- 172.21.15.70:0/1321190450 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4020070 con 0x5556e59a88d0 2024-09-12T01:51:40.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.751+0000 7fbfb27fc640 1 -- 172.21.15.70:0/1321190450 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbfb4009a10 con 0x5556e59a88d0 2024-09-12T01:51:40.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.751+0000 7fbfb27fc640 1 -- 172.21.15.70:0/1321190450 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400ed80 con 0x5556e59a88d0 2024-09-12T01:51:40.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.751+0000 7fbfc4877740 1 -- 172.21.15.70:0/1321190450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 msgr2=0x5556e59a8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:40.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.751+0000 7fbfc4877740 1 --2- 172.21.15.70:0/1321190450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 0x5556e59a8cb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4013c50 tx=0x7fbfb4011750 comp rx=0 tx=0).stop 2024-09-12T01:51:40.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.751+0000 7fbfc4877740 1 -- 172.21.15.70:0/1321190450 shutdown_connections 2024-09-12T01:51:40.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.751+0000 7fbfc4877740 1 --2- 172.21.15.70:0/1321190450 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59b7fc0 0x5556e59ba3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.751+0000 7fbfc4877740 1 --2- 172.21.15.70:0/1321190450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a91f0 0x5556e59b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.751+0000 7fbfc4877740 1 --2- 172.21.15.70:0/1321190450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 0x5556e59a8cb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.751+0000 7fbfc4877740 1 -- 172.21.15.70:0/1321190450 >> 172.21.15.70:0/1321190450 conn(0x5556e59a4f60 msgr2=0x5556e59a5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:40.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.751+0000 7fbfc4877740 1 -- 172.21.15.70:0/1321190450 shutdown_connections 2024-09-12T01:51:40.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.751+0000 7fbfc4877740 1 -- 172.21.15.70:0/1321190450 wait complete. 2024-09-12T01:51:40.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfc4877740 1 -- start start 2024-09-12T01:51:40.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfc4877740 1 Processor -- start 2024-09-12T01:51:40.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfc4877740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 0x5556e59b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfc4877740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a91f0 0x5556e59b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfc4877740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59b7fc0 0x5556e59b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfc4877740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5556e59bab90 con 0x5556e59a88d0 2024-09-12T01:51:40.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfc4877740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5556e58c9f20 con 0x5556e59b7fc0 2024-09-12T01:51:40.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfc4877740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5556e59bad10 con 0x5556e59a91f0 2024-09-12T01:51:40.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfc4877740 10 client.0 _ll_register_callbacks cb 0x5556e5893030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:40.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 0x5556e59b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 0x5556e59b7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36284/0 (socket says 172.21.15.70:36284) 2024-09-12T01:51:40.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfbbfff640 1 -- 172.21.15.70:0/2356214153 learned_addr learned my addr 172.21.15.70:0/2356214153 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:40.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.752+0000 7fbfb3fff640 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a91f0 0x5556e59b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbfc0a3b640 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59b7fc0 0x5556e59b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbfbbfff640 1 -- 172.21.15.70:0/2356214153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a91f0 msgr2=0x5556e59b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbfbbfff640 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a91f0 0x5556e59b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbfbbfff640 1 -- 172.21.15.70:0/2356214153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59b7fc0 msgr2=0x5556e59b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbfbbfff640 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59b7fc0 0x5556e59b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbfbbfff640 1 -- 172.21.15.70:0/2356214153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556e56802b0 con 0x5556e59a88d0 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbfbbfff640 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 0x5556e59b7950 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00f4f0 tx=0x7fbfac00f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f25ce03d98d448 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbf9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbf9b7fe640 1 -- 172.21.15.70:0/2356214153 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac013850 con 0x5556e59a88d0 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbf9b7fe640 1 -- 172.21.15.70:0/2356214153 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbfac0139f0 con 0x5556e59a88d0 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbfc4877740 1 -- 172.21.15.70:0/2356214153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfb4009a10 con 0x5556e59a88d0 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbf9b7fe640 1 -- 172.21.15.70:0/2356214153 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbfac013bf0 con 0x5556e59a88d0 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbfc4877740 10 client.15183 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbfc4877740 1 -- 172.21.15.70:0/2356214153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5556e59c6620 con 0x5556e59a88d0 2024-09-12T01:51:40.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbf9b7fe640 1 -- 172.21.15.70:0/2356214153 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbfb4009a10 con 0x5556e59a88d0 2024-09-12T01:51:40.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.753+0000 7fbf9b7fe640 1 -- 172.21.15.70:0/2356214153 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbfac01b490 con 0x5556e59a88d0 2024-09-12T01:51:40.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.754+0000 7fbfc4877740 10 client.15183 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:40.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.754+0000 7fbfc4877740 10 client.15183 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T01:51:40.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.754+0000 7fbfc4877740 20 client.15183 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:40.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.754+0000 7fbfc4877740 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x5556e59c8c50 0x5556e59ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.754+0000 7fbfc4877740 4 client.15183 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:51:40.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.754+0000 7fbfc4877740 1 -- 172.21.15.70:0/2356214153 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556e591c600 con 0x5556e59c8c50 2024-09-12T01:51:40.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.754+0000 7fbfb3fff640 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x5556e59c8c50 0x5556e59ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.754+0000 7fbfb3fff640 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x5556e59c8c50 0x5556e59ca0c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4d84b758d230e0d7 server_cookie=f67f8346010c9337 in_seq=0 out_seq=0 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.754+0000 7fbf9b7fe640 10 client.15183 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbf9b7fe640 1 -- 172.21.15.70:0/2356214153 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556e591c600 con 0x5556e59c8c50 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbf9b7fe640 10 client.15183 handle_command_reply: tid=0 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbfc4877740 1 client.15183 shutdown 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbfc4877740 1 -- 172.21.15.70:0/2356214153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 msgr2=0x5556e59b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbfc4877740 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 0x5556e59b7950 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00f4f0 tx=0x7fbfac00f9b0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbfc4877740 1 -- 172.21.15.70:0/2356214153 shutdown_connections 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbfc4877740 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x5556e59c8c50 0x5556e59ca0c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbfc4877740 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59b7fc0 0x5556e59b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbfc4877740 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a91f0 0x5556e59b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbfc4877740 1 --2- 172.21.15.70:0/2356214153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a88d0 0x5556e59b7950 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbf9b7fe640 0 client.15183 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:51:40.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbfc4877740 1 -- 172.21.15.70:0/2356214153 >> 172.21.15.70:0/2356214153 conn(0x5556e59a4f60 msgr2=0x5556e59aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:40.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbfc4877740 1 -- 172.21.15.70:0/2356214153 shutdown_connections 2024-09-12T01:51:40.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbfc4877740 1 -- 172.21.15.70:0/2356214153 wait complete. 2024-09-12T01:51:40.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.755+0000 7fbfc4877740 20 client.15183 trim_cache size 0 max 16384 2024-09-12T01:51:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc4877740 1 Processor -- start 2024-09-12T01:51:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc4877740 1 -- start start 2024-09-12T01:51:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc4877740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a88d0 0x5556e59ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc4877740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59a91f0 0x5556e59afa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc4877740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59b7fc0 0x5556e59aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc4877740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5556e59c8400 con 0x5556e59b7fc0 2024-09-12T01:51:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc4877740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5556e59c8ad0 con 0x5556e59a91f0 2024-09-12T01:51:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc4877740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5556e59c91a0 con 0x5556e59a88d0 2024-09-12T01:51:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc0a3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59b7fc0 0x5556e59aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc0a3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59b7fc0 0x5556e59aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36292/0 (socket says 172.21.15.70:36292) 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc0a3b640 1 -- 172.21.15.70:0/1560902090 learned_addr learned my addr 172.21.15.70:0/1560902090 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfb3fff640 1 --2- 172.21.15.70:0/1560902090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59a91f0 0x5556e59afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc0a3b640 1 -- 172.21.15.70:0/1560902090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a88d0 msgr2=0x5556e59ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc0a3b640 1 --2- 172.21.15.70:0/1560902090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a88d0 0x5556e59ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc0a3b640 1 -- 172.21.15.70:0/1560902090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59a91f0 msgr2=0x5556e59afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc0a3b640 1 --2- 172.21.15.70:0/1560902090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59a91f0 0x5556e59afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfc0a3b640 1 -- 172.21.15.70:0/1560902090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556e59bad00 con 0x5556e59b7fc0 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.773+0000 7fbfb3fff640 1 --2- 172.21.15.70:0/1560902090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59a91f0 0x5556e59afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfc0a3b640 1 --2- 172.21.15.70:0/1560902090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59b7fc0 0x5556e59aff60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4012010 tx=0x7fbfb4005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0835d02be9a141 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfb1ffb640 1 -- 172.21.15.70:0/1560902090 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4020040 con 0x5556e59b7fc0 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfb1ffb640 1 -- 172.21.15.70:0/1560902090 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbfb4013e00 con 0x5556e59b7fc0 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfb1ffb640 1 -- 172.21.15.70:0/1560902090 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4013240 con 0x5556e59b7fc0 2024-09-12T01:51:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfc4877740 1 -- 172.21.15.70:0/1560902090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59b7fc0 msgr2=0x5556e59aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfc4877740 1 --2- 172.21.15.70:0/1560902090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59b7fc0 0x5556e59aff60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4012010 tx=0x7fbfb4005e10 comp rx=0 tx=0).stop 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfc4877740 1 -- 172.21.15.70:0/1560902090 shutdown_connections 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfc4877740 1 --2- 172.21.15.70:0/1560902090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59b7fc0 0x5556e59aff60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfc4877740 1 --2- 172.21.15.70:0/1560902090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59a91f0 0x5556e59afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfc4877740 1 --2- 172.21.15.70:0/1560902090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59a88d0 0x5556e59ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfc4877740 1 -- 172.21.15.70:0/1560902090 >> 172.21.15.70:0/1560902090 conn(0x5556e59a4f60 msgr2=0x5556e59a5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfc4877740 1 -- 172.21.15.70:0/1560902090 shutdown_connections 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.774+0000 7fbfc4877740 1 -- 172.21.15.70:0/1560902090 wait complete. 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.775+0000 7fbfc4877740 1 -- start start 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.775+0000 7fbfc4877740 1 Processor -- start 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.775+0000 7fbfc4877740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59a88d0 0x5556e59cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.775+0000 7fbfc4877740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a91f0 0x5556e59cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.775+0000 7fbfc4877740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59b7fc0 0x5556e5a31350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.775+0000 7fbfc4877740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5556e59c9f40 con 0x5556e59a91f0 2024-09-12T01:51:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.775+0000 7fbfc4877740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5556e59c9870 con 0x5556e59a88d0 2024-09-12T01:51:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.775+0000 7fbfc4877740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5556e59ca610 con 0x5556e59b7fc0 2024-09-12T01:51:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.775+0000 7fbfc4877740 10 client.0 _ll_register_callbacks cb 0x7fbfac00a530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.775+0000 7fbfb3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a91f0 0x5556e59cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.775+0000 7fbfb3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a91f0 0x5556e59cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36306/0 (socket says 172.21.15.70:36306) 2024-09-12T01:51:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.775+0000 7fbfb3fff640 1 -- 172.21.15.70:0/682238830 learned_addr learned my addr 172.21.15.70:0/682238830 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbfbbfff640 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59a88d0 0x5556e59cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbfc0a3b640 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59b7fc0 0x5556e5a31350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbfb3fff640 1 -- 172.21.15.70:0/682238830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59b7fc0 msgr2=0x5556e5a31350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbfb3fff640 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59b7fc0 0x5556e5a31350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbfb3fff640 1 -- 172.21.15.70:0/682238830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59a88d0 msgr2=0x5556e59cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbfb3fff640 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59a88d0 0x5556e59cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbfb3fff640 1 -- 172.21.15.70:0/682238830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556e5a318e0 con 0x5556e59a91f0 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbfb3fff640 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a91f0 0x5556e59cbd20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40ed1f0 tx=0x7fbfa402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4edebe46c7fda83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbf9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbf9b7fe640 1 -- 172.21.15.70:0/682238830 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4049040 con 0x5556e59a91f0 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbf9b7fe640 1 -- 172.21.15.70:0/682238830 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbfa40ed300 con 0x5556e59a91f0 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbfc4877740 1 -- 172.21.15.70:0/682238830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfb4013e00 con 0x5556e59a91f0 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbf9b7fe640 1 -- 172.21.15.70:0/682238830 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbfa40bc650 con 0x5556e59a91f0 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbfc4877740 10 client.15189 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbfc4877740 1 -- 172.21.15.70:0/682238830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5556e5a32b20 con 0x5556e59a91f0 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbf9b7fe640 1 -- 172.21.15.70:0/682238830 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbfb4013e00 con 0x5556e59a91f0 2024-09-12T01:51:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.776+0000 7fbf9b7fe640 1 -- 172.21.15.70:0/682238830 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbfa40bf040 con 0x5556e59a91f0 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.777+0000 7fbfc4877740 10 client.15189 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.777+0000 7fbfc4877740 10 client.15189 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.777+0000 7fbfc4877740 20 client.15189 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.777+0000 7fbfc4877740 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x5556e5a37750 0x5556e5a36460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.777+0000 7fbfc4877740 4 client.15189 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.777+0000 7fbfc4877740 1 -- 172.21.15.70:0/682238830 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "status"}) -- 0x5556e5916b10 con 0x5556e5a37750 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.777+0000 7fbfbbfff640 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x5556e5a37750 0x5556e5a36460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.777+0000 7fbfbbfff640 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x5556e5a37750 0x5556e5a36460 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7e1f6b940923e00b server_cookie=386dea408ea8cad in_seq=0 out_seq=0 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.777+0000 7fbf9b7fe640 10 client.15189 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.777+0000 7fbf9b7fe640 1 -- 172.21.15.70:0/682238830 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5556e5916b10 con 0x5556e5a37750 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.777+0000 7fbf9b7fe640 10 client.15189 handle_command_reply: tid=0 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.777+0000 7fbfc4877740 1 client.15189 shutdown 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc4877740 1 -- 172.21.15.70:0/682238830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a91f0 msgr2=0x5556e59cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc4877740 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a91f0 0x5556e59cbd20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40ed1f0 tx=0x7fbfa402a480 comp rx=0 tx=0).stop 2024-09-12T01:51:40.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc4877740 1 -- 172.21.15.70:0/682238830 shutdown_connections 2024-09-12T01:51:40.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc4877740 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x5556e5a37750 0x5556e5a36460 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc4877740 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5556e59b7fc0 0x5556e5a31350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc4877740 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e59a91f0 0x5556e59cbd20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc4877740 1 --2- 172.21.15.70:0/682238830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5556e59a88d0 0x5556e59cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc4877740 1 -- 172.21.15.70:0/682238830 >> 172.21.15.70:0/682238830 conn(0x5556e59a4f60 msgr2=0x5556e59b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:40.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbf9b7fe640 0 client.15189 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:51:40.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc4877740 1 -- 172.21.15.70:0/682238830 shutdown_connections 2024-09-12T01:51:40.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc4877740 1 -- 172.21.15.70:0/682238830 wait complete. 2024-09-12T01:51:40.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc4877740 20 client.15189 trim_cache size 0 max 16384 2024-09-12T01:51:40.789 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:51:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:51:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 4, 2024-09-12T01:51:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24427, 2024-09-12T01:51:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:51:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:51:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:51:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 92.407034718999995, 2024-09-12T01:51:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-12T01:51:40.789 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:51:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T01:51:40.790 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 129.022350983 2024-09-12T01:51:40.790 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:51:40.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc249e640 1 -- 172.21.15.70:0/149892878 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbfa80a2b80 msgr2=0x7fbfa80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:40.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc249e640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbfa80a2b80 0x7fbfa80a5040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4011c50 tx=0x7fbfb401a000 comp rx=0 tx=0).stop 2024-09-12T01:51:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc249e640 1 -- 172.21.15.70:0/149892878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfbc103700 msgr2=0x7fbfbc198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.778+0000 7fbfc249e640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfbc103700 0x7fbfbc198ae0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4006010 tx=0x7fbfa4032c70 comp rx=0 tx=0).stop 2024-09-12T01:51:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.779+0000 7fbfc249e640 1 -- 172.21.15.70:0/149892878 shutdown_connections 2024-09-12T01:51:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.779+0000 7fbfc249e640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbfa80a2b80 0x7fbfa80a5040 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.779+0000 7fbfc249e640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfbc10c180 0x7fbfbc19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.779+0000 7fbfc249e640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfbc103700 0x7fbfbc198ae0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.779+0000 7fbfc249e640 1 --2- 172.21.15.70:0/149892878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfbc102de0 0x7fbfbc1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.779+0000 7fbfc249e640 1 -- 172.21.15.70:0/149892878 >> 172.21.15.70:0/149892878 conn(0x7fbfbc0fc7a0 msgr2=0x7fbfbc0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.779+0000 7fbfc249e640 1 -- 172.21.15.70:0/149892878 shutdown_connections 2024-09-12T01:51:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:40.779+0000 7fbfc249e640 1 -- 172.21.15.70:0/149892878 wait complete. 2024-09-12T01:51:40.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:40 smithi191 ceph-mon[35770]: pgmap v322: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:41.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:40 smithi152 ceph-mon[35055]: pgmap v322: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:41.613 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T01:51:41.859 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:41.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:41 smithi191 ceph-mon[35770]: pgmap v323: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:41.980 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:41 smithi070 ceph-mon[31177]: pgmap v323: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:42.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:41 smithi152 ceph-mon[35055]: pgmap v323: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:42.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.328+0000 7f86f7351640 1 -- 172.21.15.70:0/2276649507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f0100a80 msgr2=0x7f86f0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:42.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.328+0000 7f86f7351640 1 --2- 172.21.15.70:0/2276649507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f0100a80 0x7f86f0100ee0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009930 tx=0x7f86e002a420 comp rx=0 tx=0).stop 2024-09-12T01:51:42.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.328+0000 7f86f7351640 1 -- 172.21.15.70:0/2276649507 shutdown_connections 2024-09-12T01:51:42.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.328+0000 7f86f7351640 1 --2- 172.21.15.70:0/2276649507 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86f0101420 0x7f86f010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.328+0000 7f86f7351640 1 --2- 172.21.15.70:0/2276649507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f0100a80 0x7f86f0100ee0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.328+0000 7f86f7351640 1 --2- 172.21.15.70:0/2276649507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f0106a80 0x7f86f0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.328+0000 7f86f7351640 1 -- 172.21.15.70:0/2276649507 >> 172.21.15.70:0/2276649507 conn(0x7f86f00fc7a0 msgr2=0x7f86f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:42.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.328+0000 7f86f7351640 1 -- 172.21.15.70:0/2276649507 shutdown_connections 2024-09-12T01:51:42.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.328+0000 7f86f7351640 1 -- 172.21.15.70:0/2276649507 wait complete. 2024-09-12T01:51:42.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.329+0000 7f86f7351640 1 Processor -- start 2024-09-12T01:51:42.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.329+0000 7f86f7351640 1 -- start start 2024-09-12T01:51:42.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.329+0000 7f86f7351640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86f0100a80 0x7f86f019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.329+0000 7f86f7351640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f0101420 0x7f86f019ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.329+0000 7f86f7351640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f0106a80 0x7f86f019e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.329+0000 7f86f7351640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f86f0110fe0 con 0x7f86f0101420 2024-09-12T01:51:42.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.329+0000 7f86f7351640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f86f0110e60 con 0x7f86f0100a80 2024-09-12T01:51:42.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.329+0000 7f86f7351640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f86f0111160 con 0x7f86f0106a80 2024-09-12T01:51:42.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.329+0000 7f86f48ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f0101420 0x7f86f019ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.329+0000 7f86f48ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f0101420 0x7f86f019ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36316/0 (socket says 172.21.15.70:36316) 2024-09-12T01:51:42.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.329+0000 7f86f48ec640 1 -- 172.21.15.70:0/4284407247 learned_addr learned my addr 172.21.15.70:0/4284407247 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:42.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.329+0000 7f86f50ed640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86f0100a80 0x7f86f019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86f58ee640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f0106a80 0x7f86f019e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86f48ec640 1 -- 172.21.15.70:0/4284407247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f0106a80 msgr2=0x7f86f019e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86f48ec640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f0106a80 0x7f86f019e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86f48ec640 1 -- 172.21.15.70:0/4284407247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86f0100a80 msgr2=0x7f86f019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86f48ec640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86f0100a80 0x7f86f019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86f48ec640 1 -- 172.21.15.70:0/4284407247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f019e730 con 0x7f86f0101420 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86f58ee640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f0106a80 0x7f86f019e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86f50ed640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86f0100a80 0x7f86f019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86f48ec640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f0101420 0x7f86f019ad20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009230 tx=0x7f86e0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86e67fc640 1 -- 172.21.15.70:0/4284407247 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e003f030 con 0x7f86f0101420 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86e67fc640 1 -- 172.21.15.70:0/4284407247 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86e0003af0 con 0x7f86f0101420 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86f7351640 1 -- 172.21.15.70:0/4284407247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f019e9c0 con 0x7f86f0101420 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86e67fc640 1 -- 172.21.15.70:0/4284407247 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0035070 con 0x7f86f0101420 2024-09-12T01:51:42.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.330+0000 7f86f7351640 1 -- 172.21.15.70:0/4284407247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f01a7390 con 0x7f86f0101420 2024-09-12T01:51:42.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.333+0000 7f86e67fc640 1 -- 172.21.15.70:0/4284407247 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f86e0042030 con 0x7f86f0101420 2024-09-12T01:51:42.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.333+0000 7f86f972a740 1 Processor -- start 2024-09-12T01:51:42.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.333+0000 7f86f972a740 1 -- start start 2024-09-12T01:51:42.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.333+0000 7f86f972a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 0x559ee0892db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.333+0000 7f86f972a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee089d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.333+0000 7f86f972a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee089ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.333+0000 7f86f972a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559ee07f9090 con 0x559ee08929d0 2024-09-12T01:51:42.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f972a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559ee07a0a70 con 0x559ee08932f0 2024-09-12T01:51:42.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f972a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559ee07f5050 con 0x559ee089dbb0 2024-09-12T01:51:42.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f58ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 0x559ee0892db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f58ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 0x559ee0892db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36330/0 (socket says 172.21.15.70:36330) 2024-09-12T01:51:42.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f58ee640 1 -- 172.21.15.70:0/4155687649 learned_addr learned my addr 172.21.15.70:0/4155687649 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:42.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f48ec640 1 --2- 172.21.15.70:0/4155687649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee089ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f50ed640 1 --2- 172.21.15.70:0/4155687649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee089d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f58ee640 1 -- 172.21.15.70:0/4155687649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 msgr2=0x559ee089ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:42.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86e67fc640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86dc0a2c00 0x7f86dc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f58ee640 1 --2- 172.21.15.70:0/4155687649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee089ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f58ee640 1 -- 172.21.15.70:0/4155687649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 msgr2=0x559ee089d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:42.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f58ee640 1 --2- 172.21.15.70:0/4155687649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee089d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f58ee640 1 -- 172.21.15.70:0/4155687649 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ee07ad130 con 0x559ee08929d0 2024-09-12T01:51:42.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86e67fc640 1 -- 172.21.15.70:0/4284407247 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f86e00ef910 con 0x7f86f0101420 2024-09-12T01:51:42.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f58ee640 1 --2- 172.21.15.70:0/4155687649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 0x559ee0892db0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009ea0 tx=0x7f86e8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960a92f2c843fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:42.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86f58ee640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86dc0a2c00 0x7f86dc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86db7fe640 1 -- 172.21.15.70:0/4155687649 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8021070 con 0x559ee08929d0 2024-09-12T01:51:42.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86db7fe640 1 -- 172.21.15.70:0/4155687649 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86e801be00 con 0x559ee08929d0 2024-09-12T01:51:42.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.334+0000 7f86db7fe640 1 -- 172.21.15.70:0/4155687649 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8010cc0 con 0x559ee08929d0 2024-09-12T01:51:42.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.335+0000 7f86f972a740 1 -- 172.21.15.70:0/4155687649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 msgr2=0x559ee0892db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:42.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.335+0000 7f86f58ee640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86dc0a2c00 0x7f86dc0a50c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f86e801e000 tx=0x7f86e8021000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:42.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.335+0000 7f86f972a740 1 --2- 172.21.15.70:0/4155687649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 0x559ee0892db0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009ea0 tx=0x7f86e8009f90 comp rx=0 tx=0).stop 2024-09-12T01:51:42.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.335+0000 7f86f972a740 1 -- 172.21.15.70:0/4155687649 shutdown_connections 2024-09-12T01:51:42.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.335+0000 7f86f972a740 1 --2- 172.21.15.70:0/4155687649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee089ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.335+0000 7f86f972a740 1 --2- 172.21.15.70:0/4155687649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee089d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.335+0000 7f86f972a740 1 --2- 172.21.15.70:0/4155687649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 0x559ee0892db0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.335+0000 7f86f972a740 1 -- 172.21.15.70:0/4155687649 >> 172.21.15.70:0/4155687649 conn(0x559ee088ef60 msgr2=0x559ee088f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:42.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.335+0000 7f86f972a740 1 -- 172.21.15.70:0/4155687649 shutdown_connections 2024-09-12T01:51:42.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.335+0000 7f86f972a740 1 -- 172.21.15.70:0/4155687649 wait complete. 2024-09-12T01:51:42.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.335+0000 7f86f972a740 1 -- start start 2024-09-12T01:51:42.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f972a740 1 Processor -- start 2024-09-12T01:51:42.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f972a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 0x559ee089d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f972a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee089a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f972a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee089acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f972a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559ee08a0780 con 0x559ee08929d0 2024-09-12T01:51:42.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f972a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559ee07b3f20 con 0x559ee08932f0 2024-09-12T01:51:42.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f972a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559ee08a0900 con 0x559ee089dbb0 2024-09-12T01:51:42.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f972a740 10 client.0 _ll_register_callbacks cb 0x559ee077d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:42.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f50ed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 0x559ee089d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f50ed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 0x559ee089d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36346/0 (socket says 172.21.15.70:36346) 2024-09-12T01:51:42.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f50ed640 1 -- 172.21.15.70:0/1926939847 learned_addr learned my addr 172.21.15.70:0/1926939847 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:42.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f48ec640 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee089a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f58ee640 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee089acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f50ed640 1 -- 172.21.15.70:0/1926939847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 msgr2=0x559ee089acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f50ed640 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee089acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f50ed640 1 -- 172.21.15.70:0/1926939847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 msgr2=0x559ee089a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f50ed640 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee089a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f50ed640 1 -- 172.21.15.70:0/1926939847 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ee056a2b0 con 0x559ee08929d0 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f58ee640 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee089acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.336+0000 7f86f48ec640 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee089a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86f50ed640 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 0x559ee089d440 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00bfb0 tx=0x7f86ec00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdafef107c33efbe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86d8ff9640 1 -- 172.21.15.70:0/1926939847 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec018020 con 0x559ee08929d0 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86d8ff9640 1 -- 172.21.15.70:0/1926939847 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f86ec014870 con 0x559ee08929d0 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86f972a740 1 -- 172.21.15.70:0/1926939847 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e801be00 con 0x559ee08929d0 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86d8ff9640 1 -- 172.21.15.70:0/1926939847 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f86ec00fea0 con 0x559ee08929d0 2024-09-12T01:51:42.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86f972a740 10 client.15201 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86f972a740 1 -- 172.21.15.70:0/1926939847 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559ee08ac120 con 0x559ee08929d0 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86d8ff9640 1 -- 172.21.15.70:0/1926939847 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86e801be00 con 0x559ee08929d0 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86d8ff9640 1 -- 172.21.15.70:0/1926939847 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f86ec0133c0 con 0x559ee08929d0 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86f972a740 10 client.15201 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86f972a740 10 client.15201 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86f972a740 20 client.15201 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86f972a740 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x559ee08ae7b0 0x559ee08afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86f972a740 4 client.15201 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.337+0000 7f86f972a740 1 -- 172.21.15.70:0/1926939847 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ee0806600 con 0x559ee08ae7b0 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.338+0000 7f86f48ec640 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x559ee08ae7b0 0x559ee08afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.338+0000 7f86f48ec640 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x559ee08ae7b0 0x559ee08afc20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3914297dd1103645 server_cookie=e0363ade0fd0564b in_seq=0 out_seq=0 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.338+0000 7f86d8ff9640 10 client.15201 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:51:42.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86d8ff9640 1 -- 172.21.15.70:0/1926939847 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ee0806600 con 0x559ee08ae7b0 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86d8ff9640 10 client.15201 handle_command_reply: tid=0 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86f972a740 1 client.15201 shutdown 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86f972a740 1 -- 172.21.15.70:0/1926939847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 msgr2=0x559ee089d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86f972a740 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 0x559ee089d440 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00bfb0 tx=0x7f86ec00f670 comp rx=0 tx=0).stop 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86f972a740 1 -- 172.21.15.70:0/1926939847 shutdown_connections 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86f972a740 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x559ee08ae7b0 0x559ee08afc20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86f972a740 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee089acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86f972a740 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee089a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86f972a740 1 --2- 172.21.15.70:0/1926939847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08929d0 0x559ee089d440 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86d8ff9640 0 client.15201 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86f972a740 1 -- 172.21.15.70:0/1926939847 >> 172.21.15.70:0/1926939847 conn(0x559ee088ef60 msgr2=0x559ee0894c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86f972a740 1 -- 172.21.15.70:0/1926939847 shutdown_connections 2024-09-12T01:51:42.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86f972a740 1 -- 172.21.15.70:0/1926939847 wait complete. 2024-09-12T01:51:42.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.339+0000 7f86f972a740 20 client.15201 trim_cache size 0 max 16384 2024-09-12T01:51:42.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f972a740 1 Processor -- start 2024-09-12T01:51:42.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f972a740 1 -- start start 2024-09-12T01:51:42.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f972a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee08929d0 0x559ee08af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f972a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee0899060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f972a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee089dbb0 0x559ee0895d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f972a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559ee08adf60 con 0x559ee089dbb0 2024-09-12T01:51:42.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f972a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559ee08ae630 con 0x559ee08932f0 2024-09-12T01:51:42.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f972a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559ee08aed00 con 0x559ee08929d0 2024-09-12T01:51:42.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f58ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee089dbb0 0x559ee0895d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f58ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee089dbb0 0x559ee0895d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36354/0 (socket says 172.21.15.70:36354) 2024-09-12T01:51:42.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f58ee640 1 -- 172.21.15.70:0/1355544269 learned_addr learned my addr 172.21.15.70:0/1355544269 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:42.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f48ec640 1 --2- 172.21.15.70:0/1355544269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee0899060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f50ed640 1 --2- 172.21.15.70:0/1355544269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee08929d0 0x559ee08af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f58ee640 1 -- 172.21.15.70:0/1355544269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee08929d0 msgr2=0x559ee08af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:42.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f58ee640 1 --2- 172.21.15.70:0/1355544269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee08929d0 0x559ee08af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f58ee640 1 -- 172.21.15.70:0/1355544269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 msgr2=0x559ee0899060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:42.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f58ee640 1 --2- 172.21.15.70:0/1355544269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee0899060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f58ee640 1 -- 172.21.15.70:0/1355544269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ee0899740 con 0x559ee089dbb0 2024-09-12T01:51:42.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.357+0000 7f86f50ed640 1 --2- 172.21.15.70:0/1355544269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee08929d0 0x559ee08af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:42.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.358+0000 7f86f58ee640 1 --2- 172.21.15.70:0/1355544269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee089dbb0 0x559ee0895d00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f86e800fbc0 tx=0x7f86e8026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec145a92a85fbd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:42.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.358+0000 7f86daffd640 1 -- 172.21.15.70:0/1355544269 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e801b880 con 0x559ee089dbb0 2024-09-12T01:51:42.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.358+0000 7f86daffd640 1 -- 172.21.15.70:0/1355544269 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86e80103d0 con 0x559ee089dbb0 2024-09-12T01:51:42.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.358+0000 7f86daffd640 1 -- 172.21.15.70:0/1355544269 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8026660 con 0x559ee089dbb0 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.358+0000 7f86f972a740 1 -- 172.21.15.70:0/1355544269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee089dbb0 msgr2=0x559ee0895d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.358+0000 7f86f972a740 1 --2- 172.21.15.70:0/1355544269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee089dbb0 0x559ee0895d00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f86e800fbc0 tx=0x7f86e8026000 comp rx=0 tx=0).stop 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.358+0000 7f86f972a740 1 -- 172.21.15.70:0/1355544269 shutdown_connections 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.358+0000 7f86f972a740 1 --2- 172.21.15.70:0/1355544269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee089dbb0 0x559ee0895d00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.358+0000 7f86f972a740 1 --2- 172.21.15.70:0/1355544269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08932f0 0x559ee0899060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.358+0000 7f86f972a740 1 --2- 172.21.15.70:0/1355544269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee08929d0 0x559ee08af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.358+0000 7f86f972a740 1 -- 172.21.15.70:0/1355544269 >> 172.21.15.70:0/1355544269 conn(0x559ee088ef60 msgr2=0x559ee08955f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f972a740 1 -- 172.21.15.70:0/1355544269 shutdown_connections 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f972a740 1 -- 172.21.15.70:0/1355544269 wait complete. 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f972a740 1 -- start start 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f972a740 1 Processor -- start 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f972a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08929d0 0x559ee08b8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f972a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08932f0 0x559ee08b8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f972a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee08b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f972a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559ee08afaa0 con 0x559ee08932f0 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f972a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559ee08af3d0 con 0x559ee08929d0 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f972a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559ee08b0170 con 0x559ee089dbb0 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f972a740 10 client.0 _ll_register_callbacks cb 0x7f86ec00b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f48ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08932f0 0x559ee08b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f48ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08932f0 0x559ee08b8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36362/0 (socket says 172.21.15.70:36362) 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.359+0000 7f86f48ec640 1 -- 172.21.15.70:0/1275055236 learned_addr learned my addr 172.21.15.70:0/1275055236 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86f50ed640 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08929d0 0x559ee08b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86f58ee640 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee08b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86f48ec640 1 -- 172.21.15.70:0/1275055236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 msgr2=0x559ee08b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86f48ec640 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee08b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86f48ec640 1 -- 172.21.15.70:0/1275055236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08929d0 msgr2=0x559ee08b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:42.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86f48ec640 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08929d0 0x559ee08b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86f48ec640 1 -- 172.21.15.70:0/1275055236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ee08b1c60 con 0x559ee08932f0 2024-09-12T01:51:42.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86f48ec640 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08932f0 0x559ee08b8640 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f86e00bbf30 tx=0x7f86e002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d15166152b0f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:42.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:42.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86d8ff9640 1 -- 172.21.15.70:0/1275055236 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0049040 con 0x559ee08932f0 2024-09-12T01:51:42.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86d8ff9640 1 -- 172.21.15.70:0/1275055236 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f86e0003ca0 con 0x559ee08932f0 2024-09-12T01:51:42.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86f972a740 1 -- 172.21.15.70:0/1275055236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e80103d0 con 0x559ee08932f0 2024-09-12T01:51:42.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86d8ff9640 1 -- 172.21.15.70:0/1275055236 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f86e00bc230 con 0x559ee08932f0 2024-09-12T01:51:42.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86f972a740 10 client.15207 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:42.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86f972a740 1 -- 172.21.15.70:0/1275055236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559ee08b6670 con 0x559ee08932f0 2024-09-12T01:51:42.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86d8ff9640 1 -- 172.21.15.70:0/1275055236 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86e80103d0 con 0x559ee08932f0 2024-09-12T01:51:42.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.360+0000 7f86d8ff9640 1 -- 172.21.15.70:0/1275055236 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f86e00b88a0 con 0x559ee08932f0 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.361+0000 7f86f972a740 10 client.15207 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.361+0000 7f86f972a740 10 client.15207 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.361+0000 7f86f972a740 20 client.15207 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.361+0000 7f86f972a740 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x559ee091d480 0x559ee091c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.361+0000 7f86f972a740 4 client.15207 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.361+0000 7f86f972a740 1 -- 172.21.15.70:0/1275055236 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "status"}) -- 0x559ee0800b10 con 0x559ee091d480 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.361+0000 7f86f50ed640 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x559ee091d480 0x559ee091c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.361+0000 7f86d8ff9640 10 client.15207 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.361+0000 7f86f50ed640 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x559ee091d480 0x559ee091c190 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a49597e41ffa49eb server_cookie=cf93ad4a12605acd in_seq=0 out_seq=0 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.361+0000 7f86d8ff9640 1 -- 172.21.15.70:0/1275055236 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x559ee0800b10 con 0x559ee091d480 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.361+0000 7f86d8ff9640 10 client.15207 handle_command_reply: tid=0 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f972a740 1 client.15207 shutdown 2024-09-12T01:51:42.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f972a740 1 -- 172.21.15.70:0/1275055236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08932f0 msgr2=0x559ee08b8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:42.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f972a740 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08932f0 0x559ee08b8640 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f86e00bbf30 tx=0x7f86e002a420 comp rx=0 tx=0).stop 2024-09-12T01:51:42.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f972a740 1 -- 172.21.15.70:0/1275055236 shutdown_connections 2024-09-12T01:51:42.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f972a740 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x559ee091d480 0x559ee091c190 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f972a740 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ee089dbb0 0x559ee08b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f972a740 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ee08932f0 0x559ee08b8640 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86d8ff9640 0 client.15207 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:51:42.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f972a740 1 --2- 172.21.15.70:0/1275055236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ee08929d0 0x559ee08b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f972a740 1 -- 172.21.15.70:0/1275055236 >> 172.21.15.70:0/1275055236 conn(0x559ee088ef60 msgr2=0x559ee08955f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:42.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f972a740 1 -- 172.21.15.70:0/1275055236 shutdown_connections 2024-09-12T01:51:42.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f972a740 1 -- 172.21.15.70:0/1275055236 wait complete. 2024-09-12T01:51:42.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f972a740 20 client.15207 trim_cache size 0 max 16384 2024-09-12T01:51:42.823 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:51:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:51:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 3, 2024-09-12T01:51:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24433, 2024-09-12T01:51:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:51:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:51:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:51:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 95.000575114, 2024-09-12T01:51:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-12T01:51:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:51:42.823 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T01:51:42.824 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 128.18946211700001 2024-09-12T01:51:42.824 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:51:42.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f7351640 1 -- 172.21.15.70:0/4284407247 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86dc0a2c00 msgr2=0x7f86dc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:42.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f7351640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86dc0a2c00 0x7f86dc0a50c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f86e801e000 tx=0x7f86e8021000 comp rx=0 tx=0).stop 2024-09-12T01:51:42.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f7351640 1 -- 172.21.15.70:0/4284407247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f0101420 msgr2=0x7f86f019ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:42.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f7351640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f0101420 0x7f86f019ad20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009230 tx=0x7f86e0004270 comp rx=0 tx=0).stop 2024-09-12T01:51:42.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f7351640 1 -- 172.21.15.70:0/4284407247 shutdown_connections 2024-09-12T01:51:42.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f7351640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86dc0a2c00 0x7f86dc0a50c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f7351640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f0106a80 0x7f86f019e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f7351640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f0101420 0x7f86f019ad20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f7351640 1 --2- 172.21.15.70:0/4284407247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86f0100a80 0x7f86f019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:42.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.362+0000 7f86f7351640 1 -- 172.21.15.70:0/4284407247 >> 172.21.15.70:0/4284407247 conn(0x7f86f00fc7a0 msgr2=0x7f86f006a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:42.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.363+0000 7f86f7351640 1 -- 172.21.15.70:0/4284407247 shutdown_connections 2024-09-12T01:51:42.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:42.363+0000 7f86f7351640 1 -- 172.21.15.70:0/4284407247 wait complete. 2024-09-12T01:51:43.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T01:51:43.446 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:43.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.968+0000 7f6423d79640 1 -- 172.21.15.70:0/4066940599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f641c106f10 msgr2=0x7f641c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:43.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.968+0000 7f6423d79640 1 --2- 172.21.15.70:0/4066940599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f641c106f10 0x7f641c10ea90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6414009ca0 tx=0x7f641402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.968+0000 7f6423d79640 1 -- 172.21.15.70:0/4066940599 shutdown_connections 2024-09-12T01:51:43.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.968+0000 7f6423d79640 1 --2- 172.21.15.70:0/4066940599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f641c106f10 0x7f641c10ea90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.968+0000 7f6423d79640 1 --2- 172.21.15.70:0/4066940599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f641c102790 0x7f641c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.968+0000 7f6423d79640 1 --2- 172.21.15.70:0/4066940599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f641c101de0 0x7f641c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.968+0000 7f6423d79640 1 -- 172.21.15.70:0/4066940599 >> 172.21.15.70:0/4066940599 conn(0x7f641c0fd8c0 msgr2=0x7f641c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.968+0000 7f6423d79640 1 -- 172.21.15.70:0/4066940599 shutdown_connections 2024-09-12T01:51:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.969+0000 7f6423d79640 1 -- 172.21.15.70:0/4066940599 wait complete. 2024-09-12T01:51:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.969+0000 7f6423d79640 1 Processor -- start 2024-09-12T01:51:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.969+0000 7f6423d79640 1 -- start start 2024-09-12T01:51:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.969+0000 7f6423d79640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f641c101de0 0x7f641c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.969+0000 7f6423d79640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f641c102790 0x7f641c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.969+0000 7f6423d79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f641c106f10 0x7f641c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.969+0000 7f6423d79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f641c112090 con 0x7f641c106f10 2024-09-12T01:51:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.969+0000 7f6423d79640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f641c111f10 con 0x7f641c102790 2024-09-12T01:51:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.969+0000 7f6423d79640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f641c112210 con 0x7f641c101de0 2024-09-12T01:51:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.969+0000 7f6422316640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f641c106f10 0x7f641c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.969+0000 7f6422316640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f641c106f10 0x7f641c19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36380/0 (socket says 172.21.15.70:36380) 2024-09-12T01:51:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.969+0000 7f6422316640 1 -- 172.21.15.70:0/3410617565 learned_addr learned my addr 172.21.15.70:0/3410617565 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6421b15640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f641c101de0 0x7f641c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6421314640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f641c102790 0x7f641c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6422316640 1 -- 172.21.15.70:0/3410617565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f641c101de0 msgr2=0x7f641c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6422316640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f641c101de0 0x7f641c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6422316640 1 -- 172.21.15.70:0/3410617565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f641c102790 msgr2=0x7f641c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6422316640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f641c102790 0x7f641c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6422316640 1 -- 172.21.15.70:0/3410617565 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c19d420 con 0x7f641c106f10 2024-09-12T01:51:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6421b15640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f641c101de0 0x7f641c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6422316640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f641c106f10 0x7f641c19cd40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6414006010 tx=0x7f64140319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6412ffd640 1 -- 172.21.15.70:0/3410617565 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641402fa20 con 0x7f641c106f10 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6423d79640 1 -- 172.21.15.70:0/3410617565 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641c19d6b0 con 0x7f641c106f10 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6412ffd640 1 -- 172.21.15.70:0/3410617565 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f641402fbc0 con 0x7f641c106f10 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6412ffd640 1 -- 172.21.15.70:0/3410617565 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414046860 con 0x7f641c106f10 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.970+0000 7f6423d79640 1 -- 172.21.15.70:0/3410617565 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f641c1a4ff0 con 0x7f641c106f10 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.972+0000 7f6412ffd640 1 -- 172.21.15.70:0/3410617565 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6414046a00 con 0x7f641c106f10 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6426152740 1 Processor -- start 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6426152740 1 -- start start 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6426152740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d3fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6426152740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d4ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6426152740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d513b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6426152740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aae9ca6090 con 0x55aae9d40210 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6426152740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55aae9c4da70 con 0x55aae9d4efc0 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6426152740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55aae9ca2050 con 0x55aae9d3f8f0 2024-09-12T01:51:43.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6412ffd640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64080a2b80 0x7f64080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6421b15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d4ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6421b15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d4ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36388/0 (socket says 172.21.15.70:36388) 2024-09-12T01:51:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6421b15640 1 -- 172.21.15.70:0/3398429685 learned_addr learned my addr 172.21.15.70:0/3398429685 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6421314640 1 --2- 172.21.15.70:0/3398429685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d3fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6422316640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64080a2b80 0x7f64080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.973+0000 7f6421314640 1 --2- 172.21.15.70:0/3398429685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.974+0000 7f6412ffd640 1 -- 172.21.15.70:0/3410617565 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f64140f0610 con 0x7f641c106f10 2024-09-12T01:51:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.974+0000 7f6421b15640 1 -- 172.21.15.70:0/3398429685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 msgr2=0x55aae9d3fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.974+0000 7f6421b15640 1 --2- 172.21.15.70:0/3398429685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d3fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.974+0000 7f6421b15640 1 -- 172.21.15.70:0/3398429685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 msgr2=0x55aae9d513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.974+0000 7f6421b15640 1 --2- 172.21.15.70:0/3398429685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.974+0000 7f6421b15640 1 -- 172.21.15.70:0/3398429685 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aae9c5a130 con 0x55aae9d40210 2024-09-12T01:51:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.974+0000 7f6421314640 1 --2- 172.21.15.70:0/3398429685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.974+0000 7f6421b15640 1 --2- 172.21.15.70:0/3398429685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d4ea80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f641800bd40 tx=0x7f641800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d4ab7151360d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.974+0000 7f6422316640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64080a2b80 0x7f64080a5040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f64140b9360 tx=0x7f64140b23e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.974+0000 7f6407fff640 1 -- 172.21.15.70:0/3398429685 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418015070 con 0x55aae9d40210 2024-09-12T01:51:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.974+0000 7f6407fff640 1 -- 172.21.15.70:0/3398429685 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f641800be30 con 0x55aae9d40210 2024-09-12T01:51:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.974+0000 7f6407fff640 1 -- 172.21.15.70:0/3398429685 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418011a70 con 0x55aae9d40210 2024-09-12T01:51:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.975+0000 7f6426152740 1 -- 172.21.15.70:0/3398429685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 msgr2=0x55aae9d4ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.975+0000 7f6426152740 1 --2- 172.21.15.70:0/3398429685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d4ea80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f641800bd40 tx=0x7f641800f730 comp rx=0 tx=0).stop 2024-09-12T01:51:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.975+0000 7f6426152740 1 -- 172.21.15.70:0/3398429685 shutdown_connections 2024-09-12T01:51:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.975+0000 7f6426152740 1 --2- 172.21.15.70:0/3398429685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.975+0000 7f6426152740 1 --2- 172.21.15.70:0/3398429685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d4ea80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.975+0000 7f6426152740 1 --2- 172.21.15.70:0/3398429685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d3fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.975+0000 7f6426152740 1 -- 172.21.15.70:0/3398429685 >> 172.21.15.70:0/3398429685 conn(0x55aae9d3bf60 msgr2=0x55aae9d3c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.975+0000 7f6426152740 1 -- 172.21.15.70:0/3398429685 shutdown_connections 2024-09-12T01:51:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.975+0000 7f6426152740 1 -- 172.21.15.70:0/3398429685 wait complete. 2024-09-12T01:51:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.975+0000 7f6426152740 1 -- start start 2024-09-12T01:51:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.975+0000 7f6426152740 1 Processor -- start 2024-09-12T01:51:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6426152740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d4e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6426152740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d4bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6426152740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d4c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6426152740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aae9d51b30 con 0x55aae9d40210 2024-09-12T01:51:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6426152740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55aae9c60f20 con 0x55aae9d4efc0 2024-09-12T01:51:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6426152740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55aae9d51cb0 con 0x55aae9d3f8f0 2024-09-12T01:51:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6426152740 10 client.0 _ll_register_callbacks cb 0x55aae9c2a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6421b15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d4bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6421b15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d4bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36404/0 (socket says 172.21.15.70:36404) 2024-09-12T01:51:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6421b15640 1 -- 172.21.15.70:0/2151574883 learned_addr learned my addr 172.21.15.70:0/2151574883 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6421314640 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d4c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6421314640 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d4e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6421b15640 1 -- 172.21.15.70:0/2151574883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 msgr2=0x55aae9d4e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6421b15640 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d4e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6421b15640 1 -- 172.21.15.70:0/2151574883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 msgr2=0x55aae9d4c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6421b15640 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d4c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6421b15640 1 -- 172.21.15.70:0/2151574883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aae9a172b0 con 0x55aae9d40210 2024-09-12T01:51:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f6421b15640 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d4bc20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6418000c00 tx=0x7f641800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0f02318a78c4e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.976+0000 7f64057fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f64057fa640 1 -- 172.21.15.70:0/2151574883 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418028060 con 0x55aae9d40210 2024-09-12T01:51:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f64057fa640 1 -- 172.21.15.70:0/2151574883 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6418005250 con 0x55aae9d40210 2024-09-12T01:51:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f6426152740 1 -- 172.21.15.70:0/2151574883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f641800be30 con 0x55aae9d40210 2024-09-12T01:51:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f64057fa640 1 -- 172.21.15.70:0/2151574883 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6418015070 con 0x55aae9d40210 2024-09-12T01:51:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f6426152740 10 client.15219 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f6426152740 1 -- 172.21.15.70:0/2151574883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aae9d5d4f0 con 0x55aae9d40210 2024-09-12T01:51:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f64057fa640 1 -- 172.21.15.70:0/2151574883 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f641800be30 con 0x55aae9d40210 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f64057fa640 1 -- 172.21.15.70:0/2151574883 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f641802d070 con 0x55aae9d40210 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f6426152740 10 client.15219 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f6426152740 10 client.15219 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f6426152740 20 client.15219 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f6426152740 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55aae9d5f720 0x55aae9d60b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f6426152740 4 client.15219 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f6426152740 1 -- 172.21.15.70:0/2151574883 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aae9cb3600 con 0x55aae9d5f720 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.977+0000 7f6421314640 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55aae9d5f720 0x55aae9d60b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.978+0000 7f6421314640 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55aae9d5f720 0x55aae9d60b90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac03db8332743a80 server_cookie=66c49fb3d290b60b in_seq=0 out_seq=0 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.978+0000 7f64057fa640 10 client.15219 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f64057fa640 1 -- 172.21.15.70:0/2151574883 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aae9cb3600 con 0x55aae9d5f720 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f64057fa640 10 client.15219 handle_command_reply: tid=0 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f6426152740 1 client.15219 shutdown 2024-09-12T01:51:43.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f6426152740 1 -- 172.21.15.70:0/2151574883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 msgr2=0x55aae9d4bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f6426152740 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d4bc20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6418000c00 tx=0x7f641800bab0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f6426152740 1 -- 172.21.15.70:0/2151574883 shutdown_connections 2024-09-12T01:51:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f6426152740 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55aae9d5f720 0x55aae9d60b90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f6426152740 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d4c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f6426152740 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d4bc20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f6426152740 1 --2- 172.21.15.70:0/2151574883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d4e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f64057fa640 0 client.15219 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:51:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f6426152740 1 -- 172.21.15.70:0/2151574883 >> 172.21.15.70:0/2151574883 conn(0x55aae9d3bf60 msgr2=0x55aae9d41bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f6426152740 1 -- 172.21.15.70:0/2151574883 shutdown_connections 2024-09-12T01:51:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f6426152740 1 -- 172.21.15.70:0/2151574883 wait complete. 2024-09-12T01:51:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.979+0000 7f6426152740 20 client.15219 trim_cache size 0 max 16384 2024-09-12T01:51:44.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6426152740 1 Processor -- start 2024-09-12T01:51:44.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6426152740 1 -- start start 2024-09-12T01:51:44.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6426152740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d5fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6426152740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d5f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6426152740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d36ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6426152740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aae9d5eed0 con 0x55aae9d40210 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6426152740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55aae9d5f5a0 con 0x55aae9d4efc0 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6426152740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55aae9d5fc70 con 0x55aae9d3f8f0 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6421b15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d5f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6421b15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d5f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36408/0 (socket says 172.21.15.70:36408) 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6421b15640 1 -- 172.21.15.70:0/2399773052 learned_addr learned my addr 172.21.15.70:0/2399773052 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6421314640 1 --2- 172.21.15.70:0/2399773052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d36ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6421b15640 1 -- 172.21.15.70:0/2399773052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 msgr2=0x55aae9d5fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6421b15640 1 --2- 172.21.15.70:0/2399773052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d5fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6421b15640 1 -- 172.21.15.70:0/2399773052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 msgr2=0x55aae9d36ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:44.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6421b15640 1 --2- 172.21.15.70:0/2399773052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d36ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6421b15640 1 -- 172.21.15.70:0/2399773052 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aae9d423e0 con 0x55aae9d40210 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f6421b15640 1 --2- 172.21.15.70:0/2399773052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d5f050 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f64180059d0 tx=0x7f641800fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507e299753c1e575 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.997+0000 7f64077fe640 1 -- 172.21.15.70:0/2399773052 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418033030 con 0x55aae9d40210 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.998+0000 7f64077fe640 1 -- 172.21.15.70:0/2399773052 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f641800be30 con 0x55aae9d40210 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.998+0000 7f64077fe640 1 -- 172.21.15.70:0/2399773052 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418028040 con 0x55aae9d40210 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.998+0000 7f6426152740 1 -- 172.21.15.70:0/2399773052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 msgr2=0x55aae9d5f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.998+0000 7f6426152740 1 --2- 172.21.15.70:0/2399773052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d5f050 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f64180059d0 tx=0x7f641800fd60 comp rx=0 tx=0).stop 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.998+0000 7f6426152740 1 -- 172.21.15.70:0/2399773052 shutdown_connections 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.998+0000 7f6426152740 1 --2- 172.21.15.70:0/2399773052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d36ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.998+0000 7f6426152740 1 --2- 172.21.15.70:0/2399773052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d5f050 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.998+0000 7f6426152740 1 --2- 172.21.15.70:0/2399773052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d5fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.998+0000 7f6426152740 1 -- 172.21.15.70:0/2399773052 >> 172.21.15.70:0/2399773052 conn(0x55aae9d3bf60 msgr2=0x55aae9d472d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.998+0000 7f6426152740 1 -- 172.21.15.70:0/2399773052 shutdown_connections 2024-09-12T01:51:44.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.998+0000 7f6426152740 1 -- 172.21.15.70:0/2399773052 wait complete. 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.998+0000 7f6426152740 1 -- start start 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6426152740 1 Processor -- start 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6426152740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d61e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6426152740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d62340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6426152740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d62880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6426152740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aae9d60a10 con 0x55aae9d40210 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6426152740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55aae9d60340 con 0x55aae9d4efc0 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6426152740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55aae9d610e0 con 0x55aae9d3f8f0 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6426152740 10 client.0 _ll_register_callbacks cb 0x7f640c00e930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6421b15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d62340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6421b15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d62340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36418/0 (socket says 172.21.15.70:36418) 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6421b15640 1 -- 172.21.15.70:0/3522318968 learned_addr learned my addr 172.21.15.70:0/3522318968 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6421314640 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d61e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6421b15640 1 -- 172.21.15.70:0/3522318968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 msgr2=0x55aae9d61e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6421b15640 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d61e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6421b15640 1 -- 172.21.15.70:0/3522318968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 msgr2=0x55aae9d62880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6421b15640 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d62880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6421b15640 1 -- 172.21.15.70:0/3522318968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aae9dc8020 con 0x55aae9d40210 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:43.999+0000 7f6421314640 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d61e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f6421b15640 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d62340 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6418004c90 tx=0x7f6418004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a97f7bd53b4a6be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f64057fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f64057fa640 1 -- 172.21.15.70:0/3522318968 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418028040 con 0x55aae9d40210 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f64057fa640 1 -- 172.21.15.70:0/3522318968 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6418011830 con 0x55aae9d40210 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f6426152740 1 -- 172.21.15.70:0/3522318968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f641800be30 con 0x55aae9d40210 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f64057fa640 1 -- 172.21.15.70:0/3522318968 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6418046050 con 0x55aae9d40210 2024-09-12T01:51:44.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f6426152740 10 client.15225 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f6426152740 1 -- 172.21.15.70:0/3522318968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aae9dc9300 con 0x55aae9d40210 2024-09-12T01:51:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f64057fa640 1 -- 172.21.15.70:0/3522318968 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f641800be30 con 0x55aae9d40210 2024-09-12T01:51:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f64057fa640 1 -- 172.21.15.70:0/3522318968 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f641802d070 con 0x55aae9d40210 2024-09-12T01:51:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f6426152740 10 client.15225 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f6426152740 10 client.15225 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:51:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f6426152740 20 client.15225 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f6426152740 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55aae9dcda80 0x55aae9dcc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f6426152740 4 client.15225 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:51:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.000+0000 7f6426152740 1 -- 172.21.15.70:0/3522318968 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "status"}) -- 0x55aae9cadb10 con 0x55aae9dcda80 2024-09-12T01:51:44.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.001+0000 7f6421314640 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55aae9dcda80 0x55aae9dcc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:44.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.001+0000 7f6421314640 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55aae9dcda80 0x55aae9dcc790 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=763e83de2b8ebb5a server_cookie=de9a93d8f25a3c8d in_seq=0 out_seq=0 2024-09-12T01:51:44.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.001+0000 7f64057fa640 10 client.15225 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:51:44.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.001+0000 7f64057fa640 1 -- 172.21.15.70:0/3522318968 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55aae9cadb10 con 0x55aae9dcda80 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.001+0000 7f64057fa640 10 client.15225 handle_command_reply: tid=0 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.001+0000 7f6426152740 1 client.15225 shutdown 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.001+0000 7f6426152740 1 -- 172.21.15.70:0/3522318968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 msgr2=0x55aae9d62340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.001+0000 7f6426152740 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d62340 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6418004c90 tx=0x7f6418004e00 comp rx=0 tx=0).stop 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6426152740 1 -- 172.21.15.70:0/3522318968 shutdown_connections 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6426152740 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55aae9dcda80 0x55aae9dcc790 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6426152740 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aae9d4efc0 0x55aae9d62880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6426152740 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aae9d40210 0x55aae9d62340 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f64057fa640 0 client.15225 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6426152740 1 --2- 172.21.15.70:0/3522318968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aae9d3f8f0 0x55aae9d61e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6426152740 1 -- 172.21.15.70:0/3522318968 >> 172.21.15.70:0/3522318968 conn(0x55aae9d3bf60 msgr2=0x55aae9d41bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6426152740 1 -- 172.21.15.70:0/3522318968 shutdown_connections 2024-09-12T01:51:44.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6426152740 1 -- 172.21.15.70:0/3522318968 wait complete. 2024-09-12T01:51:44.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6426152740 20 client.15225 trim_cache size 0 max 16384 2024-09-12T01:51:44.009 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:51:44.009 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:51:44.009 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-09-12T01:51:44.009 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24437, 2024-09-12T01:51:44.009 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:51:44.009 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:51:44.009 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:51:44.009 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 97.648199876999996, 2024-09-12T01:51:44.009 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-12T01:51:44.010 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:51:44.010 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T01:51:44.010 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 127.378643341 2024-09-12T01:51:44.010 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:51:44.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6423d79640 1 -- 172.21.15.70:0/3410617565 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64080a2b80 msgr2=0x7f64080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:44.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6423d79640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64080a2b80 0x7f64080a5040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f64140b9360 tx=0x7f64140b23e0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6423d79640 1 -- 172.21.15.70:0/3410617565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f641c106f10 msgr2=0x7f641c19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:44.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6423d79640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f641c106f10 0x7f641c19cd40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6414006010 tx=0x7f64140319f0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6423d79640 1 -- 172.21.15.70:0/3410617565 shutdown_connections 2024-09-12T01:51:44.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6423d79640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64080a2b80 0x7f64080a5040 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6423d79640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f641c106f10 0x7f641c19cd40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6423d79640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f641c102790 0x7f641c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6423d79640 1 --2- 172.21.15.70:0/3410617565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f641c101de0 0x7f641c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:44.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6423d79640 1 -- 172.21.15.70:0/3410617565 >> 172.21.15.70:0/3410617565 conn(0x7f641c0fd8c0 msgr2=0x7f641c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:44.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6423d79640 1 -- 172.21.15.70:0/3410617565 shutdown_connections 2024-09-12T01:51:44.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:44.002+0000 7f6423d79640 1 -- 172.21.15.70:0/3410617565 wait complete. 2024-09-12T01:51:44.645 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T01:51:44.888 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:44.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:44 smithi191 ceph-mon[35770]: pgmap v324: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:44.987 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:44 smithi070 ceph-mon[31177]: pgmap v324: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:45.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:44 smithi152 ceph-mon[35055]: pgmap v324: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:45.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.333+0000 7f7f71942640 1 -- 172.21.15.70:0/2069329184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6c101de0 msgr2=0x7f7f6c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:45.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.333+0000 7f7f71942640 1 --2- 172.21.15.70:0/2069329184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6c101de0 0x7f7f6c1021c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009900 tx=0x7f7f6402a410 comp rx=0 tx=0).stop 2024-09-12T01:51:45.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.333+0000 7f7f71942640 1 -- 172.21.15.70:0/2069329184 shutdown_connections 2024-09-12T01:51:45.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.333+0000 7f7f71942640 1 --2- 172.21.15.70:0/2069329184 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f6c106f10 0x7f7f6c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.333+0000 7f7f71942640 1 --2- 172.21.15.70:0/2069329184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f6c102790 0x7f7f6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.333+0000 7f7f71942640 1 --2- 172.21.15.70:0/2069329184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6c101de0 0x7f7f6c1021c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.333+0000 7f7f71942640 1 -- 172.21.15.70:0/2069329184 >> 172.21.15.70:0/2069329184 conn(0x7f7f6c0fd8c0 msgr2=0x7f7f6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:45.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.333+0000 7f7f71942640 1 -- 172.21.15.70:0/2069329184 shutdown_connections 2024-09-12T01:51:45.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.333+0000 7f7f71942640 1 -- 172.21.15.70:0/2069329184 wait complete. 2024-09-12T01:51:45.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f71942640 1 Processor -- start 2024-09-12T01:51:45.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f71942640 1 -- start start 2024-09-12T01:51:45.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f71942640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6c101de0 0x7f7f6c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f71942640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f6c102790 0x7f7f6c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f71942640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f6c106f10 0x7f7f6c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f71942640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c112050 con 0x7f7f6c101de0 2024-09-12T01:51:45.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f71942640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c111ed0 con 0x7f7f6c102790 2024-09-12T01:51:45.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f71942640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1121d0 con 0x7f7f6c106f10 2024-09-12T01:51:45.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f6affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6c101de0 0x7f7f6c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f6affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6c101de0 0x7f7f6c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36432/0 (socket says 172.21.15.70:36432) 2024-09-12T01:51:45.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f6affd640 1 -- 172.21.15.70:0/2631592371 learned_addr learned my addr 172.21.15.70:0/2631592371 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:45.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f6a7fc640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f6c102790 0x7f7f6c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.334+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f6c106f10 0x7f7f6c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.335+0000 7f7f6affd640 1 -- 172.21.15.70:0/2631592371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f6c106f10 msgr2=0x7f7f6c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.335+0000 7f7f6affd640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f6c106f10 0x7f7f6c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.335+0000 7f7f6affd640 1 -- 172.21.15.70:0/2631592371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f6c102790 msgr2=0x7f7f6c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.335+0000 7f7f6affd640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f6c102790 0x7f7f6c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.335+0000 7f7f6affd640 1 -- 172.21.15.70:0/2631592371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c19d420 con 0x7f7f6c101de0 2024-09-12T01:51:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.335+0000 7f7f6affd640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6c101de0 0x7f7f6c198470 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7f64006010 tx=0x7f7f640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.335+0000 7f7f70940640 1 -- 172.21.15.70:0/2631592371 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6403f030 con 0x7f7f6c101de0 2024-09-12T01:51:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.335+0000 7f7f70940640 1 -- 172.21.15.70:0/2631592371 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f64003d00 con 0x7f7f6c101de0 2024-09-12T01:51:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.335+0000 7f7f71942640 1 -- 172.21.15.70:0/2631592371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6c19d6b0 con 0x7f7f6c101de0 2024-09-12T01:51:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.335+0000 7f7f70940640 1 -- 172.21.15.70:0/2631592371 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64035070 con 0x7f7f6c101de0 2024-09-12T01:51:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.335+0000 7f7f71942640 1 -- 172.21.15.70:0/2631592371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6c1a4ff0 con 0x7f7f6c101de0 2024-09-12T01:51:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.338+0000 7f7f70940640 1 -- 172.21.15.70:0/2631592371 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7f64042030 con 0x7f7f6c101de0 2024-09-12T01:51:45.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.338+0000 7f7f73d1b740 1 Processor -- start 2024-09-12T01:51:45.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.338+0000 7f7f73d1b740 1 -- start start 2024-09-12T01:51:45.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.338+0000 7f7f73d1b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c31db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.338+0000 7f7f73d1b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c322f0 0x55da27c3c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.338+0000 7f7f73d1b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c3cbb0 0x55da27c3efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.338+0000 7f7f73d1b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55da27b98090 con 0x55da27c319d0 2024-09-12T01:51:45.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.338+0000 7f7f73d1b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da27b3fa70 con 0x55da27c322f0 2024-09-12T01:51:45.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.338+0000 7f7f73d1b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55da27b94050 con 0x55da27c3cbb0 2024-09-12T01:51:45.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.338+0000 7f7f6b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c31db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.338+0000 7f7f6b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c31db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36438/0 (socket says 172.21.15.70:36438) 2024-09-12T01:51:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.338+0000 7f7f6b7fe640 1 -- 172.21.15.70:0/2151530077 learned_addr learned my addr 172.21.15.70:0/2151530077 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.339+0000 7f7f6b7fe640 1 -- 172.21.15.70:0/2151530077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c3cbb0 msgr2=0x55da27c3efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.339+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/2151530077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c3cbb0 0x55da27c3efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.339+0000 7f7f6b7fe640 1 -- 172.21.15.70:0/2151530077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c322f0 msgr2=0x55da27c3c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.339+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/2151530077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c322f0 0x55da27c3c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.339+0000 7f7f6b7fe640 1 -- 172.21.15.70:0/2151530077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da27b4c130 con 0x55da27c319d0 2024-09-12T01:51:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.339+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/2151530077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c31db0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00ae10 tx=0x7f7f5c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76494d06b39c9a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.339+0000 7f7f61ffb640 1 -- 172.21.15.70:0/2151530077 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c003b70 con 0x55da27c319d0 2024-09-12T01:51:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.339+0000 7f7f61ffb640 1 -- 172.21.15.70:0/2151530077 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f5c003d10 con 0x55da27c319d0 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.339+0000 7f7f61ffb640 1 -- 172.21.15.70:0/2151530077 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c010b40 con 0x55da27c319d0 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.339+0000 7f7f70940640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7f580a2b80 0x7f7f580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.339+0000 7f7f6affd640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7f580a2b80 0x7f7f580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.339+0000 7f7f70940640 1 -- 172.21.15.70:0/2631592371 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7f640ef600 con 0x7f7f6c101de0 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.340+0000 7f7f73d1b740 1 -- 172.21.15.70:0/2151530077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 msgr2=0x55da27c31db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.340+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/2151530077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c31db0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00ae10 tx=0x7f7f5c00f790 comp rx=0 tx=0).stop 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.340+0000 7f7f6affd640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7f580a2b80 0x7f7f580a5040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7f64005ec0 tx=0x7f7f640e69f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.340+0000 7f7f73d1b740 1 -- 172.21.15.70:0/2151530077 shutdown_connections 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.340+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/2151530077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c3cbb0 0x55da27c3efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.340+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/2151530077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c322f0 0x55da27c3c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.340+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/2151530077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c31db0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.340+0000 7f7f73d1b740 1 -- 172.21.15.70:0/2151530077 >> 172.21.15.70:0/2151530077 conn(0x55da27c2df60 msgr2=0x55da27c2e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.340+0000 7f7f73d1b740 1 -- 172.21.15.70:0/2151530077 shutdown_connections 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.340+0000 7f7f73d1b740 1 -- 172.21.15.70:0/2151530077 wait complete. 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.340+0000 7f7f73d1b740 1 -- start start 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.340+0000 7f7f73d1b740 1 Processor -- start 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f73d1b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c3c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f73d1b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c322f0 0x55da27c39770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f73d1b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c3cbb0 0x55da27c39cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f73d1b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55da27c3f780 con 0x55da27c319d0 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f73d1b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da27b52f20 con 0x55da27c3cbb0 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f73d1b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55da27c3f900 con 0x55da27c322f0 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f73d1b740 10 client.0 _ll_register_callbacks cb 0x55da27b1c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f6b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c3c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f6b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c3c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36452/0 (socket says 172.21.15.70:36452) 2024-09-12T01:51:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f6b7fe640 1 -- 172.21.15.70:0/3816236674 learned_addr learned my addr 172.21.15.70:0/3816236674 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c3cbb0 0x55da27c39cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f6a7fc640 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c322f0 0x55da27c39770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f6b7fe640 1 -- 172.21.15.70:0/3816236674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c322f0 msgr2=0x55da27c39770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c322f0 0x55da27c39770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f6b7fe640 1 -- 172.21.15.70:0/3816236674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c3cbb0 msgr2=0x55da27c39cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c3cbb0 0x55da27c39cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f6b7fe640 1 -- 172.21.15.70:0/3816236674 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da279092b0 con 0x55da27c319d0 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f6a7fc640 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c322f0 0x55da27c39770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c3c420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00a780 tx=0x7f7f5c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c66095e0c4a8003 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f4affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f4affd640 1 -- 172.21.15.70:0/3816236674 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c02c060 con 0x55da27c319d0 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f4affd640 1 -- 172.21.15.70:0/3816236674 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7f5c003ec0 con 0x55da27c319d0 2024-09-12T01:51:45.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.341+0000 7f7f73d1b740 1 -- 172.21.15.70:0/3816236674 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f5c003d10 con 0x55da27c319d0 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.342+0000 7f7f4affd640 1 -- 172.21.15.70:0/3816236674 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7f5c010e50 con 0x55da27c319d0 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.342+0000 7f7f73d1b740 10 client.15237 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.342+0000 7f7f73d1b740 1 -- 172.21.15.70:0/3816236674 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55da27c4b070 con 0x55da27c319d0 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.342+0000 7f7f4affd640 1 -- 172.21.15.70:0/3816236674 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f5c003d10 con 0x55da27c319d0 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.342+0000 7f7f4affd640 1 -- 172.21.15.70:0/3816236674 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7f5c031070 con 0x55da27c319d0 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.342+0000 7f7f73d1b740 10 client.15237 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.342+0000 7f7f73d1b740 10 client.15237 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.342+0000 7f7f73d1b740 20 client.15237 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.342+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55da27c4d2c0 0x55da27c4e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.342+0000 7f7f73d1b740 4 client.15237 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.342+0000 7f7f73d1b740 1 -- 172.21.15.70:0/3816236674 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da27ba5600 con 0x55da27c4d2c0 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.342+0000 7f7f6a7fc640 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55da27c4d2c0 0x55da27c4e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.343+0000 7f7f4affd640 10 client.15237 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:51:45.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.343+0000 7f7f6a7fc640 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55da27c4d2c0 0x55da27c4e730 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c73776fbf7eeb5ae server_cookie=dd982a246b904fd7 in_seq=0 out_seq=0 2024-09-12T01:51:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.343+0000 7f7f4affd640 1 -- 172.21.15.70:0/3816236674 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da27ba5600 con 0x55da27c4d2c0 2024-09-12T01:51:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.343+0000 7f7f4affd640 10 client.15237 handle_command_reply: tid=0 2024-09-12T01:51:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.343+0000 7f7f73d1b740 1 client.15237 shutdown 2024-09-12T01:51:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.343+0000 7f7f73d1b740 1 -- 172.21.15.70:0/3816236674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 msgr2=0x55da27c3c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.343+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c3c420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00a780 tx=0x7f7f5c00a710 comp rx=0 tx=0).stop 2024-09-12T01:51:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.344+0000 7f7f73d1b740 1 -- 172.21.15.70:0/3816236674 shutdown_connections 2024-09-12T01:51:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.344+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55da27c4d2c0 0x55da27c4e730 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.344+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c3cbb0 0x55da27c39cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.344+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c322f0 0x55da27c39770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.344+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/3816236674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c3c420 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.344+0000 7f7f4affd640 0 client.15237 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:51:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.344+0000 7f7f73d1b740 1 -- 172.21.15.70:0/3816236674 >> 172.21.15.70:0/3816236674 conn(0x55da27c2df60 msgr2=0x55da27c33c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.344+0000 7f7f73d1b740 1 -- 172.21.15.70:0/3816236674 shutdown_connections 2024-09-12T01:51:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.344+0000 7f7f73d1b740 1 -- 172.21.15.70:0/3816236674 wait complete. 2024-09-12T01:51:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.344+0000 7f7f73d1b740 20 client.15237 trim_cache size 0 max 16384 2024-09-12T01:51:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.361+0000 7f7f73d1b740 1 Processor -- start 2024-09-12T01:51:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.361+0000 7f7f73d1b740 1 -- start start 2024-09-12T01:51:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.361+0000 7f7f73d1b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c319d0 0x55da27c4e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.361+0000 7f7f73d1b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c322f0 0x55da27c39030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.361+0000 7f7f73d1b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c3cbb0 0x55da27c56e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.361+0000 7f7f73d1b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55da27c4ca70 con 0x55da27c322f0 2024-09-12T01:51:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.361+0000 7f7f73d1b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da27c4d140 con 0x55da27c319d0 2024-09-12T01:51:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.361+0000 7f7f73d1b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55da27c4d810 con 0x55da27c3cbb0 2024-09-12T01:51:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f6a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c322f0 0x55da27c39030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f6a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c322f0 0x55da27c39030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36458/0 (socket says 172.21.15.70:36458) 2024-09-12T01:51:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f6a7fc640 1 -- 172.21.15.70:0/780515856 learned_addr learned my addr 172.21.15.70:0/780515856 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/780515856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c319d0 0x55da27c4e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f6a7fc640 1 -- 172.21.15.70:0/780515856 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c3cbb0 msgr2=0x55da27c56e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f6a7fc640 1 --2- 172.21.15.70:0/780515856 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c3cbb0 0x55da27c56e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f6a7fc640 1 -- 172.21.15.70:0/780515856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c319d0 msgr2=0x55da27c4e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f6a7fc640 1 --2- 172.21.15.70:0/780515856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c319d0 0x55da27c4e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f6a7fc640 1 -- 172.21.15.70:0/780515856 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da27c3a290 con 0x55da27c322f0 2024-09-12T01:51:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/780515856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c319d0 0x55da27c4e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f6a7fc640 1 --2- 172.21.15.70:0/780515856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c322f0 0x55da27c39030 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7f5401bfd0 tx=0x7f7f5400a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30509feab923ee24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f617fa640 1 -- 172.21.15.70:0/780515856 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5401b5b0 con 0x55da27c322f0 2024-09-12T01:51:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f617fa640 1 -- 172.21.15.70:0/780515856 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f5401bc50 con 0x55da27c322f0 2024-09-12T01:51:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.362+0000 7f7f617fa640 1 -- 172.21.15.70:0/780515856 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54011ea0 con 0x55da27c322f0 2024-09-12T01:51:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 -- 172.21.15.70:0/780515856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c322f0 msgr2=0x55da27c39030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/780515856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c322f0 0x55da27c39030 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7f5401bfd0 tx=0x7f7f5400a530 comp rx=0 tx=0).stop 2024-09-12T01:51:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 -- 172.21.15.70:0/780515856 shutdown_connections 2024-09-12T01:51:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/780515856 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c3cbb0 0x55da27c56e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/780515856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c322f0 0x55da27c39030 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/780515856 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c319d0 0x55da27c4e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 -- 172.21.15.70:0/780515856 >> 172.21.15.70:0/780515856 conn(0x55da27c2df60 msgr2=0x55da27c38040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 -- 172.21.15.70:0/780515856 shutdown_connections 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 -- 172.21.15.70:0/780515856 wait complete. 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 -- start start 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 Processor -- start 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c57170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.363+0000 7f7f73d1b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c322f0 0x55da27c544c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f73d1b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c3cbb0 0x55da27c54a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f73d1b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55da27c4e5b0 con 0x55da27c319d0 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f73d1b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55da27c4dee0 con 0x55da27c322f0 2024-09-12T01:51:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f73d1b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55da27c4ec80 con 0x55da27c3cbb0 2024-09-12T01:51:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f73d1b740 10 client.0 _ll_register_callbacks cb 0x7f7f5c00ac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f6b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c57170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f6b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c57170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36474/0 (socket says 172.21.15.70:36474) 2024-09-12T01:51:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f6b7fe640 1 -- 172.21.15.70:0/681998355 learned_addr learned my addr 172.21.15.70:0/681998355 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f6a7fc640 1 --2- 172.21.15.70:0/681998355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c322f0 0x55da27c544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f6b7fe640 1 -- 172.21.15.70:0/681998355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c3cbb0 msgr2=0x55da27c54a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/681998355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c3cbb0 0x55da27c54a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f6b7fe640 1 -- 172.21.15.70:0/681998355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c322f0 msgr2=0x55da27c544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/681998355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c322f0 0x55da27c544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f6b7fe640 1 -- 172.21.15.70:0/681998355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da27c2dd90 con 0x55da27c319d0 2024-09-12T01:51:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f6b7fe640 1 --2- 172.21.15.70:0/681998355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c57170 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00a780 tx=0x7f7f5c0107c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6320e82e7e582e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f4affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f4affd640 1 -- 172.21.15.70:0/681998355 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c037070 con 0x55da27c319d0 2024-09-12T01:51:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f4affd640 1 -- 172.21.15.70:0/681998355 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7f5c004dc0 con 0x55da27c319d0 2024-09-12T01:51:45.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f73d1b740 1 -- 172.21.15.70:0/681998355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f5401bc50 con 0x55da27c319d0 2024-09-12T01:51:45.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f4affd640 1 -- 172.21.15.70:0/681998355 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7f5c005a20 con 0x55da27c319d0 2024-09-12T01:51:45.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f73d1b740 10 client.15243 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:45.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.364+0000 7f7f73d1b740 1 -- 172.21.15.70:0/681998355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55da27cbb7d0 con 0x55da27c319d0 2024-09-12T01:51:45.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.365+0000 7f7f4affd640 1 -- 172.21.15.70:0/681998355 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f5401bc50 con 0x55da27c319d0 2024-09-12T01:51:45.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.365+0000 7f7f4affd640 1 -- 172.21.15.70:0/681998355 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7f5c031070 con 0x55da27c319d0 2024-09-12T01:51:45.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.365+0000 7f7f73d1b740 10 client.15243 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.365+0000 7f7f73d1b740 10 client.15243 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:51:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.365+0000 7f7f73d1b740 20 client.15243 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.365+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/681998355 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55da27cc0250 0x55da27cbef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.365+0000 7f7f73d1b740 4 client.15243 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:51:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.365+0000 7f7f73d1b740 1 -- 172.21.15.70:0/681998355 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "status"}) -- 0x55da27b9fb10 con 0x55da27cc0250 2024-09-12T01:51:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.365+0000 7f7f6a7fc640 1 --2- 172.21.15.70:0/681998355 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55da27cc0250 0x55da27cbef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.365+0000 7f7f6a7fc640 1 --2- 172.21.15.70:0/681998355 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55da27cc0250 0x55da27cbef60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e5a4150c5836f728 server_cookie=2d6a3994fc2c95f4 in_seq=0 out_seq=0 2024-09-12T01:51:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.365+0000 7f7f4affd640 10 client.15243 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:51:45.395 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:51:45.395 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:51:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-09-12T01:51:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24445, 2024-09-12T01:51:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:51:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:51:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:51:45.397 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 100.01791345700001, 2024-09-12T01:51:45.397 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-12T01:51:45.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:51:45.397 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T01:51:45.397 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 126.32860643799999 2024-09-12T01:51:45.397 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:51:45.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f4affd640 1 -- 172.21.15.70:0/681998355 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55da27b9fb10 con 0x55da27cc0250 2024-09-12T01:51:45.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f4affd640 10 client.15243 handle_command_reply: tid=0 2024-09-12T01:51:45.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f73d1b740 1 client.15243 shutdown 2024-09-12T01:51:45.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f73d1b740 1 -- 172.21.15.70:0/681998355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 msgr2=0x55da27c57170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:45.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/681998355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c57170 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00a780 tx=0x7f7f5c0107c0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f73d1b740 1 -- 172.21.15.70:0/681998355 shutdown_connections 2024-09-12T01:51:45.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/681998355 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55da27cc0250 0x55da27cbef60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/681998355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55da27c3cbb0 0x55da27c54a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/681998355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55da27c322f0 0x55da27c544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f73d1b740 1 --2- 172.21.15.70:0/681998355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da27c319d0 0x55da27c57170 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f4affd640 0 client.15243 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:51:45.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f73d1b740 1 -- 172.21.15.70:0/681998355 >> 172.21.15.70:0/681998355 conn(0x55da27c2df60 msgr2=0x55da27c2e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f73d1b740 1 -- 172.21.15.70:0/681998355 shutdown_connections 2024-09-12T01:51:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f73d1b740 1 -- 172.21.15.70:0/681998355 wait complete. 2024-09-12T01:51:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.366+0000 7f7f73d1b740 20 client.15243 trim_cache size 0 max 16384 2024-09-12T01:51:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.367+0000 7f7f71942640 1 -- 172.21.15.70:0/2631592371 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7f580a2b80 msgr2=0x7f7f580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.367+0000 7f7f71942640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7f580a2b80 0x7f7f580a5040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7f64005ec0 tx=0x7f7f640e69f0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.367+0000 7f7f71942640 1 -- 172.21.15.70:0/2631592371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6c101de0 msgr2=0x7f7f6c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.367+0000 7f7f71942640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6c101de0 0x7f7f6c198470 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7f64006010 tx=0x7f7f640042f0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.367+0000 7f7f71942640 1 -- 172.21.15.70:0/2631592371 shutdown_connections 2024-09-12T01:51:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.367+0000 7f7f71942640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7f580a2b80 0x7f7f580a5040 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.367+0000 7f7f71942640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f6c106f10 0x7f7f6c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.367+0000 7f7f71942640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f6c102790 0x7f7f6c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.367+0000 7f7f71942640 1 --2- 172.21.15.70:0/2631592371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f6c101de0 0x7f7f6c198470 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:45.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.367+0000 7f7f71942640 1 -- 172.21.15.70:0/2631592371 >> 172.21.15.70:0/2631592371 conn(0x7f7f6c0fd8c0 msgr2=0x7f7f6c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:45.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.367+0000 7f7f71942640 1 -- 172.21.15.70:0/2631592371 shutdown_connections 2024-09-12T01:51:45.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:45.367+0000 7f7f71942640 1 -- 172.21.15.70:0/2631592371 wait complete. 2024-09-12T01:51:46.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T01:51:46.392 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:46.766 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:46 smithi070 ceph-mon[31177]: pgmap v325: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:46.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.845+0000 7f73a9b74640 1 -- 172.21.15.70:0/3467701103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a4102ef0 msgr2=0x7f73a410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:46.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.845+0000 7f73a9b74640 1 --2- 172.21.15.70:0/3467701103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a4102ef0 0x7f73a410da40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f739c009ca0 tx=0x7f739c02a950 comp rx=0 tx=0).stop 2024-09-12T01:51:46.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.845+0000 7f73a9b74640 1 -- 172.21.15.70:0/3467701103 shutdown_connections 2024-09-12T01:51:46.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.845+0000 7f73a9b74640 1 --2- 172.21.15.70:0/3467701103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a4102ef0 0x7f73a410da40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.845+0000 7f73a9b74640 1 --2- 172.21.15.70:0/3467701103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a4102570 0x7f73a41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.845+0000 7f73a9b74640 1 --2- 172.21.15.70:0/3467701103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a4100e20 0x7f73a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.845+0000 7f73a9b74640 1 -- 172.21.15.70:0/3467701103 >> 172.21.15.70:0/3467701103 conn(0x7f73a40fc7d0 msgr2=0x7f73a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.845+0000 7f73a9b74640 1 -- 172.21.15.70:0/3467701103 shutdown_connections 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.845+0000 7f73a9b74640 1 -- 172.21.15.70:0/3467701103 wait complete. 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a9b74640 1 Processor -- start 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a9b74640 1 -- start start 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a9b74640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a4100e20 0x7f73a4199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a9b74640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a4102570 0x7f73a4199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a9b74640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a4102ef0 0x7f73a41a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a9b74640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73a41110a0 con 0x7f73a4102570 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a9b74640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4110f20 con 0x7f73a4100e20 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a9b74640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4111220 con 0x7f73a4102ef0 2024-09-12T01:51:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a4102570 0x7f73a4199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a4102570 0x7f73a4199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36496/0 (socket says 172.21.15.70:36496) 2024-09-12T01:51:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a2ffd640 1 -- 172.21.15.70:0/2498692852 learned_addr learned my addr 172.21.15.70:0/2498692852 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a37fe640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a4100e20 0x7f73a4199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.846+0000 7f73a3fff640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a4102ef0 0x7f73a41a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.847+0000 7f73a2ffd640 1 -- 172.21.15.70:0/2498692852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a4102ef0 msgr2=0x7f73a41a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.847+0000 7f73a2ffd640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a4102ef0 0x7f73a41a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.847+0000 7f73a2ffd640 1 -- 172.21.15.70:0/2498692852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a4100e20 msgr2=0x7f73a4199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.847+0000 7f73a2ffd640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a4100e20 0x7f73a4199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.847+0000 7f73a2ffd640 1 -- 172.21.15.70:0/2498692852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a41a48f0 con 0x7f73a4102570 2024-09-12T01:51:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.847+0000 7f73a3fff640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a4102ef0 0x7f73a41a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.847+0000 7f73a2ffd640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a4102570 0x7f73a4199870 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f739400c920 tx=0x7f739400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:46.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.847+0000 7f73a0ff9640 1 -- 172.21.15.70:0/2498692852 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394007c70 con 0x7f73a4102570 2024-09-12T01:51:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.847+0000 7f73a0ff9640 1 -- 172.21.15.70:0/2498692852 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7394007e10 con 0x7f73a4102570 2024-09-12T01:51:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.847+0000 7f73a9b74640 1 -- 172.21.15.70:0/2498692852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a41a4ac0 con 0x7f73a4102570 2024-09-12T01:51:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.847+0000 7f73a0ff9640 1 -- 172.21.15.70:0/2498692852 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394018940 con 0x7f73a4102570 2024-09-12T01:51:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.847+0000 7f73a9b74640 1 -- 172.21.15.70:0/2498692852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a41a4fd0 con 0x7f73a4102570 2024-09-12T01:51:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.849+0000 7f73a0ff9640 1 -- 172.21.15.70:0/2498692852 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7394018b20 con 0x7f73a4102570 2024-09-12T01:51:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.849+0000 7f73abf4d740 1 Processor -- start 2024-09-12T01:51:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.849+0000 7f73abf4d740 1 -- start start 2024-09-12T01:51:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73abf4d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 0x55eafc1a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73abf4d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 0x55eafc1b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73abf4d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1b3bb0 0x55eafc1b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73abf4d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eafc10f090 con 0x55eafc1a89d0 2024-09-12T01:51:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73abf4d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55eafc0b6a70 con 0x55eafc1a92f0 2024-09-12T01:51:46.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73abf4d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55eafc10b050 con 0x55eafc1b3bb0 2024-09-12T01:51:46.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a0ff9640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f738c0a2b80 0x7f738c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 0x55eafc1a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 0x55eafc1a8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36504/0 (socket says 172.21.15.70:36504) 2024-09-12T01:51:46.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a3fff640 1 -- 172.21.15.70:0/903585287 learned_addr learned my addr 172.21.15.70:0/903585287 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:46.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a3fff640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f738c0a2b80 0x7f738c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a0ff9640 1 -- 172.21.15.70:0/2498692852 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f73940cf140 con 0x7f73a4102570 2024-09-12T01:51:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a2ffd640 1 --2- 172.21.15.70:0/903585287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1b3bb0 0x55eafc1b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a37fe640 1 --2- 172.21.15.70:0/903585287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 0x55eafc1b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a3fff640 1 -- 172.21.15.70:0/903585287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1b3bb0 msgr2=0x55eafc1b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a3fff640 1 --2- 172.21.15.70:0/903585287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1b3bb0 0x55eafc1b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a3fff640 1 -- 172.21.15.70:0/903585287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 msgr2=0x55eafc1b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a3fff640 1 --2- 172.21.15.70:0/903585287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 0x55eafc1b3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a3fff640 1 -- 172.21.15.70:0/903585287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eafc0c3130 con 0x55eafc1a89d0 2024-09-12T01:51:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a3fff640 1 --2- 172.21.15.70:0/903585287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 0x55eafc1a8db0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f739c006010 tx=0x7f739c02f550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab21961fa7a3204 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f7389ffb640 1 -- 172.21.15.70:0/903585287 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c034070 con 0x55eafc1a89d0 2024-09-12T01:51:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f7389ffb640 1 -- 172.21.15.70:0/903585287 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f739c04d070 con 0x55eafc1a89d0 2024-09-12T01:51:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f7389ffb640 1 -- 172.21.15.70:0/903585287 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c0488b0 con 0x55eafc1a89d0 2024-09-12T01:51:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.850+0000 7f73a3fff640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f738c0a2b80 0x7f738c0a5040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f739c04c000 tx=0x7f739c04a000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.851+0000 7f73abf4d740 1 -- 172.21.15.70:0/903585287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 msgr2=0x55eafc1a8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.851+0000 7f73abf4d740 1 --2- 172.21.15.70:0/903585287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 0x55eafc1a8db0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f739c006010 tx=0x7f739c02f550 comp rx=0 tx=0).stop 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.851+0000 7f73abf4d740 1 -- 172.21.15.70:0/903585287 shutdown_connections 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.851+0000 7f73abf4d740 1 --2- 172.21.15.70:0/903585287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1b3bb0 0x55eafc1b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.851+0000 7f73abf4d740 1 --2- 172.21.15.70:0/903585287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 0x55eafc1b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.851+0000 7f73abf4d740 1 --2- 172.21.15.70:0/903585287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 0x55eafc1a8db0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.851+0000 7f73abf4d740 1 -- 172.21.15.70:0/903585287 >> 172.21.15.70:0/903585287 conn(0x55eafc1a4f60 msgr2=0x55eafc1a5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.851+0000 7f73abf4d740 1 -- 172.21.15.70:0/903585287 shutdown_connections 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.851+0000 7f73abf4d740 1 -- 172.21.15.70:0/903585287 wait complete. 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.851+0000 7f73abf4d740 1 -- start start 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73abf4d740 1 Processor -- start 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73abf4d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a89d0 0x55eafc1b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73abf4d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 0x55eafc1b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73abf4d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 0x55eafc1b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73abf4d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eafc1b6780 con 0x55eafc1b3bb0 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73abf4d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55eafc0c9f20 con 0x55eafc1a92f0 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73abf4d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55eafc1b6900 con 0x55eafc1a89d0 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73abf4d740 10 client.0 _ll_register_callbacks cb 0x55eafc093030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 0x55eafc1b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 0x55eafc1b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36518/0 (socket says 172.21.15.70:36518) 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73a3fff640 1 -- 172.21.15.70:0/1342369085 learned_addr learned my addr 172.21.15.70:0/1342369085 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73a2ffd640 1 --2- 172.21.15.70:0/1342369085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 0x55eafc1b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73a3fff640 1 -- 172.21.15.70:0/1342369085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a89d0 msgr2=0x55eafc1b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73a3fff640 1 --2- 172.21.15.70:0/1342369085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a89d0 0x55eafc1b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73a3fff640 1 -- 172.21.15.70:0/1342369085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 msgr2=0x55eafc1b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73a3fff640 1 --2- 172.21.15.70:0/1342369085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 0x55eafc1b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73a3fff640 1 -- 172.21.15.70:0/1342369085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eafbe802b0 con 0x55eafc1b3bb0 2024-09-12T01:51:46.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f73a3fff640 1 --2- 172.21.15.70:0/1342369085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 0x55eafc1b0d10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f739c048970 tx=0x7f739c048470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327b17c814c0eee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:46.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.852+0000 7f7382ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:46.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f7382ffd640 1 -- 172.21.15.70:0/1342369085 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c034070 con 0x55eafc1b3bb0 2024-09-12T01:51:46.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f7382ffd640 1 -- 172.21.15.70:0/1342369085 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f739c004040 con 0x55eafc1b3bb0 2024-09-12T01:51:46.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f73abf4d740 1 -- 172.21.15.70:0/1342369085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f739c04d070 con 0x55eafc1b3bb0 2024-09-12T01:51:46.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f7382ffd640 1 -- 172.21.15.70:0/1342369085 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f739c004240 con 0x55eafc1b3bb0 2024-09-12T01:51:46.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f73abf4d740 10 client.15255 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:46.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f73abf4d740 1 -- 172.21.15.70:0/1342369085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eafc1b6780 con 0x55eafc1b3bb0 2024-09-12T01:51:46.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f7382ffd640 1 -- 172.21.15.70:0/1342369085 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f739c04d070 con 0x55eafc1b3bb0 2024-09-12T01:51:46.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f7382ffd640 1 -- 172.21.15.70:0/1342369085 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f739c05abd0 con 0x55eafc1b3bb0 2024-09-12T01:51:46.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f73abf4d740 10 client.15255 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:46.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f73abf4d740 10 client.15255 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f73abf4d740 20 client.15255 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f73abf4d740 1 --2- 172.21.15.70:0/1342369085 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55eafc1c41e0 0x55eafc1c5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f73abf4d740 4 client.15255 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f73abf4d740 1 -- 172.21.15.70:0/1342369085 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eafc11c600 con 0x55eafc1c41e0 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.853+0000 7f73a37fe640 1 --2- 172.21.15.70:0/1342369085 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55eafc1c41e0 0x55eafc1c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.854+0000 7f7382ffd640 10 client.15255 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.854+0000 7f73a37fe640 1 --2- 172.21.15.70:0/1342369085 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55eafc1c41e0 0x55eafc1c5650 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e16bb04f445d1d32 server_cookie=8f48cd962c418de0 in_seq=0 out_seq=0 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f7382ffd640 1 -- 172.21.15.70:0/1342369085 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eafc11c600 con 0x55eafc1c41e0 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f7382ffd640 10 client.15255 handle_command_reply: tid=0 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f73abf4d740 1 client.15255 shutdown 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f73abf4d740 1 -- 172.21.15.70:0/1342369085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 msgr2=0x55eafc1b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f73abf4d740 1 --2- 172.21.15.70:0/1342369085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 0x55eafc1b0d10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f739c048970 tx=0x7f739c048470 comp rx=0 tx=0).stop 2024-09-12T01:51:46.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f73abf4d740 1 -- 172.21.15.70:0/1342369085 shutdown_connections 2024-09-12T01:51:46.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f73abf4d740 1 --2- 172.21.15.70:0/1342369085 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55eafc1c41e0 0x55eafc1c5650 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f7382ffd640 0 client.15255 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:51:46.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f73abf4d740 1 --2- 172.21.15.70:0/1342369085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 0x55eafc1b0d10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f73abf4d740 1 --2- 172.21.15.70:0/1342369085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 0x55eafc1b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f73abf4d740 1 --2- 172.21.15.70:0/1342369085 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a89d0 0x55eafc1b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f73abf4d740 1 -- 172.21.15.70:0/1342369085 >> 172.21.15.70:0/1342369085 conn(0x55eafc1a4f60 msgr2=0x55eafc1aac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:46.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f73abf4d740 1 -- 172.21.15.70:0/1342369085 shutdown_connections 2024-09-12T01:51:46.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f73abf4d740 1 -- 172.21.15.70:0/1342369085 wait complete. 2024-09-12T01:51:46.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.855+0000 7f73abf4d740 20 client.15255 trim_cache size 0 max 16384 2024-09-12T01:51:46.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.872+0000 7f73abf4d740 1 Processor -- start 2024-09-12T01:51:46.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.872+0000 7f73abf4d740 1 -- start start 2024-09-12T01:51:46.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73abf4d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 0x55eafc1c5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73abf4d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a92f0 0x55eafc1cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73abf4d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1b3bb0 0x55eafc1ada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73abf4d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eafc1c3990 con 0x55eafc1a89d0 2024-09-12T01:51:46.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73abf4d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55eafc1c4060 con 0x55eafc1b3bb0 2024-09-12T01:51:46.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73abf4d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55eafc1c4730 con 0x55eafc1a92f0 2024-09-12T01:51:46.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73a37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 0x55eafc1c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73a37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 0x55eafc1c5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36528/0 (socket says 172.21.15.70:36528) 2024-09-12T01:51:46.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73a37fe640 1 -- 172.21.15.70:0/1474977015 learned_addr learned my addr 172.21.15.70:0/1474977015 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:46.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73a2ffd640 1 --2- 172.21.15.70:0/1474977015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a92f0 0x55eafc1cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73a37fe640 1 -- 172.21.15.70:0/1474977015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a92f0 msgr2=0x55eafc1cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:46.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73a37fe640 1 --2- 172.21.15.70:0/1474977015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a92f0 0x55eafc1cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73a37fe640 1 -- 172.21.15.70:0/1474977015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1b3bb0 msgr2=0x55eafc1ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:46.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73a3fff640 1 --2- 172.21.15.70:0/1474977015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1b3bb0 0x55eafc1ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73a37fe640 1 --2- 172.21.15.70:0/1474977015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1b3bb0 0x55eafc1ada50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73a37fe640 1 -- 172.21.15.70:0/1474977015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eafc1c4be0 con 0x55eafc1a89d0 2024-09-12T01:51:46.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73a2ffd640 1 --2- 172.21.15.70:0/1474977015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a92f0 0x55eafc1cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73a37fe640 1 --2- 172.21.15.70:0/1474977015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 0x55eafc1c5650 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f739800acb0 tx=0x7f739800a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a057e9c55898f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73897fa640 1 -- 172.21.15.70:0/1474977015 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739801f030 con 0x55eafc1a89d0 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73897fa640 1 -- 172.21.15.70:0/1474977015 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f739800ada0 con 0x55eafc1a89d0 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.873+0000 7f73897fa640 1 -- 172.21.15.70:0/1474977015 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739801b600 con 0x55eafc1a89d0 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.874+0000 7f73abf4d740 1 -- 172.21.15.70:0/1474977015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 msgr2=0x55eafc1c5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.874+0000 7f73abf4d740 1 --2- 172.21.15.70:0/1474977015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 0x55eafc1c5650 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f739800acb0 tx=0x7f739800a490 comp rx=0 tx=0).stop 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.874+0000 7f73abf4d740 1 -- 172.21.15.70:0/1474977015 shutdown_connections 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.874+0000 7f73abf4d740 1 --2- 172.21.15.70:0/1474977015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1b3bb0 0x55eafc1ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.874+0000 7f73abf4d740 1 --2- 172.21.15.70:0/1474977015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a92f0 0x55eafc1cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.874+0000 7f73abf4d740 1 --2- 172.21.15.70:0/1474977015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1a89d0 0x55eafc1c5650 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.874+0000 7f73abf4d740 1 -- 172.21.15.70:0/1474977015 >> 172.21.15.70:0/1474977015 conn(0x55eafc1a4f60 msgr2=0x55eafc1a5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.874+0000 7f73abf4d740 1 -- 172.21.15.70:0/1474977015 shutdown_connections 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.874+0000 7f73abf4d740 1 -- 172.21.15.70:0/1474977015 wait complete. 2024-09-12T01:51:46.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.874+0000 7f73abf4d740 1 -- start start 2024-09-12T01:51:46.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73abf4d740 1 Processor -- start 2024-09-12T01:51:46.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73abf4d740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a89d0 0x55eafc1ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73abf4d740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 0x55eafc1ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73abf4d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 0x55eafc229950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73abf4d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eafc1c54d0 con 0x55eafc1b3bb0 2024-09-12T01:51:46.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73abf4d740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55eafc1c4e00 con 0x55eafc1a92f0 2024-09-12T01:51:46.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73abf4d740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55eafc1c5ba0 con 0x55eafc1a89d0 2024-09-12T01:51:46.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73abf4d740 10 client.0 _ll_register_callbacks cb 0x7f739c02f3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:46.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 0x55eafc229950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 0x55eafc229950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36544/0 (socket says 172.21.15.70:36544) 2024-09-12T01:51:46.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73a3fff640 1 -- 172.21.15.70:0/152189703 learned_addr learned my addr 172.21.15.70:0/152189703 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73a2ffd640 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 0x55eafc1ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73a3fff640 1 -- 172.21.15.70:0/152189703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a89d0 msgr2=0x55eafc1ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73a37fe640 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a89d0 0x55eafc1ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73a3fff640 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a89d0 0x55eafc1ad4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73a3fff640 1 -- 172.21.15.70:0/152189703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 msgr2=0x55eafc1ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73a3fff640 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 0x55eafc1ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73a3fff640 1 -- 172.21.15.70:0/152189703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eafc229ff0 con 0x55eafc1b3bb0 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f73a3fff640 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 0x55eafc229950 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f739c030040 tx=0x7f739c02b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82f6042bbf78a9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.875+0000 7f7382ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f7382ffd640 1 -- 172.21.15.70:0/152189703 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c034040 con 0x55eafc1b3bb0 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f73abf4d740 1 -- 172.21.15.70:0/152189703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f739800ada0 con 0x55eafc1b3bb0 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f7382ffd640 1 -- 172.21.15.70:0/152189703 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f739c0045f0 con 0x55eafc1b3bb0 2024-09-12T01:51:46.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f7382ffd640 1 -- 172.21.15.70:0/152189703 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f739c06f050 con 0x55eafc1b3bb0 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f73abf4d740 10 client.15261 fetch_fsmap learned FSMap version 27 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f73abf4d740 1 -- 172.21.15.70:0/152189703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eafc2324f0 con 0x55eafc1b3bb0 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f7382ffd640 1 -- 172.21.15.70:0/152189703 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f739800ada0 con 0x55eafc1b3bb0 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f7382ffd640 1 -- 172.21.15.70:0/152189703 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f739c05a740 con 0x55eafc1b3bb0 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f73abf4d740 10 client.15261 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f73abf4d740 10 client.15261 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f73abf4d740 20 client.15261 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f73abf4d740 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55eafc1c41e0 0x55eafc235d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f73abf4d740 4 client.15261 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f73abf4d740 1 -- 172.21.15.70:0/152189703 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "status"}) -- 0x55eafc116b10 con 0x55eafc1c41e0 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.876+0000 7f73a37fe640 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55eafc1c41e0 0x55eafc235d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f73a37fe640 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55eafc1c41e0 0x55eafc235d20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0e4c9bc95617ecf server_cookie=d3d81edd5447ae51 in_seq=0 out_seq=0 2024-09-12T01:51:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f7382ffd640 10 client.15261 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f7382ffd640 1 -- 172.21.15.70:0/152189703 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55eafc116b10 con 0x55eafc1c41e0 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f7382ffd640 10 client.15261 handle_command_reply: tid=0 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f73abf4d740 1 client.15261 shutdown 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f73abf4d740 1 -- 172.21.15.70:0/152189703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 msgr2=0x55eafc229950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f73abf4d740 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 0x55eafc229950 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f739c030040 tx=0x7f739c02b050 comp rx=0 tx=0).stop 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f73abf4d740 1 -- 172.21.15.70:0/152189703 shutdown_connections 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f73abf4d740 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55eafc1c41e0 0x55eafc235d20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f73abf4d740 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eafc1b3bb0 0x55eafc229950 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f73abf4d740 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55eafc1a92f0 0x55eafc1ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f73abf4d740 1 --2- 172.21.15.70:0/152189703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eafc1a89d0 0x55eafc1ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f7382ffd640 0 client.15261 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f73abf4d740 1 -- 172.21.15.70:0/152189703 >> 172.21.15.70:0/152189703 conn(0x55eafc1a4f60 msgr2=0x55eafc1aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f73abf4d740 1 -- 172.21.15.70:0/152189703 shutdown_connections 2024-09-12T01:51:46.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.877+0000 7f73abf4d740 1 -- 172.21.15.70:0/152189703 wait complete. 2024-09-12T01:51:46.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73abf4d740 20 client.15261 trim_cache size 0 max 16384 2024-09-12T01:51:46.889 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:51:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:51:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-12T01:51:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24452, 2024-09-12T01:51:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:51:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:51:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:51:46.889 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 108.56591855000001, 2024-09-12T01:51:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-09-12T01:51:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:51:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-12T01:51:46.890 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 119.282654317 2024-09-12T01:51:46.890 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:51:46.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73a9b74640 1 -- 172.21.15.70:0/2498692852 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f738c0a2b80 msgr2=0x7f738c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:46.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73a9b74640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f738c0a2b80 0x7f738c0a5040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f739c04c000 tx=0x7f739c04a000 comp rx=0 tx=0).stop 2024-09-12T01:51:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73a9b74640 1 -- 172.21.15.70:0/2498692852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a4102570 msgr2=0x7f73a4199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73a9b74640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a4102570 0x7f73a4199870 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f739400c920 tx=0x7f739400cde0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73a9b74640 1 -- 172.21.15.70:0/2498692852 shutdown_connections 2024-09-12T01:51:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73a9b74640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f738c0a2b80 0x7f738c0a5040 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73a9b74640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73a4102ef0 0x7f73a41a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73a9b74640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a4102570 0x7f73a4199870 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73a9b74640 1 --2- 172.21.15.70:0/2498692852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73a4100e20 0x7f73a4199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73a9b74640 1 -- 172.21.15.70:0/2498692852 >> 172.21.15.70:0/2498692852 conn(0x7f73a40fc7d0 msgr2=0x7f73a41067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73a9b74640 1 -- 172.21.15.70:0/2498692852 shutdown_connections 2024-09-12T01:51:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:46.878+0000 7f73a9b74640 1 -- 172.21.15.70:0/2498692852 wait complete. 2024-09-12T01:51:46.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:46 smithi191 ceph-mon[35770]: pgmap v325: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:47.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:46 smithi152 ceph-mon[35055]: pgmap v325: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T01:51:47.524 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T01:51:47.535 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T01:51:47.535 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T01:51:47.535 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T01:51:47.535 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T01:51:47.609 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T01:51:47.609 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T01:51:47.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:51:47.609 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-12T01:51:47.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:51:47.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-09-12T01:51:47.694 INFO:teuthology.orchestra.run.smithi070.stderr:Cannot find device "ceph-brx" 2024-09-12T01:51:47.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:51:47.696 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-12T01:51:47.696 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:51:47.696 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:51:47.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T01:51:47.979 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.502+0000 7f403d60c640 1 -- 172.21.15.70:0/3139729119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038106f10 msgr2=0x7f403810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.502+0000 7f403d60c640 1 --2- 172.21.15.70:0/3139729119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038106f10 0x7f403810ea90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4028009900 tx=0x7f402802a410 comp rx=0 tx=0).stop 2024-09-12T01:51:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.502+0000 7f403d60c640 1 -- 172.21.15.70:0/3139729119 shutdown_connections 2024-09-12T01:51:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.502+0000 7f403d60c640 1 --2- 172.21.15.70:0/3139729119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038106f10 0x7f403810ea90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.502+0000 7f403d60c640 1 --2- 172.21.15.70:0/3139729119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4038102790 0x7f40381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.502+0000 7f403d60c640 1 --2- 172.21.15.70:0/3139729119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4038101de0 0x7f40381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.502+0000 7f403d60c640 1 -- 172.21.15.70:0/3139729119 >> 172.21.15.70:0/3139729119 conn(0x7f40380fd8c0 msgr2=0x7f40380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.502+0000 7f403d60c640 1 -- 172.21.15.70:0/3139729119 shutdown_connections 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.502+0000 7f403d60c640 1 -- 172.21.15.70:0/3139729119 wait complete. 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.502+0000 7f403d60c640 1 Processor -- start 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f403d60c640 1 -- start start 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f403d60c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4038101de0 0x7f40381a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f403d60c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038102790 0x7f40381a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f403d60c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4038106f10 0x7f403819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f403d60c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4038112150 con 0x7f4038102790 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f403d60c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4038111fd0 con 0x7f4038101de0 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f403d60c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f40381122d0 con 0x7f4038106f10 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f40367fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038102790 0x7f40381a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f40367fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038102790 0x7f40381a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36568/0 (socket says 172.21.15.70:36568) 2024-09-12T01:51:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f40367fc640 1 -- 172.21.15.70:0/2171255436 learned_addr learned my addr 172.21.15.70:0/2171255436 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f4036ffd640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4038101de0 0x7f40381a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f40377fe640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4038106f10 0x7f403819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f40367fc640 1 -- 172.21.15.70:0/2171255436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4038106f10 msgr2=0x7f403819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f40367fc640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4038106f10 0x7f403819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f40367fc640 1 -- 172.21.15.70:0/2171255436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4038101de0 msgr2=0x7f40381a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f40367fc640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4038101de0 0x7f40381a05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f40367fc640 1 -- 172.21.15.70:0/2171255436 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403819aef0 con 0x7f4038102790 2024-09-12T01:51:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.503+0000 7f40367fc640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038102790 0x7f40381a0af0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f402000b4a0 tx=0x7f402000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.504+0000 7f402ffff640 1 -- 172.21.15.70:0/2171255436 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020014070 con 0x7f4038102790 2024-09-12T01:51:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.504+0000 7f402ffff640 1 -- 172.21.15.70:0/2171255436 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4020010b10 con 0x7f4038102790 2024-09-12T01:51:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.504+0000 7f403d60c640 1 -- 172.21.15.70:0/2171255436 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403819b1e0 con 0x7f4038102790 2024-09-12T01:51:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.504+0000 7f402ffff640 1 -- 172.21.15.70:0/2171255436 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020017d60 con 0x7f4038102790 2024-09-12T01:51:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.504+0000 7f403d60c640 1 -- 172.21.15.70:0/2171255436 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40381a7530 con 0x7f4038102790 2024-09-12T01:51:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.505+0000 7f403d60c640 1 -- 172.21.15.70:0/2171255436 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40381032c0 con 0x7f4038102790 2024-09-12T01:51:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.506+0000 7f402ffff640 1 -- 172.21.15.70:0/2171255436 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4020017070 con 0x7f4038102790 2024-09-12T01:51:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.506+0000 7f402ffff640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f40240a2b80 0x7f40240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.506+0000 7f4036ffd640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f40240a2b80 0x7f40240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.506+0000 7f402ffff640 1 -- 172.21.15.70:0/2171255436 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f40200ce490 con 0x7f4038102790 2024-09-12T01:51:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.507+0000 7f4036ffd640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f40240a2b80 0x7f40240a5040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4030009f20 tx=0x7f40300094f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.511+0000 7f402ffff640 1 -- 172.21.15.70:0/2171255436 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f402009b3f0 con 0x7f4038102790 2024-09-12T01:51:48.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.715+0000 7f403d60c640 1 -- 172.21.15.70:0/2171255436 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f403819bbb0 con 0x7f4038102790 2024-09-12T01:51:48.717 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:48 smithi070 ceph-mon[31177]: pgmap v326: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T01:51:48.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.716+0000 7f402ffff640 1 -- 172.21.15.70:0/2171255436 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f402009acf0 con 0x7f4038102790 2024-09-12T01:51:48.717 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:51:48.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.718+0000 7f403d60c640 1 -- 172.21.15.70:0/2171255436 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f40240a2b80 msgr2=0x7f40240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.718+0000 7f403d60c640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f40240a2b80 0x7f40240a5040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4030009f20 tx=0x7f40300094f0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.718+0000 7f403d60c640 1 -- 172.21.15.70:0/2171255436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038102790 msgr2=0x7f40381a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.718+0000 7f403d60c640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038102790 0x7f40381a0af0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f402000b4a0 tx=0x7f402000b960 comp rx=0 tx=0).stop 2024-09-12T01:51:48.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.718+0000 7f403d60c640 1 -- 172.21.15.70:0/2171255436 shutdown_connections 2024-09-12T01:51:48.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.718+0000 7f403d60c640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f40240a2b80 0x7f40240a5040 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.718+0000 7f403d60c640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4038106f10 0x7f403819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.718+0000 7f403d60c640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038102790 0x7f40381a0af0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.718+0000 7f403d60c640 1 --2- 172.21.15.70:0/2171255436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4038101de0 0x7f40381a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.718+0000 7f403d60c640 1 -- 172.21.15.70:0/2171255436 >> 172.21.15.70:0/2171255436 conn(0x7f40380fd8c0 msgr2=0x7f40380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.718+0000 7f403d60c640 1 -- 172.21.15.70:0/2171255436 shutdown_connections 2024-09-12T01:51:48.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:48.718+0000 7f403d60c640 1 -- 172.21.15.70:0/2171255436 wait complete. 2024-09-12T01:51:48.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:48 smithi191 ceph-mon[35770]: pgmap v326: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T01:51:49.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:48 smithi152 ceph-mon[35055]: pgmap v326: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T01:51:49.342 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:51:49.342 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:51:49.342 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2024-09-12T01:51:49.342 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:51:49.342 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:51:49.342 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:51:49.342 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:51:49.342 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:51:49.342 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:51:49.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:51:49.343 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2024-09-12T01:51:49.359 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:51:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:51:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:51:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:51:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-09-12T01:51:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:51:49.359 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:51:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:51:49.359 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2024-09-12T01:51:49.359 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:51:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:51:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2024-09-12T01:51:49.360 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:51:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:51:49.360 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:51:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:51:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:51:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42236sec preferred_lft 42236sec 2024-09-12T01:51:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link noprefixroute 2024-09-12T01:51:49.360 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:51:49.361 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T01:51:49.361 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:51:49.361 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-12T01:51:49.361 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add name ceph-brx type bridge 2024-09-12T01:51:49.361 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr flush dev ceph-brx 2024-09-12T01:51:49.361 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set ceph-brx up 2024-09-12T01:51:49.361 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T01:51:49.361 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-12T01:51:49.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:51:49.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:51:49.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:51:49.575 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:51:49.600 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-09-12T01:51:49.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:51:49.602 DEBUG:teuthology.orchestra.run.smithi070:> route 2024-09-12T01:51:49.674 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2024-09-12T01:51:49.674 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:51:49.674 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:51:49.674 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:51:49.674 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:51:49.675 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:51:49.675 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-12T01:51:49.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:51:49.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:51:49.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:51:49.675 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-12T01:51:49.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:51:49.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:49 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2171255436' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:51:49.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:49 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2171255436' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:51:49.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:51:49.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:51:49.959 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-12T01:51:49.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:51:49.975 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2024-09-12T01:51:50.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:49 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2171255436' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:51:50.030 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:51:50.030 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-12T01:51:50.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:51:50.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T01:51:50.030 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-12T01:51:50.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:51:50.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:51:50.155 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T01:51:50.155 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:51:50.155 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-12T01:51:50.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T01:51:50.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T01:51:50.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T01:51:50.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T01:51:50.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T01:51:50.156 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-12T01:51:50.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:51:50.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:51:50.285 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:51:50.286 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-12T01:51:50.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2024-09-12T01:51:50.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T01:51:50.286 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-12T01:51:50.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:51:50.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:51:50.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:51:50.363 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:51:50.379 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:51:50.379 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:51:50.380 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:51:50.435 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T01:51:50.435 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T01:51:50.435 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/90465b6d-27c9-4db1-b628-182168bdc951 2024-09-12T01:51:50.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:51:50.435 DEBUG:teuthology.orchestra.run.smithi070:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/90465b6d-27c9-4db1-b628-182168bdc951 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-12T01:51:50.535 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-12T01:51:50.536 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-12T01:51:50.536 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-09-12T01:51:50.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:50 smithi070 ceph-mon[31177]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:50.682 INFO:teuthology.orchestra.run.smithi070.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-12T01:51:50.682 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-12T01:51:50.682 INFO:teuthology.orchestra.run.smithi070.stdout:invalid new device string format 2024-09-12T01:51:50.682 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: resolved to: "172.21.15.70:3300,172.21.15.152:3300,172.21.15.191:3300" 2024-09-12T01:51:50.682 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.70:3300,172.21.15.152:3300,172.21.15.191:3300:/volumes/qa/sv_1/90465b6d-27c9-4db1-b628-182168bdc951 2024-09-12T01:51:50.682 INFO:teuthology.orchestra.run.smithi070.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=2d8cad48-70a8-11ef-bcea-c7b262605968" will pass to kernel 2024-09-12T01:51:50.683 INFO:teuthology.orchestra.run.smithi070.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:51:50.683 INFO:teuthology.orchestra.run.smithi070.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:51:50.683 INFO:teuthology.orchestra.run.smithi070.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:51:50.683 INFO:teuthology.orchestra.run.smithi070.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:51:50.683 INFO:teuthology.orchestra.run.smithi070.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:51:50.685 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:51:50.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:51:50.685 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:51:50.716 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:51:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:51:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:51:50.813 INFO:teuthology.orchestra.run.smithi070.stdout:client24800 2024-09-12T01:51:50.813 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:51:50.813 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:51:50.831 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:51:50.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:51:50.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:51:50.927 INFO:teuthology.orchestra.run.smithi070.stdout:client24800 2024-09-12T01:51:50.928 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:51:50.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:50 smithi191 ceph-mon[35770]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:50.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:51:50.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:51:50.983 INFO:teuthology.orchestra.run.smithi070.stdout:client24800 2024-09-12T01:51:50.983 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968.client24800/status') 2024-09-12T01:51:51.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:50 smithi152 ceph-mon[35055]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T01:51:51.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:51:51.041 INFO:teuthology.orchestra.run.smithi070.stdout:instance: client.24800 (3)172.21.15.70:0/2040127995 2024-09-12T01:51:51.042 INFO:teuthology.orchestra.run.smithi070.stdout:blocklisted: false 2024-09-12T01:51:51.042 INFO:teuthology.orchestra.run.smithi070.stderr:0+1 records in 2024-09-12T01:51:51.042 INFO:teuthology.orchestra.run.smithi070.stderr:0+1 records out 2024-09-12T01:51:51.042 INFO:teuthology.orchestra.run.smithi070.stderr:71 bytes copied, 2.5472e-05 s, 2.8 MB/s 2024-09-12T01:51:51.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:51:51.049 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T01:51:51.060 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T01:51:51.061 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:51:51.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-12T01:51:51.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.162+0000 7fb43f95f640 1 -- 172.21.15.70:0/392745119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb438100a40 msgr2=0x7fb438100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:51.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.162+0000 7fb43f95f640 1 --2- 172.21.15.70:0/392745119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb438100a40 0x7fb438100e40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb428009900 tx=0x7fb42802a410 comp rx=0 tx=0).stop 2024-09-12T01:51:51.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.162+0000 7fb43f95f640 1 -- 172.21.15.70:0/392745119 shutdown_connections 2024-09-12T01:51:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.162+0000 7fb43f95f640 1 --2- 172.21.15.70:0/392745119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4381025f0 0x7fb438108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.162+0000 7fb43f95f640 1 --2- 172.21.15.70:0/392745119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb438101c30 0x7fb4381020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.162+0000 7fb43f95f640 1 --2- 172.21.15.70:0/392745119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb438100a40 0x7fb438100e40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.162+0000 7fb43f95f640 1 -- 172.21.15.70:0/392745119 >> 172.21.15.70:0/392745119 conn(0x7fb4380fc1e0 msgr2=0x7fb4380fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.162+0000 7fb43f95f640 1 -- 172.21.15.70:0/392745119 shutdown_connections 2024-09-12T01:51:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.162+0000 7fb43f95f640 1 -- 172.21.15.70:0/392745119 wait complete. 2024-09-12T01:51:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43f95f640 1 Processor -- start 2024-09-12T01:51:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43f95f640 1 -- start start 2024-09-12T01:51:51.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43f95f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb438100a40 0x7fb438196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:51.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43f95f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb438101c30 0x7fb438197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:51.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43f95f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4381025f0 0x7fb43819e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:51.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43f95f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb43810c820 con 0x7fb438100a40 2024-09-12T01:51:51.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43f95f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb43810c6a0 con 0x7fb4381025f0 2024-09-12T01:51:51.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43f95f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb43810c9a0 con 0x7fb438101c30 2024-09-12T01:51:51.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43d6fb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb438100a40 0x7fb438196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43d6fb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb438100a40 0x7fb438196d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52818/0 (socket says 172.21.15.70:52818) 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43d6fb640 1 -- 172.21.15.70:0/2428309166 learned_addr learned my addr 172.21.15.70:0/2428309166 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43defc640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4381025f0 0x7fb43819e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43cefa640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb438101c30 0x7fb438197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43d6fb640 1 -- 172.21.15.70:0/2428309166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb438101c30 msgr2=0x7fb438197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43d6fb640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb438101c30 0x7fb438197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43d6fb640 1 -- 172.21.15.70:0/2428309166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4381025f0 msgr2=0x7fb43819e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43d6fb640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4381025f0 0x7fb43819e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43d6fb640 1 -- 172.21.15.70:0/2428309166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43819e970 con 0x7fb438100a40 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43cefa640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb438101c30 0x7fb438197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.163+0000 7fb43defc640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4381025f0 0x7fb43819e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.164+0000 7fb43d6fb640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb438100a40 0x7fb438196d50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb428005ab0 tx=0x7fb4280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.164+0000 7fb42e7fc640 1 -- 172.21.15.70:0/2428309166 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42803f030 con 0x7fb438100a40 2024-09-12T01:51:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.164+0000 7fb42e7fc640 1 -- 172.21.15.70:0/2428309166 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb428003d00 con 0x7fb438100a40 2024-09-12T01:51:51.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.164+0000 7fb43f95f640 1 -- 172.21.15.70:0/2428309166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43819ec00 con 0x7fb438100a40 2024-09-12T01:51:51.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.164+0000 7fb42e7fc640 1 -- 172.21.15.70:0/2428309166 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428035070 con 0x7fb438100a40 2024-09-12T01:51:51.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.164+0000 7fb43f95f640 1 -- 172.21.15.70:0/2428309166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43819f140 con 0x7fb438100a40 2024-09-12T01:51:51.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.165+0000 7fb43f95f640 1 -- 172.21.15.70:0/2428309166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb438107d00 con 0x7fb438100a40 2024-09-12T01:51:51.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.166+0000 7fb42e7fc640 1 -- 172.21.15.70:0/2428309166 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb428042030 con 0x7fb438100a40 2024-09-12T01:51:51.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.167+0000 7fb42e7fc640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb4240a2cb0 0x7fb4240a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:51.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.167+0000 7fb43cefa640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb4240a2cb0 0x7fb4240a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:51.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.167+0000 7fb42e7fc640 1 -- 172.21.15.70:0/2428309166 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb4280ef940 con 0x7fb438100a40 2024-09-12T01:51:51.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.167+0000 7fb43cefa640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb4240a2cb0 0x7fb4240a5170 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb438198260 tx=0x7fb434005d90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.174+0000 7fb42e7fc640 1 -- 172.21.15.70:0/2428309166 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb4280bc8a0 con 0x7fb438100a40 2024-09-12T01:51:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.385+0000 7fb43f95f640 1 -- 172.21.15.70:0/2428309166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fb43802d980 con 0x7fb438100a40 2024-09-12T01:51:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.567+0000 7fb42e7fc640 1 -- 172.21.15.70:0/2428309166 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7fb4280bc1a0 con 0x7fb438100a40 2024-09-12T01:51:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.570+0000 7fb43f95f640 1 -- 172.21.15.70:0/2428309166 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb4240a2cb0 msgr2=0x7fb4240a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.570+0000 7fb43f95f640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb4240a2cb0 0x7fb4240a5170 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb438198260 tx=0x7fb434005d90 comp rx=0 tx=0).stop 2024-09-12T01:51:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.570+0000 7fb43f95f640 1 -- 172.21.15.70:0/2428309166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb438100a40 msgr2=0x7fb438196d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.570+0000 7fb43f95f640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb438100a40 0x7fb438196d50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb428005ab0 tx=0x7fb4280042f0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.570+0000 7fb43f95f640 1 -- 172.21.15.70:0/2428309166 shutdown_connections 2024-09-12T01:51:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.570+0000 7fb43f95f640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb4240a2cb0 0x7fb4240a5170 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.570+0000 7fb43f95f640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4381025f0 0x7fb43819e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.570+0000 7fb43f95f640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb438101c30 0x7fb438197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.570+0000 7fb43f95f640 1 --2- 172.21.15.70:0/2428309166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb438100a40 0x7fb438196d50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.570+0000 7fb43f95f640 1 -- 172.21.15.70:0/2428309166 >> 172.21.15.70:0/2428309166 conn(0x7fb4380fc1e0 msgr2=0x7fb438104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.570+0000 7fb43f95f640 1 -- 172.21.15.70:0/2428309166 shutdown_connections 2024-09-12T01:51:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.570+0000 7fb43f95f640 1 -- 172.21.15.70:0/2428309166 wait complete. 2024-09-12T01:51:51.582 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T01:51:51.593 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-12T01:51:51.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:51:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.703+0000 7f247be7b640 1 -- 172.21.15.70:0/389963196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2474101c00 msgr2=0x7f2474102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.703+0000 7f247be7b640 1 --2- 172.21.15.70:0/389963196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2474101c00 0x7f2474102080 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2468009900 tx=0x7f246802a410 comp rx=0 tx=0).stop 2024-09-12T01:51:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.703+0000 7f247be7b640 1 -- 172.21.15.70:0/389963196 shutdown_connections 2024-09-12T01:51:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.703+0000 7f247be7b640 1 --2- 172.21.15.70:0/389963196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24741025c0 0x7f2474108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.703+0000 7f247be7b640 1 --2- 172.21.15.70:0/389963196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2474101c00 0x7f2474102080 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.703+0000 7f247be7b640 1 --2- 172.21.15.70:0/389963196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2474100a10 0x7f2474100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.703+0000 7f247be7b640 1 -- 172.21.15.70:0/389963196 >> 172.21.15.70:0/389963196 conn(0x7f24740fc170 msgr2=0x7f24740fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f247be7b640 1 -- 172.21.15.70:0/389963196 shutdown_connections 2024-09-12T01:51:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f247be7b640 1 -- 172.21.15.70:0/389963196 wait complete. 2024-09-12T01:51:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f247be7b640 1 Processor -- start 2024-09-12T01:51:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f247be7b640 1 -- start start 2024-09-12T01:51:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f247be7b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2474100a10 0x7f2474197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f247be7b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2474101c00 0x7f2474198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f247be7b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24741025c0 0x7f247419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f247be7b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f247410d8f0 con 0x7f2474101c00 2024-09-12T01:51:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f247be7b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f247410d770 con 0x7f24741025c0 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f247be7b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f247410da70 con 0x7f2474100a10 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f2479416640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2474101c00 0x7f2474198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f2479416640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2474101c00 0x7f2474198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52830/0 (socket says 172.21.15.70:52830) 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.704+0000 7f2479416640 1 -- 172.21.15.70:0/1769855006 learned_addr learned my addr 172.21.15.70:0/1769855006 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f247a418640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24741025c0 0x7f247419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f2479416640 1 -- 172.21.15.70:0/1769855006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2474100a10 msgr2=0x7f2474197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f2479c17640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2474100a10 0x7f2474197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f2479416640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2474100a10 0x7f2474197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f2479416640 1 -- 172.21.15.70:0/1769855006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24741025c0 msgr2=0x7f247419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f2479416640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24741025c0 0x7f247419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f2479416640 1 -- 172.21.15.70:0/1769855006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247419fb40 con 0x7f2474101c00 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f247a418640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24741025c0 0x7f247419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f2479416640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2474101c00 0x7f2474198460 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2468009a20 tx=0x7f2468004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f2472ffd640 1 -- 172.21.15.70:0/1769855006 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246803f030 con 0x7f2474101c00 2024-09-12T01:51:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f247be7b640 1 -- 172.21.15.70:0/1769855006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247419fdd0 con 0x7f2474101c00 2024-09-12T01:51:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f2472ffd640 1 -- 172.21.15.70:0/1769855006 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2468003d00 con 0x7f2474101c00 2024-09-12T01:51:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f2472ffd640 1 -- 172.21.15.70:0/1769855006 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468035070 con 0x7f2474101c00 2024-09-12T01:51:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.705+0000 7f247be7b640 1 -- 172.21.15.70:0/1769855006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24741a0230 con 0x7f2474101c00 2024-09-12T01:51:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.706+0000 7f247be7b640 1 -- 172.21.15.70:0/1769855006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2474107db0 con 0x7f2474101c00 2024-09-12T01:51:51.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.707+0000 7f2472ffd640 1 -- 172.21.15.70:0/1769855006 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2468042030 con 0x7f2474101c00 2024-09-12T01:51:51.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.708+0000 7f2472ffd640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f245c0a2b90 0x7f245c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:51.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.708+0000 7f2479c17640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f245c0a2b90 0x7f245c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:51.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.708+0000 7f2472ffd640 1 -- 172.21.15.70:0/1769855006 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f24680efb30 con 0x7f2474101c00 2024-09-12T01:51:51.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.708+0000 7f2479c17640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f245c0a2b90 0x7f245c0a5050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2464005c40 tx=0x7f2464005bd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:51.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.711+0000 7f2472ffd640 1 -- 172.21.15.70:0/1769855006 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24680bca90 con 0x7f2474101c00 2024-09-12T01:51:51.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:51 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2428309166' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T01:51:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.879+0000 7f247be7b640 1 -- 172.21.15.70:0/1769855006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f247402da10 con 0x7f2474101c00 2024-09-12T01:51:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.881+0000 7f2472ffd640 1 -- 172.21.15.70:0/1769855006 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22713 (secure 0 0 0) 0x7f24680bc390 con 0x7f2474101c00 2024-09-12T01:51:51.882 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:51.882 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:50:22.600430+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:49:54.140097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:49:56.005187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:51:51.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.883+0000 7f247be7b640 1 -- 172.21.15.70:0/1769855006 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f245c0a2b90 msgr2=0x7f245c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:51.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.883+0000 7f247be7b640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f245c0a2b90 0x7f245c0a5050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2464005c40 tx=0x7f2464005bd0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.883+0000 7f247be7b640 1 -- 172.21.15.70:0/1769855006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2474101c00 msgr2=0x7f2474198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:51.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.883+0000 7f247be7b640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2474101c00 0x7f2474198460 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2468009a20 tx=0x7f2468004430 comp rx=0 tx=0).stop 2024-09-12T01:51:51.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.883+0000 7f247be7b640 1 -- 172.21.15.70:0/1769855006 shutdown_connections 2024-09-12T01:51:51.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.883+0000 7f247be7b640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f245c0a2b90 0x7f245c0a5050 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.883+0000 7f247be7b640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24741025c0 0x7f247419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.883+0000 7f247be7b640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2474101c00 0x7f2474198460 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.883+0000 7f247be7b640 1 --2- 172.21.15.70:0/1769855006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2474100a10 0x7f2474197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.883+0000 7f247be7b640 1 -- 172.21.15.70:0/1769855006 >> 172.21.15.70:0/1769855006 conn(0x7f24740fc170 msgr2=0x7f2474104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:51.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.883+0000 7f247be7b640 1 -- 172.21.15.70:0/1769855006 shutdown_connections 2024-09-12T01:51:51.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.883+0000 7f247be7b640 1 -- 172.21.15.70:0/1769855006 wait complete. 2024-09-12T01:51:51.895 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:45:33.697735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T01:49:54.140097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T01:49:56.005187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:51:51.895 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:51:51.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:51 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2428309166' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T01:51:51.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.996+0000 7fcad2aba640 1 -- 172.21.15.70:0/1714106638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcacc107810 msgr2=0x7fcacc109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:51.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.996+0000 7fcad2aba640 1 --2- 172.21.15.70:0/1714106638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcacc107810 0x7fcacc109c80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009ca0 tx=0x7fcac402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:51:51.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.996+0000 7fcad2aba640 1 -- 172.21.15.70:0/1714106638 shutdown_connections 2024-09-12T01:51:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.996+0000 7fcad2aba640 1 --2- 172.21.15.70:0/1714106638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcacc107810 0x7fcacc109c80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.996+0000 7fcad2aba640 1 --2- 172.21.15.70:0/1714106638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc104ee0 0x7fcacc1072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.996+0000 7fcad2aba640 1 --2- 172.21.15.70:0/1714106638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcacc1025b0 0x7fcacc1049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.996+0000 7fcad2aba640 1 -- 172.21.15.70:0/1714106638 >> 172.21.15.70:0/1714106638 conn(0x7fcacc0fc1b0 msgr2=0x7fcacc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.996+0000 7fcad2aba640 1 -- 172.21.15.70:0/1714106638 shutdown_connections 2024-09-12T01:51:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.996+0000 7fcad2aba640 1 -- 172.21.15.70:0/1714106638 wait complete. 2024-09-12T01:51:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad2aba640 1 Processor -- start 2024-09-12T01:51:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad2aba640 1 -- start start 2024-09-12T01:51:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad2aba640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc1025b0 0x7fcacc197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad2aba640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcacc104ee0 0x7fcacc1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:52.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad2aba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcacc107810 0x7fcacc19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad2aba640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc10d920 con 0x7fcacc107810 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad2aba640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc10d7a0 con 0x7fcacc1025b0 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad2aba640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc10daa0 con 0x7fcacc104ee0 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad1057640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcacc107810 0x7fcacc19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad1057640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcacc107810 0x7fcacc19f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52844/0 (socket says 172.21.15.70:52844) 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad1057640 1 -- 172.21.15.70:0/1989819625 learned_addr learned my addr 172.21.15.70:0/1989819625 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad0856640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc1025b0 0x7fcacc197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcac3fff640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcacc104ee0 0x7fcacc1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad1057640 1 -- 172.21.15.70:0/1989819625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcacc104ee0 msgr2=0x7fcacc1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad1057640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcacc104ee0 0x7fcacc1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad1057640 1 -- 172.21.15.70:0/1989819625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc1025b0 msgr2=0x7fcacc197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad1057640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc1025b0 0x7fcacc197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad1057640 1 -- 172.21.15.70:0/1989819625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcacc19fbd0 con 0x7fcacc107810 2024-09-12T01:51:52.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad0856640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc1025b0 0x7fcacc197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:52.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.997+0000 7fcad1057640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcacc107810 0x7fcacc19f560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcac4004af0 tx=0x7fcac4031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:52.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.998+0000 7fcac1ffb640 1 -- 172.21.15.70:0/1989819625 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4003c30 con 0x7fcacc107810 2024-09-12T01:51:52.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.998+0000 7fcac1ffb640 1 -- 172.21.15.70:0/1989819625 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcac4003dd0 con 0x7fcacc107810 2024-09-12T01:51:52.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.998+0000 7fcad2aba640 1 -- 172.21.15.70:0/1989819625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcacc19fe60 con 0x7fcacc107810 2024-09-12T01:51:52.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.998+0000 7fcac1ffb640 1 -- 172.21.15.70:0/1989819625 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac402fd50 con 0x7fcacc107810 2024-09-12T01:51:52.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.998+0000 7fcad2aba640 1 -- 172.21.15.70:0/1989819625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcacc1a0320 con 0x7fcacc107810 2024-09-12T01:51:52.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:51.999+0000 7fcad2aba640 1 -- 172.21.15.70:0/1989819625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcacc0fdca0 con 0x7fcacc107810 2024-09-12T01:51:52.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.000+0000 7fcac1ffb640 1 -- 172.21.15.70:0/1989819625 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcac4004b40 con 0x7fcacc107810 2024-09-12T01:51:52.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.001+0000 7fcac1ffb640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcab40a2b90 0x7fcab40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:52.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.001+0000 7fcad0856640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcab40a2b90 0x7fcab40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:52.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.001+0000 7fcac1ffb640 1 -- 172.21.15.70:0/1989819625 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fcac40f04a0 con 0x7fcacc107810 2024-09-12T01:51:52.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.001+0000 7fcad0856640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcab40a2b90 0x7fcab40a5050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcac80058c0 tx=0x7fcac8005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:52.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.004+0000 7fcac1ffb640 1 -- 172.21.15.70:0/1989819625 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcac40bd400 con 0x7fcacc107810 2024-09-12T01:51:52.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:51 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2428309166' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T01:51:52.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.169+0000 7fcad2aba640 1 -- 172.21.15.70:0/1989819625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcacc02da10 con 0x7fcacc107810 2024-09-12T01:51:52.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.170+0000 7fcac1ffb640 1 -- 172.21.15.70:0/1989819625 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) ==== 93+0+10 (secure 0 0 0) 0x7fcac40bcd00 con 0x7fcacc107810 2024-09-12T01:51:52.171 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-12T01:51:52.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.172+0000 7fcad2aba640 1 -- 172.21.15.70:0/1989819625 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcab40a2b90 msgr2=0x7fcab40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.172+0000 7fcad2aba640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcab40a2b90 0x7fcab40a5050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcac80058c0 tx=0x7fcac8005850 comp rx=0 tx=0).stop 2024-09-12T01:51:52.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.172+0000 7fcad2aba640 1 -- 172.21.15.70:0/1989819625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcacc107810 msgr2=0x7fcacc19f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.172+0000 7fcad2aba640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcacc107810 0x7fcacc19f560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcac4004af0 tx=0x7fcac4031ee0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.172+0000 7fcad2aba640 1 -- 172.21.15.70:0/1989819625 shutdown_connections 2024-09-12T01:51:52.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.172+0000 7fcad2aba640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcab40a2b90 0x7fcab40a5050 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.172+0000 7fcad2aba640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcacc107810 0x7fcacc19f560 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.172+0000 7fcad2aba640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcacc104ee0 0x7fcacc1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.172+0000 7fcad2aba640 1 --2- 172.21.15.70:0/1989819625 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcacc1025b0 0x7fcacc197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.172+0000 7fcad2aba640 1 -- 172.21.15.70:0/1989819625 >> 172.21.15.70:0/1989819625 conn(0x7fcacc0fc1b0 msgr2=0x7fcacc102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:52.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.172+0000 7fcad2aba640 1 -- 172.21.15.70:0/1989819625 shutdown_connections 2024-09-12T01:51:52.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.172+0000 7fcad2aba640 1 -- 172.21.15.70:0/1989819625 wait complete. 2024-09-12T01:51:52.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T01:51:52.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.285+0000 7f64262d9640 1 -- 172.21.15.70:0/518501912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6420100a00 msgr2=0x7f6420100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.285+0000 7f64262d9640 1 --2- 172.21.15.70:0/518501912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6420100a00 0x7f6420100e00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6410009900 tx=0x7f641002a410 comp rx=0 tx=0).stop 2024-09-12T01:51:52.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.285+0000 7f64262d9640 1 -- 172.21.15.70:0/518501912 shutdown_connections 2024-09-12T01:51:52.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.285+0000 7f64262d9640 1 --2- 172.21.15.70:0/518501912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64201025b0 0x7f6420108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.285+0000 7f64262d9640 1 --2- 172.21.15.70:0/518501912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6420101bf0 0x7f6420102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.285+0000 7f64262d9640 1 --2- 172.21.15.70:0/518501912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6420100a00 0x7f6420100e00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.285+0000 7f64262d9640 1 -- 172.21.15.70:0/518501912 >> 172.21.15.70:0/518501912 conn(0x7f64200fc140 msgr2=0x7f64200fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:52.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.285+0000 7f64262d9640 1 -- 172.21.15.70:0/518501912 shutdown_connections 2024-09-12T01:51:52.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.285+0000 7f64262d9640 1 -- 172.21.15.70:0/518501912 wait complete. 2024-09-12T01:51:52.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.285+0000 7f64262d9640 1 Processor -- start 2024-09-12T01:51:52.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.285+0000 7f64262d9640 1 -- start start 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f64262d9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6420100a00 0x7f6420197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f64262d9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6420101bf0 0x7f64201984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f64262d9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64201025b0 0x7f642019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f64262d9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f642010d8e0 con 0x7f6420101bf0 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f64262d9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f642010d760 con 0x7f6420100a00 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f64262d9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f642010da60 con 0x7f64201025b0 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6420101bf0 0x7f64201984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6420101bf0 0x7f64201984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52852/0 (socket says 172.21.15.70:52852) 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641f7fe640 1 -- 172.21.15.70:0/1641300551 learned_addr learned my addr 172.21.15.70:0/1641300551 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f6424876640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64201025b0 0x7f642019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641f7fe640 1 -- 172.21.15.70:0/1641300551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64201025b0 msgr2=0x7f642019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641ffff640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6420100a00 0x7f6420197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:52.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641f7fe640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64201025b0 0x7f642019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641f7fe640 1 -- 172.21.15.70:0/1641300551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6420100a00 msgr2=0x7f6420197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641f7fe640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6420100a00 0x7f6420197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641f7fe640 1 -- 172.21.15.70:0/1641300551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642019fb90 con 0x7f6420101bf0 2024-09-12T01:51:52.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f6424876640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64201025b0 0x7f642019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:52.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641f7fe640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6420101bf0 0x7f64201984b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f641400d950 tx=0x7f641400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:52.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641d7fa640 1 -- 172.21.15.70:0/1641300551 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414017030 con 0x7f6420101bf0 2024-09-12T01:51:52.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641d7fa640 1 -- 172.21.15.70:0/1641300551 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6414004020 con 0x7f6420101bf0 2024-09-12T01:51:52.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f64262d9640 1 -- 172.21.15.70:0/1641300551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642019fe80 con 0x7f6420101bf0 2024-09-12T01:51:52.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f641d7fa640 1 -- 172.21.15.70:0/1641300551 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414004a00 con 0x7f6420101bf0 2024-09-12T01:51:52.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.286+0000 7f64262d9640 1 -- 172.21.15.70:0/1641300551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64201a0340 con 0x7f6420101bf0 2024-09-12T01:51:52.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.287+0000 7f64262d9640 1 -- 172.21.15.70:0/1641300551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6420107e90 con 0x7f6420101bf0 2024-09-12T01:51:52.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.288+0000 7f641d7fa640 1 -- 172.21.15.70:0/1641300551 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f64140041d0 con 0x7f6420101bf0 2024-09-12T01:51:52.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.289+0000 7f641d7fa640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64080a2b90 0x7f64080a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:52.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.289+0000 7f641d7fa640 1 -- 172.21.15.70:0/1641300551 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f64140cf180 con 0x7f6420101bf0 2024-09-12T01:51:52.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.289+0000 7f641ffff640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64080a2b90 0x7f64080a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:52.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.290+0000 7f641ffff640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64080a2b90 0x7f64080a5050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f64100316a0 tx=0x7f6410000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:52.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.292+0000 7f641d7fa640 1 -- 172.21.15.70:0/1641300551 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f641409c0e0 con 0x7f6420101bf0 2024-09-12T01:51:52.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.461+0000 7f64262d9640 1 -- 172.21.15.70:0/1641300551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f642002da10 con 0x7f6420101bf0 2024-09-12T01:51:52.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.462+0000 7f641d7fa640 1 -- 172.21.15.70:0/1641300551 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) ==== 104+0+11 (secure 0 0 0) 0x7f641409b9e0 con 0x7f6420101bf0 2024-09-12T01:51:52.463 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-12T01:51:52.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.464+0000 7f64262d9640 1 -- 172.21.15.70:0/1641300551 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64080a2b90 msgr2=0x7f64080a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.464+0000 7f64262d9640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64080a2b90 0x7f64080a5050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f64100316a0 tx=0x7f6410000bc0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.464+0000 7f64262d9640 1 -- 172.21.15.70:0/1641300551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6420101bf0 msgr2=0x7f64201984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.464+0000 7f64262d9640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6420101bf0 0x7f64201984b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f641400d950 tx=0x7f641400de10 comp rx=0 tx=0).stop 2024-09-12T01:51:52.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.464+0000 7f64262d9640 1 -- 172.21.15.70:0/1641300551 shutdown_connections 2024-09-12T01:51:52.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.464+0000 7f64262d9640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f64080a2b90 0x7f64080a5050 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.464+0000 7f64262d9640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64201025b0 0x7f642019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.464+0000 7f64262d9640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6420101bf0 0x7f64201984b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.464+0000 7f64262d9640 1 --2- 172.21.15.70:0/1641300551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6420100a00 0x7f6420197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.464+0000 7f64262d9640 1 -- 172.21.15.70:0/1641300551 >> 172.21.15.70:0/1641300551 conn(0x7f64200fc140 msgr2=0x7f6420105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:52.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.464+0000 7f64262d9640 1 -- 172.21.15.70:0/1641300551 shutdown_connections 2024-09-12T01:51:52.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.464+0000 7f64262d9640 1 -- 172.21.15.70:0/1641300551 wait complete. 2024-09-12T01:51:52.475 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T01:51:52.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.579+0000 7fbb71423640 1 -- 172.21.15.70:0/2735111824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6c101bf0 msgr2=0x7fbb6c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.579+0000 7fbb71423640 1 --2- 172.21.15.70:0/2735111824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6c101bf0 0x7fbb6c102070 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009900 tx=0x7fbb6002a410 comp rx=0 tx=0).stop 2024-09-12T01:51:52.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.579+0000 7fbb71423640 1 -- 172.21.15.70:0/2735111824 shutdown_connections 2024-09-12T01:51:52.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.579+0000 7fbb71423640 1 --2- 172.21.15.70:0/2735111824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb6c1025b0 0x7fbb6c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.579+0000 7fbb71423640 1 --2- 172.21.15.70:0/2735111824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6c101bf0 0x7fbb6c102070 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.579+0000 7fbb71423640 1 --2- 172.21.15.70:0/2735111824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb6c100a00 0x7fbb6c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.579+0000 7fbb71423640 1 -- 172.21.15.70:0/2735111824 >> 172.21.15.70:0/2735111824 conn(0x7fbb6c0fc140 msgr2=0x7fbb6c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:52.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.579+0000 7fbb71423640 1 -- 172.21.15.70:0/2735111824 shutdown_connections 2024-09-12T01:51:52.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.579+0000 7fbb71423640 1 -- 172.21.15.70:0/2735111824 wait complete. 2024-09-12T01:51:52.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb71423640 1 Processor -- start 2024-09-12T01:51:52.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb71423640 1 -- start start 2024-09-12T01:51:52.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb71423640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb6c100a00 0x7fbb6c10b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:52.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb71423640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6c101bf0 0x7fbb6c1099c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb71423640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb6c1025b0 0x7fbb6c109f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb71423640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c10d8e0 con 0x7fbb6c101bf0 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb71423640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c10d760 con 0x7fbb6c1025b0 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb71423640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c10da60 con 0x7fbb6c100a00 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb6a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6c101bf0 0x7fbb6c1099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb6a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6c101bf0 0x7fbb6c1099c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52866/0 (socket says 172.21.15.70:52866) 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb6a7fc640 1 -- 172.21.15.70:0/933061253 learned_addr learned my addr 172.21.15.70:0/933061253 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb6b7fe640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb6c1025b0 0x7fbb6c109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb6affd640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb6c100a00 0x7fbb6c10b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb6a7fc640 1 -- 172.21.15.70:0/933061253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb6c100a00 msgr2=0x7fbb6c10b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb6a7fc640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb6c100a00 0x7fbb6c10b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb6a7fc640 1 -- 172.21.15.70:0/933061253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb6c1025b0 msgr2=0x7fbb6c109f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb6a7fc640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb6c1025b0 0x7fbb6c109f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.580+0000 7fbb6a7fc640 1 -- 172.21.15.70:0/933061253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c10a790 con 0x7fbb6c101bf0 2024-09-12T01:51:52.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.581+0000 7fbb6a7fc640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6c101bf0 0x7fbb6c1099c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009a20 tx=0x7fbb60004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:52.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.581+0000 7fbb53fff640 1 -- 172.21.15.70:0/933061253 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6003f030 con 0x7fbb6c101bf0 2024-09-12T01:51:52.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.581+0000 7fbb53fff640 1 -- 172.21.15.70:0/933061253 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb60003d00 con 0x7fbb6c101bf0 2024-09-12T01:51:52.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.581+0000 7fbb53fff640 1 -- 172.21.15.70:0/933061253 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60035070 con 0x7fbb6c101bf0 2024-09-12T01:51:52.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.581+0000 7fbb71423640 1 -- 172.21.15.70:0/933061253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6c1a1fe0 con 0x7fbb6c101bf0 2024-09-12T01:51:52.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.581+0000 7fbb71423640 1 -- 172.21.15.70:0/933061253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6c1a23f0 con 0x7fbb6c101bf0 2024-09-12T01:51:52.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.582+0000 7fbb71423640 1 -- 172.21.15.70:0/933061253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6c107e40 con 0x7fbb6c101bf0 2024-09-12T01:51:52.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.583+0000 7fbb53fff640 1 -- 172.21.15.70:0/933061253 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbb60042030 con 0x7fbb6c101bf0 2024-09-12T01:51:52.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.584+0000 7fbb53fff640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb540a2b90 0x7fbb540a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:52.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.584+0000 7fbb6affd640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb540a2b90 0x7fbb540a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:52.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.584+0000 7fbb53fff640 1 -- 172.21.15.70:0/933061253 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbb600ef5d0 con 0x7fbb6c101bf0 2024-09-12T01:51:52.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.584+0000 7fbb6affd640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb540a2b90 0x7fbb540a5050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c101a50 tx=0x7fbb5c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:52.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.588+0000 7fbb53fff640 1 -- 172.21.15.70:0/933061253 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb600bbee0 con 0x7fbb6c101bf0 2024-09-12T01:51:52.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.753+0000 7fbb71423640 1 -- 172.21.15.70:0/933061253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbb6c062e90 con 0x7fbb6c101bf0 2024-09-12T01:51:52.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.753+0000 7fbb53fff640 1 -- 172.21.15.70:0/933061253 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) ==== 100+0+11 (secure 0 0 0) 0x7fbb600c01e0 con 0x7fbb6c101bf0 2024-09-12T01:51:52.755 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-12T01:51:52.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.755+0000 7fbb71423640 1 -- 172.21.15.70:0/933061253 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb540a2b90 msgr2=0x7fbb540a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.755+0000 7fbb71423640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb540a2b90 0x7fbb540a5050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c101a50 tx=0x7fbb5c00b390 comp rx=0 tx=0).stop 2024-09-12T01:51:52.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.755+0000 7fbb71423640 1 -- 172.21.15.70:0/933061253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6c101bf0 msgr2=0x7fbb6c1099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:52.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.755+0000 7fbb71423640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6c101bf0 0x7fbb6c1099c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009a20 tx=0x7fbb60004270 comp rx=0 tx=0).stop 2024-09-12T01:51:52.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.755+0000 7fbb71423640 1 -- 172.21.15.70:0/933061253 shutdown_connections 2024-09-12T01:51:52.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.755+0000 7fbb71423640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb540a2b90 0x7fbb540a5050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.755+0000 7fbb71423640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb6c1025b0 0x7fbb6c109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.755+0000 7fbb71423640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb6c101bf0 0x7fbb6c1099c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.755+0000 7fbb71423640 1 --2- 172.21.15.70:0/933061253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb6c100a00 0x7fbb6c10b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:52.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.755+0000 7fbb71423640 1 -- 172.21.15.70:0/933061253 >> 172.21.15.70:0/933061253 conn(0x7fbb6c0fc140 msgr2=0x7fbb6c105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:52.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.756+0000 7fbb71423640 1 -- 172.21.15.70:0/933061253 shutdown_connections 2024-09-12T01:51:52.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:52.756+0000 7fbb71423640 1 -- 172.21.15.70:0/933061253 wait complete. 2024-09-12T01:51:52.766 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:52 smithi070 ceph-mon[31177]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:52.767 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:52 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2428309166' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T01:51:52.767 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:52 smithi070 ceph-mon[31177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:51:52.767 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:52 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1769855006' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:51:52.767 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:52 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1989819625' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:51:52.767 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:52 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1641300551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:51:52.768 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-12T01:51:52.768 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:51:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:52 smithi191 ceph-mon[35770]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:52 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2428309166' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T01:51:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:52 smithi191 ceph-mon[35770]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:51:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:52 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1769855006' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:51:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:52 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1989819625' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:51:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:52 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1641300551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:51:53.011 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:52 smithi152 ceph-mon[35055]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:51:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:52 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2428309166' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T01:51:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:52 smithi152 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:51:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:52 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1769855006' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:51:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:52 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1989819625' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:51:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:52 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1641300551' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:51:53.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.408+0000 7f16d5665640 1 -- 172.21.15.70:0/2185071192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16d0106a60 msgr2=0x7f16d0106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:53.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 --2- 172.21.15.70:0/2185071192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16d0106a60 0x7f16d0106e40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009930 tx=0x7f16c002a420 comp rx=0 tx=0).stop 2024-09-12T01:51:53.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 -- 172.21.15.70:0/2185071192 shutdown_connections 2024-09-12T01:51:53.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 --2- 172.21.15.70:0/2185071192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16d0101400 0x7f16d010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:53.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 --2- 172.21.15.70:0/2185071192 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16d0100a60 0x7f16d0100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:53.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 --2- 172.21.15.70:0/2185071192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16d0106a60 0x7f16d0106e40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:53.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 -- 172.21.15.70:0/2185071192 >> 172.21.15.70:0/2185071192 conn(0x7f16d00fc780 msgr2=0x7f16d00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:53.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 -- 172.21.15.70:0/2185071192 shutdown_connections 2024-09-12T01:51:53.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 -- 172.21.15.70:0/2185071192 wait complete. 2024-09-12T01:51:53.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 Processor -- start 2024-09-12T01:51:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 -- start start 2024-09-12T01:51:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16d0100a60 0x7f16d0199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16d0101400 0x7f16d0199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16d0106a60 0x7f16d01a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f16d0110fe0 con 0x7f16d0106a60 2024-09-12T01:51:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f16d0110e60 con 0x7f16d0101400 2024-09-12T01:51:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.409+0000 7f16d5665640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f16d0111160 con 0x7f16d0100a60 2024-09-12T01:51:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16cf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16d0106a60 0x7f16d01a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16cf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16d0106a60 0x7f16d01a44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52894/0 (socket says 172.21.15.70:52894) 2024-09-12T01:51:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16cf7fe640 1 -- 172.21.15.70:0/956105086 learned_addr learned my addr 172.21.15.70:0/956105086 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16ceffd640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16d0100a60 0x7f16d0199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:53.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16c7fff640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16d0101400 0x7f16d0199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:53.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16cf7fe640 1 -- 172.21.15.70:0/956105086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16d0100a60 msgr2=0x7f16d0199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:53.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16cf7fe640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16d0100a60 0x7f16d0199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:53.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16cf7fe640 1 -- 172.21.15.70:0/956105086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16d0101400 msgr2=0x7f16d0199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:53.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16cf7fe640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16d0101400 0x7f16d0199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:53.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16cf7fe640 1 -- 172.21.15.70:0/956105086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d0197230 con 0x7f16d0106a60 2024-09-12T01:51:53.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16cf7fe640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16d0106a60 0x7f16d01a44c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f16c800b970 tx=0x7f16c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:53.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16ccff9640 1 -- 172.21.15.70:0/956105086 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8019070 con 0x7f16d0106a60 2024-09-12T01:51:53.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16ccff9640 1 -- 172.21.15.70:0/956105086 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f16c800cb40 con 0x7f16d0106a60 2024-09-12T01:51:53.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16ccff9640 1 -- 172.21.15.70:0/956105086 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8007700 con 0x7f16d0106a60 2024-09-12T01:51:53.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16d5665640 1 -- 172.21.15.70:0/956105086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d0197520 con 0x7f16d0106a60 2024-09-12T01:51:53.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.410+0000 7f16d5665640 1 -- 172.21.15.70:0/956105086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d0197a10 con 0x7f16d0106a60 2024-09-12T01:51:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.411+0000 7f16d5665640 1 -- 172.21.15.70:0/956105086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d01021a0 con 0x7f16d0106a60 2024-09-12T01:51:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.413+0000 7f16ccff9640 1 -- 172.21.15.70:0/956105086 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f16c801c070 con 0x7f16d0106a60 2024-09-12T01:51:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.413+0000 7f16ccff9640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f16bc0a2b80 0x7f16bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:53.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.413+0000 7f16ceffd640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f16bc0a2b80 0x7f16bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.413+0000 7f16ccff9640 1 -- 172.21.15.70:0/956105086 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f16c80ceaa0 con 0x7f16d0106a60 2024-09-12T01:51:53.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.414+0000 7f16ceffd640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f16bc0a2b80 0x7f16bc0a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009900 tx=0x7f16c00058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:53.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.417+0000 7f16ccff9640 1 -- 172.21.15.70:0/956105086 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16c809b3b0 con 0x7f16d0106a60 2024-09-12T01:51:53.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.618+0000 7f16d5665640 1 -- 172.21.15.70:0/956105086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16d006ad80 con 0x7f16d0106a60 2024-09-12T01:51:53.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.619+0000 7f16ccff9640 1 -- 172.21.15.70:0/956105086 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f16c809f6b0 con 0x7f16d0106a60 2024-09-12T01:51:53.620 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:53.620 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-12T01:51:51:564560+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:51:51.387340+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24427,24433,24437,24445,24452]},"id":1}]} 2024-09-12T01:51:53.620 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-12T01:51:53.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.621+0000 7f16d5665640 1 -- 172.21.15.70:0/956105086 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f16bc0a2b80 msgr2=0x7f16bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:53.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.621+0000 7f16d5665640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f16bc0a2b80 0x7f16bc0a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009900 tx=0x7f16c00058d0 comp rx=0 tx=0).stop 2024-09-12T01:51:53.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.621+0000 7f16d5665640 1 -- 172.21.15.70:0/956105086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16d0106a60 msgr2=0x7f16d01a44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:53.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.621+0000 7f16d5665640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16d0106a60 0x7f16d01a44c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f16c800b970 tx=0x7f16c800be30 comp rx=0 tx=0).stop 2024-09-12T01:51:53.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.621+0000 7f16d5665640 1 -- 172.21.15.70:0/956105086 shutdown_connections 2024-09-12T01:51:53.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.621+0000 7f16d5665640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f16bc0a2b80 0x7f16bc0a5040 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:53.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.621+0000 7f16d5665640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16d0106a60 0x7f16d01a44c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:53.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.621+0000 7f16d5665640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16d0101400 0x7f16d0199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:53.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.621+0000 7f16d5665640 1 --2- 172.21.15.70:0/956105086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16d0100a60 0x7f16d0199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:53.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.621+0000 7f16d5665640 1 -- 172.21.15.70:0/956105086 >> 172.21.15.70:0/956105086 conn(0x7f16d00fc780 msgr2=0x7f16d00fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:53.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.621+0000 7f16d5665640 1 -- 172.21.15.70:0/956105086 shutdown_connections 2024-09-12T01:51:53.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:53.621+0000 7f16d5665640 1 -- 172.21.15.70:0/956105086 wait complete. 2024-09-12T01:51:53.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:53 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/933061253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:51:53.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:53 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/933061253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:51:54.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:53 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/933061253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:51:54.342 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-12T01:51:54.342 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-12T01:51:54.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:51:54.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.443+0000 7f7954b86640 1 -- 172.21.15.70:0/2881468086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950101c20 msgr2=0x7f79501020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.443+0000 7f7954b86640 1 --2- 172.21.15.70:0/2881468086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950101c20 0x7f79501020a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7938009900 tx=0x7f793802a410 comp rx=0 tx=0).stop 2024-09-12T01:51:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.443+0000 7f7954b86640 1 -- 172.21.15.70:0/2881468086 shutdown_connections 2024-09-12T01:51:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.443+0000 7f7954b86640 1 --2- 172.21.15.70:0/2881468086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79501025e0 0x7f7950108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.443+0000 7f7954b86640 1 --2- 172.21.15.70:0/2881468086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950101c20 0x7f79501020a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.443+0000 7f7954b86640 1 --2- 172.21.15.70:0/2881468086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7950100a30 0x7f7950100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.443+0000 7f7954b86640 1 -- 172.21.15.70:0/2881468086 >> 172.21.15.70:0/2881468086 conn(0x7f79500fc1b0 msgr2=0x7f79500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.443+0000 7f7954b86640 1 -- 172.21.15.70:0/2881468086 shutdown_connections 2024-09-12T01:51:54.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.443+0000 7f7954b86640 1 -- 172.21.15.70:0/2881468086 wait complete. 2024-09-12T01:51:54.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.444+0000 7f7954b86640 1 Processor -- start 2024-09-12T01:51:54.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.444+0000 7f7954b86640 1 -- start start 2024-09-12T01:51:54.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.444+0000 7f7954b86640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7950100a30 0x7f795006af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.444+0000 7f7954b86640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7950101c20 0x7f795019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.444+0000 7f7954b86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79501025e0 0x7f795019f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.444+0000 7f7954b86640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f795010c850 con 0x7f79501025e0 2024-09-12T01:51:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.444+0000 7f7954b86640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f795010c6d0 con 0x7f7950100a30 2024-09-12T01:51:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.444+0000 7f7954b86640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f795010c9d0 con 0x7f7950101c20 2024-09-12T01:51:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.444+0000 7f794ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79501025e0 0x7f795019f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.444+0000 7f794ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79501025e0 0x7f795019f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52914/0 (socket says 172.21.15.70:52914) 2024-09-12T01:51:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.444+0000 7f794ed9d640 1 -- 172.21.15.70:0/2539734166 learned_addr learned my addr 172.21.15.70:0/2539734166 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.444+0000 7f794e59c640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7950100a30 0x7f795006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f794dd9b640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7950101c20 0x7f795019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:54.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f794ed9d640 1 -- 172.21.15.70:0/2539734166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7950101c20 msgr2=0x7f795019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:54.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f794ed9d640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7950101c20 0x7f795019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f794ed9d640 1 -- 172.21.15.70:0/2539734166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7950100a30 msgr2=0x7f795006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:54.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f794ed9d640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7950100a30 0x7f795006af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f794ed9d640 1 -- 172.21.15.70:0/2539734166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795019fbf0 con 0x7f79501025e0 2024-09-12T01:51:54.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f794e59c640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7950100a30 0x7f795006af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:54.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f794dd9b640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7950101c20 0x7f795019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:54.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f794ed9d640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79501025e0 0x7f795019f2e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f794000b970 tx=0x7f794000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:54.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f79477fe640 1 -- 172.21.15.70:0/2539734166 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940019070 con 0x7f79501025e0 2024-09-12T01:51:54.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f79477fe640 1 -- 172.21.15.70:0/2539734166 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f794000cb40 con 0x7f79501025e0 2024-09-12T01:51:54.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f7954b86640 1 -- 172.21.15.70:0/2539734166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795019fe80 con 0x7f79501025e0 2024-09-12T01:51:54.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f79477fe640 1 -- 172.21.15.70:0/2539734166 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940007700 con 0x7f79501025e0 2024-09-12T01:51:54.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.445+0000 7f7954b86640 1 -- 172.21.15.70:0/2539734166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79501a03c0 con 0x7f79501025e0 2024-09-12T01:51:54.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.446+0000 7f7954b86640 1 -- 172.21.15.70:0/2539734166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7950107d70 con 0x7f79501025e0 2024-09-12T01:51:54.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.447+0000 7f79477fe640 1 -- 172.21.15.70:0/2539734166 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f794001c070 con 0x7f79501025e0 2024-09-12T01:51:54.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.448+0000 7f79477fe640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f793c0a2b90 0x7f793c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:54.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.448+0000 7f794e59c640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f793c0a2b90 0x7f793c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:54.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.448+0000 7f79477fe640 1 -- 172.21.15.70:0/2539734166 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f79400ce660 con 0x7f79501025e0 2024-09-12T01:51:54.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.449+0000 7f794e59c640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f793c0a2b90 0x7f793c0a5050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f79480058c0 tx=0x7f7948005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:54.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.452+0000 7f79477fe640 1 -- 172.21.15.70:0/2539734166 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f794009b5c0 con 0x7f79501025e0 2024-09-12T01:51:54.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.623+0000 7f7954b86640 1 -- 172.21.15.70:0/2539734166 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7950062630 con 0x7f793c0a2b90 2024-09-12T01:51:54.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.629+0000 7f79477fe640 1 -- 172.21.15.70:0/2539734166 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258899 (secure 0 0 0) 0x7f7950062630 con 0x7f793c0a2b90 2024-09-12T01:51:54.635 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:54.637 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:51:54.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.632+0000 7f7954b86640 1 -- 172.21.15.70:0/2539734166 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f793c0a2b90 msgr2=0x7f793c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.632+0000 7f7954b86640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f793c0a2b90 0x7f793c0a5050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f79480058c0 tx=0x7f7948005850 comp rx=0 tx=0).stop 2024-09-12T01:51:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.632+0000 7f7954b86640 1 -- 172.21.15.70:0/2539734166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79501025e0 msgr2=0x7f795019f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.632+0000 7f7954b86640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79501025e0 0x7f795019f2e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f794000b970 tx=0x7f794000be30 comp rx=0 tx=0).stop 2024-09-12T01:51:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.632+0000 7f7954b86640 1 -- 172.21.15.70:0/2539734166 shutdown_connections 2024-09-12T01:51:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.632+0000 7f7954b86640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f793c0a2b90 0x7f793c0a5050 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.632+0000 7f7954b86640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79501025e0 0x7f795019f2e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.632+0000 7f7954b86640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7950101c20 0x7f795019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.632+0000 7f7954b86640 1 --2- 172.21.15.70:0/2539734166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7950100a30 0x7f795006af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.632+0000 7f7954b86640 1 -- 172.21.15.70:0/2539734166 >> 172.21.15.70:0/2539734166 conn(0x7f79500fc1b0 msgr2=0x7f7950104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:54.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.632+0000 7f7954b86640 1 -- 172.21.15.70:0/2539734166 shutdown_connections 2024-09-12T01:51:54.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.632+0000 7f7954b86640 1 -- 172.21.15.70:0/2539734166 wait complete. 2024-09-12T01:51:54.644 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-12T01:51:53.499643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661493,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1182,"num_read_kb":715,"num_write":445,"num_write_kb":3091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1231128,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370456,"kb_used_data":12888,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571368,"statfs":{"total":1151940427776,"available":1151561080832,"internally_reserved":0,"allocated":13197312,"data_stored":7230543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":56,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002926"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501869+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:51:21.501869+0000","last_peered":"2024-09-12T01:51:21.501869+0000","last_clean":"2024-09-12T01:51:21.501869+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:51:21.501869+0000","last_undegraded":"2024-09-12T01:51:21.501869+0000","last_fullsized":"2024-09-12T01:51:21.501869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488982+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:51:21.488982+0000","last_peered":"2024-09-12T01:51:21.488982+0000","last_clean":"2024-09-12T01:51:21.488982+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:51:21.488982+0000","last_undegraded":"2024-09-12T01:51:21.488982+0000","last_fullsized":"2024-09-12T01:51:21.488982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501730+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:51:21.501730+0000","last_peered":"2024-09-12T01:51:21.501730+0000","last_clean":"2024-09-12T01:51:21.501730+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:51:21.501730+0000","last_undegraded":"2024-09-12T01:51:21.501730+0000","last_fullsized":"2024-09-12T01:51:21.501730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.472280+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:51:21.472280+0000","last_peered":"2024-09-12T01:51:21.472280+0000","last_clean":"2024-09-12T01:51:21.472280+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:51:21.472280+0000","last_undegraded":"2024-09-12T01:51:21.472280+0000","last_fullsized":"2024-09-12T01:51:21.472280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.472067+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:51:21.472067+0000","last_peered":"2024-09-12T01:51:21.472067+0000","last_clean":"2024-09-12T01:51:21.472067+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:51:21.472067+0000","last_undegraded":"2024-09-12T01:51:21.472067+0000","last_fullsized":"2024-09-12T01:51:21.472067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488486+0000","last_change":"2024-09-12T01:50:22.614193+0000","last_active":"2024-09-12T01:51:21.488486+0000","last_peered":"2024-09-12T01:51:21.488486+0000","last_clean":"2024-09-12T01:51:21.488486+0000","last_became_active":"2024-09-12T01:50:22.613816+0000","last_became_peered":"2024-09-12T01:50:22.613816+0000","last_unstale":"2024-09-12T01:51:21.488486+0000","last_undegraded":"2024-09-12T01:51:21.488486+0000","last_fullsized":"2024-09-12T01:51:21.488486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:29.504176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488037+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:51:21.488037+0000","last_peered":"2024-09-12T01:51:21.488037+0000","last_clean":"2024-09-12T01:51:21.488037+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:51:21.488037+0000","last_undegraded":"2024-09-12T01:51:21.488037+0000","last_fullsized":"2024-09-12T01:51:21.488037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493016+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:51:21.493016+0000","last_peered":"2024-09-12T01:51:21.493016+0000","last_clean":"2024-09-12T01:51:21.493016+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:51:21.493016+0000","last_undegraded":"2024-09-12T01:51:21.493016+0000","last_fullsized":"2024-09-12T01:51:21.493016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.500188+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:51:21.500188+0000","last_peered":"2024-09-12T01:51:21.500188+0000","last_clean":"2024-09-12T01:51:21.500188+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:51:21.500188+0000","last_undegraded":"2024-09-12T01:51:21.500188+0000","last_fullsized":"2024-09-12T01:51:21.500188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.491514+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:51:21.491514+0000","last_peered":"2024-09-12T01:51:21.491514+0000","last_clean":"2024-09-12T01:51:21.491514+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:51:21.491514+0000","last_undegraded":"2024-09-12T01:51:21.491514+0000","last_fullsized":"2024-09-12T01:51:21.491514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.499334+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:51:21.499334+0000","last_peered":"2024-09-12T01:51:21.499334+0000","last_clean":"2024-09-12T01:51:21.499334+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:51:21.499334+0000","last_undegraded":"2024-09-12T01:51:21.499334+0000","last_fullsized":"2024-09-12T01:51:21.499334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.496290+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:51:21.496290+0000","last_peered":"2024-09-12T01:51:21.496290+0000","last_clean":"2024-09-12T01:51:21.496290+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:51:21.496290+0000","last_undegraded":"2024-09-12T01:51:21.496290+0000","last_fullsized":"2024-09-12T01:51:21.496290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493477+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:51:21.493477+0000","last_peered":"2024-09-12T01:51:21.493477+0000","last_clean":"2024-09-12T01:51:21.493477+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:51:21.493477+0000","last_undegraded":"2024-09-12T01:51:21.493477+0000","last_fullsized":"2024-09-12T01:51:21.493477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.492593+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:51:21.492593+0000","last_peered":"2024-09-12T01:51:21.492593+0000","last_clean":"2024-09-12T01:51:21.492593+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:51:21.492593+0000","last_undegraded":"2024-09-12T01:51:21.492593+0000","last_fullsized":"2024-09-12T01:51:21.492593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489877+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:51:21.489877+0000","last_peered":"2024-09-12T01:51:21.489877+0000","last_clean":"2024-09-12T01:51:21.489877+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:51:21.489877+0000","last_undegraded":"2024-09-12T01:51:21.489877+0000","last_fullsized":"2024-09-12T01:51:21.489877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.497951+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:51:21.497951+0000","last_peered":"2024-09-12T01:51:21.497951+0000","last_clean":"2024-09-12T01:51:21.497951+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:51:21.497951+0000","last_undegraded":"2024-09-12T01:51:21.497951+0000","last_fullsized":"2024-09-12T01:51:21.497951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501906+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:51:21.501906+0000","last_peered":"2024-09-12T01:51:21.501906+0000","last_clean":"2024-09-12T01:51:21.501906+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:51:21.501906+0000","last_undegraded":"2024-09-12T01:51:21.501906+0000","last_fullsized":"2024-09-12T01:51:21.501906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.494924+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:51:21.494924+0000","last_peered":"2024-09-12T01:51:21.494924+0000","last_clean":"2024-09-12T01:51:21.494924+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:51:21.494924+0000","last_undegraded":"2024-09-12T01:51:21.494924+0000","last_fullsized":"2024-09-12T01:51:21.494924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484591+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:51:21.484591+0000","last_peered":"2024-09-12T01:51:21.484591+0000","last_clean":"2024-09-12T01:51:21.484591+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:51:21.484591+0000","last_undegraded":"2024-09-12T01:51:21.484591+0000","last_fullsized":"2024-09-12T01:51:21.484591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.478916+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:51:21.478916+0000","last_peered":"2024-09-12T01:51:21.478916+0000","last_clean":"2024-09-12T01:51:21.478916+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:51:21.478916+0000","last_undegraded":"2024-09-12T01:51:21.478916+0000","last_fullsized":"2024-09-12T01:51:21.478916+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.475221+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:51:21.475221+0000","last_peered":"2024-09-12T01:51:21.475221+0000","last_clean":"2024-09-12T01:51:21.475221+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:51:21.475221+0000","last_undegraded":"2024-09-12T01:51:21.475221+0000","last_fullsized":"2024-09-12T01:51:21.475221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.499408+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:51:21.499408+0000","last_peered":"2024-09-12T01:51:21.499408+0000","last_clean":"2024-09-12T01:51:21.499408+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:51:21.499408+0000","last_undegraded":"2024-09-12T01:51:21.499408+0000","last_fullsized":"2024-09-12T01:51:21.499408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.485203+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:51:21.485203+0000","last_peered":"2024-09-12T01:51:21.485203+0000","last_clean":"2024-09-12T01:51:21.485203+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:51:21.485203+0000","last_undegraded":"2024-09-12T01:51:21.485203+0000","last_fullsized":"2024-09-12T01:51:21.485203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.482413+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:51:21.482413+0000","last_peered":"2024-09-12T01:51:21.482413+0000","last_clean":"2024-09-12T01:51:21.482413+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:51:21.482413+0000","last_undegraded":"2024-09-12T01:51:21.482413+0000","last_fullsized":"2024-09-12T01:51:21.482413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484804+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:51:21.484804+0000","last_peered":"2024-09-12T01:51:21.484804+0000","last_clean":"2024-09-12T01:51:21.484804+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:51:21.484804+0000","last_undegraded":"2024-09-12T01:51:21.484804+0000","last_fullsized":"2024-09-12T01:51:21.484804+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493388+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:51:21.493388+0000","last_peered":"2024-09-12T01:51:21.493388+0000","last_clean":"2024-09-12T01:51:21.493388+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:51:21.493388+0000","last_undegraded":"2024-09-12T01:51:21.493388+0000","last_fullsized":"2024-09-12T01:51:21.493388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487787+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:51:21.487787+0000","last_peered":"2024-09-12T01:51:21.487787+0000","last_clean":"2024-09-12T01:51:21.487787+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:51:21.487787+0000","last_undegraded":"2024-09-12T01:51:21.487787+0000","last_fullsized":"2024-09-12T01:51:21.487787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.476227+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:51:21.476227+0000","last_peered":"2024-09-12T01:51:21.476227+0000","last_clean":"2024-09-12T01:51:21.476227+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:51:21.476227+0000","last_undegraded":"2024-09-12T01:51:21.476227+0000","last_fullsized":"2024-09-12T01:51:21.476227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.490901+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:51:21.490901+0000","last_peered":"2024-09-12T01:51:21.490901+0000","last_clean":"2024-09-12T01:51:21.490901+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:51:21.490901+0000","last_undegraded":"2024-09-12T01:51:21.490901+0000","last_fullsized":"2024-09-12T01:51:21.490901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484444+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:51:21.484444+0000","last_peered":"2024-09-12T01:51:21.484444+0000","last_clean":"2024-09-12T01:51:21.484444+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:51:21.484444+0000","last_undegraded":"2024-09-12T01:51:21.484444+0000","last_fullsized":"2024-09-12T01:51:21.484444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486738+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:51:21.486738+0000","last_peered":"2024-09-12T01:51:21.486738+0000","last_clean":"2024-09-12T01:51:21.486738+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:51:21.486738+0000","last_undegraded":"2024-09-12T01:51:21.486738+0000","last_fullsized":"2024-09-12T01:51:21.486738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488158+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:51:21.488158+0000","last_peered":"2024-09-12T01:51:21.488158+0000","last_clean":"2024-09-12T01:51:21.488158+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:51:21.488158+0000","last_undegraded":"2024-09-12T01:51:21.488158+0000","last_fullsized":"2024-09-12T01:51:21.488158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.483006+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:51:21.483006+0000","last_peered":"2024-09-12T01:51:21.483006+0000","last_clean":"2024-09-12T01:51:21.483006+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:51:21.483006+0000","last_undegraded":"2024-09-12T01:51:21.483006+0000","last_fullsized":"2024-09-12T01:51:21.483006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'7","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:48.526886+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:51:48.526886+0000","last_peered":"2024-09-12T01:51:48.526886+0000","last_clean":"2024-09-12T01:51:48.526886+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:51:48.526886+0000","last_undegraded":"2024-09-12T01:51:48.526886+0000","last_fullsized":"2024-09-12T01:51:48.526886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.477519+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:51:21.477519+0000","last_peered":"2024-09-12T01:51:21.477519+0000","last_clean":"2024-09-12T01:51:21.477519+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:51:21.477519+0000","last_undegraded":"2024-09-12T01:51:21.477519+0000","last_fullsized":"2024-09-12T01:51:21.477519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.688704+0000","last_change":"2024-09-12T01:50:22.688704+0000","last_active":"2024-09-12T01:50:22.688704+0000","last_peered":"2024-09-12T01:50:22.688704+0000","last_clean":"2024-09-12T01:50:22.688704+0000","last_became_active":"2024-09-12T01:50:22.682640+0000","last_became_peered":"2024-09-12T01:50:22.682640+0000","last_unstale":"2024-09-12T01:50:22.688704+0000","last_undegraded":"2024-09-12T01:50:22.688704+0000","last_fullsized":"2024-09-12T01:50:22.688704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.731438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614069+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:22.614069+0000","last_peered":"2024-09-12T01:50:22.614069+0000","last_clean":"2024-09-12T01:50:22.614069+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:22.614069+0000","last_undegraded":"2024-09-12T01:50:22.614069+0000","last_fullsized":"2024-09-12T01:50:22.614069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.480595+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:51:21.480595+0000","last_peered":"2024-09-12T01:51:21.480595+0000","last_clean":"2024-09-12T01:51:21.480595+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:51:21.480595+0000","last_undegraded":"2024-09-12T01:51:21.480595+0000","last_fullsized":"2024-09-12T01:51:21.480595+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629145+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:22.629145+0000","last_peered":"2024-09-12T01:50:22.629145+0000","last_clean":"2024-09-12T01:50:22.629145+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:22.629145+0000","last_undegraded":"2024-09-12T01:50:22.629145+0000","last_fullsized":"2024-09-12T01:50:22.629145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.495099+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:51:21.495099+0000","last_peered":"2024-09-12T01:51:21.495099+0000","last_clean":"2024-09-12T01:51:21.495099+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:51:21.495099+0000","last_undegraded":"2024-09-12T01:51:21.495099+0000","last_fullsized":"2024-09-12T01:51:21.495099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":232,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:50.528756+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:51:50.528756+0000","last_peered":"2024-09-12T01:51:50.528756+0000","last_clean":"2024-09-12T01:51:50.528756+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:51:50.528756+0000","last_undegraded":"2024-09-12T01:51:50.528756+0000","last_fullsized":"2024-09-12T01:51:50.528756+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":204,"num_read_kb":204,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.498633+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:51:21.498633+0000","last_peered":"2024-09-12T01:51:21.498633+0000","last_clean":"2024-09-12T01:51:21.498633+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:51:21.498633+0000","last_undegraded":"2024-09-12T01:51:21.498633+0000","last_fullsized":"2024-09-12T01:51:21.498633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613318+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:22.613318+0000","last_peered":"2024-09-12T01:50:22.613318+0000","last_clean":"2024-09-12T01:50:22.613318+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:22.613318+0000","last_undegraded":"2024-09-12T01:50:22.613318+0000","last_fullsized":"2024-09-12T01:50:22.613318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488858+0000","last_change":"2024-09-12T01:50:22.630618+0000","last_active":"2024-09-12T01:51:21.488858+0000","last_peered":"2024-09-12T01:51:21.488858+0000","last_clean":"2024-09-12T01:51:21.488858+0000","last_became_active":"2024-09-12T01:50:22.630327+0000","last_became_peered":"2024-09-12T01:50:22.630327+0000","last_unstale":"2024-09-12T01:51:21.488858+0000","last_undegraded":"2024-09-12T01:51:21.488858+0000","last_fullsized":"2024-09-12T01:51:21.488858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.647257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629439+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:22.629439+0000","last_peered":"2024-09-12T01:50:22.629439+0000","last_clean":"2024-09-12T01:50:22.629439+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:22.629439+0000","last_undegraded":"2024-09-12T01:50:22.629439+0000","last_fullsized":"2024-09-12T01:50:22.629439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501850+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:51:21.501850+0000","last_peered":"2024-09-12T01:51:21.501850+0000","last_clean":"2024-09-12T01:51:21.501850+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:51:21.501850+0000","last_undegraded":"2024-09-12T01:51:21.501850+0000","last_fullsized":"2024-09-12T01:51:21.501850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":290,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:49.811589+0000","last_change":"2024-09-12T01:50:22.696674+0000","last_active":"2024-09-12T01:51:49.811589+0000","last_peered":"2024-09-12T01:51:49.811589+0000","last_clean":"2024-09-12T01:51:49.811589+0000","last_became_active":"2024-09-12T01:50:22.683417+0000","last_became_peered":"2024-09-12T01:50:22.683417+0000","last_unstale":"2024-09-12T01:51:49.811589+0000","last_undegraded":"2024-09-12T01:51:49.811589+0000","last_fullsized":"2024-09-12T01:51:49.811589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:35.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62559,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":164,"num_write":38,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":49603,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486841+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:51:21.486841+0000","last_peered":"2024-09-12T01:51:21.486841+0000","last_clean":"2024-09-12T01:51:21.486841+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:51:21.486841+0000","last_undegraded":"2024-09-12T01:51:21.486841+0000","last_fullsized":"2024-09-12T01:51:21.486841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612213+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:22.612213+0000","last_peered":"2024-09-12T01:50:22.612213+0000","last_clean":"2024-09-12T01:50:22.612213+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:22.612213+0000","last_undegraded":"2024-09-12T01:50:22.612213+0000","last_fullsized":"2024-09-12T01:50:22.612213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.474550+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:51:21.474550+0000","last_peered":"2024-09-12T01:51:21.474550+0000","last_clean":"2024-09-12T01:51:21.474550+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:51:21.474550+0000","last_undegraded":"2024-09-12T01:51:21.474550+0000","last_fullsized":"2024-09-12T01:51:21.474550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629035+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:22.629035+0000","last_peered":"2024-09-12T01:50:22.629035+0000","last_clean":"2024-09-12T01:50:22.629035+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:22.629035+0000","last_undegraded":"2024-09-12T01:50:22.629035+0000","last_fullsized":"2024-09-12T01:50:22.629035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487087+0000","last_change":"2024-09-12T01:50:22.616527+0000","last_active":"2024-09-12T01:51:21.487087+0000","last_peered":"2024-09-12T01:51:21.487087+0000","last_clean":"2024-09-12T01:51:21.487087+0000","last_became_active":"2024-09-12T01:50:22.616150+0000","last_became_peered":"2024-09-12T01:50:22.616150+0000","last_unstale":"2024-09-12T01:51:21.487087+0000","last_undegraded":"2024-09-12T01:51:21.487087+0000","last_fullsized":"2024-09-12T01:51:21.487087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:58.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:50.529030+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:51:50.529030+0000","last_peered":"2024-09-12T01:51:50.529030+0000","last_clean":"2024-09-12T01:51:50.529030+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:51:50.529030+0000","last_undegraded":"2024-09-12T01:51:50.529030+0000","last_fullsized":"2024-09-12T01:51:50.529030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.495898+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:51:21.495898+0000","last_peered":"2024-09-12T01:51:21.495898+0000","last_clean":"2024-09-12T01:51:21.495898+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:51:21.495898+0000","last_undegraded":"2024-09-12T01:51:21.495898+0000","last_fullsized":"2024-09-12T01:51:21.495898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610857+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:22.610857+0000","last_peered":"2024-09-12T01:50:22.610857+0000","last_clean":"2024-09-12T01:50:22.610857+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:22.610857+0000","last_undegraded":"2024-09-12T01:50:22.610857+0000","last_fullsized":"2024-09-12T01:50:22.610857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.482779+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:51:21.482779+0000","last_peered":"2024-09-12T01:51:21.482779+0000","last_clean":"2024-09-12T01:51:21.482779+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:51:21.482779+0000","last_undegraded":"2024-09-12T01:51:21.482779+0000","last_fullsized":"2024-09-12T01:51:21.482779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611513+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:22.611513+0000","last_peered":"2024-09-12T01:50:22.611513+0000","last_clean":"2024-09-12T01:50:22.611513+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:22.611513+0000","last_undegraded":"2024-09-12T01:50:22.611513+0000","last_fullsized":"2024-09-12T01:50:22.611513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486914+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:51:21.486914+0000","last_peered":"2024-09-12T01:51:21.486914+0000","last_clean":"2024-09-12T01:51:21.486914+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:51:21.486914+0000","last_undegraded":"2024-09-12T01:51:21.486914+0000","last_fullsized":"2024-09-12T01:51:21.486914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613947+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:22.613947+0000","last_peered":"2024-09-12T01:50:22.613947+0000","last_clean":"2024-09-12T01:50:22.613947+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:22.613947+0000","last_undegraded":"2024-09-12T01:50:22.613947+0000","last_fullsized":"2024-09-12T01:50:22.613947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484475+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:51:21.484475+0000","last_peered":"2024-09-12T01:51:21.484475+0000","last_clean":"2024-09-12T01:51:21.484475+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:51:21.484475+0000","last_undegraded":"2024-09-12T01:51:21.484475+0000","last_fullsized":"2024-09-12T01:51:21.484475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629587+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:22.629587+0000","last_peered":"2024-09-12T01:50:22.629587+0000","last_clean":"2024-09-12T01:50:22.629587+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:22.629587+0000","last_undegraded":"2024-09-12T01:50:22.629587+0000","last_fullsized":"2024-09-12T01:50:22.629587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489454+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:51:21.489454+0000","last_peered":"2024-09-12T01:51:21.489454+0000","last_clean":"2024-09-12T01:51:21.489454+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:51:21.489454+0000","last_undegraded":"2024-09-12T01:51:21.489454+0000","last_fullsized":"2024-09-12T01:51:21.489454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'8","reported_seq":139,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:51.531892+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:51:51.531892+0000","last_peered":"2024-09-12T01:51:51.531892+0000","last_clean":"2024-09-12T01:51:51.531892+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:51:51.531892+0000","last_undegraded":"2024-09-12T01:51:51.531892+0000","last_fullsized":"2024-09-12T01:51:51.531892+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2012,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.500017+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:51:21.500017+0000","last_peered":"2024-09-12T01:51:21.500017+0000","last_clean":"2024-09-12T01:51:21.500017+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:51:21.500017+0000","last_undegraded":"2024-09-12T01:51:21.500017+0000","last_fullsized":"2024-09-12T01:51:21.500017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":333,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612725+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:50:22.612725+0000","last_peered":"2024-09-12T01:50:22.612725+0000","last_clean":"2024-09-12T01:50:22.612725+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:50:22.612725+0000","last_undegraded":"2024-09-12T01:50:22.612725+0000","last_fullsized":"2024-09-12T01:50:22.612725+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681903+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:22.681903+0000","last_peered":"2024-09-12T01:50:22.681903+0000","last_clean":"2024-09-12T01:50:22.681903+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:22.681903+0000","last_undegraded":"2024-09-12T01:50:22.681903+0000","last_fullsized":"2024-09-12T01:50:22.681903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.498284+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:51:21.498284+0000","last_peered":"2024-09-12T01:51:21.498284+0000","last_clean":"2024-09-12T01:51:21.498284+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:51:21.498284+0000","last_undegraded":"2024-09-12T01:51:21.498284+0000","last_fullsized":"2024-09-12T01:51:21.498284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612642+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:22.612642+0000","last_peered":"2024-09-12T01:50:22.612642+0000","last_clean":"2024-09-12T01:50:22.612642+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:22.612642+0000","last_undegraded":"2024-09-12T01:50:22.612642+0000","last_fullsized":"2024-09-12T01:50:22.612642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.481982+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:51:21.481982+0000","last_peered":"2024-09-12T01:51:21.481982+0000","last_clean":"2024-09-12T01:51:21.481982+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:51:21.481982+0000","last_undegraded":"2024-09-12T01:51:21.481982+0000","last_fullsized":"2024-09-12T01:51:21.481982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":129,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:48.525637+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:51:48.525637+0000","last_peered":"2024-09-12T01:51:48.525637+0000","last_clean":"2024-09-12T01:51:48.525637+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:51:48.525637+0000","last_undegraded":"2024-09-12T01:51:48.525637+0000","last_fullsized":"2024-09-12T01:51:48.525637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.477907+0000","last_change":"2024-09-12T01:50:22.682963+0000","last_active":"2024-09-12T01:51:21.477907+0000","last_peered":"2024-09-12T01:51:21.477907+0000","last_clean":"2024-09-12T01:51:21.477907+0000","last_became_active":"2024-09-12T01:50:22.682611+0000","last_became_peered":"2024-09-12T01:50:22.682611+0000","last_unstale":"2024-09-12T01:51:21.477907+0000","last_undegraded":"2024-09-12T01:51:21.477907+0000","last_fullsized":"2024-09-12T01:51:21.477907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:01.295098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'7","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:47.795359+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:51:47.795359+0000","last_peered":"2024-09-12T01:51:47.795359+0000","last_clean":"2024-09-12T01:51:47.795359+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:51:47.795359+0000","last_undegraded":"2024-09-12T01:51:47.795359+0000","last_fullsized":"2024-09-12T01:51:47.795359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489407+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:51:21.489407+0000","last_peered":"2024-09-12T01:51:21.489407+0000","last_clean":"2024-09-12T01:51:21.489407+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:51:21.489407+0000","last_undegraded":"2024-09-12T01:51:21.489407+0000","last_fullsized":"2024-09-12T01:51:21.489407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.683026+0000","last_change":"2024-09-12T01:50:22.683026+0000","last_active":"2024-09-12T01:50:22.683026+0000","last_peered":"2024-09-12T01:50:22.683026+0000","last_clean":"2024-09-12T01:50:22.683026+0000","last_became_active":"2024-09-12T01:50:22.682461+0000","last_became_peered":"2024-09-12T01:50:22.682461+0000","last_unstale":"2024-09-12T01:50:22.683026+0000","last_undegraded":"2024-09-12T01:50:22.683026+0000","last_fullsized":"2024-09-12T01:50:22.683026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.470081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.490807+0000","last_change":"2024-09-12T01:50:22.618050+0000","last_active":"2024-09-12T01:51:21.490807+0000","last_peered":"2024-09-12T01:51:21.490807+0000","last_clean":"2024-09-12T01:51:21.490807+0000","last_became_active":"2024-09-12T01:50:22.614871+0000","last_became_peered":"2024-09-12T01:50:22.614871+0000","last_unstale":"2024-09-12T01:51:21.490807+0000","last_undegraded":"2024-09-12T01:51:21.490807+0000","last_fullsized":"2024-09-12T01:51:21.490807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:47.652568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611446+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:22.611446+0000","last_peered":"2024-09-12T01:50:22.611446+0000","last_clean":"2024-09-12T01:50:22.611446+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:22.611446+0000","last_undegraded":"2024-09-12T01:50:22.611446+0000","last_fullsized":"2024-09-12T01:50:22.611446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.481782+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:51:21.481782+0000","last_peered":"2024-09-12T01:51:21.481782+0000","last_clean":"2024-09-12T01:51:21.481782+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:51:21.481782+0000","last_undegraded":"2024-09-12T01:51:21.481782+0000","last_fullsized":"2024-09-12T01:51:21.481782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'16","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:22.331135+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:51:22.331135+0000","last_peered":"2024-09-12T01:51:22.331135+0000","last_clean":"2024-09-12T01:51:22.331135+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:51:22.331135+0000","last_undegraded":"2024-09-12T01:51:22.331135+0000","last_fullsized":"2024-09-12T01:51:22.331135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487040+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:51:21.487040+0000","last_peered":"2024-09-12T01:51:21.487040+0000","last_clean":"2024-09-12T01:51:21.487040+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:51:21.487040+0000","last_undegraded":"2024-09-12T01:51:21.487040+0000","last_fullsized":"2024-09-12T01:51:21.487040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681518+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:22.681518+0000","last_peered":"2024-09-12T01:50:22.681518+0000","last_clean":"2024-09-12T01:50:22.681518+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:22.681518+0000","last_undegraded":"2024-09-12T01:50:22.681518+0000","last_fullsized":"2024-09-12T01:50:22.681518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489524+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:51:21.489524+0000","last_peered":"2024-09-12T01:51:21.489524+0000","last_clean":"2024-09-12T01:51:21.489524+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:51:21.489524+0000","last_undegraded":"2024-09-12T01:51:21.489524+0000","last_fullsized":"2024-09-12T01:51:21.489524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611066+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:22.611066+0000","last_peered":"2024-09-12T01:50:22.611066+0000","last_clean":"2024-09-12T01:50:22.611066+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:22.611066+0000","last_undegraded":"2024-09-12T01:50:22.611066+0000","last_fullsized":"2024-09-12T01:50:22.611066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.451681+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:51:21.451681+0000","last_peered":"2024-09-12T01:51:21.451681+0000","last_clean":"2024-09-12T01:51:21.451681+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:51:21.451681+0000","last_undegraded":"2024-09-12T01:51:21.451681+0000","last_fullsized":"2024-09-12T01:51:21.451681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613860+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:22.613860+0000","last_peered":"2024-09-12T01:50:22.613860+0000","last_clean":"2024-09-12T01:50:22.613860+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:22.613860+0000","last_undegraded":"2024-09-12T01:50:22.613860+0000","last_fullsized":"2024-09-12T01:50:22.613860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484300+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:51:21.484300+0000","last_peered":"2024-09-12T01:51:21.484300+0000","last_clean":"2024-09-12T01:51:21.484300+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:51:21.484300+0000","last_undegraded":"2024-09-12T01:51:21.484300+0000","last_fullsized":"2024-09-12T01:51:21.484300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612140+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:22.612140+0000","last_peered":"2024-09-12T01:50:22.612140+0000","last_clean":"2024-09-12T01:50:22.612140+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:22.612140+0000","last_undegraded":"2024-09-12T01:50:22.612140+0000","last_fullsized":"2024-09-12T01:50:22.612140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493228+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:51:21.493228+0000","last_peered":"2024-09-12T01:51:21.493228+0000","last_clean":"2024-09-12T01:51:21.493228+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:51:21.493228+0000","last_undegraded":"2024-09-12T01:51:21.493228+0000","last_fullsized":"2024-09-12T01:51:21.493228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611281+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:22.611281+0000","last_peered":"2024-09-12T01:50:22.611281+0000","last_clean":"2024-09-12T01:50:22.611281+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:22.611281+0000","last_undegraded":"2024-09-12T01:50:22.611281+0000","last_fullsized":"2024-09-12T01:50:22.611281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501783+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:51:21.501783+0000","last_peered":"2024-09-12T01:51:21.501783+0000","last_clean":"2024-09-12T01:51:21.501783+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:51:21.501783+0000","last_undegraded":"2024-09-12T01:51:21.501783+0000","last_fullsized":"2024-09-12T01:51:21.501783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.497079+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:51:21.497079+0000","last_peered":"2024-09-12T01:51:21.497079+0000","last_clean":"2024-09-12T01:51:21.497079+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:51:21.497079+0000","last_undegraded":"2024-09-12T01:51:21.497079+0000","last_fullsized":"2024-09-12T01:51:21.497079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611510+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:22.611510+0000","last_peered":"2024-09-12T01:50:22.611510+0000","last_clean":"2024-09-12T01:50:22.611510+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:22.611510+0000","last_undegraded":"2024-09-12T01:50:22.611510+0000","last_fullsized":"2024-09-12T01:50:22.611510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501244+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:51:21.501244+0000","last_peered":"2024-09-12T01:51:21.501244+0000","last_clean":"2024-09-12T01:51:21.501244+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:51:21.501244+0000","last_undegraded":"2024-09-12T01:51:21.501244+0000","last_fullsized":"2024-09-12T01:51:21.501244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611302+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:22.611302+0000","last_peered":"2024-09-12T01:50:22.611302+0000","last_clean":"2024-09-12T01:50:22.611302+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:22.611302+0000","last_undegraded":"2024-09-12T01:50:22.611302+0000","last_fullsized":"2024-09-12T01:50:22.611302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.502276+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:51:21.502276+0000","last_peered":"2024-09-12T01:51:21.502276+0000","last_clean":"2024-09-12T01:51:21.502276+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:51:21.502276+0000","last_undegraded":"2024-09-12T01:51:21.502276+0000","last_fullsized":"2024-09-12T01:51:21.502276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614331+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:50:22.614331+0000","last_peered":"2024-09-12T01:50:22.614331+0000","last_clean":"2024-09-12T01:50:22.614331+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:50:22.614331+0000","last_undegraded":"2024-09-12T01:50:22.614331+0000","last_fullsized":"2024-09-12T01:50:22.614331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487761+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:51:21.487761+0000","last_peered":"2024-09-12T01:51:21.487761+0000","last_clean":"2024-09-12T01:51:21.487761+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:51:21.487761+0000","last_undegraded":"2024-09-12T01:51:21.487761+0000","last_fullsized":"2024-09-12T01:51:21.487761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:50.798713+0000","last_change":"2024-09-12T01:50:22.691988+0000","last_active":"2024-09-12T01:51:50.798713+0000","last_peered":"2024-09-12T01:51:50.798713+0000","last_clean":"2024-09-12T01:51:50.798713+0000","last_became_active":"2024-09-12T01:50:22.682676+0000","last_became_peered":"2024-09-12T01:50:22.682676+0000","last_unstale":"2024-09-12T01:51:50.798713+0000","last_undegraded":"2024-09-12T01:51:50.798713+0000","last_fullsized":"2024-09-12T01:51:50.798713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:56.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70891,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1056,"num_read_kb":606,"num_write":262,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":50275,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":212673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547236,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776168,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32764,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712388,"statfs":{"total":95995035648,"available":95961485312,"internally_reserved":0,"allocated":1617920,"data_stored":1091952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939694,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":438411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1031195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528380,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":438545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1544192,"data_stored":1031011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":500739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":440520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":502017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":440192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:51:54.648 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:51:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.783+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/683653163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e981036e0 msgr2=0x7f6e98109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.783+0000 7f6e9cc0e640 1 --2- 172.21.15.70:0/683653163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e981036e0 0x7f6e98109f70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009ca0 tx=0x7f6e9002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.784+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/683653163 shutdown_connections 2024-09-12T01:51:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.784+0000 7f6e9cc0e640 1 --2- 172.21.15.70:0/683653163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e981036e0 0x7f6e98109f70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.784+0000 7f6e9cc0e640 1 --2- 172.21.15.70:0/683653163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e98102d20 0x7f6e981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.784+0000 7f6e9cc0e640 1 --2- 172.21.15.70:0/683653163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e98101b30 0x7f6e98101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.784+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/683653163 >> 172.21.15.70:0/683653163 conn(0x7f6e980fd2b0 msgr2=0x7f6e980ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.784+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/683653163 shutdown_connections 2024-09-12T01:51:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.784+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/683653163 wait complete. 2024-09-12T01:51:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.784+0000 7f6e9cc0e640 1 Processor -- start 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.784+0000 7f6e9cc0e640 1 -- start start 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.784+0000 7f6e9cc0e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e98101b30 0x7f6e98197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e9cc0e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e98102d20 0x7f6e98198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e9cc0e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e981036e0 0x7f6e9819f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e9cc0e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9810d910 con 0x7f6e981036e0 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e9cc0e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9810d790 con 0x7f6e98101b30 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e9cc0e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9810da90 con 0x7f6e98102d20 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e96d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e981036e0 0x7f6e9819f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e96d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e981036e0 0x7f6e9819f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52922/0 (socket says 172.21.15.70:52922) 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e96d9d640 1 -- 172.21.15.70:0/1546707835 learned_addr learned my addr 172.21.15.70:0/1546707835 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e95d9b640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e98102d20 0x7f6e98198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e9659c640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e98101b30 0x7f6e98197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e96d9d640 1 -- 172.21.15.70:0/1546707835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e98102d20 msgr2=0x7f6e98198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e96d9d640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e98102d20 0x7f6e98198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e96d9d640 1 -- 172.21.15.70:0/1546707835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e98101b30 msgr2=0x7f6e98197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e96d9d640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e98101b30 0x7f6e98197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e96d9d640 1 -- 172.21.15.70:0/1546707835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9819fa40 con 0x7f6e981036e0 2024-09-12T01:51:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e9659c640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e98101b30 0x7f6e98197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e95d9b640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e98102d20 0x7f6e98198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e96d9d640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e981036e0 0x7f6e9819f3d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009dc0 tx=0x7f6e9002f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e8f7fe640 1 -- 172.21.15.70:0/1546707835 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9002fe40 con 0x7f6e981036e0 2024-09-12T01:51:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/1546707835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9819fcd0 con 0x7f6e981036e0 2024-09-12T01:51:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e8f7fe640 1 -- 172.21.15.70:0/1546707835 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e90030ac0 con 0x7f6e981036e0 2024-09-12T01:51:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e8f7fe640 1 -- 172.21.15.70:0/1546707835 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90046bb0 con 0x7f6e981036e0 2024-09-12T01:51:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.785+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/1546707835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e981a0210 con 0x7f6e981036e0 2024-09-12T01:51:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.786+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/1546707835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e98108df0 con 0x7f6e981036e0 2024-09-12T01:51:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.788+0000 7f6e8f7fe640 1 -- 172.21.15.70:0/1546707835 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6e90030c70 con 0x7f6e981036e0 2024-09-12T01:51:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.788+0000 7f6e8f7fe640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6e840a2b90 0x7f6e840a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.788+0000 7f6e9659c640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6e840a2b90 0x7f6e840a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.788+0000 7f6e8f7fe640 1 -- 172.21.15.70:0/1546707835 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6e900f07f0 con 0x7f6e981036e0 2024-09-12T01:51:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.789+0000 7f6e9659c640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6e840a2b90 0x7f6e840a5050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e800058c0 tx=0x7f6e80005ec0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.793+0000 7f6e8f7fe640 1 -- 172.21.15.70:0/1546707835 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e900bd750 con 0x7f6e981036e0 2024-09-12T01:51:54.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:54 smithi191 ceph-mon[35770]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T01:51:54.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:54 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/956105086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:54.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.959+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/1546707835 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e98062630 con 0x7f6e840a2b90 2024-09-12T01:51:54.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.965+0000 7f6e8f7fe640 1 -- 172.21.15.70:0/1546707835 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258899 (secure 0 0 0) 0x7f6e98062630 con 0x7f6e840a2b90 2024-09-12T01:51:54.968 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:54.969 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:51:54.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.968+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/1546707835 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6e840a2b90 msgr2=0x7f6e840a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:54.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.968+0000 7f6e9cc0e640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6e840a2b90 0x7f6e840a5050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e800058c0 tx=0x7f6e80005ec0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.968+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/1546707835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e981036e0 msgr2=0x7f6e9819f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:54.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.968+0000 7f6e9cc0e640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e981036e0 0x7f6e9819f3d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009dc0 tx=0x7f6e9002f840 comp rx=0 tx=0).stop 2024-09-12T01:51:54.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.968+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/1546707835 shutdown_connections 2024-09-12T01:51:54.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.968+0000 7f6e9cc0e640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6e840a2b90 0x7f6e840a5050 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.968+0000 7f6e9cc0e640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e981036e0 0x7f6e9819f3d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.968+0000 7f6e9cc0e640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e98102d20 0x7f6e98198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.968+0000 7f6e9cc0e640 1 --2- 172.21.15.70:0/1546707835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e98101b30 0x7f6e98197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:54.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.968+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/1546707835 >> 172.21.15.70:0/1546707835 conn(0x7f6e980fd2b0 msgr2=0x7f6e98105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:54.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.968+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/1546707835 shutdown_connections 2024-09-12T01:51:54.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:54.968+0000 7f6e9cc0e640 1 -- 172.21.15.70:0/1546707835 wait complete. 2024-09-12T01:51:54.978 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:54 smithi070 ceph-mon[31177]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T01:51:54.978 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:54 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/956105086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:54.979 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-12T01:51:53.499643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661493,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1182,"num_read_kb":715,"num_write":445,"num_write_kb":3091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1231128,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370456,"kb_used_data":12888,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571368,"statfs":{"total":1151940427776,"available":1151561080832,"internally_reserved":0,"allocated":13197312,"data_stored":7230543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":56,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002926"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501869+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:51:21.501869+0000","last_peered":"2024-09-12T01:51:21.501869+0000","last_clean":"2024-09-12T01:51:21.501869+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:51:21.501869+0000","last_undegraded":"2024-09-12T01:51:21.501869+0000","last_fullsized":"2024-09-12T01:51:21.501869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488982+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:51:21.488982+0000","last_peered":"2024-09-12T01:51:21.488982+0000","last_clean":"2024-09-12T01:51:21.488982+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:51:21.488982+0000","last_undegraded":"2024-09-12T01:51:21.488982+0000","last_fullsized":"2024-09-12T01:51:21.488982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501730+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:51:21.501730+0000","last_peered":"2024-09-12T01:51:21.501730+0000","last_clean":"2024-09-12T01:51:21.501730+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:51:21.501730+0000","last_undegraded":"2024-09-12T01:51:21.501730+0000","last_fullsized":"2024-09-12T01:51:21.501730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.472280+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:51:21.472280+0000","last_peered":"2024-09-12T01:51:21.472280+0000","last_clean":"2024-09-12T01:51:21.472280+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:51:21.472280+0000","last_undegraded":"2024-09-12T01:51:21.472280+0000","last_fullsized":"2024-09-12T01:51:21.472280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.472067+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:51:21.472067+0000","last_peered":"2024-09-12T01:51:21.472067+0000","last_clean":"2024-09-12T01:51:21.472067+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:51:21.472067+0000","last_undegraded":"2024-09-12T01:51:21.472067+0000","last_fullsized":"2024-09-12T01:51:21.472067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488486+0000","last_change":"2024-09-12T01:50:22.614193+0000","last_active":"2024-09-12T01:51:21.488486+0000","last_peered":"2024-09-12T01:51:21.488486+0000","last_clean":"2024-09-12T01:51:21.488486+0000","last_became_active":"2024-09-12T01:50:22.613816+0000","last_became_peered":"2024-09-12T01:50:22.613816+0000","last_unstale":"2024-09-12T01:51:21.488486+0000","last_undegraded":"2024-09-12T01:51:21.488486+0000","last_fullsized":"2024-09-12T01:51:21.488486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:29.504176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488037+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:51:21.488037+0000","last_peered":"2024-09-12T01:51:21.488037+0000","last_clean":"2024-09-12T01:51:21.488037+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:51:21.488037+0000","last_undegraded":"2024-09-12T01:51:21.488037+0000","last_fullsized":"2024-09-12T01:51:21.488037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493016+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:51:21.493016+0000","last_peered":"2024-09-12T01:51:21.493016+0000","last_clean":"2024-09-12T01:51:21.493016+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:51:21.493016+0000","last_undegraded":"2024-09-12T01:51:21.493016+0000","last_fullsized":"2024-09-12T01:51:21.493016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.500188+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:51:21.500188+0000","last_peered":"2024-09-12T01:51:21.500188+0000","last_clean":"2024-09-12T01:51:21.500188+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:51:21.500188+0000","last_undegraded":"2024-09-12T01:51:21.500188+0000","last_fullsized":"2024-09-12T01:51:21.500188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.491514+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:51:21.491514+0000","last_peered":"2024-09-12T01:51:21.491514+0000","last_clean":"2024-09-12T01:51:21.491514+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:51:21.491514+0000","last_undegraded":"2024-09-12T01:51:21.491514+0000","last_fullsized":"2024-09-12T01:51:21.491514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.499334+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:51:21.499334+0000","last_peered":"2024-09-12T01:51:21.499334+0000","last_clean":"2024-09-12T01:51:21.499334+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:51:21.499334+0000","last_undegraded":"2024-09-12T01:51:21.499334+0000","last_fullsized":"2024-09-12T01:51:21.499334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.496290+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:51:21.496290+0000","last_peered":"2024-09-12T01:51:21.496290+0000","last_clean":"2024-09-12T01:51:21.496290+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:51:21.496290+0000","last_undegraded":"2024-09-12T01:51:21.496290+0000","last_fullsized":"2024-09-12T01:51:21.496290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493477+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:51:21.493477+0000","last_peered":"2024-09-12T01:51:21.493477+0000","last_clean":"2024-09-12T01:51:21.493477+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:51:21.493477+0000","last_undegraded":"2024-09-12T01:51:21.493477+0000","last_fullsized":"2024-09-12T01:51:21.493477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.492593+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:51:21.492593+0000","last_peered":"2024-09-12T01:51:21.492593+0000","last_clean":"2024-09-12T01:51:21.492593+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:51:21.492593+0000","last_undegraded":"2024-09-12T01:51:21.492593+0000","last_fullsized":"2024-09-12T01:51:21.492593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489877+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:51:21.489877+0000","last_peered":"2024-09-12T01:51:21.489877+0000","last_clean":"2024-09-12T01:51:21.489877+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:51:21.489877+0000","last_undegraded":"2024-09-12T01:51:21.489877+0000","last_fullsized":"2024-09-12T01:51:21.489877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.497951+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:51:21.497951+0000","last_peered":"2024-09-12T01:51:21.497951+0000","last_clean":"2024-09-12T01:51:21.497951+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:51:21.497951+0000","last_undegraded":"2024-09-12T01:51:21.497951+0000","last_fullsized":"2024-09-12T01:51:21.497951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501906+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:51:21.501906+0000","last_peered":"2024-09-12T01:51:21.501906+0000","last_clean":"2024-09-12T01:51:21.501906+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:51:21.501906+0000","last_undegraded":"2024-09-12T01:51:21.501906+0000","last_fullsized":"2024-09-12T01:51:21.501906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.494924+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:51:21.494924+0000","last_peered":"2024-09-12T01:51:21.494924+0000","last_clean":"2024-09-12T01:51:21.494924+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:51:21.494924+0000","last_undegraded":"2024-09-12T01:51:21.494924+0000","last_fullsized":"2024-09-12T01:51:21.494924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484591+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:51:21.484591+0000","last_peered":"2024-09-12T01:51:21.484591+0000","last_clean":"2024-09-12T01:51:21.484591+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:51:21.484591+0000","last_undegraded":"2024-09-12T01:51:21.484591+0000","last_fullsized":"2024-09-12T01:51:21.484591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.478916+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:51:21.478916+0000","last_peered":"2024-09-12T01:51:21.478916+0000","last_clean":"2024-09-12T01:51:21.478916+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:51:21.478916+0000","last_undegraded":"2024-09-12T01:51:21.478916+0000","last_fullsized":"2024-09-12T01:51:21.478916+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.475221+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:51:21.475221+0000","last_peered":"2024-09-12T01:51:21.475221+0000","last_clean":"2024-09-12T01:51:21.475221+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:51:21.475221+0000","last_undegraded":"2024-09-12T01:51:21.475221+0000","last_fullsized":"2024-09-12T01:51:21.475221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.499408+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:51:21.499408+0000","last_peered":"2024-09-12T01:51:21.499408+0000","last_clean":"2024-09-12T01:51:21.499408+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:51:21.499408+0000","last_undegraded":"2024-09-12T01:51:21.499408+0000","last_fullsized":"2024-09-12T01:51:21.499408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.485203+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:51:21.485203+0000","last_peered":"2024-09-12T01:51:21.485203+0000","last_clean":"2024-09-12T01:51:21.485203+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:51:21.485203+0000","last_undegraded":"2024-09-12T01:51:21.485203+0000","last_fullsized":"2024-09-12T01:51:21.485203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.482413+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:51:21.482413+0000","last_peered":"2024-09-12T01:51:21.482413+0000","last_clean":"2024-09-12T01:51:21.482413+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:51:21.482413+0000","last_undegraded":"2024-09-12T01:51:21.482413+0000","last_fullsized":"2024-09-12T01:51:21.482413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484804+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:51:21.484804+0000","last_peered":"2024-09-12T01:51:21.484804+0000","last_clean":"2024-09-12T01:51:21.484804+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:51:21.484804+0000","last_undegraded":"2024-09-12T01:51:21.484804+0000","last_fullsized":"2024-09-12T01:51:21.484804+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493388+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:51:21.493388+0000","last_peered":"2024-09-12T01:51:21.493388+0000","last_clean":"2024-09-12T01:51:21.493388+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:51:21.493388+0000","last_undegraded":"2024-09-12T01:51:21.493388+0000","last_fullsized":"2024-09-12T01:51:21.493388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487787+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:51:21.487787+0000","last_peered":"2024-09-12T01:51:21.487787+0000","last_clean":"2024-09-12T01:51:21.487787+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:51:21.487787+0000","last_undegraded":"2024-09-12T01:51:21.487787+0000","last_fullsized":"2024-09-12T01:51:21.487787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.476227+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:51:21.476227+0000","last_peered":"2024-09-12T01:51:21.476227+0000","last_clean":"2024-09-12T01:51:21.476227+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:51:21.476227+0000","last_undegraded":"2024-09-12T01:51:21.476227+0000","last_fullsized":"2024-09-12T01:51:21.476227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.490901+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:51:21.490901+0000","last_peered":"2024-09-12T01:51:21.490901+0000","last_clean":"2024-09-12T01:51:21.490901+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:51:21.490901+0000","last_undegraded":"2024-09-12T01:51:21.490901+0000","last_fullsized":"2024-09-12T01:51:21.490901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484444+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:51:21.484444+0000","last_peered":"2024-09-12T01:51:21.484444+0000","last_clean":"2024-09-12T01:51:21.484444+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:51:21.484444+0000","last_undegraded":"2024-09-12T01:51:21.484444+0000","last_fullsized":"2024-09-12T01:51:21.484444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486738+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:51:21.486738+0000","last_peered":"2024-09-12T01:51:21.486738+0000","last_clean":"2024-09-12T01:51:21.486738+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:51:21.486738+0000","last_undegraded":"2024-09-12T01:51:21.486738+0000","last_fullsized":"2024-09-12T01:51:21.486738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488158+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:51:21.488158+0000","last_peered":"2024-09-12T01:51:21.488158+0000","last_clean":"2024-09-12T01:51:21.488158+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:51:21.488158+0000","last_undegraded":"2024-09-12T01:51:21.488158+0000","last_fullsized":"2024-09-12T01:51:21.488158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.483006+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:51:21.483006+0000","last_peered":"2024-09-12T01:51:21.483006+0000","last_clean":"2024-09-12T01:51:21.483006+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:51:21.483006+0000","last_undegraded":"2024-09-12T01:51:21.483006+0000","last_fullsized":"2024-09-12T01:51:21.483006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'7","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:48.526886+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:51:48.526886+0000","last_peered":"2024-09-12T01:51:48.526886+0000","last_clean":"2024-09-12T01:51:48.526886+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:51:48.526886+0000","last_undegraded":"2024-09-12T01:51:48.526886+0000","last_fullsized":"2024-09-12T01:51:48.526886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.477519+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:51:21.477519+0000","last_peered":"2024-09-12T01:51:21.477519+0000","last_clean":"2024-09-12T01:51:21.477519+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:51:21.477519+0000","last_undegraded":"2024-09-12T01:51:21.477519+0000","last_fullsized":"2024-09-12T01:51:21.477519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.688704+0000","last_change":"2024-09-12T01:50:22.688704+0000","last_active":"2024-09-12T01:50:22.688704+0000","last_peered":"2024-09-12T01:50:22.688704+0000","last_clean":"2024-09-12T01:50:22.688704+0000","last_became_active":"2024-09-12T01:50:22.682640+0000","last_became_peered":"2024-09-12T01:50:22.682640+0000","last_unstale":"2024-09-12T01:50:22.688704+0000","last_undegraded":"2024-09-12T01:50:22.688704+0000","last_fullsized":"2024-09-12T01:50:22.688704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.731438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614069+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:22.614069+0000","last_peered":"2024-09-12T01:50:22.614069+0000","last_clean":"2024-09-12T01:50:22.614069+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:22.614069+0000","last_undegraded":"2024-09-12T01:50:22.614069+0000","last_fullsized":"2024-09-12T01:50:22.614069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.480595+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:51:21.480595+0000","last_peered":"2024-09-12T01:51:21.480595+0000","last_clean":"2024-09-12T01:51:21.480595+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:51:21.480595+0000","last_undegraded":"2024-09-12T01:51:21.480595+0000","last_fullsized":"2024-09-12T01:51:21.480595+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629145+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:22.629145+0000","last_peered":"2024-09-12T01:50:22.629145+0000","last_clean":"2024-09-12T01:50:22.629145+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:22.629145+0000","last_undegraded":"2024-09-12T01:50:22.629145+0000","last_fullsized":"2024-09-12T01:50:22.629145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.495099+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:51:21.495099+0000","last_peered":"2024-09-12T01:51:21.495099+0000","last_clean":"2024-09-12T01:51:21.495099+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:51:21.495099+0000","last_undegraded":"2024-09-12T01:51:21.495099+0000","last_fullsized":"2024-09-12T01:51:21.495099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":232,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:50.528756+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:51:50.528756+0000","last_peered":"2024-09-12T01:51:50.528756+0000","last_clean":"2024-09-12T01:51:50.528756+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:51:50.528756+0000","last_undegraded":"2024-09-12T01:51:50.528756+0000","last_fullsized":"2024-09-12T01:51:50.528756+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":204,"num_read_kb":204,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.498633+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:51:21.498633+0000","last_peered":"2024-09-12T01:51:21.498633+0000","last_clean":"2024-09-12T01:51:21.498633+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:51:21.498633+0000","last_undegraded":"2024-09-12T01:51:21.498633+0000","last_fullsized":"2024-09-12T01:51:21.498633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613318+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:22.613318+0000","last_peered":"2024-09-12T01:50:22.613318+0000","last_clean":"2024-09-12T01:50:22.613318+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:22.613318+0000","last_undegraded":"2024-09-12T01:50:22.613318+0000","last_fullsized":"2024-09-12T01:50:22.613318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488858+0000","last_change":"2024-09-12T01:50:22.630618+0000","last_active":"2024-09-12T01:51:21.488858+0000","last_peered":"2024-09-12T01:51:21.488858+0000","last_clean":"2024-09-12T01:51:21.488858+0000","last_became_active":"2024-09-12T01:50:22.630327+0000","last_became_peered":"2024-09-12T01:50:22.630327+0000","last_unstale":"2024-09-12T01:51:21.488858+0000","last_undegraded":"2024-09-12T01:51:21.488858+0000","last_fullsized":"2024-09-12T01:51:21.488858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.647257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629439+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:22.629439+0000","last_peered":"2024-09-12T01:50:22.629439+0000","last_clean":"2024-09-12T01:50:22.629439+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:22.629439+0000","last_undegraded":"2024-09-12T01:50:22.629439+0000","last_fullsized":"2024-09-12T01:50:22.629439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501850+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:51:21.501850+0000","last_peered":"2024-09-12T01:51:21.501850+0000","last_clean":"2024-09-12T01:51:21.501850+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:51:21.501850+0000","last_undegraded":"2024-09-12T01:51:21.501850+0000","last_fullsized":"2024-09-12T01:51:21.501850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":290,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:49.811589+0000","last_change":"2024-09-12T01:50:22.696674+0000","last_active":"2024-09-12T01:51:49.811589+0000","last_peered":"2024-09-12T01:51:49.811589+0000","last_clean":"2024-09-12T01:51:49.811589+0000","last_became_active":"2024-09-12T01:50:22.683417+0000","last_became_peered":"2024-09-12T01:50:22.683417+0000","last_unstale":"2024-09-12T01:51:49.811589+0000","last_undegraded":"2024-09-12T01:51:49.811589+0000","last_fullsized":"2024-09-12T01:51:49.811589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:35.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62559,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":164,"num_write":38,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":49603,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486841+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:51:21.486841+0000","last_peered":"2024-09-12T01:51:21.486841+0000","last_clean":"2024-09-12T01:51:21.486841+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:51:21.486841+0000","last_undegraded":"2024-09-12T01:51:21.486841+0000","last_fullsized":"2024-09-12T01:51:21.486841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612213+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:22.612213+0000","last_peered":"2024-09-12T01:50:22.612213+0000","last_clean":"2024-09-12T01:50:22.612213+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:22.612213+0000","last_undegraded":"2024-09-12T01:50:22.612213+0000","last_fullsized":"2024-09-12T01:50:22.612213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.474550+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:51:21.474550+0000","last_peered":"2024-09-12T01:51:21.474550+0000","last_clean":"2024-09-12T01:51:21.474550+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:51:21.474550+0000","last_undegraded":"2024-09-12T01:51:21.474550+0000","last_fullsized":"2024-09-12T01:51:21.474550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629035+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:22.629035+0000","last_peered":"2024-09-12T01:50:22.629035+0000","last_clean":"2024-09-12T01:50:22.629035+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:22.629035+0000","last_undegraded":"2024-09-12T01:50:22.629035+0000","last_fullsized":"2024-09-12T01:50:22.629035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487087+0000","last_change":"2024-09-12T01:50:22.616527+0000","last_active":"2024-09-12T01:51:21.487087+0000","last_peered":"2024-09-12T01:51:21.487087+0000","last_clean":"2024-09-12T01:51:21.487087+0000","last_became_active":"2024-09-12T01:50:22.616150+0000","last_became_peered":"2024-09-12T01:50:22.616150+0000","last_unstale":"2024-09-12T01:51:21.487087+0000","last_undegraded":"2024-09-12T01:51:21.487087+0000","last_fullsized":"2024-09-12T01:51:21.487087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:58.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:50.529030+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:51:50.529030+0000","last_peered":"2024-09-12T01:51:50.529030+0000","last_clean":"2024-09-12T01:51:50.529030+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:51:50.529030+0000","last_undegraded":"2024-09-12T01:51:50.529030+0000","last_fullsized":"2024-09-12T01:51:50.529030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.495898+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:51:21.495898+0000","last_peered":"2024-09-12T01:51:21.495898+0000","last_clean":"2024-09-12T01:51:21.495898+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:51:21.495898+0000","last_undegraded":"2024-09-12T01:51:21.495898+0000","last_fullsized":"2024-09-12T01:51:21.495898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610857+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:22.610857+0000","last_peered":"2024-09-12T01:50:22.610857+0000","last_clean":"2024-09-12T01:50:22.610857+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:22.610857+0000","last_undegraded":"2024-09-12T01:50:22.610857+0000","last_fullsized":"2024-09-12T01:50:22.610857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.482779+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:51:21.482779+0000","last_peered":"2024-09-12T01:51:21.482779+0000","last_clean":"2024-09-12T01:51:21.482779+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:51:21.482779+0000","last_undegraded":"2024-09-12T01:51:21.482779+0000","last_fullsized":"2024-09-12T01:51:21.482779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611513+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:22.611513+0000","last_peered":"2024-09-12T01:50:22.611513+0000","last_clean":"2024-09-12T01:50:22.611513+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:22.611513+0000","last_undegraded":"2024-09-12T01:50:22.611513+0000","last_fullsized":"2024-09-12T01:50:22.611513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486914+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:51:21.486914+0000","last_peered":"2024-09-12T01:51:21.486914+0000","last_clean":"2024-09-12T01:51:21.486914+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:51:21.486914+0000","last_undegraded":"2024-09-12T01:51:21.486914+0000","last_fullsized":"2024-09-12T01:51:21.486914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613947+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:22.613947+0000","last_peered":"2024-09-12T01:50:22.613947+0000","last_clean":"2024-09-12T01:50:22.613947+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:22.613947+0000","last_undegraded":"2024-09-12T01:50:22.613947+0000","last_fullsized":"2024-09-12T01:50:22.613947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484475+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:51:21.484475+0000","last_peered":"2024-09-12T01:51:21.484475+0000","last_clean":"2024-09-12T01:51:21.484475+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:51:21.484475+0000","last_undegraded":"2024-09-12T01:51:21.484475+0000","last_fullsized":"2024-09-12T01:51:21.484475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629587+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:22.629587+0000","last_peered":"2024-09-12T01:50:22.629587+0000","last_clean":"2024-09-12T01:50:22.629587+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:22.629587+0000","last_undegraded":"2024-09-12T01:50:22.629587+0000","last_fullsized":"2024-09-12T01:50:22.629587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489454+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:51:21.489454+0000","last_peered":"2024-09-12T01:51:21.489454+0000","last_clean":"2024-09-12T01:51:21.489454+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:51:21.489454+0000","last_undegraded":"2024-09-12T01:51:21.489454+0000","last_fullsized":"2024-09-12T01:51:21.489454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'8","reported_seq":139,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:51.531892+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:51:51.531892+0000","last_peered":"2024-09-12T01:51:51.531892+0000","last_clean":"2024-09-12T01:51:51.531892+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:51:51.531892+0000","last_undegraded":"2024-09-12T01:51:51.531892+0000","last_fullsized":"2024-09-12T01:51:51.531892+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2012,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.500017+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:51:21.500017+0000","last_peered":"2024-09-12T01:51:21.500017+0000","last_clean":"2024-09-12T01:51:21.500017+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:51:21.500017+0000","last_undegraded":"2024-09-12T01:51:21.500017+0000","last_fullsized":"2024-09-12T01:51:21.500017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":333,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612725+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:50:22.612725+0000","last_peered":"2024-09-12T01:50:22.612725+0000","last_clean":"2024-09-12T01:50:22.612725+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:50:22.612725+0000","last_undegraded":"2024-09-12T01:50:22.612725+0000","last_fullsized":"2024-09-12T01:50:22.612725+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681903+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:22.681903+0000","last_peered":"2024-09-12T01:50:22.681903+0000","last_clean":"2024-09-12T01:50:22.681903+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:22.681903+0000","last_undegraded":"2024-09-12T01:50:22.681903+0000","last_fullsized":"2024-09-12T01:50:22.681903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.498284+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:51:21.498284+0000","last_peered":"2024-09-12T01:51:21.498284+0000","last_clean":"2024-09-12T01:51:21.498284+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:51:21.498284+0000","last_undegraded":"2024-09-12T01:51:21.498284+0000","last_fullsized":"2024-09-12T01:51:21.498284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612642+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:22.612642+0000","last_peered":"2024-09-12T01:50:22.612642+0000","last_clean":"2024-09-12T01:50:22.612642+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:22.612642+0000","last_undegraded":"2024-09-12T01:50:22.612642+0000","last_fullsized":"2024-09-12T01:50:22.612642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.481982+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:51:21.481982+0000","last_peered":"2024-09-12T01:51:21.481982+0000","last_clean":"2024-09-12T01:51:21.481982+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:51:21.481982+0000","last_undegraded":"2024-09-12T01:51:21.481982+0000","last_fullsized":"2024-09-12T01:51:21.481982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":129,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:48.525637+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:51:48.525637+0000","last_peered":"2024-09-12T01:51:48.525637+0000","last_clean":"2024-09-12T01:51:48.525637+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:51:48.525637+0000","last_undegraded":"2024-09-12T01:51:48.525637+0000","last_fullsized":"2024-09-12T01:51:48.525637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.477907+0000","last_change":"2024-09-12T01:50:22.682963+0000","last_active":"2024-09-12T01:51:21.477907+0000","last_peered":"2024-09-12T01:51:21.477907+0000","last_clean":"2024-09-12T01:51:21.477907+0000","last_became_active":"2024-09-12T01:50:22.682611+0000","last_became_peered":"2024-09-12T01:50:22.682611+0000","last_unstale":"2024-09-12T01:51:21.477907+0000","last_undegraded":"2024-09-12T01:51:21.477907+0000","last_fullsized":"2024-09-12T01:51:21.477907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:01.295098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'7","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:47.795359+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:51:47.795359+0000","last_peered":"2024-09-12T01:51:47.795359+0000","last_clean":"2024-09-12T01:51:47.795359+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:51:47.795359+0000","last_undegraded":"2024-09-12T01:51:47.795359+0000","last_fullsized":"2024-09-12T01:51:47.795359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489407+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:51:21.489407+0000","last_peered":"2024-09-12T01:51:21.489407+0000","last_clean":"2024-09-12T01:51:21.489407+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:51:21.489407+0000","last_undegraded":"2024-09-12T01:51:21.489407+0000","last_fullsized":"2024-09-12T01:51:21.489407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.683026+0000","last_change":"2024-09-12T01:50:22.683026+0000","last_active":"2024-09-12T01:50:22.683026+0000","last_peered":"2024-09-12T01:50:22.683026+0000","last_clean":"2024-09-12T01:50:22.683026+0000","last_became_active":"2024-09-12T01:50:22.682461+0000","last_became_peered":"2024-09-12T01:50:22.682461+0000","last_unstale":"2024-09-12T01:50:22.683026+0000","last_undegraded":"2024-09-12T01:50:22.683026+0000","last_fullsized":"2024-09-12T01:50:22.683026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.470081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.490807+0000","last_change":"2024-09-12T01:50:22.618050+0000","last_active":"2024-09-12T01:51:21.490807+0000","last_peered":"2024-09-12T01:51:21.490807+0000","last_clean":"2024-09-12T01:51:21.490807+0000","last_became_active":"2024-09-12T01:50:22.614871+0000","last_became_peered":"2024-09-12T01:50:22.614871+0000","last_unstale":"2024-09-12T01:51:21.490807+0000","last_undegraded":"2024-09-12T01:51:21.490807+0000","last_fullsized":"2024-09-12T01:51:21.490807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:47.652568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611446+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:22.611446+0000","last_peered":"2024-09-12T01:50:22.611446+0000","last_clean":"2024-09-12T01:50:22.611446+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:22.611446+0000","last_undegraded":"2024-09-12T01:50:22.611446+0000","last_fullsized":"2024-09-12T01:50:22.611446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.481782+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:51:21.481782+0000","last_peered":"2024-09-12T01:51:21.481782+0000","last_clean":"2024-09-12T01:51:21.481782+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:51:21.481782+0000","last_undegraded":"2024-09-12T01:51:21.481782+0000","last_fullsized":"2024-09-12T01:51:21.481782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'16","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:22.331135+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:51:22.331135+0000","last_peered":"2024-09-12T01:51:22.331135+0000","last_clean":"2024-09-12T01:51:22.331135+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:51:22.331135+0000","last_undegraded":"2024-09-12T01:51:22.331135+0000","last_fullsized":"2024-09-12T01:51:22.331135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487040+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:51:21.487040+0000","last_peered":"2024-09-12T01:51:21.487040+0000","last_clean":"2024-09-12T01:51:21.487040+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:51:21.487040+0000","last_undegraded":"2024-09-12T01:51:21.487040+0000","last_fullsized":"2024-09-12T01:51:21.487040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681518+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:22.681518+0000","last_peered":"2024-09-12T01:50:22.681518+0000","last_clean":"2024-09-12T01:50:22.681518+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:22.681518+0000","last_undegraded":"2024-09-12T01:50:22.681518+0000","last_fullsized":"2024-09-12T01:50:22.681518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489524+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:51:21.489524+0000","last_peered":"2024-09-12T01:51:21.489524+0000","last_clean":"2024-09-12T01:51:21.489524+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:51:21.489524+0000","last_undegraded":"2024-09-12T01:51:21.489524+0000","last_fullsized":"2024-09-12T01:51:21.489524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611066+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:22.611066+0000","last_peered":"2024-09-12T01:50:22.611066+0000","last_clean":"2024-09-12T01:50:22.611066+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:22.611066+0000","last_undegraded":"2024-09-12T01:50:22.611066+0000","last_fullsized":"2024-09-12T01:50:22.611066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.451681+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:51:21.451681+0000","last_peered":"2024-09-12T01:51:21.451681+0000","last_clean":"2024-09-12T01:51:21.451681+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:51:21.451681+0000","last_undegraded":"2024-09-12T01:51:21.451681+0000","last_fullsized":"2024-09-12T01:51:21.451681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613860+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:22.613860+0000","last_peered":"2024-09-12T01:50:22.613860+0000","last_clean":"2024-09-12T01:50:22.613860+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:22.613860+0000","last_undegraded":"2024-09-12T01:50:22.613860+0000","last_fullsized":"2024-09-12T01:50:22.613860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484300+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:51:21.484300+0000","last_peered":"2024-09-12T01:51:21.484300+0000","last_clean":"2024-09-12T01:51:21.484300+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:51:21.484300+0000","last_undegraded":"2024-09-12T01:51:21.484300+0000","last_fullsized":"2024-09-12T01:51:21.484300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612140+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:22.612140+0000","last_peered":"2024-09-12T01:50:22.612140+0000","last_clean":"2024-09-12T01:50:22.612140+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:22.612140+0000","last_undegraded":"2024-09-12T01:50:22.612140+0000","last_fullsized":"2024-09-12T01:50:22.612140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493228+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:51:21.493228+0000","last_peered":"2024-09-12T01:51:21.493228+0000","last_clean":"2024-09-12T01:51:21.493228+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:51:21.493228+0000","last_undegraded":"2024-09-12T01:51:21.493228+0000","last_fullsized":"2024-09-12T01:51:21.493228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611281+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:22.611281+0000","last_peered":"2024-09-12T01:50:22.611281+0000","last_clean":"2024-09-12T01:50:22.611281+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:22.611281+0000","last_undegraded":"2024-09-12T01:50:22.611281+0000","last_fullsized":"2024-09-12T01:50:22.611281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501783+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:51:21.501783+0000","last_peered":"2024-09-12T01:51:21.501783+0000","last_clean":"2024-09-12T01:51:21.501783+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:51:21.501783+0000","last_undegraded":"2024-09-12T01:51:21.501783+0000","last_fullsized":"2024-09-12T01:51:21.501783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.497079+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:51:21.497079+0000","last_peered":"2024-09-12T01:51:21.497079+0000","last_clean":"2024-09-12T01:51:21.497079+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:51:21.497079+0000","last_undegraded":"2024-09-12T01:51:21.497079+0000","last_fullsized":"2024-09-12T01:51:21.497079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611510+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:22.611510+0000","last_peered":"2024-09-12T01:50:22.611510+0000","last_clean":"2024-09-12T01:50:22.611510+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:22.611510+0000","last_undegraded":"2024-09-12T01:50:22.611510+0000","last_fullsized":"2024-09-12T01:50:22.611510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501244+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:51:21.501244+0000","last_peered":"2024-09-12T01:51:21.501244+0000","last_clean":"2024-09-12T01:51:21.501244+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:51:21.501244+0000","last_undegraded":"2024-09-12T01:51:21.501244+0000","last_fullsized":"2024-09-12T01:51:21.501244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611302+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:22.611302+0000","last_peered":"2024-09-12T01:50:22.611302+0000","last_clean":"2024-09-12T01:50:22.611302+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:22.611302+0000","last_undegraded":"2024-09-12T01:50:22.611302+0000","last_fullsized":"2024-09-12T01:50:22.611302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.502276+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:51:21.502276+0000","last_peered":"2024-09-12T01:51:21.502276+0000","last_clean":"2024-09-12T01:51:21.502276+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:51:21.502276+0000","last_undegraded":"2024-09-12T01:51:21.502276+0000","last_fullsized":"2024-09-12T01:51:21.502276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614331+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:50:22.614331+0000","last_peered":"2024-09-12T01:50:22.614331+0000","last_clean":"2024-09-12T01:50:22.614331+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:50:22.614331+0000","last_undegraded":"2024-09-12T01:50:22.614331+0000","last_fullsized":"2024-09-12T01:50:22.614331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487761+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:51:21.487761+0000","last_peered":"2024-09-12T01:51:21.487761+0000","last_clean":"2024-09-12T01:51:21.487761+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:51:21.487761+0000","last_undegraded":"2024-09-12T01:51:21.487761+0000","last_fullsized":"2024-09-12T01:51:21.487761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:50.798713+0000","last_change":"2024-09-12T01:50:22.691988+0000","last_active":"2024-09-12T01:51:50.798713+0000","last_peered":"2024-09-12T01:51:50.798713+0000","last_clean":"2024-09-12T01:51:50.798713+0000","last_became_active":"2024-09-12T01:50:22.682676+0000","last_became_peered":"2024-09-12T01:50:22.682676+0000","last_unstale":"2024-09-12T01:51:50.798713+0000","last_undegraded":"2024-09-12T01:51:50.798713+0000","last_fullsized":"2024-09-12T01:51:50.798713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:56.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70891,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1056,"num_read_kb":606,"num_write":262,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":50275,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":212673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547236,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776168,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32764,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712388,"statfs":{"total":95995035648,"available":95961485312,"internally_reserved":0,"allocated":1617920,"data_stored":1091952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939694,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":438411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1031195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528380,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":438545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1544192,"data_stored":1031011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":500739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":440520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":502017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":440192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:51:54.983 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-12T01:51:54.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:51:55.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:54 smithi152 ceph-mon[35055]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T01:51:55.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:54 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/956105086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:55.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.118+0000 7f848e677640 1 -- 172.21.15.70:0/2985578488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8488101b30 msgr2=0x7f8488101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:55.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.118+0000 7f848e677640 1 --2- 172.21.15.70:0/2985578488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8488101b30 0x7f8488101f30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8478009900 tx=0x7f847802a410 comp rx=0 tx=0).stop 2024-09-12T01:51:55.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.118+0000 7f848e677640 1 -- 172.21.15.70:0/2985578488 shutdown_connections 2024-09-12T01:51:55.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.118+0000 7f848e677640 1 --2- 172.21.15.70:0/2985578488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84881036e0 0x7f8488109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.118+0000 7f848e677640 1 --2- 172.21.15.70:0/2985578488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8488102d20 0x7f84881031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.118+0000 7f848e677640 1 --2- 172.21.15.70:0/2985578488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8488101b30 0x7f8488101f30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.118+0000 7f848e677640 1 -- 172.21.15.70:0/2985578488 >> 172.21.15.70:0/2985578488 conn(0x7f84880fd2b0 msgr2=0x7f84880ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.118+0000 7f848e677640 1 -- 172.21.15.70:0/2985578488 shutdown_connections 2024-09-12T01:51:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.118+0000 7f848e677640 1 -- 172.21.15.70:0/2985578488 wait complete. 2024-09-12T01:51:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.118+0000 7f848e677640 1 Processor -- start 2024-09-12T01:51:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f848e677640 1 -- start start 2024-09-12T01:51:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f848e677640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8488101b30 0x7f8488197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f848e677640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8488102d20 0x7f8488198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f848e677640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84881036e0 0x7f848819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f848e677640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f848810d910 con 0x7f8488101b30 2024-09-12T01:51:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f848e677640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f848810d790 con 0x7f84881036e0 2024-09-12T01:51:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f848e677640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f848810da90 con 0x7f8488102d20 2024-09-12T01:51:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f8487fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8488101b30 0x7f8488197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f8487fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8488101b30 0x7f8488197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52938/0 (socket says 172.21.15.70:52938) 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f8487fff640 1 -- 172.21.15.70:0/684956171 learned_addr learned my addr 172.21.15.70:0/684956171 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f848cc14640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84881036e0 0x7f848819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f8487fff640 1 -- 172.21.15.70:0/684956171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8488102d20 msgr2=0x7f8488198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f8487fff640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8488102d20 0x7f8488198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f8487fff640 1 -- 172.21.15.70:0/684956171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84881036e0 msgr2=0x7f848819f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f8487fff640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84881036e0 0x7f848819f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f8487fff640 1 -- 172.21.15.70:0/684956171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848819fb40 con 0x7f8488101b30 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f848cc14640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84881036e0 0x7f848819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.119+0000 7f8487fff640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8488101b30 0x7f8488197f20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8478005ab0 tx=0x7f84780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.120+0000 7f84857fa640 1 -- 172.21.15.70:0/684956171 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847803f030 con 0x7f8488101b30 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.120+0000 7f84857fa640 1 -- 172.21.15.70:0/684956171 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8478003d00 con 0x7f8488101b30 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.120+0000 7f84857fa640 1 -- 172.21.15.70:0/684956171 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478035070 con 0x7f8488101b30 2024-09-12T01:51:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.120+0000 7f848e677640 1 -- 172.21.15.70:0/684956171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f848819fdd0 con 0x7f8488101b30 2024-09-12T01:51:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.120+0000 7f848e677640 1 -- 172.21.15.70:0/684956171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84881a0280 con 0x7f8488101b30 2024-09-12T01:51:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.121+0000 7f848e677640 1 -- 172.21.15.70:0/684956171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8488108ed0 con 0x7f8488101b30 2024-09-12T01:51:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.122+0000 7f84857fa640 1 -- 172.21.15.70:0/684956171 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8478042030 con 0x7f8488101b30 2024-09-12T01:51:55.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.122+0000 7f84857fa640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84700a2c10 0x7f84700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:55.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.123+0000 7f84877fe640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84700a2c10 0x7f84700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:55.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.123+0000 7f84857fa640 1 -- 172.21.15.70:0/684956171 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f84780ef900 con 0x7f8488101b30 2024-09-12T01:51:55.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.123+0000 7f84877fe640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84700a2c10 0x7f84700a50d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8488199430 tx=0x7f847c005bf0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:55.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.126+0000 7f84857fa640 1 -- 172.21.15.70:0/684956171 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84780bc860 con 0x7f8488101b30 2024-09-12T01:51:55.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.288+0000 7f848e677640 1 -- 172.21.15.70:0/684956171 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8488062630 con 0x7f84700a2c10 2024-09-12T01:51:55.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.294+0000 7f84857fa640 1 -- 172.21.15.70:0/684956171 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258899 (secure 0 0 0) 0x7f8488062630 con 0x7f84700a2c10 2024-09-12T01:51:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:55.299 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:51:55.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.298+0000 7f848e677640 1 -- 172.21.15.70:0/684956171 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84700a2c10 msgr2=0x7f84700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:55.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.298+0000 7f848e677640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84700a2c10 0x7f84700a50d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8488199430 tx=0x7f847c005bf0 comp rx=0 tx=0).stop 2024-09-12T01:51:55.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.298+0000 7f848e677640 1 -- 172.21.15.70:0/684956171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8488101b30 msgr2=0x7f8488197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:55.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.298+0000 7f848e677640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8488101b30 0x7f8488197f20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8478005ab0 tx=0x7f84780042f0 comp rx=0 tx=0).stop 2024-09-12T01:51:55.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.298+0000 7f848e677640 1 -- 172.21.15.70:0/684956171 shutdown_connections 2024-09-12T01:51:55.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.298+0000 7f848e677640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f84700a2c10 0x7f84700a50d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:55.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.298+0000 7f848e677640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84881036e0 0x7f848819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:55.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.298+0000 7f848e677640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8488102d20 0x7f8488198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:55.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.298+0000 7f848e677640 1 --2- 172.21.15.70:0/684956171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8488101b30 0x7f8488197f20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:55.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.298+0000 7f848e677640 1 -- 172.21.15.70:0/684956171 >> 172.21.15.70:0/684956171 conn(0x7f84880fd2b0 msgr2=0x7f84881060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:55.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.298+0000 7f848e677640 1 -- 172.21.15.70:0/684956171 shutdown_connections 2024-09-12T01:51:55.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:55.298+0000 7f848e677640 1 -- 172.21.15.70:0/684956171 wait complete. 2024-09-12T01:51:55.309 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-12T01:51:53.499643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661493,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1182,"num_read_kb":715,"num_write":445,"num_write_kb":3091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1231128,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":864,"ondisk_log_size":864,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370456,"kb_used_data":12888,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571368,"statfs":{"total":1151940427776,"available":1151561080832,"internally_reserved":0,"allocated":13197312,"data_stored":7230543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":56,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002926"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501869+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:51:21.501869+0000","last_peered":"2024-09-12T01:51:21.501869+0000","last_clean":"2024-09-12T01:51:21.501869+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:51:21.501869+0000","last_undegraded":"2024-09-12T01:51:21.501869+0000","last_fullsized":"2024-09-12T01:51:21.501869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488982+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:51:21.488982+0000","last_peered":"2024-09-12T01:51:21.488982+0000","last_clean":"2024-09-12T01:51:21.488982+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:51:21.488982+0000","last_undegraded":"2024-09-12T01:51:21.488982+0000","last_fullsized":"2024-09-12T01:51:21.488982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501730+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:51:21.501730+0000","last_peered":"2024-09-12T01:51:21.501730+0000","last_clean":"2024-09-12T01:51:21.501730+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:51:21.501730+0000","last_undegraded":"2024-09-12T01:51:21.501730+0000","last_fullsized":"2024-09-12T01:51:21.501730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.472280+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:51:21.472280+0000","last_peered":"2024-09-12T01:51:21.472280+0000","last_clean":"2024-09-12T01:51:21.472280+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:51:21.472280+0000","last_undegraded":"2024-09-12T01:51:21.472280+0000","last_fullsized":"2024-09-12T01:51:21.472280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.472067+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:51:21.472067+0000","last_peered":"2024-09-12T01:51:21.472067+0000","last_clean":"2024-09-12T01:51:21.472067+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:51:21.472067+0000","last_undegraded":"2024-09-12T01:51:21.472067+0000","last_fullsized":"2024-09-12T01:51:21.472067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488486+0000","last_change":"2024-09-12T01:50:22.614193+0000","last_active":"2024-09-12T01:51:21.488486+0000","last_peered":"2024-09-12T01:51:21.488486+0000","last_clean":"2024-09-12T01:51:21.488486+0000","last_became_active":"2024-09-12T01:50:22.613816+0000","last_became_peered":"2024-09-12T01:50:22.613816+0000","last_unstale":"2024-09-12T01:51:21.488486+0000","last_undegraded":"2024-09-12T01:51:21.488486+0000","last_fullsized":"2024-09-12T01:51:21.488486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:29.504176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488037+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:51:21.488037+0000","last_peered":"2024-09-12T01:51:21.488037+0000","last_clean":"2024-09-12T01:51:21.488037+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:51:21.488037+0000","last_undegraded":"2024-09-12T01:51:21.488037+0000","last_fullsized":"2024-09-12T01:51:21.488037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493016+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:51:21.493016+0000","last_peered":"2024-09-12T01:51:21.493016+0000","last_clean":"2024-09-12T01:51:21.493016+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:51:21.493016+0000","last_undegraded":"2024-09-12T01:51:21.493016+0000","last_fullsized":"2024-09-12T01:51:21.493016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.500188+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:51:21.500188+0000","last_peered":"2024-09-12T01:51:21.500188+0000","last_clean":"2024-09-12T01:51:21.500188+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:51:21.500188+0000","last_undegraded":"2024-09-12T01:51:21.500188+0000","last_fullsized":"2024-09-12T01:51:21.500188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.491514+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:51:21.491514+0000","last_peered":"2024-09-12T01:51:21.491514+0000","last_clean":"2024-09-12T01:51:21.491514+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:51:21.491514+0000","last_undegraded":"2024-09-12T01:51:21.491514+0000","last_fullsized":"2024-09-12T01:51:21.491514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.499334+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:51:21.499334+0000","last_peered":"2024-09-12T01:51:21.499334+0000","last_clean":"2024-09-12T01:51:21.499334+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:51:21.499334+0000","last_undegraded":"2024-09-12T01:51:21.499334+0000","last_fullsized":"2024-09-12T01:51:21.499334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.496290+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:51:21.496290+0000","last_peered":"2024-09-12T01:51:21.496290+0000","last_clean":"2024-09-12T01:51:21.496290+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:51:21.496290+0000","last_undegraded":"2024-09-12T01:51:21.496290+0000","last_fullsized":"2024-09-12T01:51:21.496290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493477+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:51:21.493477+0000","last_peered":"2024-09-12T01:51:21.493477+0000","last_clean":"2024-09-12T01:51:21.493477+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:51:21.493477+0000","last_undegraded":"2024-09-12T01:51:21.493477+0000","last_fullsized":"2024-09-12T01:51:21.493477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.492593+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:51:21.492593+0000","last_peered":"2024-09-12T01:51:21.492593+0000","last_clean":"2024-09-12T01:51:21.492593+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:51:21.492593+0000","last_undegraded":"2024-09-12T01:51:21.492593+0000","last_fullsized":"2024-09-12T01:51:21.492593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489877+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:51:21.489877+0000","last_peered":"2024-09-12T01:51:21.489877+0000","last_clean":"2024-09-12T01:51:21.489877+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:51:21.489877+0000","last_undegraded":"2024-09-12T01:51:21.489877+0000","last_fullsized":"2024-09-12T01:51:21.489877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.497951+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:51:21.497951+0000","last_peered":"2024-09-12T01:51:21.497951+0000","last_clean":"2024-09-12T01:51:21.497951+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:51:21.497951+0000","last_undegraded":"2024-09-12T01:51:21.497951+0000","last_fullsized":"2024-09-12T01:51:21.497951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501906+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:51:21.501906+0000","last_peered":"2024-09-12T01:51:21.501906+0000","last_clean":"2024-09-12T01:51:21.501906+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:51:21.501906+0000","last_undegraded":"2024-09-12T01:51:21.501906+0000","last_fullsized":"2024-09-12T01:51:21.501906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.494924+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:51:21.494924+0000","last_peered":"2024-09-12T01:51:21.494924+0000","last_clean":"2024-09-12T01:51:21.494924+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:51:21.494924+0000","last_undegraded":"2024-09-12T01:51:21.494924+0000","last_fullsized":"2024-09-12T01:51:21.494924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484591+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:51:21.484591+0000","last_peered":"2024-09-12T01:51:21.484591+0000","last_clean":"2024-09-12T01:51:21.484591+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:51:21.484591+0000","last_undegraded":"2024-09-12T01:51:21.484591+0000","last_fullsized":"2024-09-12T01:51:21.484591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.478916+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:51:21.478916+0000","last_peered":"2024-09-12T01:51:21.478916+0000","last_clean":"2024-09-12T01:51:21.478916+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:51:21.478916+0000","last_undegraded":"2024-09-12T01:51:21.478916+0000","last_fullsized":"2024-09-12T01:51:21.478916+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.475221+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:51:21.475221+0000","last_peered":"2024-09-12T01:51:21.475221+0000","last_clean":"2024-09-12T01:51:21.475221+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:51:21.475221+0000","last_undegraded":"2024-09-12T01:51:21.475221+0000","last_fullsized":"2024-09-12T01:51:21.475221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.499408+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:51:21.499408+0000","last_peered":"2024-09-12T01:51:21.499408+0000","last_clean":"2024-09-12T01:51:21.499408+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:51:21.499408+0000","last_undegraded":"2024-09-12T01:51:21.499408+0000","last_fullsized":"2024-09-12T01:51:21.499408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.485203+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:51:21.485203+0000","last_peered":"2024-09-12T01:51:21.485203+0000","last_clean":"2024-09-12T01:51:21.485203+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:51:21.485203+0000","last_undegraded":"2024-09-12T01:51:21.485203+0000","last_fullsized":"2024-09-12T01:51:21.485203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.482413+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:51:21.482413+0000","last_peered":"2024-09-12T01:51:21.482413+0000","last_clean":"2024-09-12T01:51:21.482413+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:51:21.482413+0000","last_undegraded":"2024-09-12T01:51:21.482413+0000","last_fullsized":"2024-09-12T01:51:21.482413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484804+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:51:21.484804+0000","last_peered":"2024-09-12T01:51:21.484804+0000","last_clean":"2024-09-12T01:51:21.484804+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:51:21.484804+0000","last_undegraded":"2024-09-12T01:51:21.484804+0000","last_fullsized":"2024-09-12T01:51:21.484804+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493388+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:51:21.493388+0000","last_peered":"2024-09-12T01:51:21.493388+0000","last_clean":"2024-09-12T01:51:21.493388+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:51:21.493388+0000","last_undegraded":"2024-09-12T01:51:21.493388+0000","last_fullsized":"2024-09-12T01:51:21.493388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487787+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:51:21.487787+0000","last_peered":"2024-09-12T01:51:21.487787+0000","last_clean":"2024-09-12T01:51:21.487787+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:51:21.487787+0000","last_undegraded":"2024-09-12T01:51:21.487787+0000","last_fullsized":"2024-09-12T01:51:21.487787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.476227+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:51:21.476227+0000","last_peered":"2024-09-12T01:51:21.476227+0000","last_clean":"2024-09-12T01:51:21.476227+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:51:21.476227+0000","last_undegraded":"2024-09-12T01:51:21.476227+0000","last_fullsized":"2024-09-12T01:51:21.476227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.490901+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:51:21.490901+0000","last_peered":"2024-09-12T01:51:21.490901+0000","last_clean":"2024-09-12T01:51:21.490901+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:51:21.490901+0000","last_undegraded":"2024-09-12T01:51:21.490901+0000","last_fullsized":"2024-09-12T01:51:21.490901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484444+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:51:21.484444+0000","last_peered":"2024-09-12T01:51:21.484444+0000","last_clean":"2024-09-12T01:51:21.484444+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:51:21.484444+0000","last_undegraded":"2024-09-12T01:51:21.484444+0000","last_fullsized":"2024-09-12T01:51:21.484444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486738+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:51:21.486738+0000","last_peered":"2024-09-12T01:51:21.486738+0000","last_clean":"2024-09-12T01:51:21.486738+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:51:21.486738+0000","last_undegraded":"2024-09-12T01:51:21.486738+0000","last_fullsized":"2024-09-12T01:51:21.486738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488158+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:51:21.488158+0000","last_peered":"2024-09-12T01:51:21.488158+0000","last_clean":"2024-09-12T01:51:21.488158+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:51:21.488158+0000","last_undegraded":"2024-09-12T01:51:21.488158+0000","last_fullsized":"2024-09-12T01:51:21.488158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.483006+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:51:21.483006+0000","last_peered":"2024-09-12T01:51:21.483006+0000","last_clean":"2024-09-12T01:51:21.483006+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:51:21.483006+0000","last_undegraded":"2024-09-12T01:51:21.483006+0000","last_fullsized":"2024-09-12T01:51:21.483006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'7","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:48.526886+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:51:48.526886+0000","last_peered":"2024-09-12T01:51:48.526886+0000","last_clean":"2024-09-12T01:51:48.526886+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:51:48.526886+0000","last_undegraded":"2024-09-12T01:51:48.526886+0000","last_fullsized":"2024-09-12T01:51:48.526886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.477519+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:51:21.477519+0000","last_peered":"2024-09-12T01:51:21.477519+0000","last_clean":"2024-09-12T01:51:21.477519+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:51:21.477519+0000","last_undegraded":"2024-09-12T01:51:21.477519+0000","last_fullsized":"2024-09-12T01:51:21.477519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.688704+0000","last_change":"2024-09-12T01:50:22.688704+0000","last_active":"2024-09-12T01:50:22.688704+0000","last_peered":"2024-09-12T01:50:22.688704+0000","last_clean":"2024-09-12T01:50:22.688704+0000","last_became_active":"2024-09-12T01:50:22.682640+0000","last_became_peered":"2024-09-12T01:50:22.682640+0000","last_unstale":"2024-09-12T01:50:22.688704+0000","last_undegraded":"2024-09-12T01:50:22.688704+0000","last_fullsized":"2024-09-12T01:50:22.688704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.731438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614069+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:22.614069+0000","last_peered":"2024-09-12T01:50:22.614069+0000","last_clean":"2024-09-12T01:50:22.614069+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:22.614069+0000","last_undegraded":"2024-09-12T01:50:22.614069+0000","last_fullsized":"2024-09-12T01:50:22.614069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.480595+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:51:21.480595+0000","last_peered":"2024-09-12T01:51:21.480595+0000","last_clean":"2024-09-12T01:51:21.480595+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:51:21.480595+0000","last_undegraded":"2024-09-12T01:51:21.480595+0000","last_fullsized":"2024-09-12T01:51:21.480595+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629145+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:22.629145+0000","last_peered":"2024-09-12T01:50:22.629145+0000","last_clean":"2024-09-12T01:50:22.629145+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:22.629145+0000","last_undegraded":"2024-09-12T01:50:22.629145+0000","last_fullsized":"2024-09-12T01:50:22.629145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.495099+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:51:21.495099+0000","last_peered":"2024-09-12T01:51:21.495099+0000","last_clean":"2024-09-12T01:51:21.495099+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:51:21.495099+0000","last_undegraded":"2024-09-12T01:51:21.495099+0000","last_fullsized":"2024-09-12T01:51:21.495099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":232,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:50.528756+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:51:50.528756+0000","last_peered":"2024-09-12T01:51:50.528756+0000","last_clean":"2024-09-12T01:51:50.528756+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:51:50.528756+0000","last_undegraded":"2024-09-12T01:51:50.528756+0000","last_fullsized":"2024-09-12T01:51:50.528756+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":204,"num_read_kb":204,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.498633+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:51:21.498633+0000","last_peered":"2024-09-12T01:51:21.498633+0000","last_clean":"2024-09-12T01:51:21.498633+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:51:21.498633+0000","last_undegraded":"2024-09-12T01:51:21.498633+0000","last_fullsized":"2024-09-12T01:51:21.498633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613318+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:22.613318+0000","last_peered":"2024-09-12T01:50:22.613318+0000","last_clean":"2024-09-12T01:50:22.613318+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:22.613318+0000","last_undegraded":"2024-09-12T01:50:22.613318+0000","last_fullsized":"2024-09-12T01:50:22.613318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488858+0000","last_change":"2024-09-12T01:50:22.630618+0000","last_active":"2024-09-12T01:51:21.488858+0000","last_peered":"2024-09-12T01:51:21.488858+0000","last_clean":"2024-09-12T01:51:21.488858+0000","last_became_active":"2024-09-12T01:50:22.630327+0000","last_became_peered":"2024-09-12T01:50:22.630327+0000","last_unstale":"2024-09-12T01:51:21.488858+0000","last_undegraded":"2024-09-12T01:51:21.488858+0000","last_fullsized":"2024-09-12T01:51:21.488858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.647257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629439+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:22.629439+0000","last_peered":"2024-09-12T01:50:22.629439+0000","last_clean":"2024-09-12T01:50:22.629439+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:22.629439+0000","last_undegraded":"2024-09-12T01:50:22.629439+0000","last_fullsized":"2024-09-12T01:50:22.629439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501850+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:51:21.501850+0000","last_peered":"2024-09-12T01:51:21.501850+0000","last_clean":"2024-09-12T01:51:21.501850+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:51:21.501850+0000","last_undegraded":"2024-09-12T01:51:21.501850+0000","last_fullsized":"2024-09-12T01:51:21.501850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":290,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:49.811589+0000","last_change":"2024-09-12T01:50:22.696674+0000","last_active":"2024-09-12T01:51:49.811589+0000","last_peered":"2024-09-12T01:51:49.811589+0000","last_clean":"2024-09-12T01:51:49.811589+0000","last_became_active":"2024-09-12T01:50:22.683417+0000","last_became_peered":"2024-09-12T01:50:22.683417+0000","last_unstale":"2024-09-12T01:51:49.811589+0000","last_undegraded":"2024-09-12T01:51:49.811589+0000","last_fullsized":"2024-09-12T01:51:49.811589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:35.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62559,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":164,"num_write":38,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":49603,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486841+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:51:21.486841+0000","last_peered":"2024-09-12T01:51:21.486841+0000","last_clean":"2024-09-12T01:51:21.486841+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:51:21.486841+0000","last_undegraded":"2024-09-12T01:51:21.486841+0000","last_fullsized":"2024-09-12T01:51:21.486841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612213+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:22.612213+0000","last_peered":"2024-09-12T01:50:22.612213+0000","last_clean":"2024-09-12T01:50:22.612213+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:22.612213+0000","last_undegraded":"2024-09-12T01:50:22.612213+0000","last_fullsized":"2024-09-12T01:50:22.612213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.474550+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:51:21.474550+0000","last_peered":"2024-09-12T01:51:21.474550+0000","last_clean":"2024-09-12T01:51:21.474550+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:51:21.474550+0000","last_undegraded":"2024-09-12T01:51:21.474550+0000","last_fullsized":"2024-09-12T01:51:21.474550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629035+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:22.629035+0000","last_peered":"2024-09-12T01:50:22.629035+0000","last_clean":"2024-09-12T01:50:22.629035+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:22.629035+0000","last_undegraded":"2024-09-12T01:50:22.629035+0000","last_fullsized":"2024-09-12T01:50:22.629035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487087+0000","last_change":"2024-09-12T01:50:22.616527+0000","last_active":"2024-09-12T01:51:21.487087+0000","last_peered":"2024-09-12T01:51:21.487087+0000","last_clean":"2024-09-12T01:51:21.487087+0000","last_became_active":"2024-09-12T01:50:22.616150+0000","last_became_peered":"2024-09-12T01:50:22.616150+0000","last_unstale":"2024-09-12T01:51:21.487087+0000","last_undegraded":"2024-09-12T01:51:21.487087+0000","last_fullsized":"2024-09-12T01:51:21.487087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:58.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:50.529030+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:51:50.529030+0000","last_peered":"2024-09-12T01:51:50.529030+0000","last_clean":"2024-09-12T01:51:50.529030+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:51:50.529030+0000","last_undegraded":"2024-09-12T01:51:50.529030+0000","last_fullsized":"2024-09-12T01:51:50.529030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.495898+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:51:21.495898+0000","last_peered":"2024-09-12T01:51:21.495898+0000","last_clean":"2024-09-12T01:51:21.495898+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:51:21.495898+0000","last_undegraded":"2024-09-12T01:51:21.495898+0000","last_fullsized":"2024-09-12T01:51:21.495898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610857+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:22.610857+0000","last_peered":"2024-09-12T01:50:22.610857+0000","last_clean":"2024-09-12T01:50:22.610857+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:22.610857+0000","last_undegraded":"2024-09-12T01:50:22.610857+0000","last_fullsized":"2024-09-12T01:50:22.610857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.482779+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:51:21.482779+0000","last_peered":"2024-09-12T01:51:21.482779+0000","last_clean":"2024-09-12T01:51:21.482779+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:51:21.482779+0000","last_undegraded":"2024-09-12T01:51:21.482779+0000","last_fullsized":"2024-09-12T01:51:21.482779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611513+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:22.611513+0000","last_peered":"2024-09-12T01:50:22.611513+0000","last_clean":"2024-09-12T01:50:22.611513+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:22.611513+0000","last_undegraded":"2024-09-12T01:50:22.611513+0000","last_fullsized":"2024-09-12T01:50:22.611513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486914+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:51:21.486914+0000","last_peered":"2024-09-12T01:51:21.486914+0000","last_clean":"2024-09-12T01:51:21.486914+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:51:21.486914+0000","last_undegraded":"2024-09-12T01:51:21.486914+0000","last_fullsized":"2024-09-12T01:51:21.486914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613947+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:22.613947+0000","last_peered":"2024-09-12T01:50:22.613947+0000","last_clean":"2024-09-12T01:50:22.613947+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:22.613947+0000","last_undegraded":"2024-09-12T01:50:22.613947+0000","last_fullsized":"2024-09-12T01:50:22.613947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484475+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:51:21.484475+0000","last_peered":"2024-09-12T01:51:21.484475+0000","last_clean":"2024-09-12T01:51:21.484475+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:51:21.484475+0000","last_undegraded":"2024-09-12T01:51:21.484475+0000","last_fullsized":"2024-09-12T01:51:21.484475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629587+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:22.629587+0000","last_peered":"2024-09-12T01:50:22.629587+0000","last_clean":"2024-09-12T01:50:22.629587+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:22.629587+0000","last_undegraded":"2024-09-12T01:50:22.629587+0000","last_fullsized":"2024-09-12T01:50:22.629587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489454+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:51:21.489454+0000","last_peered":"2024-09-12T01:51:21.489454+0000","last_clean":"2024-09-12T01:51:21.489454+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:51:21.489454+0000","last_undegraded":"2024-09-12T01:51:21.489454+0000","last_fullsized":"2024-09-12T01:51:21.489454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'8","reported_seq":139,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:51.531892+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:51:51.531892+0000","last_peered":"2024-09-12T01:51:51.531892+0000","last_clean":"2024-09-12T01:51:51.531892+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:51:51.531892+0000","last_undegraded":"2024-09-12T01:51:51.531892+0000","last_fullsized":"2024-09-12T01:51:51.531892+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2012,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.500017+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:51:21.500017+0000","last_peered":"2024-09-12T01:51:21.500017+0000","last_clean":"2024-09-12T01:51:21.500017+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:51:21.500017+0000","last_undegraded":"2024-09-12T01:51:21.500017+0000","last_fullsized":"2024-09-12T01:51:21.500017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":333,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612725+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:50:22.612725+0000","last_peered":"2024-09-12T01:50:22.612725+0000","last_clean":"2024-09-12T01:50:22.612725+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:50:22.612725+0000","last_undegraded":"2024-09-12T01:50:22.612725+0000","last_fullsized":"2024-09-12T01:50:22.612725+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681903+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:22.681903+0000","last_peered":"2024-09-12T01:50:22.681903+0000","last_clean":"2024-09-12T01:50:22.681903+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:22.681903+0000","last_undegraded":"2024-09-12T01:50:22.681903+0000","last_fullsized":"2024-09-12T01:50:22.681903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.498284+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:51:21.498284+0000","last_peered":"2024-09-12T01:51:21.498284+0000","last_clean":"2024-09-12T01:51:21.498284+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:51:21.498284+0000","last_undegraded":"2024-09-12T01:51:21.498284+0000","last_fullsized":"2024-09-12T01:51:21.498284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612642+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:22.612642+0000","last_peered":"2024-09-12T01:50:22.612642+0000","last_clean":"2024-09-12T01:50:22.612642+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:22.612642+0000","last_undegraded":"2024-09-12T01:50:22.612642+0000","last_fullsized":"2024-09-12T01:50:22.612642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.481982+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:51:21.481982+0000","last_peered":"2024-09-12T01:51:21.481982+0000","last_clean":"2024-09-12T01:51:21.481982+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:51:21.481982+0000","last_undegraded":"2024-09-12T01:51:21.481982+0000","last_fullsized":"2024-09-12T01:51:21.481982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":129,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:48.525637+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:51:48.525637+0000","last_peered":"2024-09-12T01:51:48.525637+0000","last_clean":"2024-09-12T01:51:48.525637+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:51:48.525637+0000","last_undegraded":"2024-09-12T01:51:48.525637+0000","last_fullsized":"2024-09-12T01:51:48.525637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.477907+0000","last_change":"2024-09-12T01:50:22.682963+0000","last_active":"2024-09-12T01:51:21.477907+0000","last_peered":"2024-09-12T01:51:21.477907+0000","last_clean":"2024-09-12T01:51:21.477907+0000","last_became_active":"2024-09-12T01:50:22.682611+0000","last_became_peered":"2024-09-12T01:50:22.682611+0000","last_unstale":"2024-09-12T01:51:21.477907+0000","last_undegraded":"2024-09-12T01:51:21.477907+0000","last_fullsized":"2024-09-12T01:51:21.477907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:01.295098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'7","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:47.795359+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:51:47.795359+0000","last_peered":"2024-09-12T01:51:47.795359+0000","last_clean":"2024-09-12T01:51:47.795359+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:51:47.795359+0000","last_undegraded":"2024-09-12T01:51:47.795359+0000","last_fullsized":"2024-09-12T01:51:47.795359+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489407+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:51:21.489407+0000","last_peered":"2024-09-12T01:51:21.489407+0000","last_clean":"2024-09-12T01:51:21.489407+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:51:21.489407+0000","last_undegraded":"2024-09-12T01:51:21.489407+0000","last_fullsized":"2024-09-12T01:51:21.489407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.683026+0000","last_change":"2024-09-12T01:50:22.683026+0000","last_active":"2024-09-12T01:50:22.683026+0000","last_peered":"2024-09-12T01:50:22.683026+0000","last_clean":"2024-09-12T01:50:22.683026+0000","last_became_active":"2024-09-12T01:50:22.682461+0000","last_became_peered":"2024-09-12T01:50:22.682461+0000","last_unstale":"2024-09-12T01:50:22.683026+0000","last_undegraded":"2024-09-12T01:50:22.683026+0000","last_fullsized":"2024-09-12T01:50:22.683026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.470081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.490807+0000","last_change":"2024-09-12T01:50:22.618050+0000","last_active":"2024-09-12T01:51:21.490807+0000","last_peered":"2024-09-12T01:51:21.490807+0000","last_clean":"2024-09-12T01:51:21.490807+0000","last_became_active":"2024-09-12T01:50:22.614871+0000","last_became_peered":"2024-09-12T01:50:22.614871+0000","last_unstale":"2024-09-12T01:51:21.490807+0000","last_undegraded":"2024-09-12T01:51:21.490807+0000","last_fullsized":"2024-09-12T01:51:21.490807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:47.652568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611446+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:22.611446+0000","last_peered":"2024-09-12T01:50:22.611446+0000","last_clean":"2024-09-12T01:50:22.611446+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:22.611446+0000","last_undegraded":"2024-09-12T01:50:22.611446+0000","last_fullsized":"2024-09-12T01:50:22.611446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.481782+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:51:21.481782+0000","last_peered":"2024-09-12T01:51:21.481782+0000","last_clean":"2024-09-12T01:51:21.481782+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:51:21.481782+0000","last_undegraded":"2024-09-12T01:51:21.481782+0000","last_fullsized":"2024-09-12T01:51:21.481782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'16","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:22.331135+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:51:22.331135+0000","last_peered":"2024-09-12T01:51:22.331135+0000","last_clean":"2024-09-12T01:51:22.331135+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:51:22.331135+0000","last_undegraded":"2024-09-12T01:51:22.331135+0000","last_fullsized":"2024-09-12T01:51:22.331135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487040+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:51:21.487040+0000","last_peered":"2024-09-12T01:51:21.487040+0000","last_clean":"2024-09-12T01:51:21.487040+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:51:21.487040+0000","last_undegraded":"2024-09-12T01:51:21.487040+0000","last_fullsized":"2024-09-12T01:51:21.487040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681518+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:22.681518+0000","last_peered":"2024-09-12T01:50:22.681518+0000","last_clean":"2024-09-12T01:50:22.681518+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:22.681518+0000","last_undegraded":"2024-09-12T01:50:22.681518+0000","last_fullsized":"2024-09-12T01:50:22.681518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489524+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:51:21.489524+0000","last_peered":"2024-09-12T01:51:21.489524+0000","last_clean":"2024-09-12T01:51:21.489524+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:51:21.489524+0000","last_undegraded":"2024-09-12T01:51:21.489524+0000","last_fullsized":"2024-09-12T01:51:21.489524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611066+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:22.611066+0000","last_peered":"2024-09-12T01:50:22.611066+0000","last_clean":"2024-09-12T01:50:22.611066+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:22.611066+0000","last_undegraded":"2024-09-12T01:50:22.611066+0000","last_fullsized":"2024-09-12T01:50:22.611066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.451681+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:51:21.451681+0000","last_peered":"2024-09-12T01:51:21.451681+0000","last_clean":"2024-09-12T01:51:21.451681+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:51:21.451681+0000","last_undegraded":"2024-09-12T01:51:21.451681+0000","last_fullsized":"2024-09-12T01:51:21.451681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613860+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:22.613860+0000","last_peered":"2024-09-12T01:50:22.613860+0000","last_clean":"2024-09-12T01:50:22.613860+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:22.613860+0000","last_undegraded":"2024-09-12T01:50:22.613860+0000","last_fullsized":"2024-09-12T01:50:22.613860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484300+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:51:21.484300+0000","last_peered":"2024-09-12T01:51:21.484300+0000","last_clean":"2024-09-12T01:51:21.484300+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:51:21.484300+0000","last_undegraded":"2024-09-12T01:51:21.484300+0000","last_fullsized":"2024-09-12T01:51:21.484300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612140+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:22.612140+0000","last_peered":"2024-09-12T01:50:22.612140+0000","last_clean":"2024-09-12T01:50:22.612140+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:22.612140+0000","last_undegraded":"2024-09-12T01:50:22.612140+0000","last_fullsized":"2024-09-12T01:50:22.612140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493228+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:51:21.493228+0000","last_peered":"2024-09-12T01:51:21.493228+0000","last_clean":"2024-09-12T01:51:21.493228+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:51:21.493228+0000","last_undegraded":"2024-09-12T01:51:21.493228+0000","last_fullsized":"2024-09-12T01:51:21.493228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611281+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:22.611281+0000","last_peered":"2024-09-12T01:50:22.611281+0000","last_clean":"2024-09-12T01:50:22.611281+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:22.611281+0000","last_undegraded":"2024-09-12T01:50:22.611281+0000","last_fullsized":"2024-09-12T01:50:22.611281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501783+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:51:21.501783+0000","last_peered":"2024-09-12T01:51:21.501783+0000","last_clean":"2024-09-12T01:51:21.501783+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:51:21.501783+0000","last_undegraded":"2024-09-12T01:51:21.501783+0000","last_fullsized":"2024-09-12T01:51:21.501783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.497079+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:51:21.497079+0000","last_peered":"2024-09-12T01:51:21.497079+0000","last_clean":"2024-09-12T01:51:21.497079+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:51:21.497079+0000","last_undegraded":"2024-09-12T01:51:21.497079+0000","last_fullsized":"2024-09-12T01:51:21.497079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611510+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:22.611510+0000","last_peered":"2024-09-12T01:50:22.611510+0000","last_clean":"2024-09-12T01:50:22.611510+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:22.611510+0000","last_undegraded":"2024-09-12T01:50:22.611510+0000","last_fullsized":"2024-09-12T01:50:22.611510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501244+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:51:21.501244+0000","last_peered":"2024-09-12T01:51:21.501244+0000","last_clean":"2024-09-12T01:51:21.501244+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:51:21.501244+0000","last_undegraded":"2024-09-12T01:51:21.501244+0000","last_fullsized":"2024-09-12T01:51:21.501244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611302+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:22.611302+0000","last_peered":"2024-09-12T01:50:22.611302+0000","last_clean":"2024-09-12T01:50:22.611302+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:22.611302+0000","last_undegraded":"2024-09-12T01:50:22.611302+0000","last_fullsized":"2024-09-12T01:50:22.611302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.502276+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:51:21.502276+0000","last_peered":"2024-09-12T01:51:21.502276+0000","last_clean":"2024-09-12T01:51:21.502276+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:51:21.502276+0000","last_undegraded":"2024-09-12T01:51:21.502276+0000","last_fullsized":"2024-09-12T01:51:21.502276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614331+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:50:22.614331+0000","last_peered":"2024-09-12T01:50:22.614331+0000","last_clean":"2024-09-12T01:50:22.614331+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:50:22.614331+0000","last_undegraded":"2024-09-12T01:50:22.614331+0000","last_fullsized":"2024-09-12T01:50:22.614331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487761+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:51:21.487761+0000","last_peered":"2024-09-12T01:51:21.487761+0000","last_clean":"2024-09-12T01:51:21.487761+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:51:21.487761+0000","last_undegraded":"2024-09-12T01:51:21.487761+0000","last_fullsized":"2024-09-12T01:51:21.487761+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:50.798713+0000","last_change":"2024-09-12T01:50:22.691988+0000","last_active":"2024-09-12T01:51:50.798713+0000","last_peered":"2024-09-12T01:51:50.798713+0000","last_clean":"2024-09-12T01:51:50.798713+0000","last_became_active":"2024-09-12T01:50:22.682676+0000","last_became_peered":"2024-09-12T01:50:22.682676+0000","last_unstale":"2024-09-12T01:51:50.798713+0000","last_undegraded":"2024-09-12T01:51:50.798713+0000","last_fullsized":"2024-09-12T01:51:50.798713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:56.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70891,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1056,"num_read_kb":606,"num_write":262,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":50275,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":212673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547236,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776168,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32764,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712388,"statfs":{"total":95995035648,"available":95961485312,"internally_reserved":0,"allocated":1617920,"data_stored":1091952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939694,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":438411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1031195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528380,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":438545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1544192,"data_stored":1031011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":500739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":440520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":502017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":440192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:51:55.313 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:51:55.595 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:56.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.027+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/2095570151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb14106a80 msgr2=0x7fcb14106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:56.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.027+0000 7fcb1c1ac640 1 --2- 172.21.15.70:0/2095570151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb14106a80 0x7fcb14106e60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009930 tx=0x7fcb1002a420 comp rx=0 tx=0).stop 2024-09-12T01:51:56.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.027+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/2095570151 shutdown_connections 2024-09-12T01:51:56.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.027+0000 7fcb1c1ac640 1 --2- 172.21.15.70:0/2095570151 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb14101420 0x7fcb1410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:56.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.027+0000 7fcb1c1ac640 1 --2- 172.21.15.70:0/2095570151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb14100a80 0x7fcb14100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:56.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.027+0000 7fcb1c1ac640 1 --2- 172.21.15.70:0/2095570151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb14106a80 0x7fcb14106e60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:56.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.027+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/2095570151 >> 172.21.15.70:0/2095570151 conn(0x7fcb140fc7a0 msgr2=0x7fcb140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:56.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.027+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/2095570151 shutdown_connections 2024-09-12T01:51:56.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.027+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/2095570151 wait complete. 2024-09-12T01:51:56.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb1c1ac640 1 Processor -- start 2024-09-12T01:51:56.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb1c1ac640 1 -- start start 2024-09-12T01:51:56.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb1c1ac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb14100a80 0x7fcb14102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:56.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb1c1ac640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb14101420 0x7fcb14102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:56.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb1c1ac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb14106a80 0x7fcb141030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:56.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb1c1ac640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14110fe0 con 0x7fcb14106a80 2024-09-12T01:51:56.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb1c1ac640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14110e60 con 0x7fcb14100a80 2024-09-12T01:51:56.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb1c1ac640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14111160 con 0x7fcb14101420 2024-09-12T01:51:56.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb1a749640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb14106a80 0x7fcb141030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:56.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb1a749640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb14106a80 0x7fcb141030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52956/0 (socket says 172.21.15.70:52956) 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb1a749640 1 -- 172.21.15.70:0/1802623934 learned_addr learned my addr 172.21.15.70:0/1802623934 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb19f48640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb14100a80 0x7fcb14102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.028+0000 7fcb19747640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb14101420 0x7fcb14102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.029+0000 7fcb1a749640 1 -- 172.21.15.70:0/1802623934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb14101420 msgr2=0x7fcb14102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.029+0000 7fcb1a749640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb14101420 0x7fcb14102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.029+0000 7fcb1a749640 1 -- 172.21.15.70:0/1802623934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb14100a80 msgr2=0x7fcb14102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.029+0000 7fcb1a749640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb14100a80 0x7fcb14102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.029+0000 7fcb1a749640 1 -- 172.21.15.70:0/1802623934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb141a6a50 con 0x7fcb14106a80 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.029+0000 7fcb19747640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb14101420 0x7fcb14102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.029+0000 7fcb1a749640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb14106a80 0x7fcb141030d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00b970 tx=0x7fcb0c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.029+0000 7fcb0affd640 1 -- 172.21.15.70:0/1802623934 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c019070 con 0x7fcb14106a80 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.029+0000 7fcb0affd640 1 -- 172.21.15.70:0/1802623934 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb0c00cb40 con 0x7fcb14106a80 2024-09-12T01:51:56.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.029+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/1802623934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb141a6d40 con 0x7fcb14106a80 2024-09-12T01:51:56.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.029+0000 7fcb0affd640 1 -- 172.21.15.70:0/1802623934 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c007700 con 0x7fcb14106a80 2024-09-12T01:51:56.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.029+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/1802623934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb141a7280 con 0x7fcb14106a80 2024-09-12T01:51:56.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.030+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/1802623934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb14100ee0 con 0x7fcb14106a80 2024-09-12T01:51:56.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.031+0000 7fcb0affd640 1 -- 172.21.15.70:0/1802623934 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcb0c01c070 con 0x7fcb14106a80 2024-09-12T01:51:56.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.032+0000 7fcb0affd640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcb000a2b80 0x7fcb000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:56.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.032+0000 7fcb19f48640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcb000a2b80 0x7fcb000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:56.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.032+0000 7fcb0affd640 1 -- 172.21.15.70:0/1802623934 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fcb0c0ce5b0 con 0x7fcb14106a80 2024-09-12T01:51:56.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.032+0000 7fcb19f48640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcb000a2b80 0x7fcb000a5040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009900 tx=0x7fcb100058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:56.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.036+0000 7fcb0affd640 1 -- 172.21.15.70:0/1802623934 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb0c09aec0 con 0x7fcb14106a80 2024-09-12T01:51:56.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.238+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/1802623934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb141a7510 con 0x7fcb14106a80 2024-09-12T01:51:56.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.238+0000 7fcb0affd640 1 -- 172.21.15.70:0/1802623934 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7fcb0c09f1c0 con 0x7fcb14106a80 2024-09-12T01:51:56.239 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:56.240 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-12T01:51:51:564560+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:51:51.387340+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24427,24433,24437,24445,24452]},"id":1}]} 2024-09-12T01:51:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-12T01:51:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.240+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/1802623934 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcb000a2b80 msgr2=0x7fcb000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.240+0000 7fcb1c1ac640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcb000a2b80 0x7fcb000a5040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009900 tx=0x7fcb100058d0 comp rx=0 tx=0).stop 2024-09-12T01:51:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.240+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/1802623934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb14106a80 msgr2=0x7fcb141030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.240+0000 7fcb1c1ac640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb14106a80 0x7fcb141030d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00b970 tx=0x7fcb0c00be30 comp rx=0 tx=0).stop 2024-09-12T01:51:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.240+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/1802623934 shutdown_connections 2024-09-12T01:51:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.240+0000 7fcb1c1ac640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fcb000a2b80 0x7fcb000a5040 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.240+0000 7fcb1c1ac640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb14106a80 0x7fcb141030d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.240+0000 7fcb1c1ac640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb14101420 0x7fcb14102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.240+0000 7fcb1c1ac640 1 --2- 172.21.15.70:0/1802623934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb14100a80 0x7fcb14102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.240+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/1802623934 >> 172.21.15.70:0/1802623934 conn(0x7fcb140fc7a0 msgr2=0x7fcb1406a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.241+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/1802623934 shutdown_connections 2024-09-12T01:51:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:56.241+0000 7fcb1c1ac640 1 -- 172.21.15.70:0/1802623934 wait complete. 2024-09-12T01:51:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:56 smithi191 ceph-mon[35770]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:56 smithi191 ceph-mon[35770]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:56 smithi191 ceph-mon[35770]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:56 smithi191 ceph-mon[35770]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T01:51:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:56 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1802623934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:56 smithi152 ceph-mon[35055]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:56 smithi152 ceph-mon[35055]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:56 smithi152 ceph-mon[35055]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:57.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:56 smithi152 ceph-mon[35055]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T01:51:57.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:56 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1802623934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:57.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:56 smithi070 ceph-mon[31177]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:57.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:56 smithi070 ceph-mon[31177]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:57.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:56 smithi070 ceph-mon[31177]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:51:57.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:56 smithi070 ceph-mon[31177]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-12T01:51:57.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:56 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1802623934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:51:57.052 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:51:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:57.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.772+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/1868777939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b58100a80 msgr2=0x7f8b58100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:57.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.772+0000 7f8b5f5ce640 1 --2- 172.21.15.70:0/1868777939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b58100a80 0x7f8b58100ee0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009930 tx=0x7f8b5402a420 comp rx=0 tx=0).stop 2024-09-12T01:51:57.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.772+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/1868777939 shutdown_connections 2024-09-12T01:51:57.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.772+0000 7f8b5f5ce640 1 --2- 172.21.15.70:0/1868777939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b58101420 0x7f8b5810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:57.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.772+0000 7f8b5f5ce640 1 --2- 172.21.15.70:0/1868777939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b58100a80 0x7f8b58100ee0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:57.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.772+0000 7f8b5f5ce640 1 --2- 172.21.15.70:0/1868777939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b58106a80 0x7f8b58106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:57.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.772+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/1868777939 >> 172.21.15.70:0/1868777939 conn(0x7f8b580fc7a0 msgr2=0x7f8b580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:57.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.772+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/1868777939 shutdown_connections 2024-09-12T01:51:57.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.772+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/1868777939 wait complete. 2024-09-12T01:51:57.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.772+0000 7f8b5f5ce640 1 Processor -- start 2024-09-12T01:51:57.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5f5ce640 1 -- start start 2024-09-12T01:51:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5f5ce640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b58100a80 0x7f8b58199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5f5ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b58101420 0x7f8b581998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5f5ce640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b58106a80 0x7f8b581a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5f5ce640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8b58110fa0 con 0x7f8b58101420 2024-09-12T01:51:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5f5ce640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8b58110e20 con 0x7f8b58100a80 2024-09-12T01:51:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5f5ce640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8b58111120 con 0x7f8b58106a80 2024-09-12T01:51:57.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5cb69640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b58101420 0x7f8b581998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5cb69640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b58101420 0x7f8b581998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52974/0 (socket says 172.21.15.70:52974) 2024-09-12T01:51:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5cb69640 1 -- 172.21.15.70:0/2790731415 learned_addr learned my addr 172.21.15.70:0/2790731415 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5d36a640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b58100a80 0x7f8b58199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5db6b640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b58106a80 0x7f8b581a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5cb69640 1 -- 172.21.15.70:0/2790731415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b58106a80 msgr2=0x7f8b581a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5cb69640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b58106a80 0x7f8b581a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5cb69640 1 -- 172.21.15.70:0/2790731415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b58100a80 msgr2=0x7f8b58199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:57.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5cb69640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b58100a80 0x7f8b58199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.773+0000 7f8b5cb69640 1 -- 172.21.15.70:0/2790731415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b581a4950 con 0x7f8b58101420 2024-09-12T01:51:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.774+0000 7f8b5cb69640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b58101420 0x7f8b581998d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009230 tx=0x7f8b54004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.774+0000 7f8b4a7fc640 1 -- 172.21.15.70:0/2790731415 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5403f030 con 0x7f8b58101420 2024-09-12T01:51:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.774+0000 7f8b4a7fc640 1 -- 172.21.15.70:0/2790731415 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8b54003af0 con 0x7f8b58101420 2024-09-12T01:51:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.774+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/2790731415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b581a4b20 con 0x7f8b58101420 2024-09-12T01:51:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.774+0000 7f8b4a7fc640 1 -- 172.21.15.70:0/2790731415 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54035070 con 0x7f8b58101420 2024-09-12T01:51:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.774+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/2790731415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b581a4fd0 con 0x7f8b58101420 2024-09-12T01:51:57.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.775+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/2790731415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b58100ee0 con 0x7f8b58101420 2024-09-12T01:51:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.776+0000 7f8b4a7fc640 1 -- 172.21.15.70:0/2790731415 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8b54042030 con 0x7f8b58101420 2024-09-12T01:51:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.777+0000 7f8b4a7fc640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8b440a2c00 0x7f8b440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.777+0000 7f8b5d36a640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8b440a2c00 0x7f8b440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.777+0000 7f8b4a7fc640 1 -- 172.21.15.70:0/2790731415 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8b540efb10 con 0x7f8b58101420 2024-09-12T01:51:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.777+0000 7f8b5d36a640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8b440a2c00 0x7f8b440a50c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0058c0 tx=0x7f8b4c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:57.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.780+0000 7f8b4a7fc640 1 -- 172.21.15.70:0/2790731415 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b540bc4e0 con 0x7f8b58101420 2024-09-12T01:51:57.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.946+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/2790731415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b581a51a0 con 0x7f8b58101420 2024-09-12T01:51:57.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.948+0000 7f8b4a7fc640 1 -- 172.21.15.70:0/2790731415 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22713 (secure 0 0 0) 0x7f8b540c07e0 con 0x7f8b58101420 2024-09-12T01:51:57.950 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:51:57.950 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:50:22.600430+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:49:54.140097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:49:56.005187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:51:57.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.951+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/2790731415 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8b440a2c00 msgr2=0x7f8b440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:57.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.951+0000 7f8b5f5ce640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8b440a2c00 0x7f8b440a50c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0058c0 tx=0x7f8b4c00a2d0 comp rx=0 tx=0).stop 2024-09-12T01:51:57.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.951+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/2790731415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b58101420 msgr2=0x7f8b581998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:57.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.951+0000 7f8b5f5ce640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b58101420 0x7f8b581998d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009230 tx=0x7f8b54004270 comp rx=0 tx=0).stop 2024-09-12T01:51:57.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.951+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/2790731415 shutdown_connections 2024-09-12T01:51:57.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.951+0000 7f8b5f5ce640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8b440a2c00 0x7f8b440a50c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:57.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.951+0000 7f8b5f5ce640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b58106a80 0x7f8b581a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:57.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.951+0000 7f8b5f5ce640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b58101420 0x7f8b581998d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:57.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.951+0000 7f8b5f5ce640 1 --2- 172.21.15.70:0/2790731415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b58100a80 0x7f8b58199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:57.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.951+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/2790731415 >> 172.21.15.70:0/2790731415 conn(0x7f8b580fc7a0 msgr2=0x7f8b580fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:57.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.951+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/2790731415 shutdown_connections 2024-09-12T01:51:57.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:57.951+0000 7f8b5f5ce640 1 -- 172.21.15.70:0/2790731415 wait complete. 2024-09-12T01:51:58.592 DEBUG:tasks.fwd_scrub:Yielding 2024-09-12T01:51:58.592 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-12T01:51:58.605 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:51:58.605 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-12T01:51:58.606 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-12T01:51:58.606 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:51:58.606 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:51:58.608 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-12T01:51:58.621 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T01:51:58.622 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:51:58.865 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:58.876 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:51:58.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:58 smithi191 ceph-mon[35770]: pgmap v331: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:51:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:51:58 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2790731415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:51:58.988 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:58 smithi070 ceph-mon[31177]: pgmap v331: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:51:58.988 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:51:58 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2790731415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:51:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:58 smithi152 ceph-mon[35055]: pgmap v331: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:51:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:51:58 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2790731415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:51:59.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.324+0000 7f4f47a35640 1 -- 172.21.15.70:0/2768025122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f40100b30 msgr2=0x7f4f40100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:59.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.324+0000 7f4f47a35640 1 --2- 172.21.15.70:0/2768025122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f40100b30 0x7f4f40100f10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009900 tx=0x7f4f3c02a470 comp rx=0 tx=0).stop 2024-09-12T01:51:59.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.324+0000 7f4f47a35640 1 -- 172.21.15.70:0/2768025122 shutdown_connections 2024-09-12T01:51:59.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.324+0000 7f4f47a35640 1 --2- 172.21.15.70:0/2768025122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f40105f40 0x7f4f401063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.324+0000 7f4f47a35640 1 --2- 172.21.15.70:0/2768025122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f40101450 0x7f4f40105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.324+0000 7f4f47a35640 1 --2- 172.21.15.70:0/2768025122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f40100b30 0x7f4f40100f10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.324+0000 7f4f47a35640 1 -- 172.21.15.70:0/2768025122 >> 172.21.15.70:0/2768025122 conn(0x7f4f400fc7a0 msgr2=0x7f4f400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:59.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.324+0000 7f4f47a35640 1 -- 172.21.15.70:0/2768025122 shutdown_connections 2024-09-12T01:51:59.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.324+0000 7f4f47a35640 1 -- 172.21.15.70:0/2768025122 wait complete. 2024-09-12T01:51:59.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.325+0000 7f4f47a35640 1 Processor -- start 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.325+0000 7f4f47a35640 1 -- start start 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.325+0000 7f4f47a35640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f40100b30 0x7f4f401a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.325+0000 7f4f47a35640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f40101450 0x7f4f401a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.325+0000 7f4f47a35640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f40105f40 0x7f4f4019e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.325+0000 7f4f47a35640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f401186a0 con 0x7f4f40100b30 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.325+0000 7f4f47a35640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4f40118520 con 0x7f4f40101450 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.325+0000 7f4f47a35640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f40118820 con 0x7f4f40105f40 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.325+0000 7f4f457d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f40100b30 0x7f4f401a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.325+0000 7f4f457d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f40100b30 0x7f4f401a4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52990/0 (socket says 172.21.15.70:52990) 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.325+0000 7f4f457d1640 1 -- 172.21.15.70:0/2427375647 learned_addr learned my addr 172.21.15.70:0/2427375647 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f45fd2640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f40105f40 0x7f4f4019e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f44fd0640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f40101450 0x7f4f401a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f457d1640 1 -- 172.21.15.70:0/2427375647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f40105f40 msgr2=0x7f4f4019e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f457d1640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f40105f40 0x7f4f4019e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f457d1640 1 -- 172.21.15.70:0/2427375647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f40101450 msgr2=0x7f4f401a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f457d1640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f40101450 0x7f4f401a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f457d1640 1 -- 172.21.15.70:0/2427375647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4019f080 con 0x7f4f40100b30 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f44fd0640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f40101450 0x7f4f401a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f457d1640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f40100b30 0x7f4f401a4790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c006010 tx=0x7f4f3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f367fc640 1 -- 172.21.15.70:0/2427375647 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c03f030 con 0x7f4f40100b30 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f367fc640 1 -- 172.21.15.70:0/2427375647 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f3c003d00 con 0x7f4f40100b30 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f47a35640 1 -- 172.21.15.70:0/2427375647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4019f310 con 0x7f4f40100b30 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f367fc640 1 -- 172.21.15.70:0/2427375647 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c035070 con 0x7f4f40100b30 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.326+0000 7f4f47a35640 1 -- 172.21.15.70:0/2427375647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f401ab660 con 0x7f4f40100b30 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.328+0000 7f4f367fc640 1 -- 172.21.15.70:0/2427375647 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4f3c042030 con 0x7f4f40100b30 2024-09-12T01:51:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f49e0e740 1 Processor -- start 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f49e0e740 1 -- start start 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f49e0e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045b9b60 0x55f7045b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f49e0e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 0x55f7045c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f49e0e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 0x55f7045c7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f49e0e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f70451f280 con 0x55f7045c4d40 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f49e0e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f7044c6b10 con 0x55f7045b9b60 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f49e0e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f70451b240 con 0x55f7045ba480 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f367fc640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4f2c0a2b80 0x7f4f2c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f44fd0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 0x55f7045c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f44fd0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 0x55f7045c7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53000/0 (socket says 172.21.15.70:53000) 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f44fd0640 1 -- 172.21.15.70:0/2028068500 learned_addr learned my addr 172.21.15.70:0/2028068500 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f45fd2640 1 --2- 172.21.15.70:0/2028068500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045b9b60 0x55f7045b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f457d1640 1 --2- 172.21.15.70:0/2028068500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 0x55f7045c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.329+0000 7f4f45fd2640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4f2c0a2b80 0x7f4f2c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.330+0000 7f4f367fc640 1 -- 172.21.15.70:0/2427375647 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4f3c0ef740 con 0x7f4f40100b30 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.330+0000 7f4f44fd0640 1 -- 172.21.15.70:0/2028068500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 msgr2=0x55f7045c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.330+0000 7f4f44fd0640 1 --2- 172.21.15.70:0/2028068500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 0x55f7045c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.330+0000 7f4f44fd0640 1 -- 172.21.15.70:0/2028068500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045b9b60 msgr2=0x55f7045b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.330+0000 7f4f44fd0640 1 --2- 172.21.15.70:0/2028068500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045b9b60 0x55f7045b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.330+0000 7f4f44fd0640 1 -- 172.21.15.70:0/2028068500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7044d31f0 con 0x55f7045c4d40 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.330+0000 7f4f45fd2640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4f2c0a2b80 0x7f4f2c0a5040 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4f38005c40 tx=0x7f4f38005bd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.330+0000 7f4f44fd0640 1 --2- 172.21.15.70:0/2028068500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 0x55f7045c7130 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000bae0 tx=0x7f4f3000d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8002050309284ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.330+0000 7f4f2b7fe640 1 -- 172.21.15.70:0/2028068500 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f30017420 con 0x55f7045c4d40 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.330+0000 7f4f2b7fe640 1 -- 172.21.15.70:0/2028068500 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f30017ac0 con 0x55f7045c4d40 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.330+0000 7f4f2b7fe640 1 -- 172.21.15.70:0/2028068500 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3000fb90 con 0x55f7045c4d40 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.331+0000 7f4f49e0e740 1 -- 172.21.15.70:0/2028068500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 msgr2=0x55f7045c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:59.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.331+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/2028068500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 0x55f7045c7130 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000bae0 tx=0x7f4f3000d340 comp rx=0 tx=0).stop 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.331+0000 7f4f49e0e740 1 -- 172.21.15.70:0/2028068500 shutdown_connections 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.331+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/2028068500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 0x55f7045c7130 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.331+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/2028068500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 0x55f7045c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.331+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/2028068500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045b9b60 0x55f7045b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.331+0000 7f4f49e0e740 1 -- 172.21.15.70:0/2028068500 >> 172.21.15.70:0/2028068500 conn(0x55f7045b60f0 msgr2=0x55f7045b64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.331+0000 7f4f49e0e740 1 -- 172.21.15.70:0/2028068500 shutdown_connections 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.331+0000 7f4f49e0e740 1 -- 172.21.15.70:0/2028068500 wait complete. 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.331+0000 7f4f49e0e740 1 -- start start 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.331+0000 7f4f49e0e740 1 Processor -- start 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f49e0e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 0x55f7045c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f49e0e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 0x55f7045c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f49e0e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045c4d40 0x55f7045c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f49e0e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f7045c7910 con 0x55f7045b9b60 2024-09-12T01:51:59.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f49e0e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f7044d9f10 con 0x55f7045c4d40 2024-09-12T01:51:59.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f49e0e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f7045c7a90 con 0x55f7045ba480 2024-09-12T01:51:59.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f49e0e740 10 client.0 _ll_register_callbacks cb 0x55f7044a2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:59.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f457d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 0x55f7045c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f457d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 0x55f7045c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53012/0 (socket says 172.21.15.70:53012) 2024-09-12T01:51:59.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f457d1640 1 -- 172.21.15.70:0/1809181559 learned_addr learned my addr 172.21.15.70:0/1809181559 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:59.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f45fd2640 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045c4d40 0x55f7045c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f457d1640 1 -- 172.21.15.70:0/1809181559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 msgr2=0x55f7045c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:59.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f457d1640 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 0x55f7045c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f457d1640 1 -- 172.21.15.70:0/1809181559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045c4d40 msgr2=0x55f7045c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:59.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f457d1640 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045c4d40 0x55f7045c22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f457d1640 1 -- 172.21.15.70:0/1809181559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7042906a0 con 0x55f7045b9b60 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f45fd2640 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045c4d40 0x55f7045c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f457d1640 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 0x55f7045c47f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c08f1b0 tx=0x7f4f3c08bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e00ed2325a02461 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.332+0000 7f4f28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.333+0000 7f4f28ff9640 1 -- 172.21.15.70:0/1809181559 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c049040 con 0x55f7045b9b60 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.333+0000 7f4f28ff9640 1 -- 172.21.15.70:0/1809181559 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4f3c0c00c0 con 0x55f7045b9b60 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.333+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1809181559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f30017ac0 con 0x55f7045b9b60 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.333+0000 7f4f28ff9640 1 -- 172.21.15.70:0/1809181559 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f3c0bb9c0 con 0x55f7045b9b60 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.333+0000 7f4f49e0e740 10 client.15345 fetch_fsmap learned FSMap version 28 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.333+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1809181559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7045d3440 con 0x55f7045b9b60 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.333+0000 7f4f28ff9640 1 -- 172.21.15.70:0/1809181559 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f30017ac0 con 0x55f7045b9b60 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.334+0000 7f4f28ff9640 1 -- 172.21.15.70:0/1809181559 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4f3c0b86d0 con 0x55f7045b9b60 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.334+0000 7f4f49e0e740 10 client.15345 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:51:59.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.334+0000 7f4f49e0e740 10 client.15345 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:51:59.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.334+0000 7f4f49e0e740 20 client.15345 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:59.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.334+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f7045d4890 0x55f7045d6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.334+0000 7f4f49e0e740 4 client.15345 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:51:59.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.334+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1809181559 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f70452c7f0 con 0x55f7045d4890 2024-09-12T01:51:59.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.334+0000 7f4f44fd0640 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f7045d4890 0x55f7045d6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.334+0000 7f4f44fd0640 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f7045d4890 0x55f7045d6d20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=857554029de9e4a9 server_cookie=589363e386b9abb7 in_seq=0 out_seq=0 2024-09-12T01:51:59.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.334+0000 7f4f28ff9640 10 client.15345 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:51:59.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f28ff9640 1 -- 172.21.15.70:0/1809181559 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f70452c7f0 con 0x55f7045d4890 2024-09-12T01:51:59.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f28ff9640 10 client.15345 handle_command_reply: tid=0 2024-09-12T01:51:59.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f49e0e740 1 client.15345 shutdown 2024-09-12T01:51:59.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1809181559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 msgr2=0x55f7045c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:59.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 0x55f7045c47f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c08f1b0 tx=0x7f4f3c08bfd0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1809181559 shutdown_connections 2024-09-12T01:51:59.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f7045d4890 0x55f7045d6d20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045c4d40 0x55f7045c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 0x55f7045c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f28ff9640 0 client.15345 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:51:59.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/1809181559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 0x55f7045c47f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1809181559 >> 172.21.15.70:0/1809181559 conn(0x55f7045b60f0 msgr2=0x55f7045b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:59.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1809181559 shutdown_connections 2024-09-12T01:51:59.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.335+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1809181559 wait complete. 2024-09-12T01:51:59.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.336+0000 7f4f49e0e740 20 client.15345 trim_cache size 0 max 16384 2024-09-12T01:51:59.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.352+0000 7f4f49e0e740 1 Processor -- start 2024-09-12T01:51:59.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.352+0000 7f4f49e0e740 1 -- start start 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f49e0e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045b9b60 0x55f7045bc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f49e0e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045ba480 0x55f7045dc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f49e0e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 0x55f7045dcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f49e0e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f401b3c60 con 0x55f7045c4d40 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f49e0e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4f401b57a0 con 0x55f7045ba480 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f49e0e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f401b4330 con 0x55f7045b9b60 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f45fd2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 0x55f7045dcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f45fd2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 0x55f7045dcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53018/0 (socket says 172.21.15.70:53018) 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f45fd2640 1 -- 172.21.15.70:0/566668500 learned_addr learned my addr 172.21.15.70:0/566668500 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f44fd0640 1 --2- 172.21.15.70:0/566668500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045ba480 0x55f7045dc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f457d1640 1 --2- 172.21.15.70:0/566668500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045b9b60 0x55f7045bc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f45fd2640 1 -- 172.21.15.70:0/566668500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045b9b60 msgr2=0x55f7045bc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:59.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f45fd2640 1 --2- 172.21.15.70:0/566668500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045b9b60 0x55f7045bc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f45fd2640 1 -- 172.21.15.70:0/566668500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045ba480 msgr2=0x55f7045dc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:59.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f45fd2640 1 --2- 172.21.15.70:0/566668500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045ba480 0x55f7045dc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f45fd2640 1 -- 172.21.15.70:0/566668500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7045b5f20 con 0x55f7045c4d40 2024-09-12T01:51:59.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f45fd2640 1 --2- 172.21.15.70:0/566668500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 0x55f7045dcb70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4f38012810 tx=0x7f4f380096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9abfa8b2cee9a78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:59.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f2affd640 1 -- 172.21.15.70:0/566668500 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f380105d0 con 0x55f7045c4d40 2024-09-12T01:51:59.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.353+0000 7f4f2affd640 1 -- 172.21.15.70:0/566668500 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f38010c70 con 0x55f7045c4d40 2024-09-12T01:51:59.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.354+0000 7f4f2affd640 1 -- 172.21.15.70:0/566668500 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38020440 con 0x55f7045c4d40 2024-09-12T01:51:59.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.354+0000 7f4f49e0e740 1 -- 172.21.15.70:0/566668500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 msgr2=0x55f7045dcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:59.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.354+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/566668500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 0x55f7045dcb70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4f38012810 tx=0x7f4f380096c0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.354+0000 7f4f49e0e740 1 -- 172.21.15.70:0/566668500 shutdown_connections 2024-09-12T01:51:59.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.354+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/566668500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045c4d40 0x55f7045dcb70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.354+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/566668500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045ba480 0x55f7045dc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.354+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/566668500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045b9b60 0x55f7045bc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.354+0000 7f4f49e0e740 1 -- 172.21.15.70:0/566668500 >> 172.21.15.70:0/566668500 conn(0x55f7045b60f0 msgr2=0x55f7045c0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:59.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.354+0000 7f4f49e0e740 1 -- 172.21.15.70:0/566668500 shutdown_connections 2024-09-12T01:51:59.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.354+0000 7f4f49e0e740 1 -- 172.21.15.70:0/566668500 wait complete. 2024-09-12T01:51:59.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.354+0000 7f4f49e0e740 1 -- start start 2024-09-12T01:51:59.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f49e0e740 1 Processor -- start 2024-09-12T01:51:59.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f49e0e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 0x55f7045c9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f49e0e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 0x55f7045c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f49e0e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045c4d40 0x55f70463e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f49e0e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f401b50d0 con 0x55f7045b9b60 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f49e0e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4f401b4a00 con 0x55f7045c4d40 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f49e0e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f401b1c20 con 0x55f7045ba480 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f49e0e740 10 client.0 _ll_register_callbacks cb 0x7f4f3c032bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f457d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 0x55f7045c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f457d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 0x55f7045c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53034/0 (socket says 172.21.15.70:53034) 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f457d1640 1 -- 172.21.15.70:0/1642118182 learned_addr learned my addr 172.21.15.70:0/1642118182 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f44fd0640 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 0x55f7045c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f45fd2640 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045c4d40 0x55f70463e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f457d1640 1 -- 172.21.15.70:0/1642118182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 msgr2=0x55f7045c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:59.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f457d1640 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 0x55f7045c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f457d1640 1 -- 172.21.15.70:0/1642118182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045c4d40 msgr2=0x55f70463e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f457d1640 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045c4d40 0x55f70463e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f457d1640 1 -- 172.21.15.70:0/1642118182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70463eb40 con 0x55f7045b9b60 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f45fd2640 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045c4d40 0x55f70463e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.355+0000 7f4f44fd0640 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 0x55f7045c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f457d1640 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 0x55f7045c9070 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0096c0 tx=0x7f4f3c0bc7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66804ff74a3ff3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f28ff9640 1 -- 172.21.15.70:0/1642118182 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c049040 con 0x55f7045b9b60 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f28ff9640 1 -- 172.21.15.70:0/1642118182 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4f3c0b6bd0 con 0x55f7045b9b60 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1642118182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f38010c70 con 0x55f7045b9b60 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f28ff9640 1 -- 172.21.15.70:0/1642118182 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f3c0c4cd0 con 0x55f7045b9b60 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f49e0e740 10 client.15351 fetch_fsmap learned FSMap version 28 2024-09-12T01:51:59.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1642118182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f70463eb40 con 0x55f7045b9b60 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f28ff9640 1 -- 172.21.15.70:0/1642118182 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f38010c70 con 0x55f7045b9b60 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f28ff9640 1 -- 172.21.15.70:0/1642118182 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4f3c0bc2c0 con 0x55f7045b9b60 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f49e0e740 10 client.15351 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f49e0e740 10 client.15351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f49e0e740 20 client.15351 populate_metadata read hostname 'smithi070' 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f704640140 0x55f704642550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f49e0e740 4 client.15351 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.356+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1642118182 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f704526d00 con 0x55f704640140 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.357+0000 7f4f44fd0640 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f704640140 0x55f704642550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.357+0000 7f4f44fd0640 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f704640140 0x55f704642550 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea09c20a2520f717 server_cookie=d80a04c493595c64 in_seq=0 out_seq=0 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.357+0000 7f4f28ff9640 10 client.15351 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f28ff9640 1 -- 172.21.15.70:0/1642118182 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f704526d00 con 0x55f704640140 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f28ff9640 10 client.15351 handle_command_reply: tid=0 2024-09-12T01:51:59.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f49e0e740 1 client.15351 shutdown 2024-09-12T01:51:59.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1642118182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 msgr2=0x55f7045c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:59.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 0x55f7045c9070 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0096c0 tx=0x7f4f3c0bc7e0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1642118182 shutdown_connections 2024-09-12T01:51:59.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f704640140 0x55f704642550 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f7045c4d40 0x55f70463e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f7045ba480 0x55f7045c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f49e0e740 1 --2- 172.21.15.70:0/1642118182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7045b9b60 0x55f7045c9070 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1642118182 >> 172.21.15.70:0/1642118182 conn(0x55f7045b60f0 msgr2=0x55f7045b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:59.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f28ff9640 0 client.15351 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:51:59.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1642118182 shutdown_connections 2024-09-12T01:51:59.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.358+0000 7f4f49e0e740 1 -- 172.21.15.70:0/1642118182 wait complete. 2024-09-12T01:51:59.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f49e0e740 20 client.15351 trim_cache size 0 max 16384 2024-09-12T01:51:59.365 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:51:59.365 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-12T01:51:59.365 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "e6c1c210-5999-425e-9499-9aa1f11914b0", 2024-09-12T01:51:59.365 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-12T01:51:59.365 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:51:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f47a35640 1 -- 172.21.15.70:0/2427375647 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4f2c0a2b80 msgr2=0x7f4f2c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f47a35640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4f2c0a2b80 0x7f4f2c0a5040 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4f38005c40 tx=0x7f4f38005bd0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f47a35640 1 -- 172.21.15.70:0/2427375647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f40100b30 msgr2=0x7f4f401a4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f47a35640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f40100b30 0x7f4f401a4790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c006010 tx=0x7f4f3c0042f0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f47a35640 1 -- 172.21.15.70:0/2427375647 shutdown_connections 2024-09-12T01:51:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f47a35640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4f2c0a2b80 0x7f4f2c0a5040 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f47a35640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f40105f40 0x7f4f4019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f47a35640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f40101450 0x7f4f401a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f47a35640 1 --2- 172.21.15.70:0/2427375647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f40100b30 0x7f4f401a4790 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f47a35640 1 -- 172.21.15.70:0/2427375647 >> 172.21.15.70:0/2427375647 conn(0x7f4f400fc7a0 msgr2=0x7f4f401038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f47a35640 1 -- 172.21.15.70:0/2427375647 shutdown_connections 2024-09-12T01:51:59.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.359+0000 7f4f47a35640 1 -- 172.21.15.70:0/2427375647 wait complete. 2024-09-12T01:51:59.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.830+0000 7f6e442a7640 1 -- 172.21.15.70:0/1575632582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e3c100a70 msgr2=0x7f6e3c10ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:59.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.830+0000 7f6e442a7640 1 --2- 172.21.15.70:0/1575632582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e3c100a70 0x7f6e3c10ea60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009ca0 tx=0x7f6e3402a8c0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.830+0000 7f6e442a7640 1 -- 172.21.15.70:0/1575632582 shutdown_connections 2024-09-12T01:51:59.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.830+0000 7f6e442a7640 1 --2- 172.21.15.70:0/1575632582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e3c100a70 0x7f6e3c10ea60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.830+0000 7f6e442a7640 1 --2- 172.21.15.70:0/1575632582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e3c1000d0 0x7f6e3c100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.830+0000 7f6e442a7640 1 --2- 172.21.15.70:0/1575632582 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e3c106ba0 0x7f6e3c106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.830+0000 7f6e442a7640 1 -- 172.21.15.70:0/1575632582 >> 172.21.15.70:0/1575632582 conn(0x7f6e3c077210 msgr2=0x7f6e3c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:59.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.830+0000 7f6e442a7640 1 -- 172.21.15.70:0/1575632582 shutdown_connections 2024-09-12T01:51:59.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.831+0000 7f6e442a7640 1 -- 172.21.15.70:0/1575632582 wait complete. 2024-09-12T01:51:59.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.831+0000 7f6e442a7640 1 Processor -- start 2024-09-12T01:51:59.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.831+0000 7f6e442a7640 1 -- start start 2024-09-12T01:51:59.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.831+0000 7f6e442a7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e3c1000d0 0x7f6e3c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.831+0000 7f6e442a7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e3c100a70 0x7f6e3c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.831+0000 7f6e442a7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e3c106ba0 0x7f6e3c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.831+0000 7f6e442a7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c1121b0 con 0x7f6e3c106ba0 2024-09-12T01:51:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.831+0000 7f6e442a7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c112030 con 0x7f6e3c1000d0 2024-09-12T01:51:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.831+0000 7f6e442a7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c112330 con 0x7f6e3c100a70 2024-09-12T01:51:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.831+0000 7f6e42844640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e3c106ba0 0x7f6e3c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.831+0000 7f6e42844640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e3c106ba0 0x7f6e3c19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53054/0 (socket says 172.21.15.70:53054) 2024-09-12T01:51:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.831+0000 7f6e42844640 1 -- 172.21.15.70:0/10899555 learned_addr learned my addr 172.21.15.70:0/10899555 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:51:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e42043640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e3c1000d0 0x7f6e3c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e41842640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e3c100a70 0x7f6e3c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e42844640 1 -- 172.21.15.70:0/10899555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e3c100a70 msgr2=0x7f6e3c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e42844640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e3c100a70 0x7f6e3c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e42844640 1 -- 172.21.15.70:0/10899555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e3c1000d0 msgr2=0x7f6e3c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e42844640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e3c1000d0 0x7f6e3c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e42844640 1 -- 172.21.15.70:0/10899555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c19d430 con 0x7f6e3c106ba0 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e42043640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e3c1000d0 0x7f6e3c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e42844640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e3c106ba0 0x7f6e3c19cd50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6e34005e30 tx=0x7f6e34003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e337fe640 1 -- 172.21.15.70:0/10899555 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e340316d0 con 0x7f6e3c106ba0 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e337fe640 1 -- 172.21.15.70:0/10899555 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e34031870 con 0x7f6e3c106ba0 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e442a7640 1 -- 172.21.15.70:0/10899555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c19d6c0 con 0x7f6e3c106ba0 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e337fe640 1 -- 172.21.15.70:0/10899555 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3402fc70 con 0x7f6e3c106ba0 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.832+0000 7f6e442a7640 1 -- 172.21.15.70:0/10899555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c1a5000 con 0x7f6e3c106ba0 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.833+0000 7f6e442a7640 1 -- 172.21.15.70:0/10899555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c100530 con 0x7f6e3c106ba0 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.834+0000 7f6e337fe640 1 -- 172.21.15.70:0/10899555 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6e340046d0 con 0x7f6e3c106ba0 2024-09-12T01:51:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.835+0000 7f6e337fe640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6e280a2c00 0x7f6e280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:59.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.835+0000 7f6e42043640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6e280a2c00 0x7f6e280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:59.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.835+0000 7f6e337fe640 1 -- 172.21.15.70:0/10899555 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6e340f0750 con 0x7f6e3c106ba0 2024-09-12T01:51:59.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.835+0000 7f6e42043640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6e280a2c00 0x7f6e280a50c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800abe0 tx=0x7f6e3800a5c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:59.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:51:59.838+0000 7f6e337fe640 1 -- 172.21.15.70:0/10899555 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e340bd6b0 con 0x7f6e3c106ba0 2024-09-12T01:52:00.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.005+0000 7f6e442a7640 1 -- 172.21.15.70:0/10899555 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e3c105130 con 0x7f6e280a2c00 2024-09-12T01:52:00.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.012+0000 7f6e337fe640 1 -- 172.21.15.70:0/10899555 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258901 (secure 0 0 0) 0x7f6e3c105130 con 0x7f6e280a2c00 2024-09-12T01:52:00.014 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:52:00.018 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:52:00.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.014+0000 7f6e442a7640 1 -- 172.21.15.70:0/10899555 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6e280a2c00 msgr2=0x7f6e280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.014+0000 7f6e442a7640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6e280a2c00 0x7f6e280a50c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800abe0 tx=0x7f6e3800a5c0 comp rx=0 tx=0).stop 2024-09-12T01:52:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.014+0000 7f6e442a7640 1 -- 172.21.15.70:0/10899555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e3c106ba0 msgr2=0x7f6e3c19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.014+0000 7f6e442a7640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e3c106ba0 0x7f6e3c19cd50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6e34005e30 tx=0x7f6e34003f90 comp rx=0 tx=0).stop 2024-09-12T01:52:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.015+0000 7f6e442a7640 1 -- 172.21.15.70:0/10899555 shutdown_connections 2024-09-12T01:52:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.015+0000 7f6e442a7640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6e280a2c00 0x7f6e280a50c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.015+0000 7f6e442a7640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e3c106ba0 0x7f6e3c19cd50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.015+0000 7f6e442a7640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e3c100a70 0x7f6e3c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.015+0000 7f6e442a7640 1 --2- 172.21.15.70:0/10899555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e3c1000d0 0x7f6e3c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.015+0000 7f6e442a7640 1 -- 172.21.15.70:0/10899555 >> 172.21.15.70:0/10899555 conn(0x7f6e3c077210 msgr2=0x7f6e3c104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.015+0000 7f6e442a7640 1 -- 172.21.15.70:0/10899555 shutdown_connections 2024-09-12T01:52:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:00.015+0000 7f6e442a7640 1 -- 172.21.15.70:0/10899555 wait complete. 2024-09-12T01:52:00.614 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:52:00.903 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:00 smithi070 ceph-mon[31177]: scrub queued for path: / 2024-09-12T01:52:00.903 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:00 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:52:00.903 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:00 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:52:00.903 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:00 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:52:00.903 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:00 smithi070 ceph-mon[31177]: pgmap v332: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T01:52:00.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:00 smithi191 ceph-mon[35770]: scrub queued for path: / 2024-09-12T01:52:00.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:00 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:52:00.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:00 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:52:00.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:00 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:52:00.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:00 smithi191 ceph-mon[35770]: pgmap v332: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T01:52:01.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:00 smithi152 ceph-mon[35055]: scrub queued for path: / 2024-09-12T01:52:01.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:00 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:52:01.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:00 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:52:01.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:00 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:52:01.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:00 smithi152 ceph-mon[35055]: pgmap v332: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T01:52:01.408 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-12T01:51:59.501057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666115,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1234,"num_read_kb":746,"num_write":449,"num_write_kb":3099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1231128,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370468,"kb_used_data":12900,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571356,"statfs":{"total":1151940427776,"available":1151561068544,"internally_reserved":0,"allocated":13209600,"data_stored":7244409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":57,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002733"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501869+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:51:21.501869+0000","last_peered":"2024-09-12T01:51:21.501869+0000","last_clean":"2024-09-12T01:51:21.501869+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:51:21.501869+0000","last_undegraded":"2024-09-12T01:51:21.501869+0000","last_fullsized":"2024-09-12T01:51:21.501869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488982+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:51:21.488982+0000","last_peered":"2024-09-12T01:51:21.488982+0000","last_clean":"2024-09-12T01:51:21.488982+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:51:21.488982+0000","last_undegraded":"2024-09-12T01:51:21.488982+0000","last_fullsized":"2024-09-12T01:51:21.488982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501730+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:51:21.501730+0000","last_peered":"2024-09-12T01:51:21.501730+0000","last_clean":"2024-09-12T01:51:21.501730+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:51:21.501730+0000","last_undegraded":"2024-09-12T01:51:21.501730+0000","last_fullsized":"2024-09-12T01:51:21.501730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.472404+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:51:21.472404+0000","last_peered":"2024-09-12T01:51:21.472404+0000","last_clean":"2024-09-12T01:51:21.472404+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:51:21.472404+0000","last_undegraded":"2024-09-12T01:51:21.472404+0000","last_fullsized":"2024-09-12T01:51:21.472404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.472067+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:51:21.472067+0000","last_peered":"2024-09-12T01:51:21.472067+0000","last_clean":"2024-09-12T01:51:21.472067+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:51:21.472067+0000","last_undegraded":"2024-09-12T01:51:21.472067+0000","last_fullsized":"2024-09-12T01:51:21.472067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488486+0000","last_change":"2024-09-12T01:50:22.614193+0000","last_active":"2024-09-12T01:51:21.488486+0000","last_peered":"2024-09-12T01:51:21.488486+0000","last_clean":"2024-09-12T01:51:21.488486+0000","last_became_active":"2024-09-12T01:50:22.613816+0000","last_became_peered":"2024-09-12T01:50:22.613816+0000","last_unstale":"2024-09-12T01:51:21.488486+0000","last_undegraded":"2024-09-12T01:51:21.488486+0000","last_fullsized":"2024-09-12T01:51:21.488486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:29.504176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488037+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:51:21.488037+0000","last_peered":"2024-09-12T01:51:21.488037+0000","last_clean":"2024-09-12T01:51:21.488037+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:51:21.488037+0000","last_undegraded":"2024-09-12T01:51:21.488037+0000","last_fullsized":"2024-09-12T01:51:21.488037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493016+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:51:21.493016+0000","last_peered":"2024-09-12T01:51:21.493016+0000","last_clean":"2024-09-12T01:51:21.493016+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:51:21.493016+0000","last_undegraded":"2024-09-12T01:51:21.493016+0000","last_fullsized":"2024-09-12T01:51:21.493016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.500188+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:51:21.500188+0000","last_peered":"2024-09-12T01:51:21.500188+0000","last_clean":"2024-09-12T01:51:21.500188+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:51:21.500188+0000","last_undegraded":"2024-09-12T01:51:21.500188+0000","last_fullsized":"2024-09-12T01:51:21.500188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.491514+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:51:21.491514+0000","last_peered":"2024-09-12T01:51:21.491514+0000","last_clean":"2024-09-12T01:51:21.491514+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:51:21.491514+0000","last_undegraded":"2024-09-12T01:51:21.491514+0000","last_fullsized":"2024-09-12T01:51:21.491514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.499334+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:51:21.499334+0000","last_peered":"2024-09-12T01:51:21.499334+0000","last_clean":"2024-09-12T01:51:21.499334+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:51:21.499334+0000","last_undegraded":"2024-09-12T01:51:21.499334+0000","last_fullsized":"2024-09-12T01:51:21.499334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.496290+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:51:21.496290+0000","last_peered":"2024-09-12T01:51:21.496290+0000","last_clean":"2024-09-12T01:51:21.496290+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:51:21.496290+0000","last_undegraded":"2024-09-12T01:51:21.496290+0000","last_fullsized":"2024-09-12T01:51:21.496290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493477+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:51:21.493477+0000","last_peered":"2024-09-12T01:51:21.493477+0000","last_clean":"2024-09-12T01:51:21.493477+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:51:21.493477+0000","last_undegraded":"2024-09-12T01:51:21.493477+0000","last_fullsized":"2024-09-12T01:51:21.493477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.492593+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:51:21.492593+0000","last_peered":"2024-09-12T01:51:21.492593+0000","last_clean":"2024-09-12T01:51:21.492593+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:51:21.492593+0000","last_undegraded":"2024-09-12T01:51:21.492593+0000","last_fullsized":"2024-09-12T01:51:21.492593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489877+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:51:21.489877+0000","last_peered":"2024-09-12T01:51:21.489877+0000","last_clean":"2024-09-12T01:51:21.489877+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:51:21.489877+0000","last_undegraded":"2024-09-12T01:51:21.489877+0000","last_fullsized":"2024-09-12T01:51:21.489877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.497951+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:51:21.497951+0000","last_peered":"2024-09-12T01:51:21.497951+0000","last_clean":"2024-09-12T01:51:21.497951+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:51:21.497951+0000","last_undegraded":"2024-09-12T01:51:21.497951+0000","last_fullsized":"2024-09-12T01:51:21.497951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501906+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:51:21.501906+0000","last_peered":"2024-09-12T01:51:21.501906+0000","last_clean":"2024-09-12T01:51:21.501906+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:51:21.501906+0000","last_undegraded":"2024-09-12T01:51:21.501906+0000","last_fullsized":"2024-09-12T01:51:21.501906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.494924+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:51:21.494924+0000","last_peered":"2024-09-12T01:51:21.494924+0000","last_clean":"2024-09-12T01:51:21.494924+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:51:21.494924+0000","last_undegraded":"2024-09-12T01:51:21.494924+0000","last_fullsized":"2024-09-12T01:51:21.494924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484591+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:51:21.484591+0000","last_peered":"2024-09-12T01:51:21.484591+0000","last_clean":"2024-09-12T01:51:21.484591+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:51:21.484591+0000","last_undegraded":"2024-09-12T01:51:21.484591+0000","last_fullsized":"2024-09-12T01:51:21.484591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.478916+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:51:21.478916+0000","last_peered":"2024-09-12T01:51:21.478916+0000","last_clean":"2024-09-12T01:51:21.478916+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:51:21.478916+0000","last_undegraded":"2024-09-12T01:51:21.478916+0000","last_fullsized":"2024-09-12T01:51:21.478916+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.475221+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:51:21.475221+0000","last_peered":"2024-09-12T01:51:21.475221+0000","last_clean":"2024-09-12T01:51:21.475221+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:51:21.475221+0000","last_undegraded":"2024-09-12T01:51:21.475221+0000","last_fullsized":"2024-09-12T01:51:21.475221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.499408+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:51:21.499408+0000","last_peered":"2024-09-12T01:51:21.499408+0000","last_clean":"2024-09-12T01:51:21.499408+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:51:21.499408+0000","last_undegraded":"2024-09-12T01:51:21.499408+0000","last_fullsized":"2024-09-12T01:51:21.499408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.485203+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:51:21.485203+0000","last_peered":"2024-09-12T01:51:21.485203+0000","last_clean":"2024-09-12T01:51:21.485203+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:51:21.485203+0000","last_undegraded":"2024-09-12T01:51:21.485203+0000","last_fullsized":"2024-09-12T01:51:21.485203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.482413+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:51:21.482413+0000","last_peered":"2024-09-12T01:51:21.482413+0000","last_clean":"2024-09-12T01:51:21.482413+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:51:21.482413+0000","last_undegraded":"2024-09-12T01:51:21.482413+0000","last_fullsized":"2024-09-12T01:51:21.482413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484804+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:51:21.484804+0000","last_peered":"2024-09-12T01:51:21.484804+0000","last_clean":"2024-09-12T01:51:21.484804+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:51:21.484804+0000","last_undegraded":"2024-09-12T01:51:21.484804+0000","last_fullsized":"2024-09-12T01:51:21.484804+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493388+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:51:21.493388+0000","last_peered":"2024-09-12T01:51:21.493388+0000","last_clean":"2024-09-12T01:51:21.493388+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:51:21.493388+0000","last_undegraded":"2024-09-12T01:51:21.493388+0000","last_fullsized":"2024-09-12T01:51:21.493388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487787+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:51:21.487787+0000","last_peered":"2024-09-12T01:51:21.487787+0000","last_clean":"2024-09-12T01:51:21.487787+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:51:21.487787+0000","last_undegraded":"2024-09-12T01:51:21.487787+0000","last_fullsized":"2024-09-12T01:51:21.487787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.476227+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:51:21.476227+0000","last_peered":"2024-09-12T01:51:21.476227+0000","last_clean":"2024-09-12T01:51:21.476227+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:51:21.476227+0000","last_undegraded":"2024-09-12T01:51:21.476227+0000","last_fullsized":"2024-09-12T01:51:21.476227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.490901+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:51:21.490901+0000","last_peered":"2024-09-12T01:51:21.490901+0000","last_clean":"2024-09-12T01:51:21.490901+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:51:21.490901+0000","last_undegraded":"2024-09-12T01:51:21.490901+0000","last_fullsized":"2024-09-12T01:51:21.490901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484444+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:51:21.484444+0000","last_peered":"2024-09-12T01:51:21.484444+0000","last_clean":"2024-09-12T01:51:21.484444+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:51:21.484444+0000","last_undegraded":"2024-09-12T01:51:21.484444+0000","last_fullsized":"2024-09-12T01:51:21.484444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486738+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:51:21.486738+0000","last_peered":"2024-09-12T01:51:21.486738+0000","last_clean":"2024-09-12T01:51:21.486738+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:51:21.486738+0000","last_undegraded":"2024-09-12T01:51:21.486738+0000","last_fullsized":"2024-09-12T01:51:21.486738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488158+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:51:21.488158+0000","last_peered":"2024-09-12T01:51:21.488158+0000","last_clean":"2024-09-12T01:51:21.488158+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:51:21.488158+0000","last_undegraded":"2024-09-12T01:51:21.488158+0000","last_fullsized":"2024-09-12T01:51:21.488158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.483006+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:51:21.483006+0000","last_peered":"2024-09-12T01:51:21.483006+0000","last_clean":"2024-09-12T01:51:21.483006+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:51:21.483006+0000","last_undegraded":"2024-09-12T01:51:21.483006+0000","last_fullsized":"2024-09-12T01:51:21.483006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'7","reported_seq":139,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:53.534811+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:51:53.534811+0000","last_peered":"2024-09-12T01:51:53.534811+0000","last_clean":"2024-09-12T01:51:53.534811+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:51:53.534811+0000","last_undegraded":"2024-09-12T01:51:53.534811+0000","last_fullsized":"2024-09-12T01:51:53.534811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.477519+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:51:21.477519+0000","last_peered":"2024-09-12T01:51:21.477519+0000","last_clean":"2024-09-12T01:51:21.477519+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:51:21.477519+0000","last_undegraded":"2024-09-12T01:51:21.477519+0000","last_fullsized":"2024-09-12T01:51:21.477519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.688704+0000","last_change":"2024-09-12T01:50:22.688704+0000","last_active":"2024-09-12T01:50:22.688704+0000","last_peered":"2024-09-12T01:50:22.688704+0000","last_clean":"2024-09-12T01:50:22.688704+0000","last_became_active":"2024-09-12T01:50:22.682640+0000","last_became_peered":"2024-09-12T01:50:22.682640+0000","last_unstale":"2024-09-12T01:50:22.688704+0000","last_undegraded":"2024-09-12T01:50:22.688704+0000","last_fullsized":"2024-09-12T01:50:22.688704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.731438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614069+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:22.614069+0000","last_peered":"2024-09-12T01:50:22.614069+0000","last_clean":"2024-09-12T01:50:22.614069+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:22.614069+0000","last_undegraded":"2024-09-12T01:50:22.614069+0000","last_fullsized":"2024-09-12T01:50:22.614069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.480595+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:51:21.480595+0000","last_peered":"2024-09-12T01:51:21.480595+0000","last_clean":"2024-09-12T01:51:21.480595+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:51:21.480595+0000","last_undegraded":"2024-09-12T01:51:21.480595+0000","last_fullsized":"2024-09-12T01:51:21.480595+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629145+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:22.629145+0000","last_peered":"2024-09-12T01:50:22.629145+0000","last_clean":"2024-09-12T01:50:22.629145+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:22.629145+0000","last_undegraded":"2024-09-12T01:50:22.629145+0000","last_fullsized":"2024-09-12T01:50:22.629145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.495099+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:51:21.495099+0000","last_peered":"2024-09-12T01:51:21.495099+0000","last_clean":"2024-09-12T01:51:21.495099+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:51:21.495099+0000","last_undegraded":"2024-09-12T01:51:21.495099+0000","last_fullsized":"2024-09-12T01:51:21.495099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'7","reported_seq":243,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:55.536929+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:51:55.536929+0000","last_peered":"2024-09-12T01:51:55.536929+0000","last_clean":"2024-09-12T01:51:55.536929+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:51:55.536929+0000","last_undegraded":"2024-09-12T01:51:55.536929+0000","last_fullsized":"2024-09-12T01:51:55.536929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":214,"num_read_kb":214,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.498633+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:51:21.498633+0000","last_peered":"2024-09-12T01:51:21.498633+0000","last_clean":"2024-09-12T01:51:21.498633+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:51:21.498633+0000","last_undegraded":"2024-09-12T01:51:21.498633+0000","last_fullsized":"2024-09-12T01:51:21.498633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613318+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:22.613318+0000","last_peered":"2024-09-12T01:50:22.613318+0000","last_clean":"2024-09-12T01:50:22.613318+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:22.613318+0000","last_undegraded":"2024-09-12T01:50:22.613318+0000","last_fullsized":"2024-09-12T01:50:22.613318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488858+0000","last_change":"2024-09-12T01:50:22.630618+0000","last_active":"2024-09-12T01:51:21.488858+0000","last_peered":"2024-09-12T01:51:21.488858+0000","last_clean":"2024-09-12T01:51:21.488858+0000","last_became_active":"2024-09-12T01:50:22.630327+0000","last_became_peered":"2024-09-12T01:50:22.630327+0000","last_unstale":"2024-09-12T01:51:21.488858+0000","last_undegraded":"2024-09-12T01:51:21.488858+0000","last_fullsized":"2024-09-12T01:51:21.488858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.647257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629439+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:22.629439+0000","last_peered":"2024-09-12T01:50:22.629439+0000","last_clean":"2024-09-12T01:50:22.629439+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:22.629439+0000","last_undegraded":"2024-09-12T01:50:22.629439+0000","last_fullsized":"2024-09-12T01:50:22.629439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501850+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:51:21.501850+0000","last_peered":"2024-09-12T01:51:21.501850+0000","last_clean":"2024-09-12T01:51:21.501850+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:51:21.501850+0000","last_undegraded":"2024-09-12T01:51:21.501850+0000","last_fullsized":"2024-09-12T01:51:21.501850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'39","reported_seq":305,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:54.819705+0000","last_change":"2024-09-12T01:50:22.696674+0000","last_active":"2024-09-12T01:51:54.819705+0000","last_peered":"2024-09-12T01:51:54.819705+0000","last_clean":"2024-09-12T01:51:54.819705+0000","last_became_active":"2024-09-12T01:50:22.683417+0000","last_became_peered":"2024-09-12T01:50:22.683417+0000","last_unstale":"2024-09-12T01:51:54.819705+0000","last_undegraded":"2024-09-12T01:51:54.819705+0000","last_fullsized":"2024-09-12T01:51:54.819705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:35.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67181,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":218,"num_read_kb":175,"num_write":41,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":49603,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486841+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:51:21.486841+0000","last_peered":"2024-09-12T01:51:21.486841+0000","last_clean":"2024-09-12T01:51:21.486841+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:51:21.486841+0000","last_undegraded":"2024-09-12T01:51:21.486841+0000","last_fullsized":"2024-09-12T01:51:21.486841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612213+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:22.612213+0000","last_peered":"2024-09-12T01:50:22.612213+0000","last_clean":"2024-09-12T01:50:22.612213+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:22.612213+0000","last_undegraded":"2024-09-12T01:50:22.612213+0000","last_fullsized":"2024-09-12T01:50:22.612213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.474550+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:51:21.474550+0000","last_peered":"2024-09-12T01:51:21.474550+0000","last_clean":"2024-09-12T01:51:21.474550+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:51:21.474550+0000","last_undegraded":"2024-09-12T01:51:21.474550+0000","last_fullsized":"2024-09-12T01:51:21.474550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629035+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:22.629035+0000","last_peered":"2024-09-12T01:50:22.629035+0000","last_clean":"2024-09-12T01:50:22.629035+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:22.629035+0000","last_undegraded":"2024-09-12T01:50:22.629035+0000","last_fullsized":"2024-09-12T01:50:22.629035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487087+0000","last_change":"2024-09-12T01:50:22.616527+0000","last_active":"2024-09-12T01:51:21.487087+0000","last_peered":"2024-09-12T01:51:21.487087+0000","last_clean":"2024-09-12T01:51:21.487087+0000","last_became_active":"2024-09-12T01:50:22.616150+0000","last_became_peered":"2024-09-12T01:50:22.616150+0000","last_unstale":"2024-09-12T01:51:21.487087+0000","last_undegraded":"2024-09-12T01:51:21.487087+0000","last_fullsized":"2024-09-12T01:51:21.487087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:58.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:55.535951+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:51:55.535951+0000","last_peered":"2024-09-12T01:51:55.535951+0000","last_clean":"2024-09-12T01:51:55.535951+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:51:55.535951+0000","last_undegraded":"2024-09-12T01:51:55.535951+0000","last_fullsized":"2024-09-12T01:51:55.535951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.495898+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:51:21.495898+0000","last_peered":"2024-09-12T01:51:21.495898+0000","last_clean":"2024-09-12T01:51:21.495898+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:51:21.495898+0000","last_undegraded":"2024-09-12T01:51:21.495898+0000","last_fullsized":"2024-09-12T01:51:21.495898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610857+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:22.610857+0000","last_peered":"2024-09-12T01:50:22.610857+0000","last_clean":"2024-09-12T01:50:22.610857+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:22.610857+0000","last_undegraded":"2024-09-12T01:50:22.610857+0000","last_fullsized":"2024-09-12T01:50:22.610857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.482779+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:51:21.482779+0000","last_peered":"2024-09-12T01:51:21.482779+0000","last_clean":"2024-09-12T01:51:21.482779+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:51:21.482779+0000","last_undegraded":"2024-09-12T01:51:21.482779+0000","last_fullsized":"2024-09-12T01:51:21.482779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611513+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:22.611513+0000","last_peered":"2024-09-12T01:50:22.611513+0000","last_clean":"2024-09-12T01:50:22.611513+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:22.611513+0000","last_undegraded":"2024-09-12T01:50:22.611513+0000","last_fullsized":"2024-09-12T01:50:22.611513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486914+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:51:21.486914+0000","last_peered":"2024-09-12T01:51:21.486914+0000","last_clean":"2024-09-12T01:51:21.486914+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:51:21.486914+0000","last_undegraded":"2024-09-12T01:51:21.486914+0000","last_fullsized":"2024-09-12T01:51:21.486914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613947+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:22.613947+0000","last_peered":"2024-09-12T01:50:22.613947+0000","last_clean":"2024-09-12T01:50:22.613947+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:22.613947+0000","last_undegraded":"2024-09-12T01:50:22.613947+0000","last_fullsized":"2024-09-12T01:50:22.613947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484475+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:51:21.484475+0000","last_peered":"2024-09-12T01:51:21.484475+0000","last_clean":"2024-09-12T01:51:21.484475+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:51:21.484475+0000","last_undegraded":"2024-09-12T01:51:21.484475+0000","last_fullsized":"2024-09-12T01:51:21.484475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629587+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:22.629587+0000","last_peered":"2024-09-12T01:50:22.629587+0000","last_clean":"2024-09-12T01:50:22.629587+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:22.629587+0000","last_undegraded":"2024-09-12T01:50:22.629587+0000","last_fullsized":"2024-09-12T01:50:22.629587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489454+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:51:21.489454+0000","last_peered":"2024-09-12T01:51:21.489454+0000","last_clean":"2024-09-12T01:51:21.489454+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:51:21.489454+0000","last_undegraded":"2024-09-12T01:51:21.489454+0000","last_fullsized":"2024-09-12T01:51:21.489454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'8","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:56.538883+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:51:56.538883+0000","last_peered":"2024-09-12T01:51:56.538883+0000","last_clean":"2024-09-12T01:51:56.538883+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:51:56.538883+0000","last_undegraded":"2024-09-12T01:51:56.538883+0000","last_fullsized":"2024-09-12T01:51:56.538883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2012,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.500017+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:51:21.500017+0000","last_peered":"2024-09-12T01:51:21.500017+0000","last_clean":"2024-09-12T01:51:21.500017+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:51:21.500017+0000","last_undegraded":"2024-09-12T01:51:21.500017+0000","last_fullsized":"2024-09-12T01:51:21.500017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":333,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612725+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:50:22.612725+0000","last_peered":"2024-09-12T01:50:22.612725+0000","last_clean":"2024-09-12T01:50:22.612725+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:50:22.612725+0000","last_undegraded":"2024-09-12T01:50:22.612725+0000","last_fullsized":"2024-09-12T01:50:22.612725+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681903+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:22.681903+0000","last_peered":"2024-09-12T01:50:22.681903+0000","last_clean":"2024-09-12T01:50:22.681903+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:22.681903+0000","last_undegraded":"2024-09-12T01:50:22.681903+0000","last_fullsized":"2024-09-12T01:50:22.681903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.498284+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:51:21.498284+0000","last_peered":"2024-09-12T01:51:21.498284+0000","last_clean":"2024-09-12T01:51:21.498284+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:51:21.498284+0000","last_undegraded":"2024-09-12T01:51:21.498284+0000","last_fullsized":"2024-09-12T01:51:21.498284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612697+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:22.612697+0000","last_peered":"2024-09-12T01:50:22.612697+0000","last_clean":"2024-09-12T01:50:22.612697+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:22.612697+0000","last_undegraded":"2024-09-12T01:50:22.612697+0000","last_fullsized":"2024-09-12T01:50:22.612697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.481982+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:51:21.481982+0000","last_peered":"2024-09-12T01:51:21.481982+0000","last_clean":"2024-09-12T01:51:21.481982+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:51:21.481982+0000","last_undegraded":"2024-09-12T01:51:21.481982+0000","last_fullsized":"2024-09-12T01:51:21.481982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:53.532589+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:51:53.532589+0000","last_peered":"2024-09-12T01:51:53.532589+0000","last_clean":"2024-09-12T01:51:53.532589+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:51:53.532589+0000","last_undegraded":"2024-09-12T01:51:53.532589+0000","last_fullsized":"2024-09-12T01:51:53.532589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.477907+0000","last_change":"2024-09-12T01:50:22.682963+0000","last_active":"2024-09-12T01:51:21.477907+0000","last_peered":"2024-09-12T01:51:21.477907+0000","last_clean":"2024-09-12T01:51:21.477907+0000","last_became_active":"2024-09-12T01:50:22.682611+0000","last_became_peered":"2024-09-12T01:50:22.682611+0000","last_unstale":"2024-09-12T01:51:21.477907+0000","last_undegraded":"2024-09-12T01:51:21.477907+0000","last_fullsized":"2024-09-12T01:51:21.477907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:01.295098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'7","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:52.801954+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:51:52.801954+0000","last_peered":"2024-09-12T01:51:52.801954+0000","last_clean":"2024-09-12T01:51:52.801954+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:51:52.801954+0000","last_undegraded":"2024-09-12T01:51:52.801954+0000","last_fullsized":"2024-09-12T01:51:52.801954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489407+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:51:21.489407+0000","last_peered":"2024-09-12T01:51:21.489407+0000","last_clean":"2024-09-12T01:51:21.489407+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:51:21.489407+0000","last_undegraded":"2024-09-12T01:51:21.489407+0000","last_fullsized":"2024-09-12T01:51:21.489407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.683026+0000","last_change":"2024-09-12T01:50:22.683026+0000","last_active":"2024-09-12T01:50:22.683026+0000","last_peered":"2024-09-12T01:50:22.683026+0000","last_clean":"2024-09-12T01:50:22.683026+0000","last_became_active":"2024-09-12T01:50:22.682461+0000","last_became_peered":"2024-09-12T01:50:22.682461+0000","last_unstale":"2024-09-12T01:50:22.683026+0000","last_undegraded":"2024-09-12T01:50:22.683026+0000","last_fullsized":"2024-09-12T01:50:22.683026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.470081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.490807+0000","last_change":"2024-09-12T01:50:22.618050+0000","last_active":"2024-09-12T01:51:21.490807+0000","last_peered":"2024-09-12T01:51:21.490807+0000","last_clean":"2024-09-12T01:51:21.490807+0000","last_became_active":"2024-09-12T01:50:22.614871+0000","last_became_peered":"2024-09-12T01:50:22.614871+0000","last_unstale":"2024-09-12T01:51:21.490807+0000","last_undegraded":"2024-09-12T01:51:21.490807+0000","last_fullsized":"2024-09-12T01:51:21.490807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:47.652568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611446+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:22.611446+0000","last_peered":"2024-09-12T01:50:22.611446+0000","last_clean":"2024-09-12T01:50:22.611446+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:22.611446+0000","last_undegraded":"2024-09-12T01:50:22.611446+0000","last_fullsized":"2024-09-12T01:50:22.611446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.481782+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:51:21.481782+0000","last_peered":"2024-09-12T01:51:21.481782+0000","last_clean":"2024-09-12T01:51:21.481782+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:51:21.481782+0000","last_undegraded":"2024-09-12T01:51:21.481782+0000","last_fullsized":"2024-09-12T01:51:21.481782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'16","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:22.331135+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:51:22.331135+0000","last_peered":"2024-09-12T01:51:22.331135+0000","last_clean":"2024-09-12T01:51:22.331135+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:51:22.331135+0000","last_undegraded":"2024-09-12T01:51:22.331135+0000","last_fullsized":"2024-09-12T01:51:22.331135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487040+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:51:21.487040+0000","last_peered":"2024-09-12T01:51:21.487040+0000","last_clean":"2024-09-12T01:51:21.487040+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:51:21.487040+0000","last_undegraded":"2024-09-12T01:51:21.487040+0000","last_fullsized":"2024-09-12T01:51:21.487040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681518+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:22.681518+0000","last_peered":"2024-09-12T01:50:22.681518+0000","last_clean":"2024-09-12T01:50:22.681518+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:22.681518+0000","last_undegraded":"2024-09-12T01:50:22.681518+0000","last_fullsized":"2024-09-12T01:50:22.681518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489524+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:51:21.489524+0000","last_peered":"2024-09-12T01:51:21.489524+0000","last_clean":"2024-09-12T01:51:21.489524+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:51:21.489524+0000","last_undegraded":"2024-09-12T01:51:21.489524+0000","last_fullsized":"2024-09-12T01:51:21.489524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611066+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:22.611066+0000","last_peered":"2024-09-12T01:50:22.611066+0000","last_clean":"2024-09-12T01:50:22.611066+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:22.611066+0000","last_undegraded":"2024-09-12T01:50:22.611066+0000","last_fullsized":"2024-09-12T01:50:22.611066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.451681+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:51:21.451681+0000","last_peered":"2024-09-12T01:51:21.451681+0000","last_clean":"2024-09-12T01:51:21.451681+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:51:21.451681+0000","last_undegraded":"2024-09-12T01:51:21.451681+0000","last_fullsized":"2024-09-12T01:51:21.451681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613860+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:22.613860+0000","last_peered":"2024-09-12T01:50:22.613860+0000","last_clean":"2024-09-12T01:50:22.613860+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:22.613860+0000","last_undegraded":"2024-09-12T01:50:22.613860+0000","last_fullsized":"2024-09-12T01:50:22.613860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484300+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:51:21.484300+0000","last_peered":"2024-09-12T01:51:21.484300+0000","last_clean":"2024-09-12T01:51:21.484300+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:51:21.484300+0000","last_undegraded":"2024-09-12T01:51:21.484300+0000","last_fullsized":"2024-09-12T01:51:21.484300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612140+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:22.612140+0000","last_peered":"2024-09-12T01:50:22.612140+0000","last_clean":"2024-09-12T01:50:22.612140+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:22.612140+0000","last_undegraded":"2024-09-12T01:50:22.612140+0000","last_fullsized":"2024-09-12T01:50:22.612140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493228+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:51:21.493228+0000","last_peered":"2024-09-12T01:51:21.493228+0000","last_clean":"2024-09-12T01:51:21.493228+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:51:21.493228+0000","last_undegraded":"2024-09-12T01:51:21.493228+0000","last_fullsized":"2024-09-12T01:51:21.493228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611281+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:22.611281+0000","last_peered":"2024-09-12T01:50:22.611281+0000","last_clean":"2024-09-12T01:50:22.611281+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:22.611281+0000","last_undegraded":"2024-09-12T01:50:22.611281+0000","last_fullsized":"2024-09-12T01:50:22.611281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501783+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:51:21.501783+0000","last_peered":"2024-09-12T01:51:21.501783+0000","last_clean":"2024-09-12T01:51:21.501783+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:51:21.501783+0000","last_undegraded":"2024-09-12T01:51:21.501783+0000","last_fullsized":"2024-09-12T01:51:21.501783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.497079+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:51:21.497079+0000","last_peered":"2024-09-12T01:51:21.497079+0000","last_clean":"2024-09-12T01:51:21.497079+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:51:21.497079+0000","last_undegraded":"2024-09-12T01:51:21.497079+0000","last_fullsized":"2024-09-12T01:51:21.497079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611510+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:22.611510+0000","last_peered":"2024-09-12T01:50:22.611510+0000","last_clean":"2024-09-12T01:50:22.611510+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:22.611510+0000","last_undegraded":"2024-09-12T01:50:22.611510+0000","last_fullsized":"2024-09-12T01:50:22.611510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501244+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:51:21.501244+0000","last_peered":"2024-09-12T01:51:21.501244+0000","last_clean":"2024-09-12T01:51:21.501244+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:51:21.501244+0000","last_undegraded":"2024-09-12T01:51:21.501244+0000","last_fullsized":"2024-09-12T01:51:21.501244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611302+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:22.611302+0000","last_peered":"2024-09-12T01:50:22.611302+0000","last_clean":"2024-09-12T01:50:22.611302+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:22.611302+0000","last_undegraded":"2024-09-12T01:50:22.611302+0000","last_fullsized":"2024-09-12T01:50:22.611302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.502276+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:51:21.502276+0000","last_peered":"2024-09-12T01:51:21.502276+0000","last_clean":"2024-09-12T01:51:21.502276+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:51:21.502276+0000","last_undegraded":"2024-09-12T01:51:21.502276+0000","last_fullsized":"2024-09-12T01:51:21.502276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614376+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:50:22.614376+0000","last_peered":"2024-09-12T01:50:22.614376+0000","last_clean":"2024-09-12T01:50:22.614376+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:50:22.614376+0000","last_undegraded":"2024-09-12T01:50:22.614376+0000","last_fullsized":"2024-09-12T01:50:22.614376+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487999+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:51:21.487999+0000","last_peered":"2024-09-12T01:51:21.487999+0000","last_clean":"2024-09-12T01:51:21.487999+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:51:21.487999+0000","last_undegraded":"2024-09-12T01:51:21.487999+0000","last_fullsized":"2024-09-12T01:51:21.487999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:55.805329+0000","last_change":"2024-09-12T01:50:22.691988+0000","last_active":"2024-09-12T01:51:55.805329+0000","last_peered":"2024-09-12T01:51:55.805329+0000","last_clean":"2024-09-12T01:51:55.805329+0000","last_became_active":"2024-09-12T01:50:22.682676+0000","last_became_peered":"2024-09-12T01:50:22.682676+0000","last_unstale":"2024-09-12T01:51:55.805329+0000","last_undegraded":"2024-09-12T01:51:55.805329+0000","last_fullsized":"2024-09-12T01:51:55.805329+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:56.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75513,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1108,"num_read_kb":637,"num_write":266,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":50275,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":226539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547237,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776169,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32768,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712384,"statfs":{"total":95995035648,"available":95961481216,"internally_reserved":0,"allocated":1622016,"data_stored":1096574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939695,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":438411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397560,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1031195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528381,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":438545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1544192,"data_stored":1031011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953543,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":505053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":440520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":506639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":440192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:52:01.412 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:52:01.452 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:01.710 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:01 smithi070 ceph-mon[31177]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:52:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.905+0000 7f3737478640 1 -- 172.21.15.70:0/2810562319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3730102570 msgr2=0x7f37301029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.905+0000 7f3737478640 1 --2- 172.21.15.70:0/2810562319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3730102570 0x7f37301029b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3720009900 tx=0x7f372002a480 comp rx=0 tx=0).stop 2024-09-12T01:52:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.905+0000 7f3737478640 1 -- 172.21.15.70:0/2810562319 shutdown_connections 2024-09-12T01:52:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.905+0000 7f3737478640 1 --2- 172.21.15.70:0/2810562319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3730102ef0 0x7f373010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.905+0000 7f3737478640 1 --2- 172.21.15.70:0/2810562319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3730102570 0x7f37301029b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.905+0000 7f3737478640 1 --2- 172.21.15.70:0/2810562319 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3730100e20 0x7f3730101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.905+0000 7f3737478640 1 -- 172.21.15.70:0/2810562319 >> 172.21.15.70:0/2810562319 conn(0x7f37300fc7d0 msgr2=0x7f37300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.905+0000 7f3737478640 1 -- 172.21.15.70:0/2810562319 shutdown_connections 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.905+0000 7f3737478640 1 -- 172.21.15.70:0/2810562319 wait complete. 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3737478640 1 Processor -- start 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3737478640 1 -- start start 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3737478640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3730100e20 0x7f37301973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3737478640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3730102570 0x7f3730197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3737478640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3730102ef0 0x7f373019bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3737478640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37301110a0 con 0x7f3730100e20 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3737478640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3730110f20 con 0x7f3730102ef0 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3737478640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3730111220 con 0x7f3730102570 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3735214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3730100e20 0x7f37301973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3735214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3730100e20 0x7f37301973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57172/0 (socket says 172.21.15.70:57172) 2024-09-12T01:52:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3735214640 1 -- 172.21.15.70:0/136543076 learned_addr learned my addr 172.21.15.70:0/136543076 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3735a15640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3730102ef0 0x7f373019bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3735214640 1 -- 172.21.15.70:0/136543076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3730102570 msgr2=0x7f3730197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3735214640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3730102570 0x7f3730197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3735214640 1 -- 172.21.15.70:0/136543076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3730102ef0 msgr2=0x7f373019bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3735214640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3730102ef0 0x7f373019bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3735214640 1 -- 172.21.15.70:0/136543076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373019c370 con 0x7f3730100e20 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3735a15640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3730102ef0 0x7f373019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.906+0000 7f3735214640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3730100e20 0x7f37301973c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c920 tx=0x7f372c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.907+0000 7f37267fc640 1 -- 172.21.15.70:0/136543076 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c007c70 con 0x7f3730100e20 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.907+0000 7f37267fc640 1 -- 172.21.15.70:0/136543076 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f372c007e10 con 0x7f3730100e20 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.907+0000 7f37267fc640 1 -- 172.21.15.70:0/136543076 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c018940 con 0x7f3730100e20 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.907+0000 7f3737478640 1 -- 172.21.15.70:0/136543076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373019c660 con 0x7f3730100e20 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.907+0000 7f3737478640 1 -- 172.21.15.70:0/136543076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37301a3f40 con 0x7f3730100e20 2024-09-12T01:52:01.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.909+0000 7f37267fc640 1 -- 172.21.15.70:0/136543076 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f372c018b20 con 0x7f3730100e20 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.909+0000 7f3739851740 1 Processor -- start 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.909+0000 7f3739851740 1 -- start start 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.909+0000 7f3739851740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b862e8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.909+0000 7f3739851740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8c60 0x556b862f5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.909+0000 7f3739851740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3739851740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b8624e2e0 con 0x556b862e8340 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3739851740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556b861f5ce0 con 0x556b862f5890 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3739851740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556b8624a2a0 con 0x556b862e8c60 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3735a15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b862e8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3735a15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b862e8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57184/0 (socket says 172.21.15.70:57184) 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3735a15640 1 -- 172.21.15.70:0/207179485 learned_addr learned my addr 172.21.15.70:0/207179485 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3735214640 1 --2- 172.21.15.70:0/207179485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8c60 0x556b862f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f37267fc640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f371c0a2c00 0x7f371c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3734a13640 1 --2- 172.21.15.70:0/207179485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3735a15640 1 -- 172.21.15.70:0/207179485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8c60 msgr2=0x556b862f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3735a15640 1 --2- 172.21.15.70:0/207179485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8c60 0x556b862f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3735a15640 1 -- 172.21.15.70:0/207179485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 msgr2=0x556b862f7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3735a15640 1 --2- 172.21.15.70:0/207179485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3735a15640 1 -- 172.21.15.70:0/207179485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b861da440 con 0x556b862e8340 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3734a13640 1 --2- 172.21.15.70:0/207179485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f37267fc640 1 -- 172.21.15.70:0/136543076 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f372c0cf1e0 con 0x7f3730100e20 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3735a15640 1 --2- 172.21.15.70:0/207179485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b862e8720 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3728008e60 tx=0x7f372800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25831e79707fa566 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f3735a15640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f371c0a2c00 0x7f371c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.910+0000 7f371b7fe640 1 -- 172.21.15.70:0/207179485 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372801f070 con 0x556b862e8340 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.911+0000 7f371b7fe640 1 -- 172.21.15.70:0/207179485 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f372800e3b0 con 0x556b862e8340 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.911+0000 7f371b7fe640 1 -- 172.21.15.70:0/207179485 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372800b600 con 0x556b862e8340 2024-09-12T01:52:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.911+0000 7f3739851740 1 -- 172.21.15.70:0/207179485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 msgr2=0x556b862e8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.911+0000 7f3735a15640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f371c0a2c00 0x7f371c0a50c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3728008fd0 tx=0x7f372801f000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.911+0000 7f3739851740 1 --2- 172.21.15.70:0/207179485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b862e8720 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3728008e60 tx=0x7f372800d710 comp rx=0 tx=0).stop 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.911+0000 7f3739851740 1 -- 172.21.15.70:0/207179485 shutdown_connections 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.911+0000 7f3739851740 1 --2- 172.21.15.70:0/207179485 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.911+0000 7f3739851740 1 --2- 172.21.15.70:0/207179485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8c60 0x556b862f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.911+0000 7f3739851740 1 --2- 172.21.15.70:0/207179485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b862e8720 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.911+0000 7f3739851740 1 -- 172.21.15.70:0/207179485 >> 172.21.15.70:0/207179485 conn(0x556b862e4a30 msgr2=0x556b862e4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.911+0000 7f3739851740 1 -- 172.21.15.70:0/207179485 shutdown_connections 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.911+0000 7f3739851740 1 -- 172.21.15.70:0/207179485 wait complete. 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3739851740 1 -- start start 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3739851740 1 Processor -- start 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3739851740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b862f5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3739851740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8c60 0x556b862f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3739851740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3739851740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b862f8460 con 0x556b862e8340 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3739851740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556b86209050 con 0x556b862f5890 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3739851740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556b862f85e0 con 0x556b862e8c60 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3739851740 10 client.0 _ll_register_callbacks cb 0x556b86249160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3735214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b862f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3735214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b862f5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57186/0 (socket says 172.21.15.70:57186) 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3735214640 1 -- 172.21.15.70:0/2012517628 learned_addr learned my addr 172.21.15.70:0/2012517628 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.912+0000 7f3735a15640 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3734a13640 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8c60 0x556b862f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3735214640 1 -- 172.21.15.70:0/2012517628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8c60 msgr2=0x556b862f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3735214640 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8c60 0x556b862f24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3735214640 1 -- 172.21.15.70:0/2012517628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 msgr2=0x556b862f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3735214640 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3735214640 1 -- 172.21.15.70:0/2012517628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b85fbf3c0 con 0x556b862e8340 2024-09-12T01:52:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3735a15640 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3735214640 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b862f5230 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c8f0 tx=0x7f372c09b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d52a179c2b889b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3718ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3718ff9640 1 -- 172.21.15.70:0/2012517628 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c01f300 con 0x556b862e8340 2024-09-12T01:52:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3718ff9640 1 -- 172.21.15.70:0/2012517628 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f372c0a4220 con 0x556b862e8340 2024-09-12T01:52:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3739851740 1 -- 172.21.15.70:0/2012517628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f372800e3b0 con 0x556b862e8340 2024-09-12T01:52:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3718ff9640 1 -- 172.21.15.70:0/2012517628 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f372c09ba40 con 0x556b862e8340 2024-09-12T01:52:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3739851740 10 client.15369 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3739851740 1 -- 172.21.15.70:0/2012517628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b86303e20 con 0x556b862e8340 2024-09-12T01:52:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3718ff9640 1 -- 172.21.15.70:0/2012517628 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f372800e3b0 con 0x556b862e8340 2024-09-12T01:52:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3718ff9640 1 -- 172.21.15.70:0/2012517628 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f372c09ae90 con 0x556b862e8340 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3739851740 10 client.15369 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3739851740 10 client.15369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3739851740 20 client.15369 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3739851740 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x556b863052e0 0x556b863076d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3739851740 4 client.15369 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.913+0000 7f3739851740 1 -- 172.21.15.70:0/2012517628 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b8625b850 con 0x556b863052e0 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.914+0000 7f3734a13640 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x556b863052e0 0x556b863076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.914+0000 7f3734a13640 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x556b863052e0 0x556b863076d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d74eee73a0d933a server_cookie=bafd766ec0e1d615 in_seq=0 out_seq=0 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.914+0000 7f3718ff9640 10 client.15369 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3718ff9640 1 -- 172.21.15.70:0/2012517628 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b8625b850 con 0x556b863052e0 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3718ff9640 10 client.15369 handle_command_reply: tid=0 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3739851740 1 client.15369 shutdown 2024-09-12T01:52:01.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3739851740 1 -- 172.21.15.70:0/2012517628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 msgr2=0x556b862f5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:01.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3739851740 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b862f5230 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c8f0 tx=0x7f372c09b640 comp rx=0 tx=0).stop 2024-09-12T01:52:01.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3739851740 1 -- 172.21.15.70:0/2012517628 shutdown_connections 2024-09-12T01:52:01.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3739851740 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x556b863052e0 0x556b863076d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3739851740 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3739851740 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8c60 0x556b862f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3718ff9640 0 client.15369 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:01.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3739851740 1 --2- 172.21.15.70:0/2012517628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b862f5230 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3739851740 1 -- 172.21.15.70:0/2012517628 >> 172.21.15.70:0/2012517628 conn(0x556b862e4a30 msgr2=0x556b862ea790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:01.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3739851740 1 -- 172.21.15.70:0/2012517628 shutdown_connections 2024-09-12T01:52:01.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3739851740 1 -- 172.21.15.70:0/2012517628 wait complete. 2024-09-12T01:52:01.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.915+0000 7f3739851740 20 client.15369 trim_cache size 0 max 16384 2024-09-12T01:52:01.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.934+0000 7f3739851740 1 Processor -- start 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3739851740 1 -- start start 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3739851740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b86301700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3739851740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862e8c60 0x556b8630cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3739851740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862f5890 0x556b8630d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3739851740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37301ab3e0 con 0x556b862e8340 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3739851740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f37301acf20 con 0x556b862e8c60 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3739851740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f37301abab0 con 0x556b862f5890 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3735214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b86301700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3735214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b86301700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57188/0 (socket says 172.21.15.70:57188) 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3735214640 1 -- 172.21.15.70:0/846203458 learned_addr learned my addr 172.21.15.70:0/846203458 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3734a13640 1 --2- 172.21.15.70:0/846203458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862e8c60 0x556b8630cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3735a15640 1 --2- 172.21.15.70:0/846203458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862f5890 0x556b8630d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3735214640 1 -- 172.21.15.70:0/846203458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862f5890 msgr2=0x556b8630d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:01.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3735214640 1 --2- 172.21.15.70:0/846203458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862f5890 0x556b8630d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3735214640 1 -- 172.21.15.70:0/846203458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862e8c60 msgr2=0x556b8630cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:01.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3735214640 1 --2- 172.21.15.70:0/846203458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862e8c60 0x556b8630cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3735214640 1 -- 172.21.15.70:0/846203458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b86307d00 con 0x556b862e8340 2024-09-12T01:52:01.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3735a15640 1 --2- 172.21.15.70:0/846203458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862f5890 0x556b8630d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:01.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.935+0000 7f3734a13640 1 --2- 172.21.15.70:0/846203458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862e8c60 0x556b8630cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:01.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.936+0000 7f3735214640 1 --2- 172.21.15.70:0/846203458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b86301700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f372c084fd0 tx=0x7f372c09b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79812dc2b9c3c83f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:01.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.936+0000 7f371affd640 1 -- 172.21.15.70:0/846203458 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c09fdf0 con 0x556b862e8340 2024-09-12T01:52:01.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.936+0000 7f371affd640 1 -- 172.21.15.70:0/846203458 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f372c0a46b0 con 0x556b862e8340 2024-09-12T01:52:01.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.936+0000 7f371affd640 1 -- 172.21.15.70:0/846203458 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c0a4220 con 0x556b862e8340 2024-09-12T01:52:01.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:01 smithi191 ceph-mon[35770]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:52:01.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.936+0000 7f3739851740 1 -- 172.21.15.70:0/846203458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 msgr2=0x556b86301700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:01.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.936+0000 7f3739851740 1 --2- 172.21.15.70:0/846203458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b86301700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f372c084fd0 tx=0x7f372c09b6b0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.937+0000 7f3739851740 1 -- 172.21.15.70:0/846203458 shutdown_connections 2024-09-12T01:52:01.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.937+0000 7f3739851740 1 --2- 172.21.15.70:0/846203458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862f5890 0x556b8630d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.937+0000 7f3739851740 1 --2- 172.21.15.70:0/846203458 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862e8c60 0x556b8630cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.937+0000 7f3739851740 1 --2- 172.21.15.70:0/846203458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8340 0x556b86301700 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.937+0000 7f3739851740 1 -- 172.21.15.70:0/846203458 >> 172.21.15.70:0/846203458 conn(0x556b862e4a30 msgr2=0x556b862edb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:01.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.937+0000 7f3739851740 1 -- 172.21.15.70:0/846203458 shutdown_connections 2024-09-12T01:52:01.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.937+0000 7f3739851740 1 -- 172.21.15.70:0/846203458 wait complete. 2024-09-12T01:52:01.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.937+0000 7f3739851740 1 -- start start 2024-09-12T01:52:01.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.937+0000 7f3739851740 1 Processor -- start 2024-09-12T01:52:01.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3739851740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8340 0x556b862ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3739851740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8c60 0x556b862efc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3739851740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3739851740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37301ac850 con 0x556b862e8c60 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3739851740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f37301ac180 con 0x556b862f5890 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3734a13640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8c60 0x556b862efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3739851740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f37301a93a0 con 0x556b862e8340 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3734a13640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8c60 0x556b862efc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57200/0 (socket says 172.21.15.70:57200) 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3734a13640 1 -- 172.21.15.70:0/2176325701 learned_addr learned my addr 172.21.15.70:0/2176325701 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3739851740 10 client.0 _ll_register_callbacks cb 0x7f372c00cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3735a15640 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3735214640 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8340 0x556b862ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3734a13640 1 -- 172.21.15.70:0/2176325701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8340 msgr2=0x556b862ef6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3734a13640 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8340 0x556b862ef6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3734a13640 1 -- 172.21.15.70:0/2176325701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 msgr2=0x556b862f0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:01.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3734a13640 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3734a13640 1 -- 172.21.15.70:0/2176325701 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b8636f100 con 0x556b862e8c60 2024-09-12T01:52:01.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3735214640 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8340 0x556b862ef6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:01.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3734a13640 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8c60 0x556b862efc30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f37300feca0 tx=0x7f3720004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52b149389fec7df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:01.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.938+0000 7f3718ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:01.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.939+0000 7f3718ff9640 1 -- 172.21.15.70:0/2176325701 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372004a060 con 0x556b862e8c60 2024-09-12T01:52:01.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.939+0000 7f3718ff9640 1 -- 172.21.15.70:0/2176325701 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3720005040 con 0x556b862e8c60 2024-09-12T01:52:01.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.939+0000 7f3739851740 1 -- 172.21.15.70:0/2176325701 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f372c0a46b0 con 0x556b862e8c60 2024-09-12T01:52:01.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.939+0000 7f3718ff9640 1 -- 172.21.15.70:0/2176325701 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3720035040 con 0x556b862e8c60 2024-09-12T01:52:01.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.939+0000 7f3739851740 10 client.15375 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:01.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.939+0000 7f3739851740 1 -- 172.21.15.70:0/2176325701 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b863703a0 con 0x556b862e8c60 2024-09-12T01:52:01.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.939+0000 7f3718ff9640 1 -- 172.21.15.70:0/2176325701 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f372c0a46b0 con 0x556b862e8c60 2024-09-12T01:52:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.939+0000 7f3718ff9640 1 -- 172.21.15.70:0/2176325701 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f372004f070 con 0x556b862e8c60 2024-09-12T01:52:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.939+0000 7f3739851740 10 client.15375 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.939+0000 7f3739851740 10 client.15375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.939+0000 7f3739851740 20 client.15375 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.939+0000 7f3739851740 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x556b86370b50 0x556b86372f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.940+0000 7f3739851740 4 client.15375 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:52:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.940+0000 7f3739851740 1 -- 172.21.15.70:0/2176325701 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556b86255d60 con 0x556b86370b50 2024-09-12T01:52:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.940+0000 7f3735214640 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x556b86370b50 0x556b86372f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.940+0000 7f3718ff9640 10 client.15375 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.940+0000 7f3735214640 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x556b86370b50 0x556b86372f70 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d3e3b7dec7064b9 server_cookie=25ee17324cb1f4a8 in_seq=0 out_seq=0 2024-09-12T01:52:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.940+0000 7f3718ff9640 1 -- 172.21.15.70:0/2176325701 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556b86255d60 con 0x556b86370b50 2024-09-12T01:52:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.940+0000 7f3718ff9640 10 client.15375 handle_command_reply: tid=0 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3739851740 1 client.15375 shutdown 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3739851740 1 -- 172.21.15.70:0/2176325701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8c60 msgr2=0x556b862efc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3739851740 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8c60 0x556b862efc30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f37300feca0 tx=0x7f3720004040 comp rx=0 tx=0).stop 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3739851740 1 -- 172.21.15.70:0/2176325701 shutdown_connections 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3739851740 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x556b86370b50 0x556b86372f70 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3739851740 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b862f5890 0x556b862f0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3718ff9640 0 client.15375 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3739851740 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b862e8c60 0x556b862efc30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3739851740 1 --2- 172.21.15.70:0/2176325701 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b862e8340 0x556b862ef6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3739851740 1 -- 172.21.15.70:0/2176325701 >> 172.21.15.70:0/2176325701 conn(0x556b862e4a30 msgr2=0x556b862e3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3739851740 1 -- 172.21.15.70:0/2176325701 shutdown_connections 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3739851740 1 -- 172.21.15.70:0/2176325701 wait complete. 2024-09-12T01:52:01.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.941+0000 7f3739851740 20 client.15375 trim_cache size 0 max 16384 2024-09-12T01:52:01.952 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:52:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:52:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-12T01:52:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "e6c1c210-5999-425e-9499-9aa1f11914b0": { 2024-09-12T01:52:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T01:52:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "e6c1c210-5999-425e-9499-9aa1f11914b0", 2024-09-12T01:52:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-12T01:52:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:52:01.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:52:01.952 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:52:01.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.942+0000 7f3737478640 1 -- 172.21.15.70:0/136543076 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f371c0a2c00 msgr2=0x7f371c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:01.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.942+0000 7f3737478640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f371c0a2c00 0x7f371c0a50c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3728008fd0 tx=0x7f372801f000 comp rx=0 tx=0).stop 2024-09-12T01:52:01.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.942+0000 7f3737478640 1 -- 172.21.15.70:0/136543076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3730100e20 msgr2=0x7f37301973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:01.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.942+0000 7f3737478640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3730100e20 0x7f37301973c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c920 tx=0x7f372c00cde0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.942+0000 7f3737478640 1 -- 172.21.15.70:0/136543076 shutdown_connections 2024-09-12T01:52:01.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.942+0000 7f3737478640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f371c0a2c00 0x7f371c0a50c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.942+0000 7f3737478640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3730102ef0 0x7f373019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.942+0000 7f3737478640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3730102570 0x7f3730197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.942+0000 7f3737478640 1 --2- 172.21.15.70:0/136543076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3730100e20 0x7f37301973c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:01.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.942+0000 7f3737478640 1 -- 172.21.15.70:0/136543076 >> 172.21.15.70:0/136543076 conn(0x7f37300fc7d0 msgr2=0x7f3730105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:01.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.942+0000 7f3737478640 1 -- 172.21.15.70:0/136543076 shutdown_connections 2024-09-12T01:52:01.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:01.942+0000 7f3737478640 1 -- 172.21.15.70:0/136543076 wait complete. 2024-09-12T01:52:02.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:01 smithi152 ceph-mon[35055]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:52:02.296 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:02.730 INFO:tasks.cephfs.filesystem:scrub status for tag:e6c1c210-5999-425e-9499-9aa1f11914b0 - {'path': '/', 'tag': 'e6c1c210-5999-425e-9499-9aa1f11914b0', 'options': 'recursive,force'} 2024-09-12T01:52:02.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:02 smithi070 ceph-mon[31177]: pgmap v333: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-12T01:52:02.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:02 smithi191 ceph-mon[35770]: pgmap v333: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-12T01:52:03.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:02 smithi152 ceph-mon[35055]: pgmap v333: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-12T01:52:03.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.152+0000 7f798b991640 1 -- 172.21.15.70:0/3485221685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7984102570 msgr2=0x7f79841029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:03.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.152+0000 7f798b991640 1 --2- 172.21.15.70:0/3485221685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7984102570 0x7f79841029b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7974009900 tx=0x7f797402a480 comp rx=0 tx=0).stop 2024-09-12T01:52:03.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 -- 172.21.15.70:0/3485221685 shutdown_connections 2024-09-12T01:52:03.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 --2- 172.21.15.70:0/3485221685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7984102ef0 0x7f798410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:03.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 --2- 172.21.15.70:0/3485221685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7984102570 0x7f79841029b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:03.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 --2- 172.21.15.70:0/3485221685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7984100e20 0x7f7984101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:03.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 -- 172.21.15.70:0/3485221685 >> 172.21.15.70:0/3485221685 conn(0x7f79840fc7d0 msgr2=0x7f79840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:03.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 -- 172.21.15.70:0/3485221685 shutdown_connections 2024-09-12T01:52:03.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 -- 172.21.15.70:0/3485221685 wait complete. 2024-09-12T01:52:03.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 Processor -- start 2024-09-12T01:52:03.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 -- start start 2024-09-12T01:52:03.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7984100e20 0x7f7984199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:03.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7984102570 0x7f7984199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:03.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7984102ef0 0x7f79841a4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:03.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79841110a0 con 0x7f7984100e20 2024-09-12T01:52:03.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7984110f20 con 0x7f7984102ef0 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.153+0000 7f798b991640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7984111220 con 0x7f7984102570 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f798972d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7984100e20 0x7f7984199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f798972d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7984100e20 0x7f7984199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57214/0 (socket says 172.21.15.70:57214) 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f798972d640 1 -- 172.21.15.70:0/4184856452 learned_addr learned my addr 172.21.15.70:0/4184856452 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f7988f2c640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7984102570 0x7f7984199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f798972d640 1 -- 172.21.15.70:0/4184856452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7984102570 msgr2=0x7f7984199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f798972d640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7984102570 0x7f7984199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f798972d640 1 -- 172.21.15.70:0/4184856452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7984102ef0 msgr2=0x7f79841a4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f798972d640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7984102ef0 0x7f79841a4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f798972d640 1 -- 172.21.15.70:0/4184856452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79841a49d0 con 0x7f7984100e20 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f7988f2c640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7984102570 0x7f7984199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f798972d640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7984100e20 0x7f7984199410 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f798000d950 tx=0x7f798000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f797a7fc640 1 -- 172.21.15.70:0/4184856452 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7980017070 con 0x7f7984100e20 2024-09-12T01:52:03.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f797a7fc640 1 -- 172.21.15.70:0/4184856452 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7980009c30 con 0x7f7984100e20 2024-09-12T01:52:03.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f798b991640 1 -- 172.21.15.70:0/4184856452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79841a4ba0 con 0x7f7984100e20 2024-09-12T01:52:03.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f797a7fc640 1 -- 172.21.15.70:0/4184856452 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798000f740 con 0x7f7984100e20 2024-09-12T01:52:03.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.154+0000 7f798b991640 1 -- 172.21.15.70:0/4184856452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79841a50b0 con 0x7f7984100e20 2024-09-12T01:52:03.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.155+0000 7f798b991640 1 -- 172.21.15.70:0/4184856452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7984101200 con 0x7f7984100e20 2024-09-12T01:52:03.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.156+0000 7f797a7fc640 1 -- 172.21.15.70:0/4184856452 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7980010a80 con 0x7f7984100e20 2024-09-12T01:52:03.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.157+0000 7f797a7fc640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79700a2b80 0x7f79700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:03.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.157+0000 7f7988f2c640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79700a2b80 0x7f79700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:03.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.157+0000 7f797a7fc640 1 -- 172.21.15.70:0/4184856452 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f79800ced80 con 0x7f7984100e20 2024-09-12T01:52:03.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.158+0000 7f7988f2c640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79700a2b80 0x7f79700a5040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7974031580 tx=0x7f7974032c40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:03.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.161+0000 7f797a7fc640 1 -- 172.21.15.70:0/4184856452 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7980009de0 con 0x7f7984100e20 2024-09-12T01:52:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.323+0000 7f798b991640 1 -- 172.21.15.70:0/4184856452 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7984106f50 con 0x7f79700a2b80 2024-09-12T01:52:03.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.330+0000 7f797a7fc640 1 -- 172.21.15.70:0/4184856452 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258901 (secure 0 0 0) 0x7f7984106f50 con 0x7f79700a2b80 2024-09-12T01:52:03.333 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:52:03.334 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:52:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.332+0000 7f798b991640 1 -- 172.21.15.70:0/4184856452 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79700a2b80 msgr2=0x7f79700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.332+0000 7f798b991640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79700a2b80 0x7f79700a5040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7974031580 tx=0x7f7974032c40 comp rx=0 tx=0).stop 2024-09-12T01:52:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.332+0000 7f798b991640 1 -- 172.21.15.70:0/4184856452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7984100e20 msgr2=0x7f7984199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.332+0000 7f798b991640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7984100e20 0x7f7984199410 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f798000d950 tx=0x7f798000de10 comp rx=0 tx=0).stop 2024-09-12T01:52:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.333+0000 7f798b991640 1 -- 172.21.15.70:0/4184856452 shutdown_connections 2024-09-12T01:52:03.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.333+0000 7f798b991640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79700a2b80 0x7f79700a5040 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:03.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.333+0000 7f798b991640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7984102ef0 0x7f79841a4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:03.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.333+0000 7f798b991640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7984102570 0x7f7984199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:03.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.333+0000 7f798b991640 1 --2- 172.21.15.70:0/4184856452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7984100e20 0x7f7984199410 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:03.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.333+0000 7f798b991640 1 -- 172.21.15.70:0/4184856452 >> 172.21.15.70:0/4184856452 conn(0x7f79840fc7d0 msgr2=0x7f7984106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:03.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.333+0000 7f798b991640 1 -- 172.21.15.70:0/4184856452 shutdown_connections 2024-09-12T01:52:03.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:03.333+0000 7f798b991640 1 -- 172.21.15.70:0/4184856452 wait complete. 2024-09-12T01:52:04.030 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-12T01:52:01.501685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666115,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1270,"num_read_kb":767,"num_write":449,"num_write_kb":3099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1231128,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370468,"kb_used_data":12900,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571356,"statfs":{"total":1151940427776,"available":1151561068544,"internally_reserved":0,"allocated":13209600,"data_stored":7244409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":78,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002944"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501869+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:51:21.501869+0000","last_peered":"2024-09-12T01:51:21.501869+0000","last_clean":"2024-09-12T01:51:21.501869+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:51:21.501869+0000","last_undegraded":"2024-09-12T01:51:21.501869+0000","last_fullsized":"2024-09-12T01:51:21.501869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488982+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:51:21.488982+0000","last_peered":"2024-09-12T01:51:21.488982+0000","last_clean":"2024-09-12T01:51:21.488982+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:51:21.488982+0000","last_undegraded":"2024-09-12T01:51:21.488982+0000","last_fullsized":"2024-09-12T01:51:21.488982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501730+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:51:21.501730+0000","last_peered":"2024-09-12T01:51:21.501730+0000","last_clean":"2024-09-12T01:51:21.501730+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:51:21.501730+0000","last_undegraded":"2024-09-12T01:51:21.501730+0000","last_fullsized":"2024-09-12T01:51:21.501730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.472404+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:51:21.472404+0000","last_peered":"2024-09-12T01:51:21.472404+0000","last_clean":"2024-09-12T01:51:21.472404+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:51:21.472404+0000","last_undegraded":"2024-09-12T01:51:21.472404+0000","last_fullsized":"2024-09-12T01:51:21.472404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.472067+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:51:21.472067+0000","last_peered":"2024-09-12T01:51:21.472067+0000","last_clean":"2024-09-12T01:51:21.472067+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:51:21.472067+0000","last_undegraded":"2024-09-12T01:51:21.472067+0000","last_fullsized":"2024-09-12T01:51:21.472067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488486+0000","last_change":"2024-09-12T01:50:22.614193+0000","last_active":"2024-09-12T01:51:21.488486+0000","last_peered":"2024-09-12T01:51:21.488486+0000","last_clean":"2024-09-12T01:51:21.488486+0000","last_became_active":"2024-09-12T01:50:22.613816+0000","last_became_peered":"2024-09-12T01:50:22.613816+0000","last_unstale":"2024-09-12T01:51:21.488486+0000","last_undegraded":"2024-09-12T01:51:21.488486+0000","last_fullsized":"2024-09-12T01:51:21.488486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:29.504176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488037+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:51:21.488037+0000","last_peered":"2024-09-12T01:51:21.488037+0000","last_clean":"2024-09-12T01:51:21.488037+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:51:21.488037+0000","last_undegraded":"2024-09-12T01:51:21.488037+0000","last_fullsized":"2024-09-12T01:51:21.488037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493016+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:51:21.493016+0000","last_peered":"2024-09-12T01:51:21.493016+0000","last_clean":"2024-09-12T01:51:21.493016+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:51:21.493016+0000","last_undegraded":"2024-09-12T01:51:21.493016+0000","last_fullsized":"2024-09-12T01:51:21.493016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.500188+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:51:21.500188+0000","last_peered":"2024-09-12T01:51:21.500188+0000","last_clean":"2024-09-12T01:51:21.500188+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:51:21.500188+0000","last_undegraded":"2024-09-12T01:51:21.500188+0000","last_fullsized":"2024-09-12T01:51:21.500188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.491514+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:51:21.491514+0000","last_peered":"2024-09-12T01:51:21.491514+0000","last_clean":"2024-09-12T01:51:21.491514+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:51:21.491514+0000","last_undegraded":"2024-09-12T01:51:21.491514+0000","last_fullsized":"2024-09-12T01:51:21.491514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.499334+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:51:21.499334+0000","last_peered":"2024-09-12T01:51:21.499334+0000","last_clean":"2024-09-12T01:51:21.499334+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:51:21.499334+0000","last_undegraded":"2024-09-12T01:51:21.499334+0000","last_fullsized":"2024-09-12T01:51:21.499334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.496290+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:51:21.496290+0000","last_peered":"2024-09-12T01:51:21.496290+0000","last_clean":"2024-09-12T01:51:21.496290+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:51:21.496290+0000","last_undegraded":"2024-09-12T01:51:21.496290+0000","last_fullsized":"2024-09-12T01:51:21.496290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493477+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:51:21.493477+0000","last_peered":"2024-09-12T01:51:21.493477+0000","last_clean":"2024-09-12T01:51:21.493477+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:51:21.493477+0000","last_undegraded":"2024-09-12T01:51:21.493477+0000","last_fullsized":"2024-09-12T01:51:21.493477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.492593+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:51:21.492593+0000","last_peered":"2024-09-12T01:51:21.492593+0000","last_clean":"2024-09-12T01:51:21.492593+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:51:21.492593+0000","last_undegraded":"2024-09-12T01:51:21.492593+0000","last_fullsized":"2024-09-12T01:51:21.492593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489877+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:51:21.489877+0000","last_peered":"2024-09-12T01:51:21.489877+0000","last_clean":"2024-09-12T01:51:21.489877+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:51:21.489877+0000","last_undegraded":"2024-09-12T01:51:21.489877+0000","last_fullsized":"2024-09-12T01:51:21.489877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.497951+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:51:21.497951+0000","last_peered":"2024-09-12T01:51:21.497951+0000","last_clean":"2024-09-12T01:51:21.497951+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:51:21.497951+0000","last_undegraded":"2024-09-12T01:51:21.497951+0000","last_fullsized":"2024-09-12T01:51:21.497951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501906+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:51:21.501906+0000","last_peered":"2024-09-12T01:51:21.501906+0000","last_clean":"2024-09-12T01:51:21.501906+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:51:21.501906+0000","last_undegraded":"2024-09-12T01:51:21.501906+0000","last_fullsized":"2024-09-12T01:51:21.501906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.494924+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:51:21.494924+0000","last_peered":"2024-09-12T01:51:21.494924+0000","last_clean":"2024-09-12T01:51:21.494924+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:51:21.494924+0000","last_undegraded":"2024-09-12T01:51:21.494924+0000","last_fullsized":"2024-09-12T01:51:21.494924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484591+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:51:21.484591+0000","last_peered":"2024-09-12T01:51:21.484591+0000","last_clean":"2024-09-12T01:51:21.484591+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:51:21.484591+0000","last_undegraded":"2024-09-12T01:51:21.484591+0000","last_fullsized":"2024-09-12T01:51:21.484591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.478916+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:51:21.478916+0000","last_peered":"2024-09-12T01:51:21.478916+0000","last_clean":"2024-09-12T01:51:21.478916+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:51:21.478916+0000","last_undegraded":"2024-09-12T01:51:21.478916+0000","last_fullsized":"2024-09-12T01:51:21.478916+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.475221+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:51:21.475221+0000","last_peered":"2024-09-12T01:51:21.475221+0000","last_clean":"2024-09-12T01:51:21.475221+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:51:21.475221+0000","last_undegraded":"2024-09-12T01:51:21.475221+0000","last_fullsized":"2024-09-12T01:51:21.475221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.499408+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:51:21.499408+0000","last_peered":"2024-09-12T01:51:21.499408+0000","last_clean":"2024-09-12T01:51:21.499408+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:51:21.499408+0000","last_undegraded":"2024-09-12T01:51:21.499408+0000","last_fullsized":"2024-09-12T01:51:21.499408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.485203+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:51:21.485203+0000","last_peered":"2024-09-12T01:51:21.485203+0000","last_clean":"2024-09-12T01:51:21.485203+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:51:21.485203+0000","last_undegraded":"2024-09-12T01:51:21.485203+0000","last_fullsized":"2024-09-12T01:51:21.485203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.482413+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:51:21.482413+0000","last_peered":"2024-09-12T01:51:21.482413+0000","last_clean":"2024-09-12T01:51:21.482413+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:51:21.482413+0000","last_undegraded":"2024-09-12T01:51:21.482413+0000","last_fullsized":"2024-09-12T01:51:21.482413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484804+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:51:21.484804+0000","last_peered":"2024-09-12T01:51:21.484804+0000","last_clean":"2024-09-12T01:51:21.484804+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:51:21.484804+0000","last_undegraded":"2024-09-12T01:51:21.484804+0000","last_fullsized":"2024-09-12T01:51:21.484804+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493388+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:51:21.493388+0000","last_peered":"2024-09-12T01:51:21.493388+0000","last_clean":"2024-09-12T01:51:21.493388+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:51:21.493388+0000","last_undegraded":"2024-09-12T01:51:21.493388+0000","last_fullsized":"2024-09-12T01:51:21.493388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487787+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:51:21.487787+0000","last_peered":"2024-09-12T01:51:21.487787+0000","last_clean":"2024-09-12T01:51:21.487787+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:51:21.487787+0000","last_undegraded":"2024-09-12T01:51:21.487787+0000","last_fullsized":"2024-09-12T01:51:21.487787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.476227+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:51:21.476227+0000","last_peered":"2024-09-12T01:51:21.476227+0000","last_clean":"2024-09-12T01:51:21.476227+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:51:21.476227+0000","last_undegraded":"2024-09-12T01:51:21.476227+0000","last_fullsized":"2024-09-12T01:51:21.476227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.490901+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:51:21.490901+0000","last_peered":"2024-09-12T01:51:21.490901+0000","last_clean":"2024-09-12T01:51:21.490901+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:51:21.490901+0000","last_undegraded":"2024-09-12T01:51:21.490901+0000","last_fullsized":"2024-09-12T01:51:21.490901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484444+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:51:21.484444+0000","last_peered":"2024-09-12T01:51:21.484444+0000","last_clean":"2024-09-12T01:51:21.484444+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:51:21.484444+0000","last_undegraded":"2024-09-12T01:51:21.484444+0000","last_fullsized":"2024-09-12T01:51:21.484444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486738+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:51:21.486738+0000","last_peered":"2024-09-12T01:51:21.486738+0000","last_clean":"2024-09-12T01:51:21.486738+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:51:21.486738+0000","last_undegraded":"2024-09-12T01:51:21.486738+0000","last_fullsized":"2024-09-12T01:51:21.486738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488158+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:51:21.488158+0000","last_peered":"2024-09-12T01:51:21.488158+0000","last_clean":"2024-09-12T01:51:21.488158+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:51:21.488158+0000","last_undegraded":"2024-09-12T01:51:21.488158+0000","last_fullsized":"2024-09-12T01:51:21.488158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.483006+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:51:21.483006+0000","last_peered":"2024-09-12T01:51:21.483006+0000","last_clean":"2024-09-12T01:51:21.483006+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:51:21.483006+0000","last_undegraded":"2024-09-12T01:51:21.483006+0000","last_fullsized":"2024-09-12T01:51:21.483006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'7","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:58.541791+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:51:58.541791+0000","last_peered":"2024-09-12T01:51:58.541791+0000","last_clean":"2024-09-12T01:51:58.541791+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:51:58.541791+0000","last_undegraded":"2024-09-12T01:51:58.541791+0000","last_fullsized":"2024-09-12T01:51:58.541791+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.477519+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:51:21.477519+0000","last_peered":"2024-09-12T01:51:21.477519+0000","last_clean":"2024-09-12T01:51:21.477519+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:51:21.477519+0000","last_undegraded":"2024-09-12T01:51:21.477519+0000","last_fullsized":"2024-09-12T01:51:21.477519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.688704+0000","last_change":"2024-09-12T01:50:22.688704+0000","last_active":"2024-09-12T01:50:22.688704+0000","last_peered":"2024-09-12T01:50:22.688704+0000","last_clean":"2024-09-12T01:50:22.688704+0000","last_became_active":"2024-09-12T01:50:22.682640+0000","last_became_peered":"2024-09-12T01:50:22.682640+0000","last_unstale":"2024-09-12T01:50:22.688704+0000","last_undegraded":"2024-09-12T01:50:22.688704+0000","last_fullsized":"2024-09-12T01:50:22.688704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.731438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614069+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:22.614069+0000","last_peered":"2024-09-12T01:50:22.614069+0000","last_clean":"2024-09-12T01:50:22.614069+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:22.614069+0000","last_undegraded":"2024-09-12T01:50:22.614069+0000","last_fullsized":"2024-09-12T01:50:22.614069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.480595+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:51:21.480595+0000","last_peered":"2024-09-12T01:51:21.480595+0000","last_clean":"2024-09-12T01:51:21.480595+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:51:21.480595+0000","last_undegraded":"2024-09-12T01:51:21.480595+0000","last_fullsized":"2024-09-12T01:51:21.480595+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629145+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:22.629145+0000","last_peered":"2024-09-12T01:50:22.629145+0000","last_clean":"2024-09-12T01:50:22.629145+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:22.629145+0000","last_undegraded":"2024-09-12T01:50:22.629145+0000","last_fullsized":"2024-09-12T01:50:22.629145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.495099+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:51:21.495099+0000","last_peered":"2024-09-12T01:51:21.495099+0000","last_clean":"2024-09-12T01:51:21.495099+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:51:21.495099+0000","last_undegraded":"2024-09-12T01:51:21.495099+0000","last_fullsized":"2024-09-12T01:51:21.495099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'7","reported_seq":253,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:52:00.543478+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:52:00.543478+0000","last_peered":"2024-09-12T01:52:00.543478+0000","last_clean":"2024-09-12T01:52:00.543478+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:52:00.543478+0000","last_undegraded":"2024-09-12T01:52:00.543478+0000","last_fullsized":"2024-09-12T01:52:00.543478+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.498633+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:51:21.498633+0000","last_peered":"2024-09-12T01:51:21.498633+0000","last_clean":"2024-09-12T01:51:21.498633+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:51:21.498633+0000","last_undegraded":"2024-09-12T01:51:21.498633+0000","last_fullsized":"2024-09-12T01:51:21.498633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613318+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:22.613318+0000","last_peered":"2024-09-12T01:50:22.613318+0000","last_clean":"2024-09-12T01:50:22.613318+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:22.613318+0000","last_undegraded":"2024-09-12T01:50:22.613318+0000","last_fullsized":"2024-09-12T01:50:22.613318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488858+0000","last_change":"2024-09-12T01:50:22.630618+0000","last_active":"2024-09-12T01:51:21.488858+0000","last_peered":"2024-09-12T01:51:21.488858+0000","last_clean":"2024-09-12T01:51:21.488858+0000","last_became_active":"2024-09-12T01:50:22.630327+0000","last_became_peered":"2024-09-12T01:50:22.630327+0000","last_unstale":"2024-09-12T01:51:21.488858+0000","last_undegraded":"2024-09-12T01:51:21.488858+0000","last_fullsized":"2024-09-12T01:51:21.488858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.647257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629439+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:22.629439+0000","last_peered":"2024-09-12T01:50:22.629439+0000","last_clean":"2024-09-12T01:50:22.629439+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:22.629439+0000","last_undegraded":"2024-09-12T01:50:22.629439+0000","last_fullsized":"2024-09-12T01:50:22.629439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501850+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:51:21.501850+0000","last_peered":"2024-09-12T01:51:21.501850+0000","last_clean":"2024-09-12T01:51:21.501850+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:51:21.501850+0000","last_undegraded":"2024-09-12T01:51:21.501850+0000","last_fullsized":"2024-09-12T01:51:21.501850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'39","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:59.827250+0000","last_change":"2024-09-12T01:50:22.696674+0000","last_active":"2024-09-12T01:51:59.827250+0000","last_peered":"2024-09-12T01:51:59.827250+0000","last_clean":"2024-09-12T01:51:59.827250+0000","last_became_active":"2024-09-12T01:50:22.683417+0000","last_became_peered":"2024-09-12T01:50:22.683417+0000","last_unstale":"2024-09-12T01:51:59.827250+0000","last_undegraded":"2024-09-12T01:51:59.827250+0000","last_fullsized":"2024-09-12T01:51:59.827250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:35.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67181,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":181,"num_write":41,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":49603,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486841+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:51:21.486841+0000","last_peered":"2024-09-12T01:51:21.486841+0000","last_clean":"2024-09-12T01:51:21.486841+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:51:21.486841+0000","last_undegraded":"2024-09-12T01:51:21.486841+0000","last_fullsized":"2024-09-12T01:51:21.486841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612213+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:22.612213+0000","last_peered":"2024-09-12T01:50:22.612213+0000","last_clean":"2024-09-12T01:50:22.612213+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:22.612213+0000","last_undegraded":"2024-09-12T01:50:22.612213+0000","last_fullsized":"2024-09-12T01:50:22.612213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.474550+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:51:21.474550+0000","last_peered":"2024-09-12T01:51:21.474550+0000","last_clean":"2024-09-12T01:51:21.474550+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:51:21.474550+0000","last_undegraded":"2024-09-12T01:51:21.474550+0000","last_fullsized":"2024-09-12T01:51:21.474550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629035+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:22.629035+0000","last_peered":"2024-09-12T01:50:22.629035+0000","last_clean":"2024-09-12T01:50:22.629035+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:22.629035+0000","last_undegraded":"2024-09-12T01:50:22.629035+0000","last_fullsized":"2024-09-12T01:50:22.629035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487087+0000","last_change":"2024-09-12T01:50:22.616527+0000","last_active":"2024-09-12T01:51:21.487087+0000","last_peered":"2024-09-12T01:51:21.487087+0000","last_clean":"2024-09-12T01:51:21.487087+0000","last_became_active":"2024-09-12T01:50:22.616150+0000","last_became_peered":"2024-09-12T01:50:22.616150+0000","last_unstale":"2024-09-12T01:51:21.487087+0000","last_undegraded":"2024-09-12T01:51:21.487087+0000","last_fullsized":"2024-09-12T01:51:21.487087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:58.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:55.535951+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:51:55.535951+0000","last_peered":"2024-09-12T01:51:55.535951+0000","last_clean":"2024-09-12T01:51:55.535951+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:51:55.535951+0000","last_undegraded":"2024-09-12T01:51:55.535951+0000","last_fullsized":"2024-09-12T01:51:55.535951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.495898+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:51:21.495898+0000","last_peered":"2024-09-12T01:51:21.495898+0000","last_clean":"2024-09-12T01:51:21.495898+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:51:21.495898+0000","last_undegraded":"2024-09-12T01:51:21.495898+0000","last_fullsized":"2024-09-12T01:51:21.495898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610857+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:22.610857+0000","last_peered":"2024-09-12T01:50:22.610857+0000","last_clean":"2024-09-12T01:50:22.610857+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:22.610857+0000","last_undegraded":"2024-09-12T01:50:22.610857+0000","last_fullsized":"2024-09-12T01:50:22.610857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.482779+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:51:21.482779+0000","last_peered":"2024-09-12T01:51:21.482779+0000","last_clean":"2024-09-12T01:51:21.482779+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:51:21.482779+0000","last_undegraded":"2024-09-12T01:51:21.482779+0000","last_fullsized":"2024-09-12T01:51:21.482779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611513+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:22.611513+0000","last_peered":"2024-09-12T01:50:22.611513+0000","last_clean":"2024-09-12T01:50:22.611513+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:22.611513+0000","last_undegraded":"2024-09-12T01:50:22.611513+0000","last_fullsized":"2024-09-12T01:50:22.611513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486914+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:51:21.486914+0000","last_peered":"2024-09-12T01:51:21.486914+0000","last_clean":"2024-09-12T01:51:21.486914+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:51:21.486914+0000","last_undegraded":"2024-09-12T01:51:21.486914+0000","last_fullsized":"2024-09-12T01:51:21.486914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613947+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:22.613947+0000","last_peered":"2024-09-12T01:50:22.613947+0000","last_clean":"2024-09-12T01:50:22.613947+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:22.613947+0000","last_undegraded":"2024-09-12T01:50:22.613947+0000","last_fullsized":"2024-09-12T01:50:22.613947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484475+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:51:21.484475+0000","last_peered":"2024-09-12T01:51:21.484475+0000","last_clean":"2024-09-12T01:51:21.484475+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:51:21.484475+0000","last_undegraded":"2024-09-12T01:51:21.484475+0000","last_fullsized":"2024-09-12T01:51:21.484475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629587+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:22.629587+0000","last_peered":"2024-09-12T01:50:22.629587+0000","last_clean":"2024-09-12T01:50:22.629587+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:22.629587+0000","last_undegraded":"2024-09-12T01:50:22.629587+0000","last_fullsized":"2024-09-12T01:50:22.629587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489454+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:51:21.489454+0000","last_peered":"2024-09-12T01:51:21.489454+0000","last_clean":"2024-09-12T01:51:21.489454+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:51:21.489454+0000","last_undegraded":"2024-09-12T01:51:21.489454+0000","last_fullsized":"2024-09-12T01:51:21.489454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'8","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:56.538883+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:51:56.538883+0000","last_peered":"2024-09-12T01:51:56.538883+0000","last_clean":"2024-09-12T01:51:56.538883+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:51:56.538883+0000","last_undegraded":"2024-09-12T01:51:56.538883+0000","last_fullsized":"2024-09-12T01:51:56.538883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2012,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.500017+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:51:21.500017+0000","last_peered":"2024-09-12T01:51:21.500017+0000","last_clean":"2024-09-12T01:51:21.500017+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:51:21.500017+0000","last_undegraded":"2024-09-12T01:51:21.500017+0000","last_fullsized":"2024-09-12T01:51:21.500017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":333,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612725+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:50:22.612725+0000","last_peered":"2024-09-12T01:50:22.612725+0000","last_clean":"2024-09-12T01:50:22.612725+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:50:22.612725+0000","last_undegraded":"2024-09-12T01:50:22.612725+0000","last_fullsized":"2024-09-12T01:50:22.612725+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681903+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:22.681903+0000","last_peered":"2024-09-12T01:50:22.681903+0000","last_clean":"2024-09-12T01:50:22.681903+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:22.681903+0000","last_undegraded":"2024-09-12T01:50:22.681903+0000","last_fullsized":"2024-09-12T01:50:22.681903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.498284+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:51:21.498284+0000","last_peered":"2024-09-12T01:51:21.498284+0000","last_clean":"2024-09-12T01:51:21.498284+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:51:21.498284+0000","last_undegraded":"2024-09-12T01:51:21.498284+0000","last_fullsized":"2024-09-12T01:51:21.498284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612697+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:22.612697+0000","last_peered":"2024-09-12T01:50:22.612697+0000","last_clean":"2024-09-12T01:50:22.612697+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:22.612697+0000","last_undegraded":"2024-09-12T01:50:22.612697+0000","last_fullsized":"2024-09-12T01:50:22.612697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.481982+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:51:21.481982+0000","last_peered":"2024-09-12T01:51:21.481982+0000","last_clean":"2024-09-12T01:51:21.481982+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:51:21.481982+0000","last_undegraded":"2024-09-12T01:51:21.481982+0000","last_fullsized":"2024-09-12T01:51:21.481982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":140,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:59.541242+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:51:59.541242+0000","last_peered":"2024-09-12T01:51:59.541242+0000","last_clean":"2024-09-12T01:51:59.541242+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:51:59.541242+0000","last_undegraded":"2024-09-12T01:51:59.541242+0000","last_fullsized":"2024-09-12T01:51:59.541242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.477907+0000","last_change":"2024-09-12T01:50:22.682963+0000","last_active":"2024-09-12T01:51:21.477907+0000","last_peered":"2024-09-12T01:51:21.477907+0000","last_clean":"2024-09-12T01:51:21.477907+0000","last_became_active":"2024-09-12T01:50:22.682611+0000","last_became_peered":"2024-09-12T01:50:22.682611+0000","last_unstale":"2024-09-12T01:51:21.477907+0000","last_undegraded":"2024-09-12T01:51:21.477907+0000","last_fullsized":"2024-09-12T01:51:21.477907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:01.295098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'7","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:58.810227+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:51:58.810227+0000","last_peered":"2024-09-12T01:51:58.810227+0000","last_clean":"2024-09-12T01:51:58.810227+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:51:58.810227+0000","last_undegraded":"2024-09-12T01:51:58.810227+0000","last_fullsized":"2024-09-12T01:51:58.810227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489407+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:51:21.489407+0000","last_peered":"2024-09-12T01:51:21.489407+0000","last_clean":"2024-09-12T01:51:21.489407+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:51:21.489407+0000","last_undegraded":"2024-09-12T01:51:21.489407+0000","last_fullsized":"2024-09-12T01:51:21.489407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.683026+0000","last_change":"2024-09-12T01:50:22.683026+0000","last_active":"2024-09-12T01:50:22.683026+0000","last_peered":"2024-09-12T01:50:22.683026+0000","last_clean":"2024-09-12T01:50:22.683026+0000","last_became_active":"2024-09-12T01:50:22.682461+0000","last_became_peered":"2024-09-12T01:50:22.682461+0000","last_unstale":"2024-09-12T01:50:22.683026+0000","last_undegraded":"2024-09-12T01:50:22.683026+0000","last_fullsized":"2024-09-12T01:50:22.683026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.470081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.490807+0000","last_change":"2024-09-12T01:50:22.618050+0000","last_active":"2024-09-12T01:51:21.490807+0000","last_peered":"2024-09-12T01:51:21.490807+0000","last_clean":"2024-09-12T01:51:21.490807+0000","last_became_active":"2024-09-12T01:50:22.614871+0000","last_became_peered":"2024-09-12T01:50:22.614871+0000","last_unstale":"2024-09-12T01:51:21.490807+0000","last_undegraded":"2024-09-12T01:51:21.490807+0000","last_fullsized":"2024-09-12T01:51:21.490807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:47.652568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611446+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:22.611446+0000","last_peered":"2024-09-12T01:50:22.611446+0000","last_clean":"2024-09-12T01:50:22.611446+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:22.611446+0000","last_undegraded":"2024-09-12T01:50:22.611446+0000","last_fullsized":"2024-09-12T01:50:22.611446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.481782+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:51:21.481782+0000","last_peered":"2024-09-12T01:51:21.481782+0000","last_clean":"2024-09-12T01:51:21.481782+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:51:21.481782+0000","last_undegraded":"2024-09-12T01:51:21.481782+0000","last_fullsized":"2024-09-12T01:51:21.481782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'16","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:22.331135+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:51:22.331135+0000","last_peered":"2024-09-12T01:51:22.331135+0000","last_clean":"2024-09-12T01:51:22.331135+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:51:22.331135+0000","last_undegraded":"2024-09-12T01:51:22.331135+0000","last_fullsized":"2024-09-12T01:51:22.331135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487040+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:51:21.487040+0000","last_peered":"2024-09-12T01:51:21.487040+0000","last_clean":"2024-09-12T01:51:21.487040+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:51:21.487040+0000","last_undegraded":"2024-09-12T01:51:21.487040+0000","last_fullsized":"2024-09-12T01:51:21.487040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681518+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:22.681518+0000","last_peered":"2024-09-12T01:50:22.681518+0000","last_clean":"2024-09-12T01:50:22.681518+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:22.681518+0000","last_undegraded":"2024-09-12T01:50:22.681518+0000","last_fullsized":"2024-09-12T01:50:22.681518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489524+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:51:21.489524+0000","last_peered":"2024-09-12T01:51:21.489524+0000","last_clean":"2024-09-12T01:51:21.489524+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:51:21.489524+0000","last_undegraded":"2024-09-12T01:51:21.489524+0000","last_fullsized":"2024-09-12T01:51:21.489524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611066+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:22.611066+0000","last_peered":"2024-09-12T01:50:22.611066+0000","last_clean":"2024-09-12T01:50:22.611066+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:22.611066+0000","last_undegraded":"2024-09-12T01:50:22.611066+0000","last_fullsized":"2024-09-12T01:50:22.611066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.451681+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:51:21.451681+0000","last_peered":"2024-09-12T01:51:21.451681+0000","last_clean":"2024-09-12T01:51:21.451681+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:51:21.451681+0000","last_undegraded":"2024-09-12T01:51:21.451681+0000","last_fullsized":"2024-09-12T01:51:21.451681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613860+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:22.613860+0000","last_peered":"2024-09-12T01:50:22.613860+0000","last_clean":"2024-09-12T01:50:22.613860+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:22.613860+0000","last_undegraded":"2024-09-12T01:50:22.613860+0000","last_fullsized":"2024-09-12T01:50:22.613860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484300+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:51:21.484300+0000","last_peered":"2024-09-12T01:51:21.484300+0000","last_clean":"2024-09-12T01:51:21.484300+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:51:21.484300+0000","last_undegraded":"2024-09-12T01:51:21.484300+0000","last_fullsized":"2024-09-12T01:51:21.484300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612140+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:22.612140+0000","last_peered":"2024-09-12T01:50:22.612140+0000","last_clean":"2024-09-12T01:50:22.612140+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:22.612140+0000","last_undegraded":"2024-09-12T01:50:22.612140+0000","last_fullsized":"2024-09-12T01:50:22.612140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493228+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:51:21.493228+0000","last_peered":"2024-09-12T01:51:21.493228+0000","last_clean":"2024-09-12T01:51:21.493228+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:51:21.493228+0000","last_undegraded":"2024-09-12T01:51:21.493228+0000","last_fullsized":"2024-09-12T01:51:21.493228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611281+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:22.611281+0000","last_peered":"2024-09-12T01:50:22.611281+0000","last_clean":"2024-09-12T01:50:22.611281+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:22.611281+0000","last_undegraded":"2024-09-12T01:50:22.611281+0000","last_fullsized":"2024-09-12T01:50:22.611281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501783+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:51:21.501783+0000","last_peered":"2024-09-12T01:51:21.501783+0000","last_clean":"2024-09-12T01:51:21.501783+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:51:21.501783+0000","last_undegraded":"2024-09-12T01:51:21.501783+0000","last_fullsized":"2024-09-12T01:51:21.501783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.497079+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:51:21.497079+0000","last_peered":"2024-09-12T01:51:21.497079+0000","last_clean":"2024-09-12T01:51:21.497079+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:51:21.497079+0000","last_undegraded":"2024-09-12T01:51:21.497079+0000","last_fullsized":"2024-09-12T01:51:21.497079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611510+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:22.611510+0000","last_peered":"2024-09-12T01:50:22.611510+0000","last_clean":"2024-09-12T01:50:22.611510+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:22.611510+0000","last_undegraded":"2024-09-12T01:50:22.611510+0000","last_fullsized":"2024-09-12T01:50:22.611510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501244+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:51:21.501244+0000","last_peered":"2024-09-12T01:51:21.501244+0000","last_clean":"2024-09-12T01:51:21.501244+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:51:21.501244+0000","last_undegraded":"2024-09-12T01:51:21.501244+0000","last_fullsized":"2024-09-12T01:51:21.501244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611302+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:22.611302+0000","last_peered":"2024-09-12T01:50:22.611302+0000","last_clean":"2024-09-12T01:50:22.611302+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:22.611302+0000","last_undegraded":"2024-09-12T01:50:22.611302+0000","last_fullsized":"2024-09-12T01:50:22.611302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.502276+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:51:21.502276+0000","last_peered":"2024-09-12T01:51:21.502276+0000","last_clean":"2024-09-12T01:51:21.502276+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:51:21.502276+0000","last_undegraded":"2024-09-12T01:51:21.502276+0000","last_fullsized":"2024-09-12T01:51:21.502276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614376+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:50:22.614376+0000","last_peered":"2024-09-12T01:50:22.614376+0000","last_clean":"2024-09-12T01:50:22.614376+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:50:22.614376+0000","last_undegraded":"2024-09-12T01:50:22.614376+0000","last_fullsized":"2024-09-12T01:50:22.614376+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487999+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:51:21.487999+0000","last_peered":"2024-09-12T01:51:21.487999+0000","last_clean":"2024-09-12T01:51:21.487999+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:51:21.487999+0000","last_undegraded":"2024-09-12T01:51:21.487999+0000","last_fullsized":"2024-09-12T01:51:21.487999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:55.805329+0000","last_change":"2024-09-12T01:50:22.691988+0000","last_active":"2024-09-12T01:51:55.805329+0000","last_peered":"2024-09-12T01:51:55.805329+0000","last_clean":"2024-09-12T01:51:55.805329+0000","last_became_active":"2024-09-12T01:50:22.682676+0000","last_became_peered":"2024-09-12T01:50:22.682676+0000","last_unstale":"2024-09-12T01:51:55.805329+0000","last_undegraded":"2024-09-12T01:51:55.805329+0000","last_fullsized":"2024-09-12T01:51:55.805329+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:56.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75513,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1144,"num_read_kb":658,"num_write":266,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":50275,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":226539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547238,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32768,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712384,"statfs":{"total":95995035648,"available":95961481216,"internally_reserved":0,"allocated":1622016,"data_stored":1096574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939695,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":438411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397561,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1031195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528382,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":438545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1544192,"data_stored":1031011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953543,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":505053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":440520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":506639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":440192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:52:04.034 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T01:52:04.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:52:04.278 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:04.710 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:04 smithi070 ceph-mon[31177]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:52:04.710 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:04 smithi070 ceph-mon[31177]: pgmap v334: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T01:52:04.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.709+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3844888937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5c102da0 msgr2=0x7f2a5c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:04.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.709+0000 7f2a63bc8640 1 --2- 172.21.15.70:0/3844888937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5c102da0 0x7f2a5c103180 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009900 tx=0x7f2a5802a480 comp rx=0 tx=0).stop 2024-09-12T01:52:04.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.709+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3844888937 shutdown_connections 2024-09-12T01:52:04.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.709+0000 7f2a63bc8640 1 --2- 172.21.15.70:0/3844888937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a5c10c180 0x7f2a5c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:04.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.709+0000 7f2a63bc8640 1 --2- 172.21.15.70:0/3844888937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a5c1036c0 0x7f2a5c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:04.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.709+0000 7f2a63bc8640 1 --2- 172.21.15.70:0/3844888937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5c102da0 0x7f2a5c103180 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:04.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.709+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3844888937 >> 172.21.15.70:0/3844888937 conn(0x7f2a5c0fc7a0 msgr2=0x7f2a5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:04.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.709+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3844888937 shutdown_connections 2024-09-12T01:52:04.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.709+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3844888937 wait complete. 2024-09-12T01:52:04.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.710+0000 7f2a63bc8640 1 Processor -- start 2024-09-12T01:52:04.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.710+0000 7f2a63bc8640 1 -- start start 2024-09-12T01:52:04.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.710+0000 7f2a63bc8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a5c102da0 0x7f2a5c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:04.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.710+0000 7f2a63bc8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a5c1036c0 0x7f2a5c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:04.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.710+0000 7f2a63bc8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5c10c180 0x7f2a5c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:04.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.710+0000 7f2a63bc8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c1120e0 con 0x7f2a5c10c180 2024-09-12T01:52:04.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.710+0000 7f2a63bc8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c111f60 con 0x7f2a5c102da0 2024-09-12T01:52:04.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.710+0000 7f2a63bc8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c112260 con 0x7f2a5c1036c0 2024-09-12T01:52:04.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a62165640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5c10c180 0x7f2a5c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:04.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a62165640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5c10c180 0x7f2a5c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57242/0 (socket says 172.21.15.70:57242) 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a62165640 1 -- 172.21.15.70:0/3820776817 learned_addr learned my addr 172.21.15.70:0/3820776817 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a61964640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a5c102da0 0x7f2a5c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a61163640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a5c1036c0 0x7f2a5c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a62165640 1 -- 172.21.15.70:0/3820776817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a5c1036c0 msgr2=0x7f2a5c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a62165640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a5c1036c0 0x7f2a5c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a62165640 1 -- 172.21.15.70:0/3820776817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a5c102da0 msgr2=0x7f2a5c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a62165640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a5c102da0 0x7f2a5c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a62165640 1 -- 172.21.15.70:0/3820776817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c19d4f0 con 0x7f2a5c10c180 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a61163640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a5c1036c0 0x7f2a5c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a62165640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5c10c180 0x7f2a5c19ce10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400b970 tx=0x7f2a5400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a52ffd640 1 -- 172.21.15.70:0/3820776817 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a54019070 con 0x7f2a5c10c180 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a52ffd640 1 -- 172.21.15.70:0/3820776817 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a5400cb40 con 0x7f2a5c10c180 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3820776817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5c19d7e0 con 0x7f2a5c10c180 2024-09-12T01:52:04.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a52ffd640 1 -- 172.21.15.70:0/3820776817 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a54007700 con 0x7f2a5c10c180 2024-09-12T01:52:04.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.711+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3820776817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5c100930 con 0x7f2a5c10c180 2024-09-12T01:52:04.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.712+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3820776817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a5c06b010 con 0x7f2a5c10c180 2024-09-12T01:52:04.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.715+0000 7f2a52ffd640 1 -- 172.21.15.70:0/3820776817 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2a5401c070 con 0x7f2a5c10c180 2024-09-12T01:52:04.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.716+0000 7f2a52ffd640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2a480a2c00 0x7f2a480a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:04.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.716+0000 7f2a61964640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2a480a2c00 0x7f2a480a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:04.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.716+0000 7f2a52ffd640 1 -- 172.21.15.70:0/3820776817 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2a540ceb00 con 0x7f2a5c10c180 2024-09-12T01:52:04.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.716+0000 7f2a61964640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2a480a2c00 0x7f2a480a50c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009230 tx=0x7f2a580058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:04.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.719+0000 7f2a52ffd640 1 -- 172.21.15.70:0/3820776817 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a5409b3d0 con 0x7f2a5c10c180 2024-09-12T01:52:04.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.881+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3820776817 --> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a5c107290 con 0x7f2a480a2c00 2024-09-12T01:52:04.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.887+0000 7f2a52ffd640 1 -- 172.21.15.70:0/3820776817 <== mgr.14148 v2:172.21.15.70:6800/633920150 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258901 (secure 0 0 0) 0x7f2a58031810 con 0x7f2a480a2c00 2024-09-12T01:52:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:52:04.892 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-12T01:52:04.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.890+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3820776817 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2a480a2c00 msgr2=0x7f2a480a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:04.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.890+0000 7f2a63bc8640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2a480a2c00 0x7f2a480a50c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009230 tx=0x7f2a580058d0 comp rx=0 tx=0).stop 2024-09-12T01:52:04.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.890+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3820776817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5c10c180 msgr2=0x7f2a5c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:04.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.890+0000 7f2a63bc8640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5c10c180 0x7f2a5c19ce10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400b970 tx=0x7f2a5400be30 comp rx=0 tx=0).stop 2024-09-12T01:52:04.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.890+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3820776817 shutdown_connections 2024-09-12T01:52:04.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.890+0000 7f2a63bc8640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2a480a2c00 0x7f2a480a50c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:04.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.890+0000 7f2a63bc8640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5c10c180 0x7f2a5c19ce10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:04.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.890+0000 7f2a63bc8640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a5c1036c0 0x7f2a5c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:04.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.890+0000 7f2a63bc8640 1 --2- 172.21.15.70:0/3820776817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a5c102da0 0x7f2a5c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:04.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.890+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3820776817 >> 172.21.15.70:0/3820776817 conn(0x7f2a5c0fc7a0 msgr2=0x7f2a5c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:04.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.890+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3820776817 shutdown_connections 2024-09-12T01:52:04.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:04.890+0000 7f2a63bc8640 1 -- 172.21.15.70:0/3820776817 wait complete. 2024-09-12T01:52:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:04 smithi191 ceph-mon[35770]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:52:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:04 smithi191 ceph-mon[35770]: pgmap v334: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T01:52:05.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:04 smithi152 ceph-mon[35055]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:52:05.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:04 smithi152 ceph-mon[35055]: pgmap v334: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T01:52:05.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:05 smithi070 ceph-mon[31177]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:52:05.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:05 smithi070 ceph-mon[31177]: pgmap v335: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-12T01:52:05.888 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-12T01:52:03.502318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666115,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1286,"num_read_kb":773,"num_write":449,"num_write_kb":3099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1231128,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370468,"kb_used_data":12900,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571356,"statfs":{"total":1151940427776,"available":1151561068544,"internally_reserved":0,"allocated":13209600,"data_stored":7244409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":64,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003124"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501869+0000","last_change":"2024-09-12T01:49:57.330135+0000","last_active":"2024-09-12T01:51:21.501869+0000","last_peered":"2024-09-12T01:51:21.501869+0000","last_clean":"2024-09-12T01:51:21.501869+0000","last_became_active":"2024-09-12T01:49:57.329764+0000","last_became_peered":"2024-09-12T01:49:57.329764+0000","last_unstale":"2024-09-12T01:51:21.501869+0000","last_undegraded":"2024-09-12T01:51:21.501869+0000","last_fullsized":"2024-09-12T01:51:21.501869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.312482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.494831+0000","last_change":"2024-09-12T01:49:57.320747+0000","last_active":"2024-09-12T01:51:21.494831+0000","last_peered":"2024-09-12T01:51:21.494831+0000","last_clean":"2024-09-12T01:51:21.494831+0000","last_became_active":"2024-09-12T01:49:57.320412+0000","last_became_peered":"2024-09-12T01:49:57.320412+0000","last_unstale":"2024-09-12T01:51:21.494831+0000","last_undegraded":"2024-09-12T01:51:21.494831+0000","last_fullsized":"2024-09-12T01:51:21.494831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501801+0000","last_change":"2024-09-12T01:49:57.326912+0000","last_active":"2024-09-12T01:51:21.501801+0000","last_peered":"2024-09-12T01:51:21.501801+0000","last_clean":"2024-09-12T01:51:21.501801+0000","last_became_active":"2024-09-12T01:49:57.326592+0000","last_became_peered":"2024-09-12T01:49:57.326592+0000","last_unstale":"2024-09-12T01:51:21.501801+0000","last_undegraded":"2024-09-12T01:51:21.501801+0000","last_fullsized":"2024-09-12T01:51:21.501801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.764547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.472404+0000","last_change":"2024-09-12T01:49:57.324714+0000","last_active":"2024-09-12T01:51:21.472404+0000","last_peered":"2024-09-12T01:51:21.472404+0000","last_clean":"2024-09-12T01:51:21.472404+0000","last_became_active":"2024-09-12T01:49:57.324240+0000","last_became_peered":"2024-09-12T01:49:57.324240+0000","last_unstale":"2024-09-12T01:51:21.472404+0000","last_undegraded":"2024-09-12T01:51:21.472404+0000","last_fullsized":"2024-09-12T01:51:21.472404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:00.062085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.472067+0000","last_change":"2024-09-12T01:49:57.316876+0000","last_active":"2024-09-12T01:51:21.472067+0000","last_peered":"2024-09-12T01:51:21.472067+0000","last_clean":"2024-09-12T01:51:21.472067+0000","last_became_active":"2024-09-12T01:49:57.316526+0000","last_became_peered":"2024-09-12T01:49:57.316526+0000","last_unstale":"2024-09-12T01:51:21.472067+0000","last_undegraded":"2024-09-12T01:51:21.472067+0000","last_fullsized":"2024-09-12T01:51:21.472067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:17.147327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488486+0000","last_change":"2024-09-12T01:50:22.614193+0000","last_active":"2024-09-12T01:51:21.488486+0000","last_peered":"2024-09-12T01:51:21.488486+0000","last_clean":"2024-09-12T01:51:21.488486+0000","last_became_active":"2024-09-12T01:50:22.613816+0000","last_became_peered":"2024-09-12T01:50:22.613816+0000","last_unstale":"2024-09-12T01:51:21.488486+0000","last_undegraded":"2024-09-12T01:51:21.488486+0000","last_fullsized":"2024-09-12T01:51:21.488486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:29.504176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488037+0000","last_change":"2024-09-12T01:49:57.315027+0000","last_active":"2024-09-12T01:51:21.488037+0000","last_peered":"2024-09-12T01:51:21.488037+0000","last_clean":"2024-09-12T01:51:21.488037+0000","last_became_active":"2024-09-12T01:49:57.314298+0000","last_became_peered":"2024-09-12T01:49:57.314298+0000","last_unstale":"2024-09-12T01:51:21.488037+0000","last_undegraded":"2024-09-12T01:51:21.488037+0000","last_fullsized":"2024-09-12T01:51:21.488037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:41.299729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493016+0000","last_change":"2024-09-12T01:49:57.308797+0000","last_active":"2024-09-12T01:51:21.493016+0000","last_peered":"2024-09-12T01:51:21.493016+0000","last_clean":"2024-09-12T01:51:21.493016+0000","last_became_active":"2024-09-12T01:49:57.308516+0000","last_became_peered":"2024-09-12T01:49:57.308516+0000","last_unstale":"2024-09-12T01:51:21.493016+0000","last_undegraded":"2024-09-12T01:51:21.493016+0000","last_fullsized":"2024-09-12T01:51:21.493016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:21.458692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.500188+0000","last_change":"2024-09-12T01:49:57.323410+0000","last_active":"2024-09-12T01:51:21.500188+0000","last_peered":"2024-09-12T01:51:21.500188+0000","last_clean":"2024-09-12T01:51:21.500188+0000","last_became_active":"2024-09-12T01:49:57.323106+0000","last_became_peered":"2024-09-12T01:49:57.323106+0000","last_unstale":"2024-09-12T01:51:21.500188+0000","last_undegraded":"2024-09-12T01:51:21.500188+0000","last_fullsized":"2024-09-12T01:51:21.500188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:11.978976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.491514+0000","last_change":"2024-09-12T01:49:57.321851+0000","last_active":"2024-09-12T01:51:21.491514+0000","last_peered":"2024-09-12T01:51:21.491514+0000","last_clean":"2024-09-12T01:51:21.491514+0000","last_became_active":"2024-09-12T01:49:57.321522+0000","last_became_peered":"2024-09-12T01:49:57.321522+0000","last_unstale":"2024-09-12T01:51:21.491514+0000","last_undegraded":"2024-09-12T01:51:21.491514+0000","last_fullsized":"2024-09-12T01:51:21.491514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:27.457232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.499334+0000","last_change":"2024-09-12T01:49:57.329192+0000","last_active":"2024-09-12T01:51:21.499334+0000","last_peered":"2024-09-12T01:51:21.499334+0000","last_clean":"2024-09-12T01:51:21.499334+0000","last_became_active":"2024-09-12T01:49:57.328529+0000","last_became_peered":"2024-09-12T01:49:57.328529+0000","last_unstale":"2024-09-12T01:51:21.499334+0000","last_undegraded":"2024-09-12T01:51:21.499334+0000","last_fullsized":"2024-09-12T01:51:21.499334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:18.676793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.496290+0000","last_change":"2024-09-12T01:49:57.325331+0000","last_active":"2024-09-12T01:51:21.496290+0000","last_peered":"2024-09-12T01:51:21.496290+0000","last_clean":"2024-09-12T01:51:21.496290+0000","last_became_active":"2024-09-12T01:49:57.324909+0000","last_became_peered":"2024-09-12T01:49:57.324909+0000","last_unstale":"2024-09-12T01:51:21.496290+0000","last_undegraded":"2024-09-12T01:51:21.496290+0000","last_fullsized":"2024-09-12T01:51:21.496290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:57.292392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493477+0000","last_change":"2024-09-12T01:49:57.317727+0000","last_active":"2024-09-12T01:51:21.493477+0000","last_peered":"2024-09-12T01:51:21.493477+0000","last_clean":"2024-09-12T01:51:21.493477+0000","last_became_active":"2024-09-12T01:49:57.317256+0000","last_became_peered":"2024-09-12T01:49:57.317256+0000","last_unstale":"2024-09-12T01:51:21.493477+0000","last_undegraded":"2024-09-12T01:51:21.493477+0000","last_fullsized":"2024-09-12T01:51:21.493477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.492593+0000","last_change":"2024-09-12T01:49:57.320145+0000","last_active":"2024-09-12T01:51:21.492593+0000","last_peered":"2024-09-12T01:51:21.492593+0000","last_clean":"2024-09-12T01:51:21.492593+0000","last_became_active":"2024-09-12T01:49:57.319862+0000","last_became_peered":"2024-09-12T01:49:57.319862+0000","last_unstale":"2024-09-12T01:51:21.492593+0000","last_undegraded":"2024-09-12T01:51:21.492593+0000","last_fullsized":"2024-09-12T01:51:21.492593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:18.161927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489877+0000","last_change":"2024-09-12T01:49:57.321630+0000","last_active":"2024-09-12T01:51:21.489877+0000","last_peered":"2024-09-12T01:51:21.489877+0000","last_clean":"2024-09-12T01:51:21.489877+0000","last_became_active":"2024-09-12T01:49:57.321273+0000","last_became_peered":"2024-09-12T01:49:57.321273+0000","last_unstale":"2024-09-12T01:51:21.489877+0000","last_undegraded":"2024-09-12T01:51:21.489877+0000","last_fullsized":"2024-09-12T01:51:21.489877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:39.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.497951+0000","last_change":"2024-09-12T01:49:57.321844+0000","last_active":"2024-09-12T01:51:21.497951+0000","last_peered":"2024-09-12T01:51:21.497951+0000","last_clean":"2024-09-12T01:51:21.497951+0000","last_became_active":"2024-09-12T01:49:57.319855+0000","last_became_peered":"2024-09-12T01:49:57.319855+0000","last_unstale":"2024-09-12T01:51:21.497951+0000","last_undegraded":"2024-09-12T01:51:21.497951+0000","last_fullsized":"2024-09-12T01:51:21.497951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:29.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501906+0000","last_change":"2024-09-12T01:49:57.328345+0000","last_active":"2024-09-12T01:51:21.501906+0000","last_peered":"2024-09-12T01:51:21.501906+0000","last_clean":"2024-09-12T01:51:21.501906+0000","last_became_active":"2024-09-12T01:49:57.327989+0000","last_became_peered":"2024-09-12T01:49:57.327989+0000","last_unstale":"2024-09-12T01:51:21.501906+0000","last_undegraded":"2024-09-12T01:51:21.501906+0000","last_fullsized":"2024-09-12T01:51:21.501906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.037093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.494924+0000","last_change":"2024-09-12T01:49:57.321178+0000","last_active":"2024-09-12T01:51:21.494924+0000","last_peered":"2024-09-12T01:51:21.494924+0000","last_clean":"2024-09-12T01:51:21.494924+0000","last_became_active":"2024-09-12T01:49:57.320851+0000","last_became_peered":"2024-09-12T01:49:57.320851+0000","last_unstale":"2024-09-12T01:51:21.494924+0000","last_undegraded":"2024-09-12T01:51:21.494924+0000","last_fullsized":"2024-09-12T01:51:21.494924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:43.115356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484591+0000","last_change":"2024-09-12T01:49:57.328366+0000","last_active":"2024-09-12T01:51:21.484591+0000","last_peered":"2024-09-12T01:51:21.484591+0000","last_clean":"2024-09-12T01:51:21.484591+0000","last_became_active":"2024-09-12T01:49:57.328062+0000","last_became_peered":"2024-09-12T01:49:57.328062+0000","last_unstale":"2024-09-12T01:51:21.484591+0000","last_undegraded":"2024-09-12T01:51:21.484591+0000","last_fullsized":"2024-09-12T01:51:21.484591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:01.864750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.478916+0000","last_change":"2024-09-12T01:49:57.323776+0000","last_active":"2024-09-12T01:51:21.478916+0000","last_peered":"2024-09-12T01:51:21.478916+0000","last_clean":"2024-09-12T01:51:21.478916+0000","last_became_active":"2024-09-12T01:49:57.323457+0000","last_became_peered":"2024-09-12T01:49:57.323457+0000","last_unstale":"2024-09-12T01:51:21.478916+0000","last_undegraded":"2024-09-12T01:51:21.478916+0000","last_fullsized":"2024-09-12T01:51:21.478916+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:42.868202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.475221+0000","last_change":"2024-09-12T01:49:57.316844+0000","last_active":"2024-09-12T01:51:21.475221+0000","last_peered":"2024-09-12T01:51:21.475221+0000","last_clean":"2024-09-12T01:51:21.475221+0000","last_became_active":"2024-09-12T01:49:57.315981+0000","last_became_peered":"2024-09-12T01:49:57.315981+0000","last_unstale":"2024-09-12T01:51:21.475221+0000","last_undegraded":"2024-09-12T01:51:21.475221+0000","last_fullsized":"2024-09-12T01:51:21.475221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.836815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.499408+0000","last_change":"2024-09-12T01:49:57.317439+0000","last_active":"2024-09-12T01:51:21.499408+0000","last_peered":"2024-09-12T01:51:21.499408+0000","last_clean":"2024-09-12T01:51:21.499408+0000","last_became_active":"2024-09-12T01:49:57.316787+0000","last_became_peered":"2024-09-12T01:49:57.316787+0000","last_unstale":"2024-09-12T01:51:21.499408+0000","last_undegraded":"2024-09-12T01:51:21.499408+0000","last_fullsized":"2024-09-12T01:51:21.499408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.438236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.485203+0000","last_change":"2024-09-12T01:49:57.326027+0000","last_active":"2024-09-12T01:51:21.485203+0000","last_peered":"2024-09-12T01:51:21.485203+0000","last_clean":"2024-09-12T01:51:21.485203+0000","last_became_active":"2024-09-12T01:49:57.325714+0000","last_became_peered":"2024-09-12T01:49:57.325714+0000","last_unstale":"2024-09-12T01:51:21.485203+0000","last_undegraded":"2024-09-12T01:51:21.485203+0000","last_fullsized":"2024-09-12T01:51:21.485203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:11.109139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.482413+0000","last_change":"2024-09-12T01:49:57.313184+0000","last_active":"2024-09-12T01:51:21.482413+0000","last_peered":"2024-09-12T01:51:21.482413+0000","last_clean":"2024-09-12T01:51:21.482413+0000","last_became_active":"2024-09-12T01:49:57.312745+0000","last_became_peered":"2024-09-12T01:49:57.312745+0000","last_unstale":"2024-09-12T01:51:21.482413+0000","last_undegraded":"2024-09-12T01:51:21.482413+0000","last_fullsized":"2024-09-12T01:51:21.482413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.959507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484804+0000","last_change":"2024-09-12T01:49:57.326751+0000","last_active":"2024-09-12T01:51:21.484804+0000","last_peered":"2024-09-12T01:51:21.484804+0000","last_clean":"2024-09-12T01:51:21.484804+0000","last_became_active":"2024-09-12T01:49:57.326376+0000","last_became_peered":"2024-09-12T01:49:57.326376+0000","last_unstale":"2024-09-12T01:51:21.484804+0000","last_undegraded":"2024-09-12T01:51:21.484804+0000","last_fullsized":"2024-09-12T01:51:21.484804+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:38.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493388+0000","last_change":"2024-09-12T01:49:57.327033+0000","last_active":"2024-09-12T01:51:21.493388+0000","last_peered":"2024-09-12T01:51:21.493388+0000","last_clean":"2024-09-12T01:51:21.493388+0000","last_became_active":"2024-09-12T01:49:57.326481+0000","last_became_peered":"2024-09-12T01:49:57.326481+0000","last_unstale":"2024-09-12T01:51:21.493388+0000","last_undegraded":"2024-09-12T01:51:21.493388+0000","last_fullsized":"2024-09-12T01:51:21.493388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:56.799930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487787+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:51:21.487787+0000","last_peered":"2024-09-12T01:51:21.487787+0000","last_clean":"2024-09-12T01:51:21.487787+0000","last_became_active":"2024-09-12T01:49:57.323039+0000","last_became_peered":"2024-09-12T01:49:57.323039+0000","last_unstale":"2024-09-12T01:51:21.487787+0000","last_undegraded":"2024-09-12T01:51:21.487787+0000","last_fullsized":"2024-09-12T01:51:21.487787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:23.998388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.476227+0000","last_change":"2024-09-12T01:49:57.325796+0000","last_active":"2024-09-12T01:51:21.476227+0000","last_peered":"2024-09-12T01:51:21.476227+0000","last_clean":"2024-09-12T01:51:21.476227+0000","last_became_active":"2024-09-12T01:49:57.325493+0000","last_became_peered":"2024-09-12T01:49:57.325493+0000","last_unstale":"2024-09-12T01:51:21.476227+0000","last_undegraded":"2024-09-12T01:51:21.476227+0000","last_fullsized":"2024-09-12T01:51:21.476227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:42.545778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.490989+0000","last_change":"2024-09-12T01:49:57.322046+0000","last_active":"2024-09-12T01:51:21.490989+0000","last_peered":"2024-09-12T01:51:21.490989+0000","last_clean":"2024-09-12T01:51:21.490989+0000","last_became_active":"2024-09-12T01:49:57.321747+0000","last_became_peered":"2024-09-12T01:49:57.321747+0000","last_unstale":"2024-09-12T01:51:21.490989+0000","last_undegraded":"2024-09-12T01:51:21.490989+0000","last_fullsized":"2024-09-12T01:51:21.490989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.198141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.485292+0000","last_change":"2024-09-12T01:49:57.329249+0000","last_active":"2024-09-12T01:51:21.485292+0000","last_peered":"2024-09-12T01:51:21.485292+0000","last_clean":"2024-09-12T01:51:21.485292+0000","last_became_active":"2024-09-12T01:49:57.328883+0000","last_became_peered":"2024-09-12T01:49:57.328883+0000","last_unstale":"2024-09-12T01:51:21.485292+0000","last_undegraded":"2024-09-12T01:51:21.485292+0000","last_fullsized":"2024-09-12T01:51:21.485292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:44.766693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486906+0000","last_change":"2024-09-12T01:49:57.327328+0000","last_active":"2024-09-12T01:51:21.486906+0000","last_peered":"2024-09-12T01:51:21.486906+0000","last_clean":"2024-09-12T01:51:21.486906+0000","last_became_active":"2024-09-12T01:49:57.326526+0000","last_became_peered":"2024-09-12T01:49:57.326526+0000","last_unstale":"2024-09-12T01:51:21.486906+0000","last_undegraded":"2024-09-12T01:51:21.486906+0000","last_fullsized":"2024-09-12T01:51:21.486906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:08.775793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488158+0000","last_change":"2024-09-12T01:49:57.326932+0000","last_active":"2024-09-12T01:51:21.488158+0000","last_peered":"2024-09-12T01:51:21.488158+0000","last_clean":"2024-09-12T01:51:21.488158+0000","last_became_active":"2024-09-12T01:49:57.326561+0000","last_became_peered":"2024-09-12T01:49:57.326561+0000","last_unstale":"2024-09-12T01:51:21.488158+0000","last_undegraded":"2024-09-12T01:51:21.488158+0000","last_fullsized":"2024-09-12T01:51:21.488158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:10.620992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.483006+0000","last_change":"2024-09-12T01:49:57.321801+0000","last_active":"2024-09-12T01:51:21.483006+0000","last_peered":"2024-09-12T01:51:21.483006+0000","last_clean":"2024-09-12T01:51:21.483006+0000","last_became_active":"2024-09-12T01:49:57.321476+0000","last_became_peered":"2024-09-12T01:49:57.321476+0000","last_unstale":"2024-09-12T01:51:21.483006+0000","last_undegraded":"2024-09-12T01:51:21.483006+0000","last_fullsized":"2024-09-12T01:51:21.483006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.371474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'7","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:58.541791+0000","last_change":"2024-09-12T01:49:55.302228+0000","last_active":"2024-09-12T01:51:58.541791+0000","last_peered":"2024-09-12T01:51:58.541791+0000","last_clean":"2024-09-12T01:51:58.541791+0000","last_became_active":"2024-09-12T01:49:55.301857+0000","last_became_peered":"2024-09-12T01:49:55.301857+0000","last_unstale":"2024-09-12T01:51:58.541791+0000","last_undegraded":"2024-09-12T01:51:58.541791+0000","last_fullsized":"2024-09-12T01:51:58.541791+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.523679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.477519+0000","last_change":"2024-09-12T01:49:57.324020+0000","last_active":"2024-09-12T01:51:21.477519+0000","last_peered":"2024-09-12T01:51:21.477519+0000","last_clean":"2024-09-12T01:51:21.477519+0000","last_became_active":"2024-09-12T01:49:57.323688+0000","last_became_peered":"2024-09-12T01:49:57.323688+0000","last_unstale":"2024-09-12T01:51:21.477519+0000","last_undegraded":"2024-09-12T01:51:21.477519+0000","last_fullsized":"2024-09-12T01:51:21.477519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:59.708447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.688704+0000","last_change":"2024-09-12T01:50:22.688704+0000","last_active":"2024-09-12T01:50:22.688704+0000","last_peered":"2024-09-12T01:50:22.688704+0000","last_clean":"2024-09-12T01:50:22.688704+0000","last_became_active":"2024-09-12T01:50:22.682640+0000","last_became_peered":"2024-09-12T01:50:22.682640+0000","last_unstale":"2024-09-12T01:50:22.688704+0000","last_undegraded":"2024-09-12T01:50:22.688704+0000","last_fullsized":"2024-09-12T01:50:22.688704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.731438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614069+0000","last_change":"2024-09-12T01:49:55.296494+0000","last_active":"2024-09-12T01:50:22.614069+0000","last_peered":"2024-09-12T01:50:22.614069+0000","last_clean":"2024-09-12T01:50:22.614069+0000","last_became_active":"2024-09-12T01:49:55.296097+0000","last_became_peered":"2024-09-12T01:49:55.296097+0000","last_unstale":"2024-09-12T01:50:22.614069+0000","last_undegraded":"2024-09-12T01:50:22.614069+0000","last_fullsized":"2024-09-12T01:50:22.614069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:05.052023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.480595+0000","last_change":"2024-09-12T01:49:57.313255+0000","last_active":"2024-09-12T01:51:21.480595+0000","last_peered":"2024-09-12T01:51:21.480595+0000","last_clean":"2024-09-12T01:51:21.480595+0000","last_became_active":"2024-09-12T01:49:57.312874+0000","last_became_peered":"2024-09-12T01:49:57.312874+0000","last_unstale":"2024-09-12T01:51:21.480595+0000","last_undegraded":"2024-09-12T01:51:21.480595+0000","last_fullsized":"2024-09-12T01:51:21.480595+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:30.224682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629145+0000","last_change":"2024-09-12T01:49:55.294981+0000","last_active":"2024-09-12T01:50:22.629145+0000","last_peered":"2024-09-12T01:50:22.629145+0000","last_clean":"2024-09-12T01:50:22.629145+0000","last_became_active":"2024-09-12T01:49:55.294625+0000","last_became_peered":"2024-09-12T01:49:55.294625+0000","last_unstale":"2024-09-12T01:50:22.629145+0000","last_undegraded":"2024-09-12T01:50:22.629145+0000","last_fullsized":"2024-09-12T01:50:22.629145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:47.178463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.495099+0000","last_change":"2024-09-12T01:49:57.321412+0000","last_active":"2024-09-12T01:51:21.495099+0000","last_peered":"2024-09-12T01:51:21.495099+0000","last_clean":"2024-09-12T01:51:21.495099+0000","last_became_active":"2024-09-12T01:49:57.320797+0000","last_became_peered":"2024-09-12T01:49:57.320797+0000","last_unstale":"2024-09-12T01:51:21.495099+0000","last_undegraded":"2024-09-12T01:51:21.495099+0000","last_fullsized":"2024-09-12T01:51:21.495099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:42.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'7","reported_seq":253,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:52:00.543478+0000","last_change":"2024-09-12T01:49:55.303941+0000","last_active":"2024-09-12T01:52:00.543478+0000","last_peered":"2024-09-12T01:52:00.543478+0000","last_clean":"2024-09-12T01:52:00.543478+0000","last_became_active":"2024-09-12T01:49:55.303516+0000","last_became_peered":"2024-09-12T01:49:55.303516+0000","last_unstale":"2024-09-12T01:52:00.543478+0000","last_undegraded":"2024-09-12T01:52:00.543478+0000","last_fullsized":"2024-09-12T01:52:00.543478+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:16.097261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":224,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.498633+0000","last_change":"2024-09-12T01:49:57.327781+0000","last_active":"2024-09-12T01:51:21.498633+0000","last_peered":"2024-09-12T01:51:21.498633+0000","last_clean":"2024-09-12T01:51:21.498633+0000","last_became_active":"2024-09-12T01:49:57.327444+0000","last_became_peered":"2024-09-12T01:49:57.327444+0000","last_unstale":"2024-09-12T01:51:21.498633+0000","last_undegraded":"2024-09-12T01:51:21.498633+0000","last_fullsized":"2024-09-12T01:51:21.498633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613318+0000","last_change":"2024-09-12T01:49:55.300180+0000","last_active":"2024-09-12T01:50:22.613318+0000","last_peered":"2024-09-12T01:50:22.613318+0000","last_clean":"2024-09-12T01:50:22.613318+0000","last_became_active":"2024-09-12T01:49:55.299721+0000","last_became_peered":"2024-09-12T01:49:55.299721+0000","last_unstale":"2024-09-12T01:50:22.613318+0000","last_undegraded":"2024-09-12T01:50:22.613318+0000","last_fullsized":"2024-09-12T01:50:22.613318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:41.605927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.488858+0000","last_change":"2024-09-12T01:50:22.630618+0000","last_active":"2024-09-12T01:51:21.488858+0000","last_peered":"2024-09-12T01:51:21.488858+0000","last_clean":"2024-09-12T01:51:21.488858+0000","last_became_active":"2024-09-12T01:50:22.630327+0000","last_became_peered":"2024-09-12T01:50:22.630327+0000","last_unstale":"2024-09-12T01:51:21.488858+0000","last_undegraded":"2024-09-12T01:51:21.488858+0000","last_fullsized":"2024-09-12T01:51:21.488858+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.647257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629439+0000","last_change":"2024-09-12T01:49:55.713104+0000","last_active":"2024-09-12T01:50:22.629439+0000","last_peered":"2024-09-12T01:50:22.629439+0000","last_clean":"2024-09-12T01:50:22.629439+0000","last_became_active":"2024-09-12T01:49:55.712273+0000","last_became_peered":"2024-09-12T01:49:55.712273+0000","last_unstale":"2024-09-12T01:50:22.629439+0000","last_undegraded":"2024-09-12T01:50:22.629439+0000","last_fullsized":"2024-09-12T01:50:22.629439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:14.605502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501850+0000","last_change":"2024-09-12T01:49:57.326985+0000","last_active":"2024-09-12T01:51:21.501850+0000","last_peered":"2024-09-12T01:51:21.501850+0000","last_clean":"2024-09-12T01:51:21.501850+0000","last_became_active":"2024-09-12T01:49:57.326215+0000","last_became_peered":"2024-09-12T01:49:57.326215+0000","last_unstale":"2024-09-12T01:51:21.501850+0000","last_undegraded":"2024-09-12T01:51:21.501850+0000","last_fullsized":"2024-09-12T01:51:21.501850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:08.781111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'39","reported_seq":316,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:59.827250+0000","last_change":"2024-09-12T01:50:22.696674+0000","last_active":"2024-09-12T01:51:59.827250+0000","last_peered":"2024-09-12T01:51:59.827250+0000","last_clean":"2024-09-12T01:51:59.827250+0000","last_became_active":"2024-09-12T01:50:22.683417+0000","last_became_peered":"2024-09-12T01:50:22.683417+0000","last_unstale":"2024-09-12T01:51:59.827250+0000","last_undegraded":"2024-09-12T01:51:59.827250+0000","last_fullsized":"2024-09-12T01:51:59.827250+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:35.001528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67181,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":181,"num_write":41,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":49603,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486841+0000","last_change":"2024-09-12T01:49:57.323011+0000","last_active":"2024-09-12T01:51:21.486841+0000","last_peered":"2024-09-12T01:51:21.486841+0000","last_clean":"2024-09-12T01:51:21.486841+0000","last_became_active":"2024-09-12T01:49:57.322667+0000","last_became_peered":"2024-09-12T01:49:57.322667+0000","last_unstale":"2024-09-12T01:51:21.486841+0000","last_undegraded":"2024-09-12T01:51:21.486841+0000","last_fullsized":"2024-09-12T01:51:21.486841+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:16.412416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612213+0000","last_change":"2024-09-12T01:49:55.300185+0000","last_active":"2024-09-12T01:50:22.612213+0000","last_peered":"2024-09-12T01:50:22.612213+0000","last_clean":"2024-09-12T01:50:22.612213+0000","last_became_active":"2024-09-12T01:49:55.299691+0000","last_became_peered":"2024-09-12T01:49:55.299691+0000","last_unstale":"2024-09-12T01:50:22.612213+0000","last_undegraded":"2024-09-12T01:50:22.612213+0000","last_fullsized":"2024-09-12T01:50:22.612213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:32.602086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.474550+0000","last_change":"2024-09-12T01:49:57.315650+0000","last_active":"2024-09-12T01:51:21.474550+0000","last_peered":"2024-09-12T01:51:21.474550+0000","last_clean":"2024-09-12T01:51:21.474550+0000","last_became_active":"2024-09-12T01:49:57.315309+0000","last_became_peered":"2024-09-12T01:49:57.315309+0000","last_unstale":"2024-09-12T01:51:21.474550+0000","last_undegraded":"2024-09-12T01:51:21.474550+0000","last_fullsized":"2024-09-12T01:51:21.474550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:17.154468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629035+0000","last_change":"2024-09-12T01:49:55.295238+0000","last_active":"2024-09-12T01:50:22.629035+0000","last_peered":"2024-09-12T01:50:22.629035+0000","last_clean":"2024-09-12T01:50:22.629035+0000","last_became_active":"2024-09-12T01:49:55.294877+0000","last_became_peered":"2024-09-12T01:49:55.294877+0000","last_unstale":"2024-09-12T01:50:22.629035+0000","last_undegraded":"2024-09-12T01:50:22.629035+0000","last_fullsized":"2024-09-12T01:50:22.629035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.233692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487087+0000","last_change":"2024-09-12T01:50:22.616527+0000","last_active":"2024-09-12T01:51:21.487087+0000","last_peered":"2024-09-12T01:51:21.487087+0000","last_clean":"2024-09-12T01:51:21.487087+0000","last_became_active":"2024-09-12T01:50:22.616150+0000","last_became_peered":"2024-09-12T01:50:22.616150+0000","last_unstale":"2024-09-12T01:51:21.487087+0000","last_undegraded":"2024-09-12T01:51:21.487087+0000","last_fullsized":"2024-09-12T01:51:21.487087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:58.607091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":142,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:52:00.543101+0000","last_change":"2024-09-12T01:49:55.300540+0000","last_active":"2024-09-12T01:52:00.543101+0000","last_peered":"2024-09-12T01:52:00.543101+0000","last_clean":"2024-09-12T01:52:00.543101+0000","last_became_active":"2024-09-12T01:49:55.298765+0000","last_became_peered":"2024-09-12T01:49:55.298765+0000","last_unstale":"2024-09-12T01:52:00.543101+0000","last_undegraded":"2024-09-12T01:52:00.543101+0000","last_fullsized":"2024-09-12T01:52:00.543101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.135229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.495898+0000","last_change":"2024-09-12T01:49:57.324944+0000","last_active":"2024-09-12T01:51:21.495898+0000","last_peered":"2024-09-12T01:51:21.495898+0000","last_clean":"2024-09-12T01:51:21.495898+0000","last_became_active":"2024-09-12T01:49:57.324544+0000","last_became_peered":"2024-09-12T01:49:57.324544+0000","last_unstale":"2024-09-12T01:51:21.495898+0000","last_undegraded":"2024-09-12T01:51:21.495898+0000","last_fullsized":"2024-09-12T01:51:21.495898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:41.230989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.610857+0000","last_change":"2024-09-12T01:49:55.713630+0000","last_active":"2024-09-12T01:50:22.610857+0000","last_peered":"2024-09-12T01:50:22.610857+0000","last_clean":"2024-09-12T01:50:22.610857+0000","last_became_active":"2024-09-12T01:49:55.712927+0000","last_became_peered":"2024-09-12T01:49:55.712927+0000","last_unstale":"2024-09-12T01:50:22.610857+0000","last_undegraded":"2024-09-12T01:50:22.610857+0000","last_fullsized":"2024-09-12T01:50:22.610857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:00.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.482779+0000","last_change":"2024-09-12T01:49:57.323196+0000","last_active":"2024-09-12T01:51:21.482779+0000","last_peered":"2024-09-12T01:51:21.482779+0000","last_clean":"2024-09-12T01:51:21.482779+0000","last_became_active":"2024-09-12T01:49:57.322859+0000","last_became_peered":"2024-09-12T01:49:57.322859+0000","last_unstale":"2024-09-12T01:51:21.482779+0000","last_undegraded":"2024-09-12T01:51:21.482779+0000","last_fullsized":"2024-09-12T01:51:21.482779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:52.605384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611513+0000","last_change":"2024-09-12T01:49:55.304099+0000","last_active":"2024-09-12T01:50:22.611513+0000","last_peered":"2024-09-12T01:50:22.611513+0000","last_clean":"2024-09-12T01:50:22.611513+0000","last_became_active":"2024-09-12T01:49:55.303712+0000","last_became_peered":"2024-09-12T01:49:55.303712+0000","last_unstale":"2024-09-12T01:50:22.611513+0000","last_undegraded":"2024-09-12T01:50:22.611513+0000","last_fullsized":"2024-09-12T01:50:22.611513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.394966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.486914+0000","last_change":"2024-09-12T01:49:57.331476+0000","last_active":"2024-09-12T01:51:21.486914+0000","last_peered":"2024-09-12T01:51:21.486914+0000","last_clean":"2024-09-12T01:51:21.486914+0000","last_became_active":"2024-09-12T01:49:57.330504+0000","last_became_peered":"2024-09-12T01:49:57.330504+0000","last_unstale":"2024-09-12T01:51:21.486914+0000","last_undegraded":"2024-09-12T01:51:21.486914+0000","last_fullsized":"2024-09-12T01:51:21.486914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.498258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613947+0000","last_change":"2024-09-12T01:49:55.299427+0000","last_active":"2024-09-12T01:50:22.613947+0000","last_peered":"2024-09-12T01:50:22.613947+0000","last_clean":"2024-09-12T01:50:22.613947+0000","last_became_active":"2024-09-12T01:49:55.299100+0000","last_became_peered":"2024-09-12T01:49:55.299100+0000","last_unstale":"2024-09-12T01:50:22.613947+0000","last_undegraded":"2024-09-12T01:50:22.613947+0000","last_fullsized":"2024-09-12T01:50:22.613947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:56.174614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484475+0000","last_change":"2024-09-12T01:49:57.323241+0000","last_active":"2024-09-12T01:51:21.484475+0000","last_peered":"2024-09-12T01:51:21.484475+0000","last_clean":"2024-09-12T01:51:21.484475+0000","last_became_active":"2024-09-12T01:49:57.322664+0000","last_became_peered":"2024-09-12T01:49:57.322664+0000","last_unstale":"2024-09-12T01:51:21.484475+0000","last_undegraded":"2024-09-12T01:51:21.484475+0000","last_fullsized":"2024-09-12T01:51:21.484475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:28.214708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.629587+0000","last_change":"2024-09-12T01:49:55.296670+0000","last_active":"2024-09-12T01:50:22.629587+0000","last_peered":"2024-09-12T01:50:22.629587+0000","last_clean":"2024-09-12T01:50:22.629587+0000","last_became_active":"2024-09-12T01:49:55.296211+0000","last_became_peered":"2024-09-12T01:49:55.296211+0000","last_unstale":"2024-09-12T01:50:22.629587+0000","last_undegraded":"2024-09-12T01:50:22.629587+0000","last_fullsized":"2024-09-12T01:50:22.629587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:05.196259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489454+0000","last_change":"2024-09-12T01:49:57.321401+0000","last_active":"2024-09-12T01:51:21.489454+0000","last_peered":"2024-09-12T01:51:21.489454+0000","last_clean":"2024-09-12T01:51:21.489454+0000","last_became_active":"2024-09-12T01:49:57.321089+0000","last_became_peered":"2024-09-12T01:49:57.321089+0000","last_unstale":"2024-09-12T01:51:21.489454+0000","last_undegraded":"2024-09-12T01:51:21.489454+0000","last_fullsized":"2024-09-12T01:51:21.489454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:41.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'8","reported_seq":149,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:52:01.545525+0000","last_change":"2024-09-12T01:49:55.712800+0000","last_active":"2024-09-12T01:52:01.545525+0000","last_peered":"2024-09-12T01:52:01.545525+0000","last_clean":"2024-09-12T01:52:01.545525+0000","last_became_active":"2024-09-12T01:49:55.712352+0000","last_became_peered":"2024-09-12T01:49:55.712352+0000","last_unstale":"2024-09-12T01:52:01.545525+0000","last_undegraded":"2024-09-12T01:52:01.545525+0000","last_fullsized":"2024-09-12T01:52:01.545525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:17.570652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2012,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":119,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.500017+0000","last_change":"2024-09-12T01:49:57.329653+0000","last_active":"2024-09-12T01:51:21.500017+0000","last_peered":"2024-09-12T01:51:21.500017+0000","last_clean":"2024-09-12T01:51:21.500017+0000","last_became_active":"2024-09-12T01:49:57.329312+0000","last_became_peered":"2024-09-12T01:49:57.329312+0000","last_unstale":"2024-09-12T01:51:21.500017+0000","last_undegraded":"2024-09-12T01:51:21.500017+0000","last_fullsized":"2024-09-12T01:51:21.500017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.540182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":333,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612725+0000","last_change":"2024-09-12T01:48:49.584927+0000","last_active":"2024-09-12T01:50:22.612725+0000","last_peered":"2024-09-12T01:50:22.612725+0000","last_clean":"2024-09-12T01:50:22.612725+0000","last_became_active":"2024-09-12T01:48:49.584569+0000","last_became_peered":"2024-09-12T01:48:49.584569+0000","last_unstale":"2024-09-12T01:50:22.612725+0000","last_undegraded":"2024-09-12T01:50:22.612725+0000","last_fullsized":"2024-09-12T01:50:22.612725+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:45:34.454036+0000","last_clean_scrub_stamp":"2024-09-12T01:45:34.454036+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:43.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681978+0000","last_change":"2024-09-12T01:49:55.298377+0000","last_active":"2024-09-12T01:50:22.681978+0000","last_peered":"2024-09-12T01:50:22.681978+0000","last_clean":"2024-09-12T01:50:22.681978+0000","last_became_active":"2024-09-12T01:49:55.297913+0000","last_became_peered":"2024-09-12T01:49:55.297913+0000","last_unstale":"2024-09-12T01:50:22.681978+0000","last_undegraded":"2024-09-12T01:50:22.681978+0000","last_fullsized":"2024-09-12T01:50:22.681978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:50.309407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.498440+0000","last_change":"2024-09-12T01:49:57.318410+0000","last_active":"2024-09-12T01:51:21.498440+0000","last_peered":"2024-09-12T01:51:21.498440+0000","last_clean":"2024-09-12T01:51:21.498440+0000","last_became_active":"2024-09-12T01:49:57.317992+0000","last_became_peered":"2024-09-12T01:49:57.317992+0000","last_unstale":"2024-09-12T01:51:21.498440+0000","last_undegraded":"2024-09-12T01:51:21.498440+0000","last_fullsized":"2024-09-12T01:51:21.498440+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:15.751592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612697+0000","last_change":"2024-09-12T01:49:55.301928+0000","last_active":"2024-09-12T01:50:22.612697+0000","last_peered":"2024-09-12T01:50:22.612697+0000","last_clean":"2024-09-12T01:50:22.612697+0000","last_became_active":"2024-09-12T01:49:55.301507+0000","last_became_peered":"2024-09-12T01:49:55.301507+0000","last_unstale":"2024-09-12T01:50:22.612697+0000","last_undegraded":"2024-09-12T01:50:22.612697+0000","last_fullsized":"2024-09-12T01:50:22.612697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:23.192962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.481982+0000","last_change":"2024-09-12T01:49:57.325898+0000","last_active":"2024-09-12T01:51:21.481982+0000","last_peered":"2024-09-12T01:51:21.481982+0000","last_clean":"2024-09-12T01:51:21.481982+0000","last_became_active":"2024-09-12T01:49:57.325601+0000","last_became_peered":"2024-09-12T01:49:57.325601+0000","last_unstale":"2024-09-12T01:51:21.481982+0000","last_undegraded":"2024-09-12T01:51:21.481982+0000","last_fullsized":"2024-09-12T01:51:21.481982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:35.497195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":140,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:59.541242+0000","last_change":"2024-09-12T01:49:55.712909+0000","last_active":"2024-09-12T01:51:59.541242+0000","last_peered":"2024-09-12T01:51:59.541242+0000","last_clean":"2024-09-12T01:51:59.541242+0000","last_became_active":"2024-09-12T01:49:55.712559+0000","last_became_peered":"2024-09-12T01:49:55.712559+0000","last_unstale":"2024-09-12T01:51:59.541242+0000","last_undegraded":"2024-09-12T01:51:59.541242+0000","last_fullsized":"2024-09-12T01:51:59.541242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.025602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.477907+0000","last_change":"2024-09-12T01:50:22.682963+0000","last_active":"2024-09-12T01:51:21.477907+0000","last_peered":"2024-09-12T01:51:21.477907+0000","last_clean":"2024-09-12T01:51:21.477907+0000","last_became_active":"2024-09-12T01:50:22.682611+0000","last_became_peered":"2024-09-12T01:50:22.682611+0000","last_unstale":"2024-09-12T01:51:21.477907+0000","last_undegraded":"2024-09-12T01:51:21.477907+0000","last_fullsized":"2024-09-12T01:51:21.477907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:01.295098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'7","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:58.810227+0000","last_change":"2024-09-12T01:49:55.297593+0000","last_active":"2024-09-12T01:51:58.810227+0000","last_peered":"2024-09-12T01:51:58.810227+0000","last_clean":"2024-09-12T01:51:58.810227+0000","last_became_active":"2024-09-12T01:49:55.295570+0000","last_became_peered":"2024-09-12T01:49:55.295570+0000","last_unstale":"2024-09-12T01:51:58.810227+0000","last_undegraded":"2024-09-12T01:51:58.810227+0000","last_fullsized":"2024-09-12T01:51:58.810227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:36.307283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489407+0000","last_change":"2024-09-12T01:49:57.322329+0000","last_active":"2024-09-12T01:51:21.489407+0000","last_peered":"2024-09-12T01:51:21.489407+0000","last_clean":"2024-09-12T01:51:21.489407+0000","last_became_active":"2024-09-12T01:49:57.322010+0000","last_became_peered":"2024-09-12T01:49:57.322010+0000","last_unstale":"2024-09-12T01:51:21.489407+0000","last_undegraded":"2024-09-12T01:51:21.489407+0000","last_fullsized":"2024-09-12T01:51:21.489407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:50.485994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.683611+0000","last_change":"2024-09-12T01:50:22.683026+0000","last_active":"2024-09-12T01:50:22.683611+0000","last_peered":"2024-09-12T01:50:22.683611+0000","last_clean":"2024-09-12T01:50:22.683611+0000","last_became_active":"2024-09-12T01:50:22.682461+0000","last_became_peered":"2024-09-12T01:50:22.682461+0000","last_unstale":"2024-09-12T01:50:22.683611+0000","last_undegraded":"2024-09-12T01:50:22.683611+0000","last_fullsized":"2024-09-12T01:50:22.683611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.470081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.490807+0000","last_change":"2024-09-12T01:50:22.618050+0000","last_active":"2024-09-12T01:51:21.490807+0000","last_peered":"2024-09-12T01:51:21.490807+0000","last_clean":"2024-09-12T01:51:21.490807+0000","last_became_active":"2024-09-12T01:50:22.614871+0000","last_became_peered":"2024-09-12T01:50:22.614871+0000","last_unstale":"2024-09-12T01:51:21.490807+0000","last_undegraded":"2024-09-12T01:51:21.490807+0000","last_fullsized":"2024-09-12T01:51:21.490807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:47.652568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611446+0000","last_change":"2024-09-12T01:49:55.713020+0000","last_active":"2024-09-12T01:50:22.611446+0000","last_peered":"2024-09-12T01:50:22.611446+0000","last_clean":"2024-09-12T01:50:22.611446+0000","last_became_active":"2024-09-12T01:49:55.712593+0000","last_became_peered":"2024-09-12T01:49:55.712593+0000","last_unstale":"2024-09-12T01:50:22.611446+0000","last_undegraded":"2024-09-12T01:50:22.611446+0000","last_fullsized":"2024-09-12T01:50:22.611446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:09.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.481782+0000","last_change":"2024-09-12T01:49:57.325956+0000","last_active":"2024-09-12T01:51:21.481782+0000","last_peered":"2024-09-12T01:51:21.481782+0000","last_clean":"2024-09-12T01:51:21.481782+0000","last_became_active":"2024-09-12T01:49:57.325596+0000","last_became_peered":"2024-09-12T01:49:57.325596+0000","last_unstale":"2024-09-12T01:51:21.481782+0000","last_undegraded":"2024-09-12T01:51:21.481782+0000","last_fullsized":"2024-09-12T01:51:21.481782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:22.101157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'16","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:22.331135+0000","last_change":"2024-09-12T01:49:55.297615+0000","last_active":"2024-09-12T01:51:22.331135+0000","last_peered":"2024-09-12T01:51:22.331135+0000","last_clean":"2024-09-12T01:51:22.331135+0000","last_became_active":"2024-09-12T01:49:55.297290+0000","last_became_peered":"2024-09-12T01:49:55.297290+0000","last_unstale":"2024-09-12T01:51:22.331135+0000","last_undegraded":"2024-09-12T01:51:22.331135+0000","last_fullsized":"2024-09-12T01:51:22.331135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:53.203582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487040+0000","last_change":"2024-09-12T01:49:57.319419+0000","last_active":"2024-09-12T01:51:21.487040+0000","last_peered":"2024-09-12T01:51:21.487040+0000","last_clean":"2024-09-12T01:51:21.487040+0000","last_became_active":"2024-09-12T01:49:57.318570+0000","last_became_peered":"2024-09-12T01:49:57.318570+0000","last_unstale":"2024-09-12T01:51:21.487040+0000","last_undegraded":"2024-09-12T01:51:21.487040+0000","last_fullsized":"2024-09-12T01:51:21.487040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.182011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.681518+0000","last_change":"2024-09-12T01:49:55.514034+0000","last_active":"2024-09-12T01:50:22.681518+0000","last_peered":"2024-09-12T01:50:22.681518+0000","last_clean":"2024-09-12T01:50:22.681518+0000","last_became_active":"2024-09-12T01:49:55.513649+0000","last_became_peered":"2024-09-12T01:49:55.513649+0000","last_unstale":"2024-09-12T01:50:22.681518+0000","last_undegraded":"2024-09-12T01:50:22.681518+0000","last_fullsized":"2024-09-12T01:50:22.681518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:30.408959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.489524+0000","last_change":"2024-09-12T01:49:57.321479+0000","last_active":"2024-09-12T01:51:21.489524+0000","last_peered":"2024-09-12T01:51:21.489524+0000","last_clean":"2024-09-12T01:51:21.489524+0000","last_became_active":"2024-09-12T01:49:57.321197+0000","last_became_peered":"2024-09-12T01:49:57.321197+0000","last_unstale":"2024-09-12T01:51:21.489524+0000","last_undegraded":"2024-09-12T01:51:21.489524+0000","last_fullsized":"2024-09-12T01:51:21.489524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.648536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611066+0000","last_change":"2024-09-12T01:49:55.712751+0000","last_active":"2024-09-12T01:50:22.611066+0000","last_peered":"2024-09-12T01:50:22.611066+0000","last_clean":"2024-09-12T01:50:22.611066+0000","last_became_active":"2024-09-12T01:49:55.712362+0000","last_became_peered":"2024-09-12T01:49:55.712362+0000","last_unstale":"2024-09-12T01:50:22.611066+0000","last_undegraded":"2024-09-12T01:50:22.611066+0000","last_fullsized":"2024-09-12T01:50:22.611066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:31.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.451681+0000","last_change":"2024-09-12T01:49:57.324601+0000","last_active":"2024-09-12T01:51:21.451681+0000","last_peered":"2024-09-12T01:51:21.451681+0000","last_clean":"2024-09-12T01:51:21.451681+0000","last_became_active":"2024-09-12T01:49:57.324212+0000","last_became_peered":"2024-09-12T01:49:57.324212+0000","last_unstale":"2024-09-12T01:51:21.451681+0000","last_undegraded":"2024-09-12T01:51:21.451681+0000","last_fullsized":"2024-09-12T01:51:21.451681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:36.668185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.613860+0000","last_change":"2024-09-12T01:49:55.294609+0000","last_active":"2024-09-12T01:50:22.613860+0000","last_peered":"2024-09-12T01:50:22.613860+0000","last_clean":"2024-09-12T01:50:22.613860+0000","last_became_active":"2024-09-12T01:49:55.294273+0000","last_became_peered":"2024-09-12T01:49:55.294273+0000","last_unstale":"2024-09-12T01:50:22.613860+0000","last_undegraded":"2024-09-12T01:50:22.613860+0000","last_fullsized":"2024-09-12T01:50:22.613860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:20.726374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.484300+0000","last_change":"2024-09-12T01:49:57.331906+0000","last_active":"2024-09-12T01:51:21.484300+0000","last_peered":"2024-09-12T01:51:21.484300+0000","last_clean":"2024-09-12T01:51:21.484300+0000","last_became_active":"2024-09-12T01:49:57.331566+0000","last_became_peered":"2024-09-12T01:49:57.331566+0000","last_unstale":"2024-09-12T01:51:21.484300+0000","last_undegraded":"2024-09-12T01:51:21.484300+0000","last_fullsized":"2024-09-12T01:51:21.484300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:24.390246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.612140+0000","last_change":"2024-09-12T01:49:55.300401+0000","last_active":"2024-09-12T01:50:22.612140+0000","last_peered":"2024-09-12T01:50:22.612140+0000","last_clean":"2024-09-12T01:50:22.612140+0000","last_became_active":"2024-09-12T01:49:55.299763+0000","last_became_peered":"2024-09-12T01:49:55.299763+0000","last_unstale":"2024-09-12T01:50:22.612140+0000","last_undegraded":"2024-09-12T01:50:22.612140+0000","last_fullsized":"2024-09-12T01:50:22.612140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:05.581766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.493228+0000","last_change":"2024-09-12T01:49:57.314007+0000","last_active":"2024-09-12T01:51:21.493228+0000","last_peered":"2024-09-12T01:51:21.493228+0000","last_clean":"2024-09-12T01:51:21.493228+0000","last_became_active":"2024-09-12T01:49:57.313709+0000","last_became_peered":"2024-09-12T01:49:57.313709+0000","last_unstale":"2024-09-12T01:51:21.493228+0000","last_undegraded":"2024-09-12T01:51:21.493228+0000","last_fullsized":"2024-09-12T01:51:21.493228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:10.818799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611281+0000","last_change":"2024-09-12T01:49:55.298937+0000","last_active":"2024-09-12T01:50:22.611281+0000","last_peered":"2024-09-12T01:50:22.611281+0000","last_clean":"2024-09-12T01:50:22.611281+0000","last_became_active":"2024-09-12T01:49:55.298567+0000","last_became_peered":"2024-09-12T01:49:55.298567+0000","last_unstale":"2024-09-12T01:50:22.611281+0000","last_undegraded":"2024-09-12T01:50:22.611281+0000","last_fullsized":"2024-09-12T01:50:22.611281+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:58.737511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501783+0000","last_change":"2024-09-12T01:49:57.317209+0000","last_active":"2024-09-12T01:51:21.501783+0000","last_peered":"2024-09-12T01:51:21.501783+0000","last_clean":"2024-09-12T01:51:21.501783+0000","last_became_active":"2024-09-12T01:49:57.316683+0000","last_became_peered":"2024-09-12T01:49:57.316683+0000","last_unstale":"2024-09-12T01:51:21.501783+0000","last_undegraded":"2024-09-12T01:51:21.501783+0000","last_fullsized":"2024-09-12T01:51:21.501783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:54.872885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.497079+0000","last_change":"2024-09-12T01:49:57.325126+0000","last_active":"2024-09-12T01:51:21.497079+0000","last_peered":"2024-09-12T01:51:21.497079+0000","last_clean":"2024-09-12T01:51:21.497079+0000","last_became_active":"2024-09-12T01:49:57.324808+0000","last_became_peered":"2024-09-12T01:49:57.324808+0000","last_unstale":"2024-09-12T01:51:21.497079+0000","last_undegraded":"2024-09-12T01:51:21.497079+0000","last_fullsized":"2024-09-12T01:51:21.497079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:33.429054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611510+0000","last_change":"2024-09-12T01:49:55.302358+0000","last_active":"2024-09-12T01:50:22.611510+0000","last_peered":"2024-09-12T01:50:22.611510+0000","last_clean":"2024-09-12T01:50:22.611510+0000","last_became_active":"2024-09-12T01:49:55.302017+0000","last_became_peered":"2024-09-12T01:49:55.302017+0000","last_unstale":"2024-09-12T01:50:22.611510+0000","last_undegraded":"2024-09-12T01:50:22.611510+0000","last_fullsized":"2024-09-12T01:50:22.611510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:37.550239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.501244+0000","last_change":"2024-09-12T01:49:57.327678+0000","last_active":"2024-09-12T01:51:21.501244+0000","last_peered":"2024-09-12T01:51:21.501244+0000","last_clean":"2024-09-12T01:51:21.501244+0000","last_became_active":"2024-09-12T01:49:57.327355+0000","last_became_peered":"2024-09-12T01:49:57.327355+0000","last_unstale":"2024-09-12T01:51:21.501244+0000","last_undegraded":"2024-09-12T01:51:21.501244+0000","last_fullsized":"2024-09-12T01:51:21.501244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:39.024944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.611302+0000","last_change":"2024-09-12T01:49:55.299702+0000","last_active":"2024-09-12T01:50:22.611302+0000","last_peered":"2024-09-12T01:50:22.611302+0000","last_clean":"2024-09-12T01:50:22.611302+0000","last_became_active":"2024-09-12T01:49:55.298968+0000","last_became_peered":"2024-09-12T01:49:55.298968+0000","last_unstale":"2024-09-12T01:50:22.611302+0000","last_undegraded":"2024-09-12T01:50:22.611302+0000","last_fullsized":"2024-09-12T01:50:22.611302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:04.820187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.502339+0000","last_change":"2024-09-12T01:49:57.318137+0000","last_active":"2024-09-12T01:51:21.502339+0000","last_peered":"2024-09-12T01:51:21.502339+0000","last_clean":"2024-09-12T01:51:21.502339+0000","last_became_active":"2024-09-12T01:49:57.317508+0000","last_became_peered":"2024-09-12T01:49:57.317508+0000","last_unstale":"2024-09-12T01:51:21.502339+0000","last_undegraded":"2024-09-12T01:51:21.502339+0000","last_fullsized":"2024-09-12T01:51:21.502339+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:08.320312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:50:22.614376+0000","last_change":"2024-09-12T01:49:55.711943+0000","last_active":"2024-09-12T01:50:22.614376+0000","last_peered":"2024-09-12T01:50:22.614376+0000","last_clean":"2024-09-12T01:50:22.614376+0000","last_became_active":"2024-09-12T01:49:55.711615+0000","last_became_peered":"2024-09-12T01:49:55.711615+0000","last_unstale":"2024-09-12T01:50:22.614376+0000","last_undegraded":"2024-09-12T01:50:22.614376+0000","last_fullsized":"2024-09-12T01:50:22.614376+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:32.773928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:51:21.487999+0000","last_change":"2024-09-12T01:49:57.327021+0000","last_active":"2024-09-12T01:51:21.487999+0000","last_peered":"2024-09-12T01:51:21.487999+0000","last_clean":"2024-09-12T01:51:21.487999+0000","last_became_active":"2024-09-12T01:49:57.326454+0000","last_became_peered":"2024-09-12T01:49:57.326454+0000","last_unstale":"2024-09-12T01:51:21.487999+0000","last_undegraded":"2024-09-12T01:51:21.487999+0000","last_fullsized":"2024-09-12T01:51:21.487999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:56.292576+0000","last_clean_scrub_stamp":"2024-09-12T01:49:56.292576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:41.623735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'14","reported_seq":172,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T01:52:01.813752+0000","last_change":"2024-09-12T01:50:22.691988+0000","last_active":"2024-09-12T01:52:01.813752+0000","last_peered":"2024-09-12T01:52:01.813752+0000","last_clean":"2024-09-12T01:52:01.813752+0000","last_became_active":"2024-09-12T01:50:22.682676+0000","last_became_peered":"2024-09-12T01:50:22.682676+0000","last_unstale":"2024-09-12T01:52:01.813752+0000","last_undegraded":"2024-09-12T01:52:01.813752+0000","last_fullsized":"2024-09-12T01:52:01.813752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:49:54.276163+0000","last_clean_scrub_stamp":"2024-09-12T01:49:54.276163+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:56.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75513,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1160,"num_read_kb":664,"num_write":266,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":50275,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":226539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547238,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":439878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32768,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712384,"statfs":{"total":95995035648,"available":95961481216,"internally_reserved":0,"allocated":1622016,"data_stored":1096574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939696,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":438411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397561,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1523712,"data_stored":1031195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528382,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":438545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1544192,"data_stored":1031011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":505053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":437719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":440520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":506639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":942080,"data_stored":440192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:52:05.892 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:52:05.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:05 smithi191 ceph-mon[35770]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:52:05.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:05 smithi191 ceph-mon[35770]: pgmap v335: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-12T01:52:06.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:05 smithi152 ceph-mon[35055]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:52:06.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:05 smithi152 ceph-mon[35055]: pgmap v335: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-12T01:52:06.134 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.602+0000 7ff99f058640 1 -- 172.21.15.70:0/932518837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff998106a80 msgr2=0x7ff998106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.602+0000 7ff99f058640 1 --2- 172.21.15.70:0/932518837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff998106a80 0x7ff998106e60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff988009930 tx=0x7ff98802a420 comp rx=0 tx=0).stop 2024-09-12T01:52:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.602+0000 7ff99f058640 1 -- 172.21.15.70:0/932518837 shutdown_connections 2024-09-12T01:52:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.602+0000 7ff99f058640 1 --2- 172.21.15.70:0/932518837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff998101420 0x7ff99810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.602+0000 7ff99f058640 1 --2- 172.21.15.70:0/932518837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff998100a80 0x7ff998100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.602+0000 7ff99f058640 1 --2- 172.21.15.70:0/932518837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff998106a80 0x7ff998106e60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.602+0000 7ff99f058640 1 -- 172.21.15.70:0/932518837 >> 172.21.15.70:0/932518837 conn(0x7ff9980fc7a0 msgr2=0x7ff9980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.603+0000 7ff99f058640 1 -- 172.21.15.70:0/932518837 shutdown_connections 2024-09-12T01:52:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.603+0000 7ff99f058640 1 -- 172.21.15.70:0/932518837 wait complete. 2024-09-12T01:52:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.603+0000 7ff99f058640 1 Processor -- start 2024-09-12T01:52:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.603+0000 7ff99f058640 1 -- start start 2024-09-12T01:52:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.603+0000 7ff99f058640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff998100a80 0x7ff998198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.603+0000 7ff99f058640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff998101420 0x7ff998198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.603+0000 7ff99f058640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff998106a80 0x7ff99819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99f058640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff998110f60 con 0x7ff998106a80 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99f058640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff998110de0 con 0x7ff998101420 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99f058640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff9981110e0 con 0x7ff998100a80 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99d5f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff998106a80 0x7ff99819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99d5f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff998106a80 0x7ff99819ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57248/0 (socket says 172.21.15.70:57248) 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99d5f5640 1 -- 172.21.15.70:0/3759579749 learned_addr learned my addr 172.21.15.70:0/3759579749 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99cdf4640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff998100a80 0x7ff998198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff997fff640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff998101420 0x7ff998198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99d5f5640 1 -- 172.21.15.70:0/3759579749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff998100a80 msgr2=0x7ff998198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99d5f5640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff998100a80 0x7ff998198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99d5f5640 1 -- 172.21.15.70:0/3759579749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff998101420 msgr2=0x7ff998198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99d5f5640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff998101420 0x7ff998198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99d5f5640 1 -- 172.21.15.70:0/3759579749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99819d4f0 con 0x7ff998106a80 2024-09-12T01:52:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff997fff640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff998101420 0x7ff998198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99d5f5640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff998106a80 0x7ff99819ce10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff99000eb10 tx=0x7ff99000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff995ffb640 1 -- 172.21.15.70:0/3759579749 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990004b20 con 0x7ff998106a80 2024-09-12T01:52:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff99f058640 1 -- 172.21.15.70:0/3759579749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99819d7e0 con 0x7ff998106a80 2024-09-12T01:52:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff995ffb640 1 -- 172.21.15.70:0/3759579749 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff990004cc0 con 0x7ff998106a80 2024-09-12T01:52:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.604+0000 7ff995ffb640 1 -- 172.21.15.70:0/3759579749 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9900107f0 con 0x7ff998106a80 2024-09-12T01:52:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.605+0000 7ff99f058640 1 -- 172.21.15.70:0/3759579749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9981a50c0 con 0x7ff998106a80 2024-09-12T01:52:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.606+0000 7ff99f058640 1 -- 172.21.15.70:0/3759579749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff998100ee0 con 0x7ff998106a80 2024-09-12T01:52:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.607+0000 7ff995ffb640 1 -- 172.21.15.70:0/3759579749 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff990005020 con 0x7ff998106a80 2024-09-12T01:52:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.607+0000 7ff995ffb640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff9840a2b80 0x7ff9840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.607+0000 7ff99cdf4640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff9840a2b80 0x7ff9840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.607+0000 7ff995ffb640 1 -- 172.21.15.70:0/3759579749 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff9900cf620 con 0x7ff998106a80 2024-09-12T01:52:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.608+0000 7ff99cdf4640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff9840a2b80 0x7ff9840a5040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff988009900 tx=0x7ff9880058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.611+0000 7ff995ffb640 1 -- 172.21.15.70:0/3759579749 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff99009c580 con 0x7ff998106a80 2024-09-12T01:52:06.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.812+0000 7ff99f058640 1 -- 172.21.15.70:0/3759579749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff99802d7c0 con 0x7ff998106a80 2024-09-12T01:52:06.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.812+0000 7ff995ffb640 1 -- 172.21.15.70:0/3759579749 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7ff99009be80 con 0x7ff998106a80 2024-09-12T01:52:06.812 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:52:06.813 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-12T01:51:51:564560+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:51:51.387340+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24427,24433,24437,24445,24452]},"id":1}]} 2024-09-12T01:52:06.813 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-12T01:52:06.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.815+0000 7ff99f058640 1 -- 172.21.15.70:0/3759579749 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff9840a2b80 msgr2=0x7ff9840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:06.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.815+0000 7ff99f058640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff9840a2b80 0x7ff9840a5040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff988009900 tx=0x7ff9880058d0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.815+0000 7ff99f058640 1 -- 172.21.15.70:0/3759579749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff998106a80 msgr2=0x7ff99819ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:06.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.815+0000 7ff99f058640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff998106a80 0x7ff99819ce10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff99000eb10 tx=0x7ff99000c2d0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.815+0000 7ff99f058640 1 -- 172.21.15.70:0/3759579749 shutdown_connections 2024-09-12T01:52:06.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.815+0000 7ff99f058640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff9840a2b80 0x7ff9840a5040 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.815+0000 7ff99f058640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff998106a80 0x7ff99819ce10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.815+0000 7ff99f058640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff998101420 0x7ff998198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.815+0000 7ff99f058640 1 --2- 172.21.15.70:0/3759579749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff998100a80 0x7ff998198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:06.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.815+0000 7ff99f058640 1 -- 172.21.15.70:0/3759579749 >> 172.21.15.70:0/3759579749 conn(0x7ff9980fc7a0 msgr2=0x7ff99806aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:06.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.815+0000 7ff99f058640 1 -- 172.21.15.70:0/3759579749 shutdown_connections 2024-09-12T01:52:06.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:06.815+0000 7ff99f058640 1 -- 172.21.15.70:0/3759579749 wait complete. 2024-09-12T01:52:07.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:06 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3759579749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:07.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:06 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3759579749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:07.269 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:06 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3759579749' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:07.525 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:52:07.789 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:08.134 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:07 smithi152 ceph-mon[35055]: pgmap v336: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-12T01:52:08.134 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:08.182 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:07 smithi070 ceph-mon[31177]: pgmap v336: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-12T01:52:08.182 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:08.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:07 smithi191 ceph-mon[35770]: pgmap v336: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-12T01:52:08.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:08.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.262+0000 7f2602284640 1 -- 172.21.15.70:0/2264331790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25fc101200 msgr2=0x7f25fc101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:08.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.262+0000 7f2602284640 1 --2- 172.21.15.70:0/2264331790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25fc101200 0x7f25fc101660 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009900 tx=0x7f25f002a410 comp rx=0 tx=0).stop 2024-09-12T01:52:08.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.262+0000 7f2602284640 1 -- 172.21.15.70:0/2264331790 shutdown_connections 2024-09-12T01:52:08.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.262+0000 7f2602284640 1 --2- 172.21.15.70:0/2264331790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25fc101ba0 0x7f25fc10d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.262+0000 7f2602284640 1 --2- 172.21.15.70:0/2264331790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25fc101200 0x7f25fc101660 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.262+0000 7f2602284640 1 --2- 172.21.15.70:0/2264331790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc105ad0 0x7f25fc105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.262+0000 7f2602284640 1 -- 172.21.15.70:0/2264331790 >> 172.21.15.70:0/2264331790 conn(0x7f25fc077210 msgr2=0x7f25fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:08.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.262+0000 7f2602284640 1 -- 172.21.15.70:0/2264331790 shutdown_connections 2024-09-12T01:52:08.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.262+0000 7f2602284640 1 -- 172.21.15.70:0/2264331790 wait complete. 2024-09-12T01:52:08.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.263+0000 7f2602284640 1 Processor -- start 2024-09-12T01:52:08.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.263+0000 7f2602284640 1 -- start start 2024-09-12T01:52:08.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f2602284640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25fc101200 0x7f25fc1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:08.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f2602284640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc101ba0 0x7f25fc197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:08.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f2602284640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25fc105ad0 0x7f25fc19bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:08.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f2602284640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc111010 con 0x7f25fc101200 2024-09-12T01:52:08.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f2602284640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc110e90 con 0x7f25fc105ad0 2024-09-12T01:52:08.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f2602284640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc111190 con 0x7f25fc101ba0 2024-09-12T01:52:08.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f25fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25fc101200 0x7f25fc1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:08.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f25fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25fc101200 0x7f25fc1973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57258/0 (socket says 172.21.15.70:57258) 2024-09-12T01:52:08.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f25fbfff640 1 -- 172.21.15.70:0/3114214347 learned_addr learned my addr 172.21.15.70:0/3114214347 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:08.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f2600821640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25fc105ad0 0x7f25fc19bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:08.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f25fb7fe640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc101ba0 0x7f25fc197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:08.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f25fbfff640 1 -- 172.21.15.70:0/3114214347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc101ba0 msgr2=0x7f25fc197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:08.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f25fbfff640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc101ba0 0x7f25fc197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f25fbfff640 1 -- 172.21.15.70:0/3114214347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25fc105ad0 msgr2=0x7f25fc19bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:08.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f25fbfff640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25fc105ad0 0x7f25fc19bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f25fbfff640 1 -- 172.21.15.70:0/3114214347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25fc19c3a0 con 0x7f25fc101200 2024-09-12T01:52:08.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f2600821640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25fc105ad0 0x7f25fc19bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:08.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f25fbfff640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25fc101200 0x7f25fc1973f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00d770 tx=0x7f25ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:08.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.264+0000 7f25f97fa640 1 -- 172.21.15.70:0/3114214347 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec017070 con 0x7f25fc101200 2024-09-12T01:52:08.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.265+0000 7f2602284640 1 -- 172.21.15.70:0/3114214347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25fc19c690 con 0x7f25fc101200 2024-09-12T01:52:08.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.265+0000 7f25f97fa640 1 -- 172.21.15.70:0/3114214347 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25ec005520 con 0x7f25fc101200 2024-09-12T01:52:08.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.265+0000 7f25f97fa640 1 -- 172.21.15.70:0/3114214347 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec010460 con 0x7f25fc101200 2024-09-12T01:52:08.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.265+0000 7f2602284640 1 -- 172.21.15.70:0/3114214347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25fc1a3f70 con 0x7f25fc101200 2024-09-12T01:52:08.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.266+0000 7f2602284640 1 -- 172.21.15.70:0/3114214347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25fc102210 con 0x7f25fc101200 2024-09-12T01:52:08.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.267+0000 7f25f97fa640 1 -- 172.21.15.70:0/3114214347 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f25ec004ea0 con 0x7f25fc101200 2024-09-12T01:52:08.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.268+0000 7f25f97fa640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f25e40a2b80 0x7f25e40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:08.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.268+0000 7f25fb7fe640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f25e40a2b80 0x7f25e40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:08.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.268+0000 7f25f97fa640 1 -- 172.21.15.70:0/3114214347 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f25ec0ce9e0 con 0x7f25fc101200 2024-09-12T01:52:08.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.268+0000 7f25fb7fe640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f25e40a2b80 0x7f25e40a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009230 tx=0x7f25f00058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:08.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.272+0000 7f25f97fa640 1 -- 172.21.15.70:0/3114214347 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25ec09b2f0 con 0x7f25fc101200 2024-09-12T01:52:08.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.477+0000 7f2602284640 1 -- 172.21.15.70:0/3114214347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25fc1a4140 con 0x7f25fc101200 2024-09-12T01:52:08.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.478+0000 7f25f97fa640 1 -- 172.21.15.70:0/3114214347 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f25ec09f5f0 con 0x7f25fc101200 2024-09-12T01:52:08.478 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:52:08.479 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-12T01:51:51:564560+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:51:51.387340+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24427,24433,24437,24445,24452]},"id":1}]} 2024-09-12T01:52:08.479 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-12T01:52:08.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.480+0000 7f2602284640 1 -- 172.21.15.70:0/3114214347 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f25e40a2b80 msgr2=0x7f25e40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:08.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.480+0000 7f2602284640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f25e40a2b80 0x7f25e40a5040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009230 tx=0x7f25f00058d0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.480+0000 7f2602284640 1 -- 172.21.15.70:0/3114214347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25fc101200 msgr2=0x7f25fc1973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:08.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.480+0000 7f2602284640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25fc101200 0x7f25fc1973f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00d770 tx=0x7f25ec00dc30 comp rx=0 tx=0).stop 2024-09-12T01:52:08.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.480+0000 7f2602284640 1 -- 172.21.15.70:0/3114214347 shutdown_connections 2024-09-12T01:52:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.480+0000 7f2602284640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f25e40a2b80 0x7f25e40a5040 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.480+0000 7f2602284640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25fc105ad0 0x7f25fc19bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.480+0000 7f2602284640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc101ba0 0x7f25fc197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.480+0000 7f2602284640 1 --2- 172.21.15.70:0/3114214347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25fc101200 0x7f25fc1973f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.480+0000 7f2602284640 1 -- 172.21.15.70:0/3114214347 >> 172.21.15.70:0/3114214347 conn(0x7f25fc077210 msgr2=0x7f25fc1039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.480+0000 7f2602284640 1 -- 172.21.15.70:0/3114214347 shutdown_connections 2024-09-12T01:52:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:08.480+0000 7f2602284640 1 -- 172.21.15.70:0/3114214347 wait complete. 2024-09-12T01:52:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:08 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3114214347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:09.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:08 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3114214347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:09.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:08 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3114214347' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:09.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:52:09.699 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:10.118 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:10.118 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:10.119 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:10.119 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:09 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:10.119 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:09 smithi070 ceph-mon[31177]: pgmap v337: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:52:10.187 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:10.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:10.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:10.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:09 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:10.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:09 smithi191 ceph-mon[35770]: pgmap v337: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:52:10.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.198+0000 7f2759317640 1 -- 172.21.15.70:0/102323875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754100a80 msgr2=0x7f2754100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:10.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.198+0000 7f2759317640 1 --2- 172.21.15.70:0/102323875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754100a80 0x7f2754100ee0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2748009930 tx=0x7f274802a420 comp rx=0 tx=0).stop 2024-09-12T01:52:10.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.199+0000 7f2759317640 1 -- 172.21.15.70:0/102323875 shutdown_connections 2024-09-12T01:52:10.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.199+0000 7f2759317640 1 --2- 172.21.15.70:0/102323875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2754101420 0x7f275410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:10.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.199+0000 7f2759317640 1 --2- 172.21.15.70:0/102323875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754100a80 0x7f2754100ee0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:10.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.199+0000 7f2759317640 1 --2- 172.21.15.70:0/102323875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2754106a80 0x7f2754106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:10.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.199+0000 7f2759317640 1 -- 172.21.15.70:0/102323875 >> 172.21.15.70:0/102323875 conn(0x7f27540fc7a0 msgr2=0x7f27540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:10.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.199+0000 7f2759317640 1 -- 172.21.15.70:0/102323875 shutdown_connections 2024-09-12T01:52:10.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.199+0000 7f2759317640 1 -- 172.21.15.70:0/102323875 wait complete. 2024-09-12T01:52:10.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.199+0000 7f2759317640 1 Processor -- start 2024-09-12T01:52:10.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.199+0000 7f2759317640 1 -- start start 2024-09-12T01:52:10.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f2759317640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2754100a80 0x7f2754199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:10.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f2759317640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754101420 0x7f2754199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:10.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f2759317640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2754106a80 0x7f27541a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:10.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f2759317640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2754111000 con 0x7f2754101420 2024-09-12T01:52:10.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f2759317640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2754110e80 con 0x7f2754100a80 2024-09-12T01:52:10.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f2759317640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2754111180 con 0x7f2754106a80 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f27527fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754101420 0x7f2754199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f27527fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754101420 0x7f2754199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57268/0 (socket says 172.21.15.70:57268) 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f27527fc640 1 -- 172.21.15.70:0/2447108410 learned_addr learned my addr 172.21.15.70:0/2447108410 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f2752ffd640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2754100a80 0x7f2754199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f27537fe640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2754106a80 0x7f27541a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f27527fc640 1 -- 172.21.15.70:0/2447108410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2754106a80 msgr2=0x7f27541a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f27527fc640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2754106a80 0x7f27541a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f27527fc640 1 -- 172.21.15.70:0/2447108410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2754100a80 msgr2=0x7f2754199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f27527fc640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2754100a80 0x7f2754199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f27527fc640 1 -- 172.21.15.70:0/2447108410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27541a49f0 con 0x7f2754101420 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f2752ffd640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2754100a80 0x7f2754199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f27527fc640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754101420 0x7f2754199970 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2748009230 tx=0x7f2748004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f273bfff640 1 -- 172.21.15.70:0/2447108410 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274803f030 con 0x7f2754101420 2024-09-12T01:52:10.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f273bfff640 1 -- 172.21.15.70:0/2447108410 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2748003af0 con 0x7f2754101420 2024-09-12T01:52:10.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f2759317640 1 -- 172.21.15.70:0/2447108410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27541a4bc0 con 0x7f2754101420 2024-09-12T01:52:10.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f273bfff640 1 -- 172.21.15.70:0/2447108410 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748035070 con 0x7f2754101420 2024-09-12T01:52:10.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.200+0000 7f2759317640 1 -- 172.21.15.70:0/2447108410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27541a5010 con 0x7f2754101420 2024-09-12T01:52:10.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.202+0000 7f2759317640 1 -- 172.21.15.70:0/2447108410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2754100ee0 con 0x7f2754101420 2024-09-12T01:52:10.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.203+0000 7f273bfff640 1 -- 172.21.15.70:0/2447108410 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2748042030 con 0x7f2754101420 2024-09-12T01:52:10.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.204+0000 7f273bfff640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f273c0a2b80 0x7f273c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:10.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.204+0000 7f2752ffd640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f273c0a2b80 0x7f273c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:10.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.204+0000 7f273bfff640 1 -- 172.21.15.70:0/2447108410 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f27480efb80 con 0x7f2754101420 2024-09-12T01:52:10.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.204+0000 7f2752ffd640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f273c0a2b80 0x7f273c0a5040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2744009930 tx=0x7f2744008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:10.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.207+0000 7f273bfff640 1 -- 172.21.15.70:0/2447108410 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f27480bcba0 con 0x7f2754101420 2024-09-12T01:52:10.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:10.262 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:10.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:10.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:09 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:10.263 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:09 smithi152 ceph-mon[35055]: pgmap v337: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T01:52:10.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.390+0000 7f2759317640 1 -- 172.21.15.70:0/2447108410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27541a5320 con 0x7f2754101420 2024-09-12T01:52:10.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.392+0000 7f273bfff640 1 -- 172.21.15.70:0/2447108410 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22713 (secure 0 0 0) 0x7f27480bc4a0 con 0x7f2754101420 2024-09-12T01:52:10.392 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:52:10.392 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:50:22.600430+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:49:54.140097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:49:56.005187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:52:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.396+0000 7f2759317640 1 -- 172.21.15.70:0/2447108410 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f273c0a2b80 msgr2=0x7f273c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.396+0000 7f2759317640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f273c0a2b80 0x7f273c0a5040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2744009930 tx=0x7f2744008040 comp rx=0 tx=0).stop 2024-09-12T01:52:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.396+0000 7f2759317640 1 -- 172.21.15.70:0/2447108410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754101420 msgr2=0x7f2754199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.396+0000 7f2759317640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754101420 0x7f2754199970 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2748009230 tx=0x7f2748004270 comp rx=0 tx=0).stop 2024-09-12T01:52:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.396+0000 7f2759317640 1 -- 172.21.15.70:0/2447108410 shutdown_connections 2024-09-12T01:52:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.396+0000 7f2759317640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f273c0a2b80 0x7f273c0a5040 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.396+0000 7f2759317640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2754106a80 0x7f27541a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.396+0000 7f2759317640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754101420 0x7f2754199970 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.396+0000 7f2759317640 1 --2- 172.21.15.70:0/2447108410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2754100a80 0x7f2754199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:10.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.396+0000 7f2759317640 1 -- 172.21.15.70:0/2447108410 >> 172.21.15.70:0/2447108410 conn(0x7f27540fc7a0 msgr2=0x7f27540fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:10.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.396+0000 7f2759317640 1 -- 172.21.15.70:0/2447108410 shutdown_connections 2024-09-12T01:52:10.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:10.396+0000 7f2759317640 1 -- 172.21.15.70:0/2447108410 wait complete. 2024-09-12T01:52:10.999 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-12T01:52:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:11.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:11 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:11.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:11 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:11.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:11 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2447108410' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:52:11.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:11 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:11.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:11 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:11.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:11 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:11.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:11 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:11.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:11 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:11.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:11 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2447108410' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:52:11.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:11 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:11.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:11 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:11.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:11 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:11.746 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.745+0000 7fea1f511640 1 -- 172.21.15.70:0/3770318163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea18102630 msgr2=0x7fea18104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:11.746 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.745+0000 7fea1f511640 1 --2- 172.21.15.70:0/3770318163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea18102630 0x7fea18104a20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fea10009900 tx=0x7fea1002a410 comp rx=0 tx=0).stop 2024-09-12T01:52:11.746 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 -- 172.21.15.70:0/3770318163 shutdown_connections 2024-09-12T01:52:11.746 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 --2- 172.21.15.70:0/3770318163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea18107890 0x7fea18109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.746 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 --2- 172.21.15.70:0/3770318163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea18104f60 0x7fea18107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.746 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 --2- 172.21.15.70:0/3770318163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea18102630 0x7fea18104a20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.747 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 -- 172.21.15.70:0/3770318163 >> 172.21.15.70:0/3770318163 conn(0x7fea180fc1b0 msgr2=0x7fea180fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:11.747 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 -- 172.21.15.70:0/3770318163 shutdown_connections 2024-09-12T01:52:11.747 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 -- 172.21.15.70:0/3770318163 wait complete. 2024-09-12T01:52:11.747 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 Processor -- start 2024-09-12T01:52:11.747 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 -- start start 2024-09-12T01:52:11.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea18102630 0x7fea18197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea18104f60 0x7fea18198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea18107890 0x7fea1819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea1810d940 con 0x7fea18107890 2024-09-12T01:52:11.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fea1810d7c0 con 0x7fea18102630 2024-09-12T01:52:11.749 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1f511640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fea1810dac0 con 0x7fea18104f60 2024-09-12T01:52:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.746+0000 7fea1daae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea18107890 0x7fea1819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1daae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea18107890 0x7fea1819f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38874/0 (socket says 172.21.15.70:38874) 2024-09-12T01:52:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1daae640 1 -- 172.21.15.70:0/2714713413 learned_addr learned my addr 172.21.15.70:0/2714713413 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1caac640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea18104f60 0x7fea18198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1d2ad640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea18102630 0x7fea18197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1daae640 1 -- 172.21.15.70:0/2714713413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea18104f60 msgr2=0x7fea18198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1daae640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea18104f60 0x7fea18198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1daae640 1 -- 172.21.15.70:0/2714713413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea18102630 msgr2=0x7fea18197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:11.750 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1daae640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea18102630 0x7fea18197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1daae640 1 -- 172.21.15.70:0/2714713413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1819faf0 con 0x7fea18107890 2024-09-12T01:52:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1d2ad640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea18102630 0x7fea18197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1daae640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea18107890 0x7fea1819f480 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fea0800cab0 tx=0x7fea0800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea167fc640 1 -- 172.21.15.70:0/2714713413 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0800ad60 con 0x7fea18107890 2024-09-12T01:52:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea167fc640 1 -- 172.21.15.70:0/2714713413 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea0800f950 con 0x7fea18107890 2024-09-12T01:52:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea167fc640 1 -- 172.21.15.70:0/2714713413 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea08018aa0 con 0x7fea18107890 2024-09-12T01:52:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1f511640 1 -- 172.21.15.70:0/2714713413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1819fde0 con 0x7fea18107890 2024-09-12T01:52:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.747+0000 7fea1f511640 1 -- 172.21.15.70:0/2714713413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea181a02a0 con 0x7fea18107890 2024-09-12T01:52:11.751 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.749+0000 7fea167fc640 1 -- 172.21.15.70:0/2714713413 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fea0800fb00 con 0x7fea18107890 2024-09-12T01:52:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea222a6740 1 Processor -- start 2024-09-12T01:52:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea222a6740 1 -- start start 2024-09-12T01:52:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea222a6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b61f9a0 0x55dc5b61fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea222a6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 0x55dc5b624da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea222a6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 0x55dc5b627830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea222a6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dc5b5832f0 con 0x55dc5b625370 2024-09-12T01:52:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea222a6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dc5b52b270 con 0x55dc5b61f9a0 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea222a6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dc5b57f2b0 con 0x55dc5b6202e0 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea1caac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 0x55dc5b627830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea1caac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 0x55dc5b627830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38888/0 (socket says 172.21.15.70:38888) 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea1caac640 1 -- 172.21.15.70:0/835383106 learned_addr learned my addr 172.21.15.70:0/835383106 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea167fc640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fea000a2cb0 0x7fea000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea1caac640 1 --2- 172.21.15.70:0/835383106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b61f9a0 0x55dc5b61fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.750+0000 7fea1d2ad640 1 --2- 172.21.15.70:0/835383106 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 0x55dc5b624da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.751+0000 7fea1caac640 1 -- 172.21.15.70:0/835383106 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 msgr2=0x55dc5b624da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.751+0000 7fea1caac640 1 --2- 172.21.15.70:0/835383106 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 0x55dc5b624da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.751+0000 7fea1caac640 1 -- 172.21.15.70:0/835383106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b61f9a0 msgr2=0x55dc5b61fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.751+0000 7fea1caac640 1 --2- 172.21.15.70:0/835383106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b61f9a0 0x55dc5b61fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.751+0000 7fea167fc640 1 -- 172.21.15.70:0/2714713413 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fea080cf6b0 con 0x7fea18107890 2024-09-12T01:52:11.758 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.751+0000 7fea1caac640 1 -- 172.21.15.70:0/835383106 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc5b52a340 con 0x55dc5b625370 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.751+0000 7fea1caac640 1 --2- 172.21.15.70:0/835383106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 0x55dc5b627830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00afd0 tx=0x7fea0c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff60e6e668482f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.751+0000 7fea1daae640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fea000a2cb0 0x7fea000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.751+0000 7fe9ff7fe640 1 -- 172.21.15.70:0/835383106 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c005220 con 0x55dc5b625370 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.751+0000 7fe9ff7fe640 1 -- 172.21.15.70:0/835383106 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea0c004ca0 con 0x55dc5b625370 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.751+0000 7fe9ff7fe640 1 -- 172.21.15.70:0/835383106 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00fce0 con 0x55dc5b625370 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.752+0000 7fea222a6740 1 -- 172.21.15.70:0/835383106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 msgr2=0x55dc5b627830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.752+0000 7fea1daae640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fea000a2cb0 0x7fea000a5170 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fea08005c10 tx=0x7fea08004a40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.752+0000 7fea222a6740 1 --2- 172.21.15.70:0/835383106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 0x55dc5b627830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00afd0 tx=0x7fea0c00a7d0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.752+0000 7fea222a6740 1 -- 172.21.15.70:0/835383106 shutdown_connections 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.752+0000 7fea222a6740 1 --2- 172.21.15.70:0/835383106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 0x55dc5b627830 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.752+0000 7fea222a6740 1 --2- 172.21.15.70:0/835383106 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 0x55dc5b624da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.752+0000 7fea222a6740 1 --2- 172.21.15.70:0/835383106 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b61f9a0 0x55dc5b61fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.759 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.752+0000 7fea222a6740 1 -- 172.21.15.70:0/835383106 >> 172.21.15.70:0/835383106 conn(0x55dc5b61b010 msgr2=0x55dc5b61b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.752+0000 7fea222a6740 1 -- 172.21.15.70:0/835383106 shutdown_connections 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.752+0000 7fea222a6740 1 -- 172.21.15.70:0/835383106 wait complete. 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.752+0000 7fea222a6740 1 -- start start 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.752+0000 7fea222a6740 1 Processor -- start 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea222a6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 0x55dc5b629c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea222a6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b6202e0 0x55dc5b62a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea222a6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b625370 0x55dc5b631180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea222a6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dc5b628340 con 0x55dc5b61f9a0 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea222a6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dc5b50c290 con 0x55dc5b6202e0 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea222a6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dc5b6284c0 con 0x55dc5b625370 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea222a6740 10 client.0 _ll_register_callbacks cb 0x55dc5b53d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea1caac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 0x55dc5b629c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea1caac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 0x55dc5b629c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38892/0 (socket says 172.21.15.70:38892) 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea1caac640 1 -- 172.21.15.70:0/1500235587 learned_addr learned my addr 172.21.15.70:0/1500235587 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea1caac640 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b625370 0x55dc5b631180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea1d2ad640 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b6202e0 0x55dc5b62a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea1caac640 1 -- 172.21.15.70:0/1500235587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b625370 msgr2=0x55dc5b631180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea1caac640 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b625370 0x55dc5b631180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea1caac640 1 -- 172.21.15.70:0/1500235587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b6202e0 msgr2=0x55dc5b62a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea1caac640 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b6202e0 0x55dc5b62a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea1caac640 1 -- 172.21.15.70:0/1500235587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc5b296210 con 0x55dc5b61f9a0 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea1caac640 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 0x55dc5b629c00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00a3f0 tx=0x7fea0c00a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf322faa12e92a29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fe9fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fe9fcff9640 1 -- 172.21.15.70:0/1500235587 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00fea0 con 0x55dc5b61f9a0 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea222a6740 1 -- 172.21.15.70:0/1500235587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea0c004ca0 con 0x55dc5b61f9a0 2024-09-12T01:52:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fe9fcff9640 1 -- 172.21.15.70:0/1500235587 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fea0c005220 con 0x55dc5b61f9a0 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fe9fcff9640 1 -- 172.21.15.70:0/1500235587 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fea0c005420 con 0x55dc5b61f9a0 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.753+0000 7fea222a6740 10 client.15417 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.754+0000 7fea222a6740 1 -- 172.21.15.70:0/1500235587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dc5b362620 con 0x55dc5b61f9a0 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.754+0000 7fe9fcff9640 1 -- 172.21.15.70:0/1500235587 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea0c004ca0 con 0x55dc5b61f9a0 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.754+0000 7fe9fcff9640 1 -- 172.21.15.70:0/1500235587 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fea0c01b070 con 0x55dc5b61f9a0 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.754+0000 7fea222a6740 10 client.15417 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.754+0000 7fea222a6740 10 client.15417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.754+0000 7fea222a6740 20 client.15417 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.754+0000 7fea222a6740 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dc5b635630 0x55dc5b637a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.754+0000 7fea222a6740 4 client.15417 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.754+0000 7fea222a6740 1 -- 172.21.15.70:0/1500235587 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc5b590a20 con 0x55dc5b635630 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.754+0000 7fea1d2ad640 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dc5b635630 0x55dc5b637a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.755+0000 7fe9fcff9640 10 client.15417 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.755+0000 7fea1d2ad640 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dc5b635630 0x55dc5b637a20 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e453522d23268459 server_cookie=3085ed3d8f1dc159 in_seq=0 out_seq=0 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.755+0000 7fe9fcff9640 1 -- 172.21.15.70:0/1500235587 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc5b590a20 con 0x55dc5b635630 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.755+0000 7fe9fcff9640 10 client.15417 handle_command_reply: tid=0 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.755+0000 7fea222a6740 1 client.15417 shutdown 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.755+0000 7fea222a6740 1 -- 172.21.15.70:0/1500235587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 msgr2=0x55dc5b629c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.755+0000 7fea222a6740 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 0x55dc5b629c00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00a3f0 tx=0x7fea0c00a380 comp rx=0 tx=0).stop 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.756+0000 7fea222a6740 1 -- 172.21.15.70:0/1500235587 shutdown_connections 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.756+0000 7fea222a6740 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dc5b635630 0x55dc5b637a20 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.756+0000 7fea222a6740 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b625370 0x55dc5b631180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.756+0000 7fea222a6740 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b6202e0 0x55dc5b62a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.756+0000 7fe9fcff9640 0 client.15417 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.756+0000 7fea222a6740 1 --2- 172.21.15.70:0/1500235587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 0x55dc5b629c00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.756+0000 7fea222a6740 1 -- 172.21.15.70:0/1500235587 >> 172.21.15.70:0/1500235587 conn(0x55dc5b61b010 msgr2=0x55dc5b61c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.756+0000 7fea222a6740 1 -- 172.21.15.70:0/1500235587 shutdown_connections 2024-09-12T01:52:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.756+0000 7fea222a6740 1 -- 172.21.15.70:0/1500235587 wait complete. 2024-09-12T01:52:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.756+0000 7fea222a6740 20 client.15417 trim_cache size 0 max 16384 2024-09-12T01:52:11.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:11 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:11.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:11 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:11.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:11 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2447108410' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:52:11.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:11 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:11.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:11 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:11.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:11 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:52:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea222a6740 1 Processor -- start 2024-09-12T01:52:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea222a6740 1 -- start start 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea222a6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 0x55dc5b62a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea222a6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 0x55dc5b6310a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea222a6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b625370 0x55dc5b61a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea222a6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea181a9100 con 0x55dc5b61f9a0 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea222a6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fea181aac40 con 0x55dc5b625370 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea222a6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fea181a97d0 con 0x55dc5b6202e0 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea1caac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 0x55dc5b62a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea1caac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 0x55dc5b62a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38906/0 (socket says 172.21.15.70:38906) 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea1caac640 1 -- 172.21.15.70:0/1084726837 learned_addr learned my addr 172.21.15.70:0/1084726837 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea1d2ad640 1 --2- 172.21.15.70:0/1084726837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 0x55dc5b6310a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea1caac640 1 -- 172.21.15.70:0/1084726837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 msgr2=0x55dc5b6310a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea1caac640 1 --2- 172.21.15.70:0/1084726837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 0x55dc5b6310a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea1caac640 1 -- 172.21.15.70:0/1084726837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b625370 msgr2=0x55dc5b61a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.770+0000 7fea1caac640 1 --2- 172.21.15.70:0/1084726837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b625370 0x55dc5b61a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.771+0000 7fea1caac640 1 -- 172.21.15.70:0/1084726837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc5b6207c0 con 0x55dc5b61f9a0 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.771+0000 7fea1caac640 1 --2- 172.21.15.70:0/1084726837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 0x55dc5b62a1d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fea0c029ef0 tx=0x7fea0c005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4859a1c8c9e798 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.771+0000 7fe9feffd640 1 -- 172.21.15.70:0/1084726837 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c038070 con 0x55dc5b61f9a0 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.771+0000 7fe9feffd640 1 -- 172.21.15.70:0/1084726837 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea0c020070 con 0x55dc5b61f9a0 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.771+0000 7fe9feffd640 1 -- 172.21.15.70:0/1084726837 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c005280 con 0x55dc5b61f9a0 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.771+0000 7fea222a6740 1 -- 172.21.15.70:0/1084726837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 msgr2=0x55dc5b62a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.771+0000 7fea222a6740 1 --2- 172.21.15.70:0/1084726837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 0x55dc5b62a1d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fea0c029ef0 tx=0x7fea0c005ec0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.771+0000 7fea222a6740 1 -- 172.21.15.70:0/1084726837 shutdown_connections 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.771+0000 7fea222a6740 1 --2- 172.21.15.70:0/1084726837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b625370 0x55dc5b61a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.771+0000 7fea222a6740 1 --2- 172.21.15.70:0/1084726837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 0x55dc5b6310a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.771+0000 7fea222a6740 1 --2- 172.21.15.70:0/1084726837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b61f9a0 0x55dc5b62a1d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.771+0000 7fea222a6740 1 -- 172.21.15.70:0/1084726837 >> 172.21.15.70:0/1084726837 conn(0x55dc5b61b010 msgr2=0x55dc5b61bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea222a6740 1 -- 172.21.15.70:0/1084726837 shutdown_connections 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea222a6740 1 -- 172.21.15.70:0/1084726837 wait complete. 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea222a6740 1 -- start start 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea222a6740 1 Processor -- start 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea222a6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b61f9a0 0x55dc5b62e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea222a6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 0x55dc5b62edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea222a6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 0x55dc5b62fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea222a6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea181aa570 con 0x55dc5b625370 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea222a6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fea181a9ea0 con 0x55dc5b61f9a0 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea222a6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fea181a70c0 con 0x55dc5b6202e0 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea222a6740 10 client.0 _ll_register_callbacks cb 0x7fea0c011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea1caac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 0x55dc5b62fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea1caac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 0x55dc5b62fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38916/0 (socket says 172.21.15.70:38916) 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.772+0000 7fea1caac640 1 -- 172.21.15.70:0/782835949 learned_addr learned my addr 172.21.15.70:0/782835949 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea1caac640 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b61f9a0 0x55dc5b62e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea1d2ad640 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 0x55dc5b62edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea1caac640 1 -- 172.21.15.70:0/782835949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 msgr2=0x55dc5b62edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea1caac640 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 0x55dc5b62edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea1caac640 1 -- 172.21.15.70:0/782835949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b61f9a0 msgr2=0x55dc5b62e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea1caac640 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b61f9a0 0x55dc5b62e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea1caac640 1 -- 172.21.15.70:0/782835949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc5b6303f0 con 0x55dc5b625370 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea1caac640 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 0x55dc5b62fde0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fea0c01c490 tx=0x7fea0c00afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a16953fd8e7a362 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fe9fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fe9fcff9640 1 -- 172.21.15.70:0/782835949 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c038030 con 0x55dc5b625370 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fe9fcff9640 1 -- 172.21.15.70:0/782835949 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fea0c00a630 con 0x55dc5b625370 2024-09-12T01:52:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea222a6740 1 -- 172.21.15.70:0/782835949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea0c020070 con 0x55dc5b625370 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fe9fcff9640 1 -- 172.21.15.70:0/782835949 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fea0c004f50 con 0x55dc5b625370 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea222a6740 10 client.15423 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea222a6740 1 -- 172.21.15.70:0/782835949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dc5b6a0420 con 0x55dc5b625370 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fe9fcff9640 1 -- 172.21.15.70:0/782835949 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea0c020070 con 0x55dc5b625370 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fe9fcff9640 1 -- 172.21.15.70:0/782835949 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fea0c01b040 con 0x55dc5b625370 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea222a6740 10 client.15423 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea222a6740 10 client.15423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea222a6740 20 client.15423 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea222a6740 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dc5b6a0cb0 0x55dc5b6a30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea222a6740 4 client.15423 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.773+0000 7fea222a6740 1 -- 172.21.15.70:0/782835949 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dc5b58ad70 con 0x55dc5b6a0cb0 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.774+0000 7fea1d2ad640 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dc5b6a0cb0 0x55dc5b6a30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.774+0000 7fe9fcff9640 10 client.15423 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.774+0000 7fea1d2ad640 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dc5b6a0cb0 0x55dc5b6a30d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=647a3be517fd2e81 server_cookie=943aae8ce04abdc in_seq=0 out_seq=0 2024-09-12T01:52:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.785+0000 7fe9fcff9640 1 -- 172.21.15.70:0/782835949 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dc5b58ad70 con 0x55dc5b6a0cb0 2024-09-12T01:52:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.785+0000 7fe9fcff9640 10 client.15423 handle_command_reply: tid=0 2024-09-12T01:52:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.785+0000 7fea222a6740 1 client.15423 shutdown 2024-09-12T01:52:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.785+0000 7fea222a6740 1 -- 172.21.15.70:0/782835949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 msgr2=0x55dc5b62fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.785+0000 7fea222a6740 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 0x55dc5b62fde0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fea0c01c490 tx=0x7fea0c00afd0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.785+0000 7fea222a6740 1 -- 172.21.15.70:0/782835949 shutdown_connections 2024-09-12T01:52:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.785+0000 7fea222a6740 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dc5b6a0cb0 0x55dc5b6a30d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.785+0000 7fea222a6740 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc5b625370 0x55dc5b62fde0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.785+0000 7fea222a6740 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc5b6202e0 0x55dc5b62edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.785+0000 7fea222a6740 1 --2- 172.21.15.70:0/782835949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc5b61f9a0 0x55dc5b62e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.785+0000 7fe9fcff9640 0 client.15423 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.785+0000 7fea222a6740 1 -- 172.21.15.70:0/782835949 >> 172.21.15.70:0/782835949 conn(0x55dc5b61b010 msgr2=0x55dc5b61c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea222a6740 1 -- 172.21.15.70:0/782835949 shutdown_connections 2024-09-12T01:52:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea222a6740 1 -- 172.21.15.70:0/782835949 wait complete. 2024-09-12T01:52:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea222a6740 20 client.15423 trim_cache size 0 max 16384 2024-09-12T01:52:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:52:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:52:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:52:11.787 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:52:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea1f511640 1 -- 172.21.15.70:0/2714713413 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fea000a2cb0 msgr2=0x7fea000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea1f511640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fea000a2cb0 0x7fea000a5170 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fea08005c10 tx=0x7fea08004a40 comp rx=0 tx=0).stop 2024-09-12T01:52:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea1f511640 1 -- 172.21.15.70:0/2714713413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea18107890 msgr2=0x7fea1819f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea1f511640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea18107890 0x7fea1819f480 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fea0800cab0 tx=0x7fea0800ceb0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea1f511640 1 -- 172.21.15.70:0/2714713413 shutdown_connections 2024-09-12T01:52:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea1f511640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fea000a2cb0 0x7fea000a5170 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea1f511640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea18107890 0x7fea1819f480 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea1f511640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea18104f60 0x7fea18198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea1f511640 1 --2- 172.21.15.70:0/2714713413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea18102630 0x7fea18197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea1f511640 1 -- 172.21.15.70:0/2714713413 >> 172.21.15.70:0/2714713413 conn(0x7fea180fc1b0 msgr2=0x7fea18102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea1f511640 1 -- 172.21.15.70:0/2714713413 shutdown_connections 2024-09-12T01:52:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:11.786+0000 7fea1f511640 1 -- 172.21.15.70:0/2714713413 wait complete. 2024-09-12T01:52:12.348 INFO:teuthology.orchestra.run.smithi070.stdout:{"run_dir":"/var/run/ceph"} 2024-09-12T01:52:12.348 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-12T01:52:12.348 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 481 2024-09-12T01:52:12.349 DEBUG:tasks.quiescer:Yielding 2024-09-12T01:52:12.349 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:52:12.366 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T01:52:12.366 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:52:12.366 INFO:tasks.workunit:timeout=3h 2024-09-12T01:52:12.366 INFO:tasks.workunit:cleanup=True 2024-09-12T01:52:12.367 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:52:12.367 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:52:12.384 INFO:teuthology.orchestra.run.smithi070.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T01:52:12.384 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T01:52:12.384 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-12T01:52:12.385 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:52:12.385 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T01:52:12.385 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-12 01:50:15.509538295 +0000 2024-09-12T01:52:12.385 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-12 01:50:15.509538295 +0000 2024-09-12T01:52:12.385 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-12 01:51:50.708871788 +0000 2024-09-12T01:52:12.385 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-12 01:50:15.509538295 +0000 2024-09-12T01:52:12.385 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:52:12.385 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T01:52:12.458 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T01:52:12.514 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:52:12.621 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:12.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:12 smithi191 ceph-mon[35770]: pgmap v338: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:52:12.742 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:12 smithi070 ceph-mon[31177]: pgmap v338: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:52:12.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:12 smithi152 ceph-mon[35055]: pgmap v338: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:52:13.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.123+0000 7f486c758640 1 -- 172.21.15.70:0/1457170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48641082a0 msgr2=0x7f486410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.123+0000 7f486c758640 1 --2- 172.21.15.70:0/1457170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48641082a0 0x7f486410ec40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f485c009930 tx=0x7f485c02a440 comp rx=0 tx=0).stop 2024-09-12T01:52:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.123+0000 7f486c758640 1 -- 172.21.15.70:0/1457170 shutdown_connections 2024-09-12T01:52:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.123+0000 7f486c758640 1 --2- 172.21.15.70:0/1457170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48641082a0 0x7f486410ec40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.123+0000 7f486c758640 1 --2- 172.21.15.70:0/1457170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48641036e0 0x7f4864107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.123+0000 7f486c758640 1 --2- 172.21.15.70:0/1457170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4864102d30 0x7f4864103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.123+0000 7f486c758640 1 -- 172.21.15.70:0/1457170 >> 172.21.15.70:0/1457170 conn(0x7f48640fc7d0 msgr2=0x7f48640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.123+0000 7f486c758640 1 -- 172.21.15.70:0/1457170 shutdown_connections 2024-09-12T01:52:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.123+0000 7f486c758640 1 -- 172.21.15.70:0/1457170 wait complete. 2024-09-12T01:52:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.124+0000 7f486c758640 1 Processor -- start 2024-09-12T01:52:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.124+0000 7f486c758640 1 -- start start 2024-09-12T01:52:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.124+0000 7f486c758640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4864102d30 0x7f4864198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.124+0000 7f486c758640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48641036e0 0x7f4864198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.124+0000 7f486c758640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48641082a0 0x7f486419cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.124+0000 7f486c758640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4864112220 con 0x7f48641036e0 2024-09-12T01:52:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.124+0000 7f486c758640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f48641120a0 con 0x7f48641082a0 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.124+0000 7f486c758640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f48641123a0 con 0x7f4864102d30 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.124+0000 7f4869cf3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48641036e0 0x7f4864198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f4869cf3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48641036e0 0x7f4864198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38930/0 (socket says 172.21.15.70:38930) 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f4869cf3640 1 -- 172.21.15.70:0/1924429454 learned_addr learned my addr 172.21.15.70:0/1924429454 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f486a4f4640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4864102d30 0x7f4864198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f486acf5640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48641082a0 0x7f486419cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f4869cf3640 1 -- 172.21.15.70:0/1924429454 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4864102d30 msgr2=0x7f4864198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f4869cf3640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4864102d30 0x7f4864198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f4869cf3640 1 -- 172.21.15.70:0/1924429454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48641082a0 msgr2=0x7f486419cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f4869cf3640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48641082a0 0x7f486419cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f4869cf3640 1 -- 172.21.15.70:0/1924429454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486419d630 con 0x7f48641036e0 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f486acf5640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48641082a0 0x7f486419cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f4869cf3640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48641036e0 0x7f4864198bc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4854006fd0 tx=0x7f485400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f485b7fe640 1 -- 172.21.15.70:0/1924429454 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854011830 con 0x7f48641036e0 2024-09-12T01:52:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f485b7fe640 1 -- 172.21.15.70:0/1924429454 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4854016070 con 0x7f48641036e0 2024-09-12T01:52:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f486c758640 1 -- 172.21.15.70:0/1924429454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486419d920 con 0x7f48641036e0 2024-09-12T01:52:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f485b7fe640 1 -- 172.21.15.70:0/1924429454 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485400f2e0 con 0x7f48641036e0 2024-09-12T01:52:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.125+0000 7f486c758640 1 -- 172.21.15.70:0/1924429454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48641a5200 con 0x7f48641036e0 2024-09-12T01:52:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.127+0000 7f486c758640 1 -- 172.21.15.70:0/1924429454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4864103110 con 0x7f48641036e0 2024-09-12T01:52:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.128+0000 7f485b7fe640 1 -- 172.21.15.70:0/1924429454 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f48540119d0 con 0x7f48641036e0 2024-09-12T01:52:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.129+0000 7f485b7fe640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f48500a2c00 0x7f48500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.129+0000 7f486a4f4640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f48500a2c00 0x7f48500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.129+0000 7f485b7fe640 1 -- 172.21.15.70:0/1924429454 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f48540cecb0 con 0x7f48641036e0 2024-09-12T01:52:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.130+0000 7f486a4f4640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f48500a2c00 0x7f48500a50c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4860005fd0 tx=0x7f4860009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.133+0000 7f485b7fe640 1 -- 172.21.15.70:0/1924429454 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f485409bc10 con 0x7f48641036e0 2024-09-12T01:52:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.341+0000 7f486c758640 1 -- 172.21.15.70:0/1924429454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48641999e0 con 0x7f48641036e0 2024-09-12T01:52:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.342+0000 7f485b7fe640 1 -- 172.21.15.70:0/1924429454 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f48641999e0 con 0x7f48641036e0 2024-09-12T01:52:13.342 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:52:13.342 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-12T01:51:51:564560+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:51:51.387340+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24427,24433,24437,24445,24452]},"id":1}]} 2024-09-12T01:52:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-12T01:52:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.344+0000 7f486c758640 1 -- 172.21.15.70:0/1924429454 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f48500a2c00 msgr2=0x7f48500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.344+0000 7f486c758640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f48500a2c00 0x7f48500a50c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4860005fd0 tx=0x7f4860009500 comp rx=0 tx=0).stop 2024-09-12T01:52:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.344+0000 7f486c758640 1 -- 172.21.15.70:0/1924429454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48641036e0 msgr2=0x7f4864198bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.344+0000 7f486c758640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48641036e0 0x7f4864198bc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4854006fd0 tx=0x7f485400b8e0 comp rx=0 tx=0).stop 2024-09-12T01:52:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.344+0000 7f486c758640 1 -- 172.21.15.70:0/1924429454 shutdown_connections 2024-09-12T01:52:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.344+0000 7f486c758640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f48500a2c00 0x7f48500a50c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.344+0000 7f486c758640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48641082a0 0x7f486419cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.344+0000 7f486c758640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48641036e0 0x7f4864198bc0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.344+0000 7f486c758640 1 --2- 172.21.15.70:0/1924429454 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4864102d30 0x7f4864198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.344+0000 7f486c758640 1 -- 172.21.15.70:0/1924429454 >> 172.21.15.70:0/1924429454 conn(0x7f48640fc7d0 msgr2=0x7f48640fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.344+0000 7f486c758640 1 -- 172.21.15.70:0/1924429454 shutdown_connections 2024-09-12T01:52:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:13.345+0000 7f486c758640 1 -- 172.21.15.70:0/1924429454 wait complete. 2024-09-12T01:52:13.663 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:13 smithi070 ceph-mon[31177]: scrub summary: idle 2024-09-12T01:52:13.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:13 smithi191 ceph-mon[35770]: scrub summary: idle 2024-09-12T01:52:13.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:13 smithi152 ceph-mon[35055]: scrub summary: idle 2024-09-12T01:52:13.966 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T01:49:57.864263+0000', 'modified': '2024-09-12T01:51:51.387340+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24452, 'mds_1': 24445, 'mds_2': 24437, 'mds_3': 24433, 'mds_4': 24427}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14637': {'gid': 14637, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6839/3076923681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 3076923681}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 3076923681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14649': {'gid': 14649, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6841/3509291516', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6840', 'nonce': 3509291516}, {'type': 'v1', 'addr': '172.21.15.70:6841', 'nonce': 3509291516}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24392': {'gid': 24392, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6833/2100585386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 2100585386}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 2100585386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6833/1019939610', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 1019939610}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 1019939610}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.152:6835/2743921312', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 2743921312}, {'type': 'v1', 'addr': '172.21.15.152:6835', 'nonce': 2743921312}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24427': {'gid': 24427, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.191:6835/97556731', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 97556731}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 97556731}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24433': {'gid': 24433, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.191:6837/1473295002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 1473295002}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 1473295002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.152:6837/3978171312', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6836', 'nonce': 3978171312}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 3978171312}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.191:6839/1679121869', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 1679121869}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 1679121869}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24452': {'gid': 24452, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.152:6839/3057936512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6838', 'nonce': 3057936512}, {'type': 'v1', 'addr': '172.21.15.152:6839', 'nonce': 3057936512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24452, 'qdb_cluster': [24427, 24433, 24437, 24445, 24452]} 2024-09-12T01:52:13.966 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T01:52:13.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-12T01:52:14.249 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:14.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:14 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1924429454' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:14.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:14 smithi070 ceph-mon[31177]: pgmap v339: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T01:52:14.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:14 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1924429454' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:14.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:14 smithi191 ceph-mon[35770]: pgmap v339: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T01:52:14.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.706+0000 7f86b99c2640 1 -- 172.21.15.70:0/1645289479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b4106a80 msgr2=0x7f86b4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:14.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.706+0000 7f86b99c2640 1 --2- 172.21.15.70:0/1645289479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b4106a80 0x7f86b4106e60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009930 tx=0x7f86a402a420 comp rx=0 tx=0).stop 2024-09-12T01:52:14.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.706+0000 7f86b99c2640 1 -- 172.21.15.70:0/1645289479 shutdown_connections 2024-09-12T01:52:14.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.706+0000 7f86b99c2640 1 --2- 172.21.15.70:0/1645289479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b4101420 0x7f86b410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.706+0000 7f86b99c2640 1 --2- 172.21.15.70:0/1645289479 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86b4100a80 0x7f86b4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.706+0000 7f86b99c2640 1 --2- 172.21.15.70:0/1645289479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b4106a80 0x7f86b4106e60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.706+0000 7f86b99c2640 1 -- 172.21.15.70:0/1645289479 >> 172.21.15.70:0/1645289479 conn(0x7f86b40fc7a0 msgr2=0x7f86b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:14.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.706+0000 7f86b99c2640 1 -- 172.21.15.70:0/1645289479 shutdown_connections 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.706+0000 7f86b99c2640 1 -- 172.21.15.70:0/1645289479 wait complete. 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.706+0000 7f86b99c2640 1 Processor -- start 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.706+0000 7f86b99c2640 1 -- start start 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b99c2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b4100a80 0x7f86b4197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b99c2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86b4101420 0x7f86b4197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b99c2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b4106a80 0x7f86b4197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b99c2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4111000 con 0x7f86b4100a80 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b99c2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4110e80 con 0x7f86b4106a80 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b99c2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4111180 con 0x7f86b4101420 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b4100a80 0x7f86b4197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b4100a80 0x7f86b4197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38940/0 (socket says 172.21.15.70:38940) 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b2ffd640 1 -- 172.21.15.70:0/3452301134 learned_addr learned my addr 172.21.15.70:0/3452301134 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:14.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b37fe640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b4106a80 0x7f86b4197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b2ffd640 1 -- 172.21.15.70:0/3452301134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86b4101420 msgr2=0x7f86b4197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b27fc640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86b4101420 0x7f86b4197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86b4101420 0x7f86b4197740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b2ffd640 1 -- 172.21.15.70:0/3452301134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b4106a80 msgr2=0x7f86b4197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b4106a80 0x7f86b4197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b2ffd640 1 -- 172.21.15.70:0/3452301134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b41a6a70 con 0x7f86b4100a80 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b4100a80 0x7f86b4197200 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009230 tx=0x7f86a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b89c0640 1 -- 172.21.15.70:0/3452301134 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a403f030 con 0x7f86b4100a80 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b99c2640 1 -- 172.21.15.70:0/3452301134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b41a6d00 con 0x7f86b4100a80 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b89c0640 1 -- 172.21.15.70:0/3452301134 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86a4003af0 con 0x7f86b4100a80 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.707+0000 7f86b89c0640 1 -- 172.21.15.70:0/3452301134 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4035070 con 0x7f86b4100a80 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.708+0000 7f86b99c2640 1 -- 172.21.15.70:0/3452301134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b41a71d0 con 0x7f86b4100a80 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.710+0000 7f86b89c0640 1 -- 172.21.15.70:0/3452301134 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f86a4042030 con 0x7f86b4100a80 2024-09-12T01:52:14.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.710+0000 7f86bbd9b740 1 Processor -- start 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.710+0000 7f86bbd9b740 1 -- start start 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86bbd9b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f0359d0 0x55773f035db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86bbd9b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f040670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86bbd9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f040bb0 0x55773f042fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86bbd9b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55773ef9c090 con 0x55773f0359d0 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86bbd9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55773ef43a70 con 0x55773f040bb0 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86bbd9b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55773ef98050 con 0x55773f0362f0 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f0359d0 0x55773f035db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f0359d0 0x55773f035db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38948/0 (socket says 172.21.15.70:38948) 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b37fe640 1 -- 172.21.15.70:0/3405136711 learned_addr learned my addr 172.21.15.70:0/3405136711 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b27fc640 1 --2- 172.21.15.70:0/3405136711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f040bb0 0x55773f042fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b89c0640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f869c0a2b80 0x7f869c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/3405136711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f040670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b37fe640 1 -- 172.21.15.70:0/3405136711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 msgr2=0x55773f040670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b89c0640 1 -- 172.21.15.70:0/3452301134 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f86a40ef960 con 0x7f86b4100a80 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b37fe640 1 --2- 172.21.15.70:0/3405136711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f040670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b37fe640 1 -- 172.21.15.70:0/3405136711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f040bb0 msgr2=0x55773f042fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b37fe640 1 --2- 172.21.15.70:0/3405136711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f040bb0 0x55773f042fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b37fe640 1 -- 172.21.15.70:0/3405136711 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55773ef50130 con 0x55773f0359d0 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/3405136711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f040670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b27fc640 1 --2- 172.21.15.70:0/3405136711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f040bb0 0x55773f042fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b37fe640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f869c0a2b80 0x7f869c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.711+0000 7f86b37fe640 1 --2- 172.21.15.70:0/3405136711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f0359d0 0x55773f035db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00c4a0 tx=0x7f86ac00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57de34a21b2b7d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f8699ffb640 1 -- 172.21.15.70:0/3405136711 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac018640 con 0x55773f0359d0 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f8699ffb640 1 -- 172.21.15.70:0/3405136711 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86ac01e070 con 0x55773f0359d0 2024-09-12T01:52:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f86b37fe640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f869c0a2b80 0x7f869c0a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f86ac01d000 tx=0x7f86ac017000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f8699ffb640 1 -- 172.21.15.70:0/3405136711 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00aa30 con 0x55773f0359d0 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3405136711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f0359d0 msgr2=0x55773f035db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/3405136711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f0359d0 0x55773f035db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00c4a0 tx=0x7f86ac00c960 comp rx=0 tx=0).stop 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3405136711 shutdown_connections 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/3405136711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f040bb0 0x55773f042fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/3405136711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f040670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/3405136711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f0359d0 0x55773f035db0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3405136711 >> 172.21.15.70:0/3405136711 conn(0x55773f031f60 msgr2=0x55773f032340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3405136711 shutdown_connections 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.712+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3405136711 wait complete. 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.713+0000 7f86bbd9b740 1 -- start start 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.713+0000 7f86bbd9b740 1 Processor -- start 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.713+0000 7f86bbd9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0359d0 0x55773f040460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.713+0000 7f86bbd9b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f03d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.713+0000 7f86bbd9b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f03dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.713+0000 7f86bbd9b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55773f043780 con 0x55773f040bb0 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.713+0000 7f86bbd9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55773ef56f20 con 0x55773f0359d0 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.713+0000 7f86bbd9b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55773f043900 con 0x55773f0362f0 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.713+0000 7f86bbd9b740 10 client.0 _ll_register_callbacks cb 0x55773ef20030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.713+0000 7f86b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f03dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.713+0000 7f86b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f03dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38962/0 (socket says 172.21.15.70:38962) 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.713+0000 7f86b37fe640 1 -- 172.21.15.70:0/3314867774 learned_addr learned my addr 172.21.15.70:0/3314867774 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0359d0 0x55773f040460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86b37fe640 1 -- 172.21.15.70:0/3314867774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 msgr2=0x55773f03d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86b27fc640 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f03d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86b37fe640 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f03d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86b37fe640 1 -- 172.21.15.70:0/3314867774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0359d0 msgr2=0x55773f040460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:14.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86b37fe640 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0359d0 0x55773f040460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86b37fe640 1 -- 172.21.15.70:0/3314867774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55773ed0d2b0 con 0x55773f040bb0 2024-09-12T01:52:14.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86b27fc640 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f03d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:14.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0359d0 0x55773f040460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:14.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86b37fe640 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f03dcf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00a570 tx=0x7f86ac018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d82183d1a02da33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:14.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f8692ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:14.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f8692ffd640 1 -- 172.21.15.70:0/3314867774 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac018c70 con 0x55773f040bb0 2024-09-12T01:52:14.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f8692ffd640 1 -- 172.21.15.70:0/3314867774 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f86ac022430 con 0x55773f040bb0 2024-09-12T01:52:14.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3314867774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86ac01e070 con 0x55773f040bb0 2024-09-12T01:52:14.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f8692ffd640 1 -- 172.21.15.70:0/3314867774 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f86ac022670 con 0x55773f040bb0 2024-09-12T01:52:14.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86bbd9b740 10 client.15441 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:14.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3314867774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55773f04f0d0 con 0x55773f040bb0 2024-09-12T01:52:14.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.714+0000 7f8692ffd640 1 -- 172.21.15.70:0/3314867774 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86ac01e070 con 0x55773f040bb0 2024-09-12T01:52:14.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.715+0000 7f8692ffd640 1 -- 172.21.15.70:0/3314867774 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f86ac029020 con 0x55773f040bb0 2024-09-12T01:52:14.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.715+0000 7f86bbd9b740 10 client.15441 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:14.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.715+0000 7f86bbd9b740 10 client.15441 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T01:52:14.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.715+0000 7f86bbd9b740 20 client.15441 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:14.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.715+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55773f0514b0 0x55773f052920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.715+0000 7f86bbd9b740 4 client.15441 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:14.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.715+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3314867774 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55773efa9600 con 0x55773f0514b0 2024-09-12T01:52:14.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.715+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55773f0514b0 0x55773f052920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.715+0000 7f8692ffd640 10 client.15441 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:52:14.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.715+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55773f0514b0 0x55773f052920 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f2319bde651db462 server_cookie=12fe1ee287432a1b in_seq=0 out_seq=0 2024-09-12T01:52:14.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f8692ffd640 1 -- 172.21.15.70:0/3314867774 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55773efa9600 con 0x55773f0514b0 2024-09-12T01:52:14.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f8692ffd640 10 client.15441 handle_command_reply: tid=0 2024-09-12T01:52:14.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f86bbd9b740 1 client.15441 shutdown 2024-09-12T01:52:14.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3314867774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 msgr2=0x55773f03dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:14.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f03dcf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00a570 tx=0x7f86ac018670 comp rx=0 tx=0).stop 2024-09-12T01:52:14.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3314867774 shutdown_connections 2024-09-12T01:52:14.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55773f0514b0 0x55773f052920 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f03dcf0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f03d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/3314867774 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0359d0 0x55773f040460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3314867774 >> 172.21.15.70:0/3314867774 conn(0x55773f031f60 msgr2=0x55773f037c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:14.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f8692ffd640 0 client.15441 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:52:14.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3314867774 shutdown_connections 2024-09-12T01:52:14.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.716+0000 7f86bbd9b740 1 -- 172.21.15.70:0/3314867774 wait complete. 2024-09-12T01:52:14.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.717+0000 7f86bbd9b740 20 client.15441 trim_cache size 0 max 16384 2024-09-12T01:52:14.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.734+0000 7f86bbd9b740 1 Processor -- start 2024-09-12T01:52:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.734+0000 7f86bbd9b740 1 -- start start 2024-09-12T01:52:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.734+0000 7f86bbd9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0359d0 0x55773f050de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.734+0000 7f86bbd9b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f052250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.734+0000 7f86bbd9b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f05ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.734+0000 7f86bbd9b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55773f050c60 con 0x55773f040bb0 2024-09-12T01:52:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.734+0000 7f86bbd9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55773f051330 con 0x55773f0359d0 2024-09-12T01:52:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.734+0000 7f86bbd9b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55773f051a00 con 0x55773f0362f0 2024-09-12T01:52:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.734+0000 7f86b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f05ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.734+0000 7f86b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f05ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38972/0 (socket says 172.21.15.70:38972) 2024-09-12T01:52:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.734+0000 7f86b37fe640 1 -- 172.21.15.70:0/749682998 learned_addr learned my addr 172.21.15.70:0/749682998 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.734+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/749682998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0359d0 0x55773f050de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.735+0000 7f86b27fc640 1 --2- 172.21.15.70:0/749682998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.735+0000 7f86b37fe640 1 -- 172.21.15.70:0/749682998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 msgr2=0x55773f052250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.735+0000 7f86b37fe640 1 --2- 172.21.15.70:0/749682998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f052250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.735+0000 7f86b37fe640 1 -- 172.21.15.70:0/749682998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0359d0 msgr2=0x55773f050de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.735+0000 7f86b37fe640 1 --2- 172.21.15.70:0/749682998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0359d0 0x55773f050de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.735+0000 7f86b37fe640 1 -- 172.21.15.70:0/749682998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55773f036120 con 0x55773f040bb0 2024-09-12T01:52:14.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.735+0000 7f86b27fc640 1 --2- 172.21.15.70:0/749682998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f052250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:14.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.735+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/749682998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0359d0 0x55773f050de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:14.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.735+0000 7f86b37fe640 1 --2- 172.21.15.70:0/749682998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f05ac00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009d80 tx=0x7f86ac007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f631c63f22d959e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:14.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.735+0000 7f86997fa640 1 -- 172.21.15.70:0/749682998 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00a5a0 con 0x55773f040bb0 2024-09-12T01:52:14.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.735+0000 7f86997fa640 1 -- 172.21.15.70:0/749682998 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86ac01e050 con 0x55773f040bb0 2024-09-12T01:52:14.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.735+0000 7f86997fa640 1 -- 172.21.15.70:0/749682998 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac02bb30 con 0x55773f040bb0 2024-09-12T01:52:14.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 -- 172.21.15.70:0/749682998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 msgr2=0x55773f05ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:14.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/749682998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f05ac00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009d80 tx=0x7f86ac007c70 comp rx=0 tx=0).stop 2024-09-12T01:52:14.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 -- 172.21.15.70:0/749682998 shutdown_connections 2024-09-12T01:52:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/749682998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f05ac00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/749682998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0362f0 0x55773f052250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/749682998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0359d0 0x55773f050de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 -- 172.21.15.70:0/749682998 >> 172.21.15.70:0/749682998 conn(0x55773f031f60 msgr2=0x55773f032340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 -- 172.21.15.70:0/749682998 shutdown_connections 2024-09-12T01:52:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 -- 172.21.15.70:0/749682998 wait complete. 2024-09-12T01:52:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 -- start start 2024-09-12T01:52:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 Processor -- start 2024-09-12T01:52:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0359d0 0x55773f05b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0362f0 0x55773f055720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f055d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55773f0527a0 con 0x55773f040bb0 2024-09-12T01:52:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55773f0520d0 con 0x55773f0362f0 2024-09-12T01:52:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.736+0000 7f86bbd9b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55773f052e70 con 0x55773f0359d0 2024-09-12T01:52:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86bbd9b740 10 client.0 _ll_register_callbacks cb 0x7f86a80092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f055d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f055d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38982/0 (socket says 172.21.15.70:38982) 2024-09-12T01:52:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86b37fe640 1 -- 172.21.15.70:0/1437641391 learned_addr learned my addr 172.21.15.70:0/1437641391 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0359d0 0x55773f05b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86b27fc640 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0362f0 0x55773f055720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86b37fe640 1 -- 172.21.15.70:0/1437641391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0359d0 msgr2=0x55773f05b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86b37fe640 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0359d0 0x55773f05b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86b37fe640 1 -- 172.21.15.70:0/1437641391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0362f0 msgr2=0x55773f055720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86b37fe640 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0362f0 0x55773f055720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86b37fe640 1 -- 172.21.15.70:0/1437641391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55773f056560 con 0x55773f040bb0 2024-09-12T01:52:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0359d0 0x55773f05b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86b37fe640 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f055d30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009a80 tx=0x7f86ac0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133c4d056ad86979 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f8692ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f8692ffd640 1 -- 172.21.15.70:0/1437641391 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac022430 con 0x55773f040bb0 2024-09-12T01:52:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f8692ffd640 1 -- 172.21.15.70:0/1437641391 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f86ac02bd40 con 0x55773f040bb0 2024-09-12T01:52:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86bbd9b740 1 -- 172.21.15.70:0/1437641391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86ac01e050 con 0x55773f040bb0 2024-09-12T01:52:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f8692ffd640 1 -- 172.21.15.70:0/1437641391 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f86ac018a70 con 0x55773f040bb0 2024-09-12T01:52:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86bbd9b740 10 client.15447 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.737+0000 7f86bbd9b740 1 -- 172.21.15.70:0/1437641391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55773f0bac50 con 0x55773f040bb0 2024-09-12T01:52:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.738+0000 7f8692ffd640 1 -- 172.21.15.70:0/1437641391 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86ac01e050 con 0x55773f040bb0 2024-09-12T01:52:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.738+0000 7f8692ffd640 1 -- 172.21.15.70:0/1437641391 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f86ac044030 con 0x55773f040bb0 2024-09-12T01:52:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.738+0000 7f86bbd9b740 10 client.15447 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.738+0000 7f86bbd9b740 10 client.15447 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T01:52:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.738+0000 7f86bbd9b740 20 client.15447 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.738+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55773f0bf360 0x55773f0be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.738+0000 7f86bbd9b740 4 client.15447 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:52:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.738+0000 7f86bbd9b740 1 -- 172.21.15.70:0/1437641391 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "status"}) -- 0x55773efa3b10 con 0x55773f0bf360 2024-09-12T01:52:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.738+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55773f0bf360 0x55773f0be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86b2ffd640 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55773f0bf360 0x55773f0be070 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c7c713241e5a51d1 server_cookie=4cb1552e69dac035 in_seq=0 out_seq=0 2024-09-12T01:52:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f8692ffd640 10 client.15447 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:52:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f8692ffd640 1 -- 172.21.15.70:0/1437641391 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55773efa3b10 con 0x55773f0bf360 2024-09-12T01:52:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f8692ffd640 10 client.15447 handle_command_reply: tid=0 2024-09-12T01:52:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86bbd9b740 1 client.15447 shutdown 2024-09-12T01:52:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86bbd9b740 1 -- 172.21.15.70:0/1437641391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 msgr2=0x55773f055d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f055d30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009a80 tx=0x7f86ac0095f0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86bbd9b740 1 -- 172.21.15.70:0/1437641391 shutdown_connections 2024-09-12T01:52:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55773f0bf360 0x55773f0be070 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55773f040bb0 0x55773f055d30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55773f0362f0 0x55773f055720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86bbd9b740 1 --2- 172.21.15.70:0/1437641391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55773f0359d0 0x55773f05b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86bbd9b740 1 -- 172.21.15.70:0/1437641391 >> 172.21.15.70:0/1437641391 conn(0x55773f031f60 msgr2=0x55773f03ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f8692ffd640 0 client.15447 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:52:14.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86bbd9b740 1 -- 172.21.15.70:0/1437641391 shutdown_connections 2024-09-12T01:52:14.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86bbd9b740 1 -- 172.21.15.70:0/1437641391 wait complete. 2024-09-12T01:52:14.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.739+0000 7f86bbd9b740 20 client.15447 trim_cache size 0 max 16384 2024-09-12T01:52:14.748 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:52:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:52:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 4, 2024-09-12T01:52:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24427, 2024-09-12T01:52:14.748 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:52:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:52:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:52:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 126.36852700599999, 2024-09-12T01:52:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 28, 2024-09-12T01:52:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:52:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-12T01:52:14.749 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 162.98384190300001 2024-09-12T01:52:14.749 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:52:14.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.740+0000 7f86b99c2640 1 -- 172.21.15.70:0/3452301134 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f869c0a2b80 msgr2=0x7f869c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:14.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.740+0000 7f86b99c2640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f869c0a2b80 0x7f869c0a5040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f86ac01d000 tx=0x7f86ac017000 comp rx=0 tx=0).stop 2024-09-12T01:52:14.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.740+0000 7f86b99c2640 1 -- 172.21.15.70:0/3452301134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b4100a80 msgr2=0x7f86b4197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:14.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.740+0000 7f86b99c2640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b4100a80 0x7f86b4197200 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009230 tx=0x7f86a4004270 comp rx=0 tx=0).stop 2024-09-12T01:52:14.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.740+0000 7f86b99c2640 1 -- 172.21.15.70:0/3452301134 shutdown_connections 2024-09-12T01:52:14.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.740+0000 7f86b99c2640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f869c0a2b80 0x7f869c0a5040 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.740+0000 7f86b99c2640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b4106a80 0x7f86b4197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.740+0000 7f86b99c2640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86b4101420 0x7f86b4197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.740+0000 7f86b99c2640 1 --2- 172.21.15.70:0/3452301134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86b4100a80 0x7f86b4197200 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:14.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.740+0000 7f86b99c2640 1 -- 172.21.15.70:0/3452301134 >> 172.21.15.70:0/3452301134 conn(0x7f86b40fc7a0 msgr2=0x7f86b40fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:14.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.740+0000 7f86b99c2640 1 -- 172.21.15.70:0/3452301134 shutdown_connections 2024-09-12T01:52:14.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:14.740+0000 7f86b99c2640 1 -- 172.21.15.70:0/3452301134 wait complete. 2024-09-12T01:52:14.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:14 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1924429454' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:14.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:14 smithi152 ceph-mon[35055]: pgmap v339: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T01:52:15.539 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T01:52:15.785 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:16.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.197+0000 7f82a8355640 1 -- 172.21.15.70:0/1121301594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82a0101bc0 msgr2=0x7f82a010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:16.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.197+0000 7f82a8355640 1 --2- 172.21.15.70:0/1121301594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82a0101bc0 0x7f82a010d910 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8298009ca0 tx=0x7f829802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.197+0000 7f82a8355640 1 -- 172.21.15.70:0/1121301594 shutdown_connections 2024-09-12T01:52:16.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.197+0000 7f82a8355640 1 --2- 172.21.15.70:0/1121301594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82a0101bc0 0x7f82a010d910 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.197+0000 7f82a8355640 1 --2- 172.21.15.70:0/1121301594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82a0101240 0x7f82a0101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.197+0000 7f82a8355640 1 --2- 172.21.15.70:0/1121301594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82a0105a90 0x7f82a0105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.197+0000 7f82a8355640 1 -- 172.21.15.70:0/1121301594 >> 172.21.15.70:0/1121301594 conn(0x7f82a0077210 msgr2=0x7f82a00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:16.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.197+0000 7f82a8355640 1 -- 172.21.15.70:0/1121301594 shutdown_connections 2024-09-12T01:52:16.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.197+0000 7f82a8355640 1 -- 172.21.15.70:0/1121301594 wait complete. 2024-09-12T01:52:16.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a8355640 1 Processor -- start 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a8355640 1 -- start start 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a8355640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82a0101240 0x7f82a019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a8355640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82a0101bc0 0x7f82a019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a8355640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82a0105a90 0x7f82a019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a8355640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82a0111090 con 0x7f82a0101240 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a8355640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f82a0110f10 con 0x7f82a0101bc0 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a8355640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f82a0111210 con 0x7f82a0105a90 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a60f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82a0101240 0x7f82a019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a60f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82a0101240 0x7f82a019a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39000/0 (socket says 172.21.15.70:39000) 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a60f1640 1 -- 172.21.15.70:0/3079808803 learned_addr learned my addr 172.21.15.70:0/3079808803 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a58f0640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82a0101bc0 0x7f82a019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a68f2640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82a0105a90 0x7f82a019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a60f1640 1 -- 172.21.15.70:0/3079808803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82a0105a90 msgr2=0x7f82a019efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a60f1640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82a0105a90 0x7f82a019efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a60f1640 1 -- 172.21.15.70:0/3079808803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82a0101bc0 msgr2=0x7f82a019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a60f1640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82a0101bc0 0x7f82a019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a60f1640 1 -- 172.21.15.70:0/3079808803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a019f690 con 0x7f82a0101240 2024-09-12T01:52:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.198+0000 7f82a58f0640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82a0101bc0 0x7f82a019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.199+0000 7f82a60f1640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82a0101240 0x7f82a019a6e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f829400d770 tx=0x7f829400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.199+0000 7f82937fe640 1 -- 172.21.15.70:0/3079808803 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294017070 con 0x7f82a0101240 2024-09-12T01:52:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.199+0000 7f82937fe640 1 -- 172.21.15.70:0/3079808803 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8294005520 con 0x7f82a0101240 2024-09-12T01:52:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.199+0000 7f82937fe640 1 -- 172.21.15.70:0/3079808803 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294010460 con 0x7f82a0101240 2024-09-12T01:52:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.199+0000 7f82a8355640 1 -- 172.21.15.70:0/3079808803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a019f980 con 0x7f82a0101240 2024-09-12T01:52:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.199+0000 7f82a8355640 1 -- 172.21.15.70:0/3079808803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a01a7260 con 0x7f82a0101240 2024-09-12T01:52:16.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.201+0000 7f82937fe640 1 -- 172.21.15.70:0/3079808803 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8294004ea0 con 0x7f82a0101240 2024-09-12T01:52:16.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82aa72e740 1 Processor -- start 2024-09-12T01:52:16.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82aa72e740 1 -- start start 2024-09-12T01:52:16.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82937fe640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f828c0a2b80 0x7f828c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82aa72e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd920f9d0 0x55fdd920fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82aa72e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd92102f0 0x55fdd921a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82aa72e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd921abb0 0x55fdd921cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82aa72e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fdd9176090 con 0x55fdd92102f0 2024-09-12T01:52:16.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82aa72e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fdd911da70 con 0x55fdd921abb0 2024-09-12T01:52:16.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82aa72e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fdd9172050 con 0x55fdd920f9d0 2024-09-12T01:52:16.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82937fe640 1 -- 172.21.15.70:0/3079808803 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f82940cec60 con 0x7f82a0101240 2024-09-12T01:52:16.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82a68f2640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f828c0a2b80 0x7f828c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82a60f1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd920f9d0 0x55fdd920fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82a58f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd92102f0 0x55fdd921a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82a60f1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd920f9d0 0x55fdd920fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:58984/0 (socket says 172.21.15.70:58984) 2024-09-12T01:52:16.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82a60f1640 1 -- 172.21.15.70:0/955766594 learned_addr learned my addr 172.21.15.70:0/955766594 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:16.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.202+0000 7f82a68f2640 1 --2- 172.21.15.70:0/955766594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd921abb0 0x55fdd921cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.203+0000 7f82a60f1640 1 -- 172.21.15.70:0/955766594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd921abb0 msgr2=0x55fdd921cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:16.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.203+0000 7f82a60f1640 1 --2- 172.21.15.70:0/955766594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd921abb0 0x55fdd921cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.203+0000 7f82a60f1640 1 -- 172.21.15.70:0/955766594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd92102f0 msgr2=0x55fdd921a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:16.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.203+0000 7f82a60f1640 1 --2- 172.21.15.70:0/955766594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd92102f0 0x55fdd921a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.203+0000 7f82a60f1640 1 -- 172.21.15.70:0/955766594 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdd912a130 con 0x55fdd920f9d0 2024-09-12T01:52:16.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.203+0000 7f82a58f0640 1 --2- 172.21.15.70:0/955766594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd92102f0 0x55fdd921a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:16.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.203+0000 7f82a68f2640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f828c0a2b80 0x7f828c0a5040 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8298009a60 tx=0x7f829802f470 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:16.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.203+0000 7f82a60f1640 1 --2- 172.21.15.70:0/955766594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd920f9d0 0x55fdd920fdb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8294097e50 tx=0x7f8294097850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dfd5f8c93248f3d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:16.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.203+0000 7f8290dea640 1 -- 172.21.15.70:0/955766594 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294020040 con 0x55fdd920f9d0 2024-09-12T01:52:16.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.203+0000 7f8290dea640 1 -- 172.21.15.70:0/955766594 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f82940056d0 con 0x55fdd920f9d0 2024-09-12T01:52:16.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.203+0000 7f8290dea640 1 -- 172.21.15.70:0/955766594 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294097af0 con 0x55fdd920f9d0 2024-09-12T01:52:16.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.204+0000 7f82aa72e740 1 -- 172.21.15.70:0/955766594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd920f9d0 msgr2=0x55fdd920fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:16.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.204+0000 7f82aa72e740 1 --2- 172.21.15.70:0/955766594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd920f9d0 0x55fdd920fdb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8294097e50 tx=0x7f8294097850 comp rx=0 tx=0).stop 2024-09-12T01:52:16.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.204+0000 7f82aa72e740 1 -- 172.21.15.70:0/955766594 shutdown_connections 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.204+0000 7f82aa72e740 1 --2- 172.21.15.70:0/955766594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd921abb0 0x55fdd921cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.204+0000 7f82aa72e740 1 --2- 172.21.15.70:0/955766594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd92102f0 0x55fdd921a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.204+0000 7f82aa72e740 1 --2- 172.21.15.70:0/955766594 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd920f9d0 0x55fdd920fdb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.204+0000 7f82aa72e740 1 -- 172.21.15.70:0/955766594 >> 172.21.15.70:0/955766594 conn(0x55fdd920bf60 msgr2=0x55fdd920c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.204+0000 7f82aa72e740 1 -- 172.21.15.70:0/955766594 shutdown_connections 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.204+0000 7f82aa72e740 1 -- 172.21.15.70:0/955766594 wait complete. 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.204+0000 7f82aa72e740 1 -- start start 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.204+0000 7f82aa72e740 1 Processor -- start 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82aa72e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 0x55fdd921a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82aa72e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd92102f0 0x55fdd92177c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82aa72e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd921abb0 0x55fdd9217d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82aa72e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fdd921d780 con 0x55fdd920f9d0 2024-09-12T01:52:16.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82aa72e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fdd9130f20 con 0x55fdd92102f0 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82aa72e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fdd921d900 con 0x55fdd921abb0 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82aa72e740 10 client.0 _ll_register_callbacks cb 0x55fdd90fa030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a60f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 0x55fdd921a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a60f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 0x55fdd921a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39024/0 (socket says 172.21.15.70:39024) 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a60f1640 1 -- 172.21.15.70:0/3487824844 learned_addr learned my addr 172.21.15.70:0/3487824844 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a68f2640 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd921abb0 0x55fdd9217d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a58f0640 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd92102f0 0x55fdd92177c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a60f1640 1 -- 172.21.15.70:0/3487824844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd921abb0 msgr2=0x55fdd9217d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a60f1640 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd921abb0 0x55fdd9217d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a60f1640 1 -- 172.21.15.70:0/3487824844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd92102f0 msgr2=0x55fdd92177c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a60f1640 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd92102f0 0x55fdd92177c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a60f1640 1 -- 172.21.15.70:0/3487824844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdd8ee72b0 con 0x55fdd920f9d0 2024-09-12T01:52:16.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a68f2640 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd921abb0 0x55fdd9217d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a58f0640 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd92102f0 0x55fdd92177c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82a60f1640 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 0x55fdd921a470 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8294009fd0 tx=0x7f829409b0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c46073ac1f2092e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f8289ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f8289ffb640 1 -- 172.21.15.70:0/3487824844 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82940b3020 con 0x55fdd920f9d0 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f8289ffb640 1 -- 172.21.15.70:0/3487824844 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8294005190 con 0x55fdd920f9d0 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.205+0000 7f82aa72e740 1 -- 172.21.15.70:0/3487824844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fdd9183600 con 0x55fdd920f9d0 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.206+0000 7f8289ffb640 1 -- 172.21.15.70:0/3487824844 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8294020070 con 0x55fdd920f9d0 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.206+0000 7f82aa72e740 10 client.15459 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.206+0000 7f82aa72e740 1 -- 172.21.15.70:0/3487824844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fdd92290d0 con 0x55fdd920f9d0 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.206+0000 7f8289ffb640 1 -- 172.21.15.70:0/3487824844 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55fdd9183600 con 0x55fdd920f9d0 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.206+0000 7f8289ffb640 1 -- 172.21.15.70:0/3487824844 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f82940ccbe0 con 0x55fdd920f9d0 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.206+0000 7f82aa72e740 10 client.15459 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:16.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.206+0000 7f82aa72e740 10 client.15459 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:52:16.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.206+0000 7f82aa72e740 20 client.15459 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:16.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.206+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fdd922b270 0x55fdd922c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.206+0000 7f82aa72e740 4 client.15459 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:16.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.206+0000 7f82aa72e740 1 -- 172.21.15.70:0/3487824844 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdd917db10 con 0x55fdd922b270 2024-09-12T01:52:16.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.206+0000 7f82a58f0640 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fdd922b270 0x55fdd922c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.207+0000 7f82a58f0640 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fdd922b270 0x55fdd922c6e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e6fb4861dab08fbf server_cookie=12f94dca0edf2f81 in_seq=0 out_seq=0 2024-09-12T01:52:16.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.207+0000 7f8289ffb640 10 client.15459 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:52:16.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f8289ffb640 1 -- 172.21.15.70:0/3487824844 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fdd917db10 con 0x55fdd922b270 2024-09-12T01:52:16.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f8289ffb640 10 client.15459 handle_command_reply: tid=0 2024-09-12T01:52:16.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f82aa72e740 1 client.15459 shutdown 2024-09-12T01:52:16.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f82aa72e740 1 -- 172.21.15.70:0/3487824844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 msgr2=0x55fdd921a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:16.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 0x55fdd921a470 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8294009fd0 tx=0x7f829409b0f0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f82aa72e740 1 -- 172.21.15.70:0/3487824844 shutdown_connections 2024-09-12T01:52:16.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fdd922b270 0x55fdd922c6e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd921abb0 0x55fdd9217d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd92102f0 0x55fdd92177c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3487824844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 0x55fdd921a470 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f8289ffb640 0 client.15459 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:52:16.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f82aa72e740 1 -- 172.21.15.70:0/3487824844 >> 172.21.15.70:0/3487824844 conn(0x55fdd920bf60 msgr2=0x55fdd9211c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:16.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f82aa72e740 1 -- 172.21.15.70:0/3487824844 shutdown_connections 2024-09-12T01:52:16.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f82aa72e740 1 -- 172.21.15.70:0/3487824844 wait complete. 2024-09-12T01:52:16.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.208+0000 7f82aa72e740 20 client.15459 trim_cache size 0 max 16384 2024-09-12T01:52:16.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.225+0000 7f82aa72e740 1 Processor -- start 2024-09-12T01:52:16.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82aa72e740 1 -- start start 2024-09-12T01:52:16.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82aa72e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd920f9d0 0x55fdd922b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82aa72e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd92102f0 0x55fdd922c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82aa72e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd921abb0 0x55fdd922aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82aa72e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fdd922aa20 con 0x55fdd921abb0 2024-09-12T01:52:16.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82aa72e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fdd922b0f0 con 0x55fdd920f9d0 2024-09-12T01:52:16.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82aa72e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fdd922b7c0 con 0x55fdd92102f0 2024-09-12T01:52:16.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82a68f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd921abb0 0x55fdd922aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82a68f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd921abb0 0x55fdd922aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39038/0 (socket says 172.21.15.70:39038) 2024-09-12T01:52:16.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82a68f2640 1 -- 172.21.15.70:0/3600002227 learned_addr learned my addr 172.21.15.70:0/3600002227 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:16.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82a60f1640 1 --2- 172.21.15.70:0/3600002227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd920f9d0 0x55fdd922b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82a68f2640 1 -- 172.21.15.70:0/3600002227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd92102f0 msgr2=0x55fdd922c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:16.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82a58f0640 1 --2- 172.21.15.70:0/3600002227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd92102f0 0x55fdd922c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82a68f2640 1 --2- 172.21.15.70:0/3600002227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd92102f0 0x55fdd922c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82a68f2640 1 -- 172.21.15.70:0/3600002227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd920f9d0 msgr2=0x55fdd922b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82a68f2640 1 --2- 172.21.15.70:0/3600002227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd920f9d0 0x55fdd922b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82a68f2640 1 -- 172.21.15.70:0/3600002227 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdd921d890 con 0x55fdd921abb0 2024-09-12T01:52:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82a60f1640 1 --2- 172.21.15.70:0/3600002227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd920f9d0 0x55fdd922b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.226+0000 7f82a68f2640 1 --2- 172.21.15.70:0/3600002227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd921abb0 0x55fdd922aba0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f829802ade0 tx=0x7f829804a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96cffdbc86f9343a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f828bfff640 1 -- 172.21.15.70:0/3600002227 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8298031ba0 con 0x55fdd921abb0 2024-09-12T01:52:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f828bfff640 1 -- 172.21.15.70:0/3600002227 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8298031920 con 0x55fdd921abb0 2024-09-12T01:52:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f828bfff640 1 -- 172.21.15.70:0/3600002227 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8298030b80 con 0x55fdd921abb0 2024-09-12T01:52:16.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f82aa72e740 1 -- 172.21.15.70:0/3600002227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd921abb0 msgr2=0x55fdd922aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:16.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3600002227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd921abb0 0x55fdd922aba0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f829802ade0 tx=0x7f829804a000 comp rx=0 tx=0).stop 2024-09-12T01:52:16.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f82aa72e740 1 -- 172.21.15.70:0/3600002227 shutdown_connections 2024-09-12T01:52:16.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3600002227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd921abb0 0x55fdd922aba0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3600002227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd92102f0 0x55fdd922c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3600002227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd920f9d0 0x55fdd922b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f82aa72e740 1 -- 172.21.15.70:0/3600002227 >> 172.21.15.70:0/3600002227 conn(0x55fdd920bf60 msgr2=0x55fdd9218f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:16.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f82aa72e740 1 -- 172.21.15.70:0/3600002227 shutdown_connections 2024-09-12T01:52:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f82aa72e740 1 -- 172.21.15.70:0/3600002227 wait complete. 2024-09-12T01:52:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.227+0000 7f82aa72e740 1 -- start start 2024-09-12T01:52:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82aa72e740 1 Processor -- start 2024-09-12T01:52:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82aa72e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 0x55fdd9234f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82aa72e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd92102f0 0x55fdd922f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82aa72e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd921abb0 0x55fdd922f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82aa72e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fdd922c560 con 0x55fdd920f9d0 2024-09-12T01:52:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82aa72e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fdd922be90 con 0x55fdd92102f0 2024-09-12T01:52:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82aa72e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fdd922cc30 con 0x55fdd921abb0 2024-09-12T01:52:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82aa72e740 10 client.0 _ll_register_callbacks cb 0x7f829409f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82a60f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 0x55fdd9234f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82a60f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 0x55fdd9234f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39040/0 (socket says 172.21.15.70:39040) 2024-09-12T01:52:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82a60f1640 1 -- 172.21.15.70:0/3463356100 learned_addr learned my addr 172.21.15.70:0/3463356100 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82a58f0640 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd92102f0 0x55fdd922f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82a68f2640 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd921abb0 0x55fdd922f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82a60f1640 1 -- 172.21.15.70:0/3463356100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd921abb0 msgr2=0x55fdd922f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82a60f1640 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd921abb0 0x55fdd922f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82a60f1640 1 -- 172.21.15.70:0/3463356100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd92102f0 msgr2=0x55fdd922f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:16.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82a60f1640 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd92102f0 0x55fdd922f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82a60f1640 1 -- 172.21.15.70:0/3463356100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdd922fde0 con 0x55fdd920f9d0 2024-09-12T01:52:16.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f82a60f1640 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 0x55fdd9234f10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8294097890 tx=0x7f82940b42a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81794abe7e5166eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:16.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.228+0000 7f8289ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:16.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f8289ffb640 1 -- 172.21.15.70:0/3463356100 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294065060 con 0x55fdd920f9d0 2024-09-12T01:52:16.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f8289ffb640 1 -- 172.21.15.70:0/3463356100 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8294005190 con 0x55fdd920f9d0 2024-09-12T01:52:16.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f82aa72e740 1 -- 172.21.15.70:0/3463356100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8298031920 con 0x55fdd920f9d0 2024-09-12T01:52:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f8289ffb640 1 -- 172.21.15.70:0/3463356100 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f82940b3030 con 0x55fdd920f9d0 2024-09-12T01:52:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f82aa72e740 10 client.15465 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f82aa72e740 1 -- 172.21.15.70:0/3463356100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fdd922fde0 con 0x55fdd920f9d0 2024-09-12T01:52:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f8289ffb640 1 -- 172.21.15.70:0/3463356100 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8298031920 con 0x55fdd920f9d0 2024-09-12T01:52:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f8289ffb640 1 -- 172.21.15.70:0/3463356100 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f829407b020 con 0x55fdd920f9d0 2024-09-12T01:52:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f82aa72e740 10 client.15465 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f82aa72e740 10 client.15465 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T01:52:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f82aa72e740 20 client.15465 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fdd9298ec0 0x55fdd9297bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f82aa72e740 4 client.15465 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:52:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f82aa72e740 1 -- 172.21.15.70:0/3463356100 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "status"}) -- 0x55fdd90fa0e0 con 0x55fdd9298ec0 2024-09-12T01:52:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.229+0000 7f82a58f0640 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fdd9298ec0 0x55fdd9297bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f8289ffb640 10 client.15465 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:52:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82a58f0640 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fdd9298ec0 0x55fdd9297bd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bdce996a163ca82c server_cookie=2faeb309ae1e5174 in_seq=0 out_seq=0 2024-09-12T01:52:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f8289ffb640 1 -- 172.21.15.70:0/3463356100 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fdd90fa0e0 con 0x55fdd9298ec0 2024-09-12T01:52:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f8289ffb640 10 client.15465 handle_command_reply: tid=0 2024-09-12T01:52:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82aa72e740 1 client.15465 shutdown 2024-09-12T01:52:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82aa72e740 1 -- 172.21.15.70:0/3463356100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 msgr2=0x55fdd9234f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 0x55fdd9234f10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8294097890 tx=0x7f82940b42a0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82aa72e740 1 -- 172.21.15.70:0/3463356100 shutdown_connections 2024-09-12T01:52:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fdd9298ec0 0x55fdd9297bd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fdd921abb0 0x55fdd922f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fdd92102f0 0x55fdd922f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f8289ffb640 0 client.15465 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:52:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82aa72e740 1 --2- 172.21.15.70:0/3463356100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdd920f9d0 0x55fdd9234f10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82aa72e740 1 -- 172.21.15.70:0/3463356100 >> 172.21.15.70:0/3463356100 conn(0x55fdd920bf60 msgr2=0x55fdd9217080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82aa72e740 1 -- 172.21.15.70:0/3463356100 shutdown_connections 2024-09-12T01:52:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82aa72e740 1 -- 172.21.15.70:0/3463356100 wait complete. 2024-09-12T01:52:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.230+0000 7f82aa72e740 20 client.15465 trim_cache size 0 max 16384 2024-09-12T01:52:16.243 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:52:16.243 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:52:16.243 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 3, 2024-09-12T01:52:16.243 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24433, 2024-09-12T01:52:16.243 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:52:16.243 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:52:16.243 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:52:16.243 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 128.86805317100001, 2024-09-12T01:52:16.244 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 28, 2024-09-12T01:52:16.244 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:52:16.244 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-12T01:52:16.244 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 162.05694067499999 2024-09-12T01:52:16.244 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:52:16.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.231+0000 7f82a8355640 1 -- 172.21.15.70:0/3079808803 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f828c0a2b80 msgr2=0x7f828c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:16.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.231+0000 7f82a8355640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f828c0a2b80 0x7f828c0a5040 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8298009a60 tx=0x7f829802f470 comp rx=0 tx=0).stop 2024-09-12T01:52:16.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.231+0000 7f82a8355640 1 -- 172.21.15.70:0/3079808803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82a0101240 msgr2=0x7f82a019a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:16.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.231+0000 7f82a8355640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82a0101240 0x7f82a019a6e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f829400d770 tx=0x7f829400dc30 comp rx=0 tx=0).stop 2024-09-12T01:52:16.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.231+0000 7f82a8355640 1 -- 172.21.15.70:0/3079808803 shutdown_connections 2024-09-12T01:52:16.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.231+0000 7f82a8355640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f828c0a2b80 0x7f828c0a5040 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.231+0000 7f82a8355640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82a0105a90 0x7f82a019efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.231+0000 7f82a8355640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82a0101bc0 0x7f82a019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.231+0000 7f82a8355640 1 --2- 172.21.15.70:0/3079808803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82a0101240 0x7f82a019a6e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:16.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.231+0000 7f82a8355640 1 -- 172.21.15.70:0/3079808803 >> 172.21.15.70:0/3079808803 conn(0x7f82a0077210 msgr2=0x7f82a01042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:16.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.231+0000 7f82a8355640 1 -- 172.21.15.70:0/3079808803 shutdown_connections 2024-09-12T01:52:16.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:16.231+0000 7f82a8355640 1 -- 172.21.15.70:0/3079808803 wait complete. 2024-09-12T01:52:16.889 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:16 smithi070 ceph-mon[31177]: pgmap v340: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-12T01:52:16.914 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T01:52:16.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:16 smithi191 ceph-mon[35770]: pgmap v340: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-12T01:52:17.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:16 smithi152 ceph-mon[35055]: pgmap v340: 97 pgs: 97 active+clean; 651 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-12T01:52:17.158 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:17.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.615+0000 7fca59202640 1 -- 172.21.15.70:0/2202249900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca541068f0 msgr2=0x7fca54106cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.615+0000 7fca59202640 1 --2- 172.21.15.70:0/2202249900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca541068f0 0x7fca54106cd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fca44009930 tx=0x7fca4402a420 comp rx=0 tx=0).stop 2024-09-12T01:52:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.616+0000 7fca59202640 1 -- 172.21.15.70:0/2202249900 shutdown_connections 2024-09-12T01:52:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.616+0000 7fca59202640 1 --2- 172.21.15.70:0/2202249900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca54101290 0x7fca5410d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.616+0000 7fca59202640 1 --2- 172.21.15.70:0/2202249900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca541008f0 0x7fca54100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.616+0000 7fca59202640 1 --2- 172.21.15.70:0/2202249900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca541068f0 0x7fca54106cd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.616+0000 7fca59202640 1 -- 172.21.15.70:0/2202249900 >> 172.21.15.70:0/2202249900 conn(0x7fca540fc630 msgr2=0x7fca540fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.616+0000 7fca59202640 1 -- 172.21.15.70:0/2202249900 shutdown_connections 2024-09-12T01:52:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.616+0000 7fca59202640 1 -- 172.21.15.70:0/2202249900 wait complete. 2024-09-12T01:52:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.616+0000 7fca59202640 1 Processor -- start 2024-09-12T01:52:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.616+0000 7fca59202640 1 -- start start 2024-09-12T01:52:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca59202640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca541008f0 0x7fca54197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca59202640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca54101290 0x7fca541977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca59202640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca541068f0 0x7fca5419bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca59202640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca54110e10 con 0x7fca541068f0 2024-09-12T01:52:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca59202640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fca54110c90 con 0x7fca541008f0 2024-09-12T01:52:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca59202640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fca54110f90 con 0x7fca54101290 2024-09-12T01:52:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca541068f0 0x7fca5419bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca541068f0 0x7fca5419bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39052/0 (socket says 172.21.15.70:39052) 2024-09-12T01:52:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca5359e640 1 -- 172.21.15.70:0/1952921356 learned_addr learned my addr 172.21.15.70:0/1952921356 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca52d9d640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca541008f0 0x7fca54197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca4bfff640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca54101290 0x7fca541977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca5359e640 1 -- 172.21.15.70:0/1952921356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca54101290 msgr2=0x7fca541977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:17.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca5359e640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca54101290 0x7fca541977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca5359e640 1 -- 172.21.15.70:0/1952921356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca541008f0 msgr2=0x7fca54197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:17.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca5359e640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca541008f0 0x7fca54197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca5359e640 1 -- 172.21.15.70:0/1952921356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5419c240 con 0x7fca541068f0 2024-09-12T01:52:17.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca5359e640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca541068f0 0x7fca5419bb60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00cce0 tx=0x7fca4c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:17.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca50d99640 1 -- 172.21.15.70:0/1952921356 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c00f450 con 0x7fca541068f0 2024-09-12T01:52:17.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca50d99640 1 -- 172.21.15.70:0/1952921356 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca4c00faf0 con 0x7fca541068f0 2024-09-12T01:52:17.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca59202640 1 -- 172.21.15.70:0/1952921356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5419c530 con 0x7fca541068f0 2024-09-12T01:52:17.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.617+0000 7fca50d99640 1 -- 172.21.15.70:0/1952921356 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c018cc0 con 0x7fca541068f0 2024-09-12T01:52:17.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.618+0000 7fca59202640 1 -- 172.21.15.70:0/1952921356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca541a3e10 con 0x7fca541068f0 2024-09-12T01:52:17.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.620+0000 7fca50d99640 1 -- 172.21.15.70:0/1952921356 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fca4c00f5f0 con 0x7fca541068f0 2024-09-12T01:52:17.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.620+0000 7fca5b5db740 1 Processor -- start 2024-09-12T01:52:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.620+0000 7fca5b5db740 1 -- start start 2024-09-12T01:52:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca5b5db740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f27289bd0 0x556f27289fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca5b5db740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f2728a4f0 0x556f27294870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca5b5db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 0x556f272971a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca50d99640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca400a2b80 0x7fca400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca5b5db740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f271f0090 con 0x556f2728a4f0 2024-09-12T01:52:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca5b5db740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556f27197a70 con 0x556f27289bd0 2024-09-12T01:52:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca5b5db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556f271ec050 con 0x556f27294db0 2024-09-12T01:52:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca52d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f2728a4f0 0x556f27294870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca4bfff640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca400a2b80 0x7fca400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca52d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f2728a4f0 0x556f27294870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39054/0 (socket says 172.21.15.70:39054) 2024-09-12T01:52:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca52d9d640 1 -- 172.21.15.70:0/7267001 learned_addr learned my addr 172.21.15.70:0/7267001 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca50d99640 1 -- 172.21.15.70:0/1952921356 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fca4c0cf420 con 0x7fca541068f0 2024-09-12T01:52:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca4bfff640 1 --2- 172.21.15.70:0/7267001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f27289bd0 0x556f27289fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca5359e640 1 --2- 172.21.15.70:0/7267001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 0x556f272971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca52d9d640 1 -- 172.21.15.70:0/7267001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 msgr2=0x556f272971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca52d9d640 1 --2- 172.21.15.70:0/7267001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 0x556f272971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca52d9d640 1 -- 172.21.15.70:0/7267001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f27289bd0 msgr2=0x556f27289fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca52d9d640 1 --2- 172.21.15.70:0/7267001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f27289bd0 0x556f27289fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca52d9d640 1 -- 172.21.15.70:0/7267001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f271a4130 con 0x556f2728a4f0 2024-09-12T01:52:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca4bfff640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca400a2b80 0x7fca400a5040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fca3c005d70 tx=0x7fca3c011810 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:17.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca52d9d640 1 --2- 172.21.15.70:0/7267001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f2728a4f0 0x556f27294870 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fca4402a940 tx=0x7fca440316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4cfbd47f1ee58e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:17.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.621+0000 7fca497fa640 1 -- 172.21.15.70:0/7267001 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44040070 con 0x556f2728a4f0 2024-09-12T01:52:17.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.622+0000 7fca497fa640 1 -- 172.21.15.70:0/7267001 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca44005020 con 0x556f2728a4f0 2024-09-12T01:52:17.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.622+0000 7fca497fa640 1 -- 172.21.15.70:0/7267001 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44035040 con 0x556f2728a4f0 2024-09-12T01:52:17.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.622+0000 7fca5b5db740 1 -- 172.21.15.70:0/7267001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f2728a4f0 msgr2=0x556f27294870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:17.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.622+0000 7fca5b5db740 1 --2- 172.21.15.70:0/7267001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f2728a4f0 0x556f27294870 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fca4402a940 tx=0x7fca440316f0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.622+0000 7fca5b5db740 1 -- 172.21.15.70:0/7267001 shutdown_connections 2024-09-12T01:52:17.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.622+0000 7fca5b5db740 1 --2- 172.21.15.70:0/7267001 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 0x556f272971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.622+0000 7fca5b5db740 1 --2- 172.21.15.70:0/7267001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f2728a4f0 0x556f27294870 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.622+0000 7fca5b5db740 1 --2- 172.21.15.70:0/7267001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f27289bd0 0x556f27289fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.622+0000 7fca5b5db740 1 -- 172.21.15.70:0/7267001 >> 172.21.15.70:0/7267001 conn(0x556f27286160 msgr2=0x556f27286540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:17.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.622+0000 7fca5b5db740 1 -- 172.21.15.70:0/7267001 shutdown_connections 2024-09-12T01:52:17.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.622+0000 7fca5b5db740 1 -- 172.21.15.70:0/7267001 wait complete. 2024-09-12T01:52:17.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca5b5db740 1 -- start start 2024-09-12T01:52:17.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca5b5db740 1 Processor -- start 2024-09-12T01:52:17.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca5b5db740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 0x556f27294660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca5b5db740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f272919b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca5b5db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 0x556f27291ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca5b5db740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f27297980 con 0x556f27289bd0 2024-09-12T01:52:17.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca5b5db740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556f271aaf20 con 0x556f2728a4f0 2024-09-12T01:52:17.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca5b5db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556f27297b00 con 0x556f27294db0 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca5b5db740 10 client.0 _ll_register_callbacks cb 0x556f27174030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca52d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 0x556f27294660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca52d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 0x556f27294660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39066/0 (socket says 172.21.15.70:39066) 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca52d9d640 1 -- 172.21.15.70:0/2406869575 learned_addr learned my addr 172.21.15.70:0/2406869575 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca5359e640 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 0x556f27291ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca4bfff640 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f272919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.623+0000 7fca52d9d640 1 -- 172.21.15.70:0/2406869575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 msgr2=0x556f27291ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca52d9d640 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 0x556f27291ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca52d9d640 1 -- 172.21.15.70:0/2406869575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 msgr2=0x556f272919b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca52d9d640 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f272919b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca52d9d640 1 -- 172.21.15.70:0/2406869575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f26f612b0 con 0x556f27289bd0 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca52d9d640 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 0x556f27294660 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fca44005940 tx=0x7fca4402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a0234e145cdc5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca3a7fc640 1 -- 172.21.15.70:0/2406869575 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4404b020 con 0x556f27289bd0 2024-09-12T01:52:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca3a7fc640 1 -- 172.21.15.70:0/2406869575 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fca44004940 con 0x556f27289bd0 2024-09-12T01:52:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca5b5db740 1 -- 172.21.15.70:0/2406869575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca44005020 con 0x556f27289bd0 2024-09-12T01:52:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca3a7fc640 1 -- 172.21.15.70:0/2406869575 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca44035070 con 0x556f27289bd0 2024-09-12T01:52:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca5b5db740 10 client.15477 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca5b5db740 1 -- 172.21.15.70:0/2406869575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556f272a32a0 con 0x556f27289bd0 2024-09-12T01:52:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca3a7fc640 1 -- 172.21.15.70:0/2406869575 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca44005020 con 0x556f27289bd0 2024-09-12T01:52:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca3a7fc640 1 -- 172.21.15.70:0/2406869575 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca44052430 con 0x556f27289bd0 2024-09-12T01:52:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.624+0000 7fca5b5db740 10 client.15477 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.625+0000 7fca5b5db740 10 client.15477 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:52:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.625+0000 7fca5b5db740 20 client.15477 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.625+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556f272a5430 0x556f272a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.625+0000 7fca5b5db740 4 client.15477 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.625+0000 7fca5b5db740 1 -- 172.21.15.70:0/2406869575 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f271fd600 con 0x556f272a5430 2024-09-12T01:52:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.625+0000 7fca4bfff640 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556f272a5430 0x556f272a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.625+0000 7fca4bfff640 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556f272a5430 0x556f272a68a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=65b2be855d2ad201 server_cookie=88e1cc489cd07e68 in_seq=0 out_seq=0 2024-09-12T01:52:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.625+0000 7fca3a7fc640 10 client.15477 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:52:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.626+0000 7fca3a7fc640 1 -- 172.21.15.70:0/2406869575 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f271fd600 con 0x556f272a5430 2024-09-12T01:52:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.626+0000 7fca3a7fc640 10 client.15477 handle_command_reply: tid=0 2024-09-12T01:52:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.626+0000 7fca5b5db740 1 client.15477 shutdown 2024-09-12T01:52:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.626+0000 7fca5b5db740 1 -- 172.21.15.70:0/2406869575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 msgr2=0x556f27294660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.626+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 0x556f27294660 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fca44005940 tx=0x7fca4402a420 comp rx=0 tx=0).stop 2024-09-12T01:52:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.626+0000 7fca5b5db740 1 -- 172.21.15.70:0/2406869575 shutdown_connections 2024-09-12T01:52:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.626+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556f272a5430 0x556f272a68a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.626+0000 7fca3a7fc640 0 client.15477 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:52:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.626+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 0x556f27291ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.626+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f272919b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.626+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2406869575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 0x556f27294660 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.626+0000 7fca5b5db740 1 -- 172.21.15.70:0/2406869575 >> 172.21.15.70:0/2406869575 conn(0x556f27286160 msgr2=0x556f2728be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:17.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.627+0000 7fca5b5db740 1 -- 172.21.15.70:0/2406869575 shutdown_connections 2024-09-12T01:52:17.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.627+0000 7fca5b5db740 1 -- 172.21.15.70:0/2406869575 wait complete. 2024-09-12T01:52:17.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.627+0000 7fca5b5db740 20 client.15477 trim_cache size 0 max 16384 2024-09-12T01:52:17.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.644+0000 7fca5b5db740 1 Processor -- start 2024-09-12T01:52:17.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.644+0000 7fca5b5db740 1 -- start start 2024-09-12T01:52:17.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.644+0000 7fca5b5db740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 0x556f272a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.644+0000 7fca5b5db740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f2728ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.644+0000 7fca5b5db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 0x556f2728f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.644+0000 7fca5b5db740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f272a4be0 con 0x556f27289bd0 2024-09-12T01:52:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.644+0000 7fca5b5db740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556f272a52b0 con 0x556f2728a4f0 2024-09-12T01:52:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.644+0000 7fca5b5db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556f272a5980 con 0x556f27294db0 2024-09-12T01:52:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.644+0000 7fca52d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 0x556f272a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.644+0000 7fca52d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 0x556f272a4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39070/0 (socket says 172.21.15.70:39070) 2024-09-12T01:52:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.644+0000 7fca52d9d640 1 -- 172.21.15.70:0/2551397514 learned_addr learned my addr 172.21.15.70:0/2551397514 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.645+0000 7fca4bfff640 1 --2- 172.21.15.70:0/2551397514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f2728ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.645+0000 7fca52d9d640 1 -- 172.21.15.70:0/2551397514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 msgr2=0x556f2728f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.645+0000 7fca52d9d640 1 --2- 172.21.15.70:0/2551397514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 0x556f2728f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.645+0000 7fca52d9d640 1 -- 172.21.15.70:0/2551397514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 msgr2=0x556f2728ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.645+0000 7fca52d9d640 1 --2- 172.21.15.70:0/2551397514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f2728ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.645+0000 7fca52d9d640 1 -- 172.21.15.70:0/2551397514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f2728a320 con 0x556f27289bd0 2024-09-12T01:52:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.645+0000 7fca52d9d640 1 --2- 172.21.15.70:0/2551397514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 0x556f272a4d60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fca44031c40 tx=0x7fca44005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662a4f082eada15a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.645+0000 7fca48ff9640 1 -- 172.21.15.70:0/2551397514 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4404b040 con 0x556f27289bd0 2024-09-12T01:52:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.645+0000 7fca48ff9640 1 -- 172.21.15.70:0/2551397514 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca44052a70 con 0x556f27289bd0 2024-09-12T01:52:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.645+0000 7fca48ff9640 1 -- 172.21.15.70:0/2551397514 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44040040 con 0x556f27289bd0 2024-09-12T01:52:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 -- 172.21.15.70:0/2551397514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 msgr2=0x556f272a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2551397514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 0x556f272a4d60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fca44031c40 tx=0x7fca44005850 comp rx=0 tx=0).stop 2024-09-12T01:52:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 -- 172.21.15.70:0/2551397514 shutdown_connections 2024-09-12T01:52:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2551397514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27294db0 0x556f2728f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2551397514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f2728ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2551397514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27289bd0 0x556f272a4d60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 -- 172.21.15.70:0/2551397514 >> 172.21.15.70:0/2551397514 conn(0x556f27286160 msgr2=0x556f2728cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 -- 172.21.15.70:0/2551397514 shutdown_connections 2024-09-12T01:52:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 -- 172.21.15.70:0/2551397514 wait complete. 2024-09-12T01:52:17.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 -- start start 2024-09-12T01:52:17.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 Processor -- start 2024-09-12T01:52:17.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27289bd0 0x556f272af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f272a8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27294db0 0x556f272a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f272a6720 con 0x556f27294db0 2024-09-12T01:52:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556f272a6050 con 0x556f2728a4f0 2024-09-12T01:52:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556f272a6df0 con 0x556f27289bd0 2024-09-12T01:52:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.646+0000 7fca5b5db740 10 client.0 _ll_register_callbacks cb 0x7fca44031640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27294db0 0x556f272a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27294db0 0x556f272a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39072/0 (socket says 172.21.15.70:39072) 2024-09-12T01:52:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca5359e640 1 -- 172.21.15.70:0/2606222090 learned_addr learned my addr 172.21.15.70:0/2606222090 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca52d9d640 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27289bd0 0x556f272af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca4bfff640 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f272a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca5359e640 1 -- 172.21.15.70:0/2606222090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27289bd0 msgr2=0x556f272af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca5359e640 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27289bd0 0x556f272af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca5359e640 1 -- 172.21.15.70:0/2606222090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 msgr2=0x556f272a8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca5359e640 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f272a8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca5359e640 1 -- 172.21.15.70:0/2606222090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f272acf20 con 0x556f27294db0 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca4bfff640 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f272a8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca52d9d640 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27289bd0 0x556f272af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca5359e640 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27294db0 0x556f272a8e70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fca4c09bc10 tx=0x7fca4c0791d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a6ec84e14ae4f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca3a7fc640 1 -- 172.21.15.70:0/2606222090 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c018e60 con 0x556f27294db0 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca3a7fc640 1 -- 172.21.15.70:0/2606222090 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fca4c0cd030 con 0x556f27294db0 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca5b5db740 1 -- 172.21.15.70:0/2606222090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca44052a70 con 0x556f27294db0 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca3a7fc640 1 -- 172.21.15.70:0/2606222090 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca4c09bc80 con 0x556f27294db0 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca5b5db740 10 client.15483 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca5b5db740 1 -- 172.21.15.70:0/2606222090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556f2730fd60 con 0x556f27294db0 2024-09-12T01:52:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.647+0000 7fca3a7fc640 1 -- 172.21.15.70:0/2606222090 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca44052a70 con 0x556f27294db0 2024-09-12T01:52:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.648+0000 7fca3a7fc640 1 -- 172.21.15.70:0/2606222090 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fca4c09b0d0 con 0x556f27294db0 2024-09-12T01:52:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.648+0000 7fca5b5db740 10 client.15483 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.648+0000 7fca5b5db740 10 client.15483 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T01:52:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.648+0000 7fca5b5db740 20 client.15483 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.648+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556f272a5430 0x556f27313670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.648+0000 7fca5b5db740 4 client.15483 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:52:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.648+0000 7fca5b5db740 1 -- 172.21.15.70:0/2606222090 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "status"}) -- 0x556f271f7b10 con 0x556f272a5430 2024-09-12T01:52:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.648+0000 7fca52d9d640 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556f272a5430 0x556f27313670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.648+0000 7fca3a7fc640 10 client.15483 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:52:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.648+0000 7fca52d9d640 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556f272a5430 0x556f27313670 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4abe3a1cf2bb7a0 server_cookie=ae6b014a2c99fd7d in_seq=0 out_seq=0 2024-09-12T01:52:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca3a7fc640 1 -- 172.21.15.70:0/2606222090 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556f271f7b10 con 0x556f272a5430 2024-09-12T01:52:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca3a7fc640 10 client.15483 handle_command_reply: tid=0 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca5b5db740 1 client.15483 shutdown 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca5b5db740 1 -- 172.21.15.70:0/2606222090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27294db0 msgr2=0x556f272a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27294db0 0x556f272a8e70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fca4c09bc10 tx=0x7fca4c0791d0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca5b5db740 1 -- 172.21.15.70:0/2606222090 shutdown_connections 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556f272a5430 0x556f27313670 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f27294db0 0x556f272a8e70 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556f2728a4f0 0x556f272a8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca5b5db740 1 --2- 172.21.15.70:0/2606222090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f27289bd0 0x556f272af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca3a7fc640 0 client.15483 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca5b5db740 1 -- 172.21.15.70:0/2606222090 >> 172.21.15.70:0/2606222090 conn(0x556f27286160 msgr2=0x556f27291270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca5b5db740 1 -- 172.21.15.70:0/2606222090 shutdown_connections 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca5b5db740 1 -- 172.21.15.70:0/2606222090 wait complete. 2024-09-12T01:52:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca5b5db740 20 client.15483 trim_cache size 0 max 16384 2024-09-12T01:52:17.656 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:52:17.656 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:52:17.656 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-09-12T01:52:17.656 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24437, 2024-09-12T01:52:17.656 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:52:17.656 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:52:17.656 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:52:17.656 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 131.29448461999999, 2024-09-12T01:52:17.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 28, 2024-09-12T01:52:17.656 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:52:17.656 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-12T01:52:17.657 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 161.02492750100001 2024-09-12T01:52:17.657 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:52:17.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca59202640 1 -- 172.21.15.70:0/1952921356 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca400a2b80 msgr2=0x7fca400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:17.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca59202640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca400a2b80 0x7fca400a5040 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fca3c005d70 tx=0x7fca3c011810 comp rx=0 tx=0).stop 2024-09-12T01:52:17.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca59202640 1 -- 172.21.15.70:0/1952921356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca541068f0 msgr2=0x7fca5419bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.649+0000 7fca59202640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca541068f0 0x7fca5419bb60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00cce0 tx=0x7fca4c00a620 comp rx=0 tx=0).stop 2024-09-12T01:52:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.650+0000 7fca59202640 1 -- 172.21.15.70:0/1952921356 shutdown_connections 2024-09-12T01:52:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.650+0000 7fca59202640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fca400a2b80 0x7fca400a5040 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.650+0000 7fca59202640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca541068f0 0x7fca5419bb60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.650+0000 7fca59202640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca54101290 0x7fca541977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.650+0000 7fca59202640 1 --2- 172.21.15.70:0/1952921356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca541008f0 0x7fca54197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.650+0000 7fca59202640 1 -- 172.21.15.70:0/1952921356 >> 172.21.15.70:0/1952921356 conn(0x7fca540fc630 msgr2=0x7fca540fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.650+0000 7fca59202640 1 -- 172.21.15.70:0/1952921356 shutdown_connections 2024-09-12T01:52:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:17.650+0000 7fca59202640 1 -- 172.21.15.70:0/1952921356 wait complete. 2024-09-12T01:52:18.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T01:52:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:18.738 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:18 smithi070 ceph-mon[31177]: pgmap v341: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-12T01:52:18.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:18 smithi191 ceph-mon[35770]: pgmap v341: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-12T01:52:19.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:18 smithi152 ceph-mon[35055]: pgmap v341: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-12T01:52:19.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.070+0000 7f869efb2640 1 -- 172.21.15.70:0/4252915048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698102570 msgr2=0x7f86981029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:19.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.070+0000 7f869efb2640 1 --2- 172.21.15.70:0/4252915048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698102570 0x7f86981029b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8684009900 tx=0x7f868402a480 comp rx=0 tx=0).stop 2024-09-12T01:52:19.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.070+0000 7f869efb2640 1 -- 172.21.15.70:0/4252915048 shutdown_connections 2024-09-12T01:52:19.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.070+0000 7f869efb2640 1 --2- 172.21.15.70:0/4252915048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8698102ef0 0x7f869810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.070+0000 7f869efb2640 1 --2- 172.21.15.70:0/4252915048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698102570 0x7f86981029b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.070+0000 7f869efb2640 1 --2- 172.21.15.70:0/4252915048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8698100e20 0x7f8698101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.070+0000 7f869efb2640 1 -- 172.21.15.70:0/4252915048 >> 172.21.15.70:0/4252915048 conn(0x7f86980fc7d0 msgr2=0x7f86980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:19.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.070+0000 7f869efb2640 1 -- 172.21.15.70:0/4252915048 shutdown_connections 2024-09-12T01:52:19.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.070+0000 7f869efb2640 1 -- 172.21.15.70:0/4252915048 wait complete. 2024-09-12T01:52:19.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f869efb2640 1 Processor -- start 2024-09-12T01:52:19.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f869efb2640 1 -- start start 2024-09-12T01:52:19.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f869efb2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8698100e20 0x7f8698197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f869efb2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698102570 0x7f8698197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f869efb2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8698102ef0 0x7f8698197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f869efb2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8698111070 con 0x7f8698102570 2024-09-12T01:52:19.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f869efb2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8698110ef0 con 0x7f8698102ef0 2024-09-12T01:52:19.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f869efb2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f86981111f0 con 0x7f8698100e20 2024-09-12T01:52:19.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f8697fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698102570 0x7f8698197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f8697fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698102570 0x7f8698197740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39082/0 (socket says 172.21.15.70:39082) 2024-09-12T01:52:19.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f8697fff640 1 -- 172.21.15.70:0/2195716247 learned_addr learned my addr 172.21.15.70:0/2195716247 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:19.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f869cd4e640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8698100e20 0x7f8698197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f869d54f640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8698102ef0 0x7f8698197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f8697fff640 1 -- 172.21.15.70:0/2195716247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8698100e20 msgr2=0x7f8698197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:19.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f8697fff640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8698100e20 0x7f8698197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f8697fff640 1 -- 172.21.15.70:0/2195716247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8698102ef0 msgr2=0x7f8698197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:19.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f8697fff640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8698102ef0 0x7f8698197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f8697fff640 1 -- 172.21.15.70:0/2195716247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86981a6a70 con 0x7f8698102570 2024-09-12T01:52:19.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f869cd4e640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8698100e20 0x7f8698197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.071+0000 7f8697fff640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698102570 0x7f8698197740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8684006010 tx=0x7f8684004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.072+0000 7f8695ffb640 1 -- 172.21.15.70:0/2195716247 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868403f030 con 0x7f8698102570 2024-09-12T01:52:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.072+0000 7f8695ffb640 1 -- 172.21.15.70:0/2195716247 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8684005500 con 0x7f8698102570 2024-09-12T01:52:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.072+0000 7f869efb2640 1 -- 172.21.15.70:0/2195716247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86981a6d00 con 0x7f8698102570 2024-09-12T01:52:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.072+0000 7f8695ffb640 1 -- 172.21.15.70:0/2195716247 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684035070 con 0x7f8698102570 2024-09-12T01:52:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.072+0000 7f869efb2640 1 -- 172.21.15.70:0/2195716247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86981a71d0 con 0x7f8698102570 2024-09-12T01:52:19.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.074+0000 7f8695ffb640 1 -- 172.21.15.70:0/2195716247 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8684042030 con 0x7f8698102570 2024-09-12T01:52:19.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.074+0000 7f86a138b740 1 Processor -- start 2024-09-12T01:52:19.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f86a138b740 1 -- start start 2024-09-12T01:52:19.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f86a138b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f86a138b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17d6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f86a138b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 0x55a9b17d8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f86a138b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a9b1732090 con 0x55a9b17cb9d0 2024-09-12T01:52:19.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f86a138b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a9b16d9a70 con 0x55a9b17d6bb0 2024-09-12T01:52:19.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f86a138b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a9b172e050 con 0x55a9b17cc2f0 2024-09-12T01:52:19.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f8695ffb640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86880a2c00 0x7f86880a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f869d54f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f869d54f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39094/0 (socket says 172.21.15.70:39094) 2024-09-12T01:52:19.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f869d54f640 1 -- 172.21.15.70:0/3131849344 learned_addr learned my addr 172.21.15.70:0/3131849344 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:19.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f869d54f640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86880a2c00 0x7f86880a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f869cd4e640 1 --2- 172.21.15.70:0/3131849344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17d6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f8695ffb640 1 -- 172.21.15.70:0/2195716247 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f86840ef650 con 0x7f8698102570 2024-09-12T01:52:19.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.075+0000 7f8697fff640 1 --2- 172.21.15.70:0/3131849344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 0x55a9b17d8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.076+0000 7f869cd4e640 1 -- 172.21.15.70:0/3131849344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 msgr2=0x55a9b17d8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:19.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.076+0000 7f869cd4e640 1 --2- 172.21.15.70:0/3131849344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 0x55a9b17d8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.076+0000 7f869cd4e640 1 -- 172.21.15.70:0/3131849344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 msgr2=0x55a9b17cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:19.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.076+0000 7f869cd4e640 1 --2- 172.21.15.70:0/3131849344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.076+0000 7f869cd4e640 1 -- 172.21.15.70:0/3131849344 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b16e6130 con 0x55a9b17cc2f0 2024-09-12T01:52:19.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.076+0000 7f869d54f640 1 --2- 172.21.15.70:0/3131849344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:19.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.076+0000 7f869d54f640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86880a2c00 0x7f86880a50c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8690013b90 tx=0x7f869000b940 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:19.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.076+0000 7f869cd4e640 1 --2- 172.21.15.70:0/3131849344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17d6670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f868c00cbd0 tx=0x7f868c00e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c53cd211a317085d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:19.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.076+0000 7f8682ffd640 1 -- 172.21.15.70:0/3131849344 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c005220 con 0x55a9b17cc2f0 2024-09-12T01:52:19.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.076+0000 7f8682ffd640 1 -- 172.21.15.70:0/3131849344 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f868c004ca0 con 0x55a9b17cc2f0 2024-09-12T01:52:19.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.076+0000 7f8682ffd640 1 -- 172.21.15.70:0/3131849344 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c010850 con 0x55a9b17cc2f0 2024-09-12T01:52:19.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.077+0000 7f86a138b740 1 -- 172.21.15.70:0/3131849344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 msgr2=0x55a9b17d6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:19.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.077+0000 7f86a138b740 1 --2- 172.21.15.70:0/3131849344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17d6670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f868c00cbd0 tx=0x7f868c00e720 comp rx=0 tx=0).stop 2024-09-12T01:52:19.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.077+0000 7f86a138b740 1 -- 172.21.15.70:0/3131849344 shutdown_connections 2024-09-12T01:52:19.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.077+0000 7f86a138b740 1 --2- 172.21.15.70:0/3131849344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 0x55a9b17d8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.077+0000 7f86a138b740 1 --2- 172.21.15.70:0/3131849344 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17d6670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.077+0000 7f86a138b740 1 --2- 172.21.15.70:0/3131849344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.077+0000 7f86a138b740 1 -- 172.21.15.70:0/3131849344 >> 172.21.15.70:0/3131849344 conn(0x55a9b17c7f60 msgr2=0x55a9b17c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:19.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.077+0000 7f86a138b740 1 -- 172.21.15.70:0/3131849344 shutdown_connections 2024-09-12T01:52:19.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.077+0000 7f86a138b740 1 -- 172.21.15.70:0/3131849344 wait complete. 2024-09-12T01:52:19.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.077+0000 7f86a138b740 1 -- start start 2024-09-12T01:52:19.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.077+0000 7f86a138b740 1 Processor -- start 2024-09-12T01:52:19.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f86a138b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17d6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f86a138b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17d36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f86a138b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 0x55a9b17d3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f86a138b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a9b17d9780 con 0x55a9b17cb9d0 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f86a138b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a9b16ecf20 con 0x55a9b17d6bb0 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f86a138b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a9b17d9900 con 0x55a9b17cc2f0 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f86a138b740 10 client.0 _ll_register_callbacks cb 0x55a9b16b6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f869cd4e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17d6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f869cd4e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17d6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39108/0 (socket says 172.21.15.70:39108) 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f869cd4e640 1 -- 172.21.15.70:0/2715758870 learned_addr learned my addr 172.21.15.70:0/2715758870 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f869d54f640 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 0x55a9b17d3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f8697fff640 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17d36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f869cd4e640 1 -- 172.21.15.70:0/2715758870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 msgr2=0x55a9b17d36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f869cd4e640 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17d36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f869cd4e640 1 -- 172.21.15.70:0/2715758870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 msgr2=0x55a9b17d3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f869cd4e640 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 0x55a9b17d3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f869cd4e640 1 -- 172.21.15.70:0/2715758870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b14a32b0 con 0x55a9b17cb9d0 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f869cd4e640 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17d6320 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f868c0058c0 tx=0x7f868c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c1882db0a248f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f8677fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f8677fff640 1 -- 172.21.15.70:0/2715758870 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c00c7d0 con 0x55a9b17cb9d0 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.078+0000 7f86a138b740 1 -- 172.21.15.70:0/2715758870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f868c004ca0 con 0x55a9b17cb9d0 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f8677fff640 1 -- 172.21.15.70:0/2715758870 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f868c004020 con 0x55a9b17cb9d0 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f8677fff640 1 -- 172.21.15.70:0/2715758870 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f868c004220 con 0x55a9b17cb9d0 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f86a138b740 10 client.15495 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f86a138b740 1 -- 172.21.15.70:0/2715758870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a9b17e4f90 con 0x55a9b17cb9d0 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f8677fff640 1 -- 172.21.15.70:0/2715758870 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f868c004ca0 con 0x55a9b17cb9d0 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f8677fff640 1 -- 172.21.15.70:0/2715758870 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f868c02e050 con 0x55a9b17cb9d0 2024-09-12T01:52:19.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f86a138b740 10 client.15495 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f86a138b740 10 client.15495 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f86a138b740 20 client.15495 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f86a138b740 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55a9b17e7220 0x55a9b17e8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f86a138b740 4 client.15495 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f86a138b740 1 -- 172.21.15.70:0/2715758870 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9b173f600 con 0x55a9b17e7220 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.079+0000 7f8697fff640 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55a9b17e7220 0x55a9b17e8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.080+0000 7f8697fff640 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55a9b17e7220 0x55a9b17e8690 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a5a7046b598cbf09 server_cookie=8391ef7d35be83a2 in_seq=0 out_seq=0 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.080+0000 7f8677fff640 10 client.15495 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f8677fff640 1 -- 172.21.15.70:0/2715758870 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9b173f600 con 0x55a9b17e7220 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f8677fff640 10 client.15495 handle_command_reply: tid=0 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f86a138b740 1 client.15495 shutdown 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f86a138b740 1 -- 172.21.15.70:0/2715758870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 msgr2=0x55a9b17d6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:19.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f86a138b740 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17d6320 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f868c0058c0 tx=0x7f868c0048f0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f86a138b740 1 -- 172.21.15.70:0/2715758870 shutdown_connections 2024-09-12T01:52:19.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f86a138b740 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55a9b17e7220 0x55a9b17e8690 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f86a138b740 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 0x55a9b17d3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f86a138b740 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17d36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f8677fff640 0 client.15495 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:52:19.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f86a138b740 1 --2- 172.21.15.70:0/2715758870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17d6320 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f86a138b740 1 -- 172.21.15.70:0/2715758870 >> 172.21.15.70:0/2715758870 conn(0x55a9b17c7f60 msgr2=0x55a9b17cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:19.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f86a138b740 1 -- 172.21.15.70:0/2715758870 shutdown_connections 2024-09-12T01:52:19.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f86a138b740 1 -- 172.21.15.70:0/2715758870 wait complete. 2024-09-12T01:52:19.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.081+0000 7f86a138b740 20 client.15495 trim_cache size 0 max 16384 2024-09-12T01:52:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.098+0000 7f86a138b740 1 Processor -- start 2024-09-12T01:52:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.098+0000 7f86a138b740 1 -- start start 2024-09-12T01:52:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f86a138b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17cb9d0 0x55a9b17e8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f86a138b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cc2f0 0x55a9b17cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f86a138b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17d6bb0 0x55a9b17cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f86a138b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a9b17e69d0 con 0x55a9b17cc2f0 2024-09-12T01:52:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f86a138b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a9b17e70a0 con 0x55a9b17cb9d0 2024-09-12T01:52:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f86a138b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a9b17e7770 con 0x55a9b17d6bb0 2024-09-12T01:52:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f8697fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cc2f0 0x55a9b17cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f8697fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cc2f0 0x55a9b17cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39124/0 (socket says 172.21.15.70:39124) 2024-09-12T01:52:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f8697fff640 1 -- 172.21.15.70:0/3085370137 learned_addr learned my addr 172.21.15.70:0/3085370137 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f8697fff640 1 -- 172.21.15.70:0/3085370137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17d6bb0 msgr2=0x55a9b17cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f8697fff640 1 --2- 172.21.15.70:0/3085370137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17d6bb0 0x55a9b17cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f8697fff640 1 -- 172.21.15.70:0/3085370137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17cb9d0 msgr2=0x55a9b17e8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f8697fff640 1 --2- 172.21.15.70:0/3085370137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17cb9d0 0x55a9b17e8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f8697fff640 1 -- 172.21.15.70:0/3085370137 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b17d6690 con 0x55a9b17cc2f0 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f8697fff640 1 --2- 172.21.15.70:0/3085370137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cc2f0 0x55a9b17cee10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8684005ec0 tx=0x7f86840035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72164a1a62917ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f86827fc640 1 -- 172.21.15.70:0/3085370137 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684049040 con 0x55a9b17cc2f0 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f86827fc640 1 -- 172.21.15.70:0/3085370137 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86840bc5b0 con 0x55a9b17cc2f0 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.099+0000 7f86827fc640 1 -- 172.21.15.70:0/3085370137 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684004370 con 0x55a9b17cc2f0 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.100+0000 7f86a138b740 1 -- 172.21.15.70:0/3085370137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cc2f0 msgr2=0x55a9b17cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.100+0000 7f86a138b740 1 --2- 172.21.15.70:0/3085370137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cc2f0 0x55a9b17cee10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8684005ec0 tx=0x7f86840035f0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.100+0000 7f86a138b740 1 -- 172.21.15.70:0/3085370137 shutdown_connections 2024-09-12T01:52:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.100+0000 7f86a138b740 1 --2- 172.21.15.70:0/3085370137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17d6bb0 0x55a9b17cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.100+0000 7f86a138b740 1 --2- 172.21.15.70:0/3085370137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cc2f0 0x55a9b17cee10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.100+0000 7f86a138b740 1 --2- 172.21.15.70:0/3085370137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17cb9d0 0x55a9b17e8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.100+0000 7f86a138b740 1 -- 172.21.15.70:0/3085370137 >> 172.21.15.70:0/3085370137 conn(0x55a9b17c7f60 msgr2=0x55a9b17cd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.100+0000 7f86a138b740 1 -- 172.21.15.70:0/3085370137 shutdown_connections 2024-09-12T01:52:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.100+0000 7f86a138b740 1 -- 172.21.15.70:0/3085370137 wait complete. 2024-09-12T01:52:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.100+0000 7f86a138b740 1 -- start start 2024-09-12T01:52:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.100+0000 7f86a138b740 1 Processor -- start 2024-09-12T01:52:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f86a138b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f86a138b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17f1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f86a138b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 0x55a9b17d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f86a138b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a9b17e8510 con 0x55a9b17cb9d0 2024-09-12T01:52:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f86a138b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a9b17e7e40 con 0x55a9b17d6bb0 2024-09-12T01:52:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f86a138b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a9b17e8be0 con 0x55a9b17cc2f0 2024-09-12T01:52:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f86a138b740 10 client.0 _ll_register_callbacks cb 0x7f868c014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f869cd4e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f869cd4e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39140/0 (socket says 172.21.15.70:39140) 2024-09-12T01:52:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f869cd4e640 1 -- 172.21.15.70:0/627038422 learned_addr learned my addr 172.21.15.70:0/627038422 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f869d54f640 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 0x55a9b17d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f8697fff640 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f869cd4e640 1 -- 172.21.15.70:0/627038422 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 msgr2=0x55a9b17f1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f869cd4e640 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17f1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f869cd4e640 1 -- 172.21.15.70:0/627038422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 msgr2=0x55a9b17d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:19.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f869cd4e640 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 0x55a9b17d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f869cd4e640 1 -- 172.21.15.70:0/627038422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b17d0910 con 0x55a9b17cb9d0 2024-09-12T01:52:19.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f8697fff640 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:19.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f869cd4e640 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17f0c00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f868c00ec20 tx=0x7f868c010620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ba5c09ecfb7ac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:19.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f8677fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:19.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.101+0000 7f8677fff640 1 -- 172.21.15.70:0/627038422 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c010430 con 0x55a9b17cb9d0 2024-09-12T01:52:19.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f8677fff640 1 -- 172.21.15.70:0/627038422 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f868c022040 con 0x55a9b17cb9d0 2024-09-12T01:52:19.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f86a138b740 1 -- 172.21.15.70:0/627038422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86840bc5b0 con 0x55a9b17cb9d0 2024-09-12T01:52:19.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f8677fff640 1 -- 172.21.15.70:0/627038422 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f868c00c7d0 con 0x55a9b17cb9d0 2024-09-12T01:52:19.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f86a138b740 10 client.15501 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:19.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f86a138b740 1 -- 172.21.15.70:0/627038422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a9b17ef340 con 0x55a9b17cb9d0 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f8677fff640 1 -- 172.21.15.70:0/627038422 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86840bc5b0 con 0x55a9b17cb9d0 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f8677fff640 1 -- 172.21.15.70:0/627038422 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f868c039020 con 0x55a9b17cb9d0 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f86a138b740 10 client.15501 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f86a138b740 10 client.15501 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f86a138b740 20 client.15501 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f86a138b740 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55a9b18560b0 0x55a9b1854dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f86a138b740 4 client.15501 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f86a138b740 1 -- 172.21.15.70:0/627038422 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "status"}) -- 0x55a9b1739b10 con 0x55a9b18560b0 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.102+0000 7f8697fff640 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55a9b18560b0 0x55a9b1854dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f8697fff640 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55a9b18560b0 0x55a9b1854dc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f46a793da2d5511f server_cookie=a2019c76a78a911f in_seq=0 out_seq=0 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f8677fff640 10 client.15501 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f8677fff640 1 -- 172.21.15.70:0/627038422 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a9b1739b10 con 0x55a9b18560b0 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f8677fff640 10 client.15501 handle_command_reply: tid=0 2024-09-12T01:52:19.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f86a138b740 1 client.15501 shutdown 2024-09-12T01:52:19.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f86a138b740 1 -- 172.21.15.70:0/627038422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 msgr2=0x55a9b17f0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:19.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f86a138b740 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17f0c00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f868c00ec20 tx=0x7f868c010620 comp rx=0 tx=0).stop 2024-09-12T01:52:19.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f86a138b740 1 -- 172.21.15.70:0/627038422 shutdown_connections 2024-09-12T01:52:19.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f86a138b740 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55a9b18560b0 0x55a9b1854dc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f86a138b740 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a9b17d6bb0 0x55a9b17d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f86a138b740 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a9b17cc2f0 0x55a9b17f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f86a138b740 1 --2- 172.21.15.70:0/627038422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9b17cb9d0 0x55a9b17f0c00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f86a138b740 1 -- 172.21.15.70:0/627038422 >> 172.21.15.70:0/627038422 conn(0x55a9b17c7f60 msgr2=0x55a9b17cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:19.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.103+0000 7f8677fff640 0 client.15501 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:52:19.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f86a138b740 1 -- 172.21.15.70:0/627038422 shutdown_connections 2024-09-12T01:52:19.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f86a138b740 1 -- 172.21.15.70:0/627038422 wait complete. 2024-09-12T01:52:19.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f86a138b740 20 client.15501 trim_cache size 0 max 16384 2024-09-12T01:52:19.117 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:52:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:52:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-09-12T01:52:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24445, 2024-09-12T01:52:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:52:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:52:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:52:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 133.75444263099999, 2024-09-12T01:52:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 28, 2024-09-12T01:52:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:52:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-12T01:52:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 160.065136346 2024-09-12T01:52:19.118 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:52:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f869efb2640 1 -- 172.21.15.70:0/2195716247 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86880a2c00 msgr2=0x7f86880a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f869efb2640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86880a2c00 0x7f86880a50c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8690013b90 tx=0x7f869000b940 comp rx=0 tx=0).stop 2024-09-12T01:52:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f869efb2640 1 -- 172.21.15.70:0/2195716247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698102570 msgr2=0x7f8698197740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f869efb2640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698102570 0x7f8698197740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8684006010 tx=0x7f8684004c00 comp rx=0 tx=0).stop 2024-09-12T01:52:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f869efb2640 1 -- 172.21.15.70:0/2195716247 shutdown_connections 2024-09-12T01:52:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f869efb2640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f86880a2c00 0x7f86880a50c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f869efb2640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8698102ef0 0x7f8698197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f869efb2640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698102570 0x7f8698197740 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f869efb2640 1 --2- 172.21.15.70:0/2195716247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8698100e20 0x7f8698197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f869efb2640 1 -- 172.21.15.70:0/2195716247 >> 172.21.15.70:0/2195716247 conn(0x7f86980fc7d0 msgr2=0x7f86980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f869efb2640 1 -- 172.21.15.70:0/2195716247 shutdown_connections 2024-09-12T01:52:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:19.104+0000 7f869efb2640 1 -- 172.21.15.70:0/2195716247 wait complete. 2024-09-12T01:52:19.843 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T01:52:20.092 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:20.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.579+0000 7f36dc1c5640 1 -- 172.21.15.70:0/2189858858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36d4102570 msgr2=0x7f36d41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.579+0000 7f36dc1c5640 1 --2- 172.21.15.70:0/2189858858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36d4102570 0x7f36d41029b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009900 tx=0x7f36c402a480 comp rx=0 tx=0).stop 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.579+0000 7f36dc1c5640 1 -- 172.21.15.70:0/2189858858 shutdown_connections 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.579+0000 7f36dc1c5640 1 --2- 172.21.15.70:0/2189858858 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4102ef0 0x7f36d410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.579+0000 7f36dc1c5640 1 --2- 172.21.15.70:0/2189858858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36d4102570 0x7f36d41029b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.579+0000 7f36dc1c5640 1 --2- 172.21.15.70:0/2189858858 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d4100e20 0x7f36d4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.579+0000 7f36dc1c5640 1 -- 172.21.15.70:0/2189858858 >> 172.21.15.70:0/2189858858 conn(0x7f36d40fc7d0 msgr2=0x7f36d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.579+0000 7f36dc1c5640 1 -- 172.21.15.70:0/2189858858 shutdown_connections 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.579+0000 7f36dc1c5640 1 -- 172.21.15.70:0/2189858858 wait complete. 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36dc1c5640 1 Processor -- start 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36dc1c5640 1 -- start start 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36dc1c5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d4100e20 0x7f36d41993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36dc1c5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4102570 0x7f36d4199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36dc1c5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36d4102ef0 0x7f36d41a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36dc1c5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f36d41110a0 con 0x7f36d4102ef0 2024-09-12T01:52:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36dc1c5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f36d4110f20 con 0x7f36d4100e20 2024-09-12T01:52:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36dc1c5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f36d4111220 con 0x7f36d4102570 2024-09-12T01:52:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36da762640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36d4102ef0 0x7f36d41a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36d9f61640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d4100e20 0x7f36d41993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36d9f61640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d4100e20 0x7f36d41993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:51528/0 (socket says 172.21.15.70:51528) 2024-09-12T01:52:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36da762640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36d4102ef0 0x7f36d41a4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35284/0 (socket says 172.21.15.70:35284) 2024-09-12T01:52:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36d9f61640 1 -- 172.21.15.70:0/1442035834 learned_addr learned my addr 172.21.15.70:0/1442035834 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36d9760640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4102570 0x7f36d4199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36d9f61640 1 -- 172.21.15.70:0/1442035834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4102570 msgr2=0x7f36d4199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36d9f61640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4102570 0x7f36d4199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36d9f61640 1 -- 172.21.15.70:0/1442035834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36d4102ef0 msgr2=0x7f36d41a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36d9f61640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36d4102ef0 0x7f36d41a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36d9f61640 1 -- 172.21.15.70:0/1442035834 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d41a49b0 con 0x7f36d4100e20 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.580+0000 7f36da762640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36d4102ef0 0x7f36d41a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.581+0000 7f36d9f61640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d4100e20 0x7f36d41993f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f36d000e9f0 tx=0x7f36d000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.581+0000 7f36caffd640 1 -- 172.21.15.70:0/1442035834 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d000cd80 con 0x7f36d4100e20 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.581+0000 7f36caffd640 1 -- 172.21.15.70:0/1442035834 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f36d0010930 con 0x7f36d4100e20 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.581+0000 7f36dc1c5640 1 -- 172.21.15.70:0/1442035834 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d41a4b80 con 0x7f36d4100e20 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.581+0000 7f36caffd640 1 -- 172.21.15.70:0/1442035834 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d0018b00 con 0x7f36d4100e20 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.581+0000 7f36dc1c5640 1 -- 172.21.15.70:0/1442035834 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d41a5090 con 0x7f36d4100e20 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.583+0000 7f36caffd640 1 -- 172.21.15.70:0/1442035834 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f36d0018ca0 con 0x7f36d4100e20 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.583+0000 7f36de59e740 1 Processor -- start 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.583+0000 7f36de59e740 1 -- start start 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36de59e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705979d0 0x55ea70597db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36de59e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705982f0 0x55ea705a2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36de59e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea705a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36de59e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ea704fe090 con 0x55ea705a2bb0 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36de59e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ea704a5a70 con 0x55ea705982f0 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36de59e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ea704fa050 con 0x55ea705979d0 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36caffd640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f36c00a2b80 0x7f36c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36d9760640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea705a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36d9f61640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705982f0 0x55ea705a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36da762640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705979d0 0x55ea70597db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36d9760640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea705a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35298/0 (socket says 172.21.15.70:35298) 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36d9760640 1 -- 172.21.15.70:0/321562826 learned_addr learned my addr 172.21.15.70:0/321562826 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36da762640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f36c00a2b80 0x7f36c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36caffd640 1 -- 172.21.15.70:0/1442035834 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f36d00cf3c0 con 0x7f36d4100e20 2024-09-12T01:52:20.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36d9760640 1 -- 172.21.15.70:0/321562826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705979d0 msgr2=0x55ea70597db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36d9760640 1 --2- 172.21.15.70:0/321562826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705979d0 0x55ea70597db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36d9760640 1 -- 172.21.15.70:0/321562826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705982f0 msgr2=0x55ea705a2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36d9760640 1 --2- 172.21.15.70:0/321562826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705982f0 0x55ea705a2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36d9760640 1 -- 172.21.15.70:0/321562826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea704b2130 con 0x55ea705a2bb0 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36da762640 1 --2- 172.21.15.70:0/321562826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705979d0 0x55ea70597db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36d9760640 1 --2- 172.21.15.70:0/321562826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea705a4fa0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009900 tx=0x7f36c4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c030d67c0be2c979 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.584+0000 7f36da762640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f36c00a2b80 0x7f36c00a5040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f36cc005fd0 tx=0x7f36cc009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.585+0000 7f36bffff640 1 -- 172.21.15.70:0/321562826 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c4040070 con 0x55ea705a2bb0 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.585+0000 7f36bffff640 1 -- 172.21.15.70:0/321562826 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f36c40318a0 con 0x55ea705a2bb0 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.585+0000 7f36bffff640 1 -- 172.21.15.70:0/321562826 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c4035040 con 0x55ea705a2bb0 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.585+0000 7f36de59e740 1 -- 172.21.15.70:0/321562826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 msgr2=0x55ea705a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.585+0000 7f36de59e740 1 --2- 172.21.15.70:0/321562826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea705a4fa0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009900 tx=0x7f36c4005bd0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.585+0000 7f36de59e740 1 -- 172.21.15.70:0/321562826 shutdown_connections 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.585+0000 7f36de59e740 1 --2- 172.21.15.70:0/321562826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea705a4fa0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.585+0000 7f36de59e740 1 --2- 172.21.15.70:0/321562826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705982f0 0x55ea705a2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.585+0000 7f36de59e740 1 --2- 172.21.15.70:0/321562826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705979d0 0x55ea70597db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.585+0000 7f36de59e740 1 -- 172.21.15.70:0/321562826 >> 172.21.15.70:0/321562826 conn(0x55ea70593f60 msgr2=0x55ea70594340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.585+0000 7f36de59e740 1 -- 172.21.15.70:0/321562826 shutdown_connections 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.585+0000 7f36de59e740 1 -- 172.21.15.70:0/321562826 wait complete. 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.586+0000 7f36de59e740 1 -- start start 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.586+0000 7f36de59e740 1 Processor -- start 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.586+0000 7f36de59e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705979d0 0x55ea705a2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.586+0000 7f36de59e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705982f0 0x55ea7059f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.586+0000 7f36de59e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea7059fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.586+0000 7f36de59e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ea705a5780 con 0x55ea705a2bb0 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.586+0000 7f36de59e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ea704b8f20 con 0x55ea705979d0 2024-09-12T01:52:20.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.586+0000 7f36de59e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ea705a5900 con 0x55ea705982f0 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.586+0000 7f36de59e740 10 client.0 _ll_register_callbacks cb 0x55ea70482030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.586+0000 7f36da762640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea7059fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.586+0000 7f36da762640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea7059fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35310/0 (socket says 172.21.15.70:35310) 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.586+0000 7f36da762640 1 -- 172.21.15.70:0/2506544849 learned_addr learned my addr 172.21.15.70:0/2506544849 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36d9f61640 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705979d0 0x55ea705a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36d9760640 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705982f0 0x55ea7059f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36da762640 1 -- 172.21.15.70:0/2506544849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705982f0 msgr2=0x55ea7059f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36da762640 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705982f0 0x55ea7059f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36da762640 1 -- 172.21.15.70:0/2506544849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705979d0 msgr2=0x55ea705a2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36da762640 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705979d0 0x55ea705a2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36da762640 1 -- 172.21.15.70:0/2506544849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea7026f2b0 con 0x55ea705a2bb0 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36d9f61640 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705979d0 0x55ea705a2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:20.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36d9760640 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705982f0 0x55ea7059f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36da762640 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea7059fbf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f36cc011fa0 tx=0x7f36cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7cadda7f04e4c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36bd7fa640 1 -- 172.21.15.70:0/2506544849 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc010840 con 0x55ea705a2bb0 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36bd7fa640 1 -- 172.21.15.70:0/2506544849 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f36cc0109e0 con 0x55ea705a2bb0 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36de59e740 1 -- 172.21.15.70:0/2506544849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36c40318a0 con 0x55ea705a2bb0 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36bd7fa640 1 -- 172.21.15.70:0/2506544849 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f36cc010be0 con 0x55ea705a2bb0 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36de59e740 10 client.15513 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.587+0000 7f36de59e740 1 -- 172.21.15.70:0/2506544849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ea705b1040 con 0x55ea705a2bb0 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.588+0000 7f36bd7fa640 1 -- 172.21.15.70:0/2506544849 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f36c40318a0 con 0x55ea705a2bb0 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.588+0000 7f36bd7fa640 1 -- 172.21.15.70:0/2506544849 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f36cc028070 con 0x55ea705a2bb0 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.588+0000 7f36de59e740 10 client.15513 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.588+0000 7f36de59e740 10 client.15513 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.588+0000 7f36de59e740 20 client.15513 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:20.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.588+0000 7f36de59e740 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55ea705b36a0 0x55ea705b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.588+0000 7f36de59e740 4 client.15513 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.588+0000 7f36de59e740 1 -- 172.21.15.70:0/2506544849 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea7050b600 con 0x55ea705b36a0 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.588+0000 7f36d9f61640 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55ea705b36a0 0x55ea705b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.589+0000 7f36d9f61640 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55ea705b36a0 0x55ea705b4b10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ded9845db9a88a5 server_cookie=7311e549eb82e3ab in_seq=0 out_seq=0 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.589+0000 7f36bd7fa640 10 client.15513 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.589+0000 7f36bd7fa640 1 -- 172.21.15.70:0/2506544849 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea7050b600 con 0x55ea705b36a0 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.589+0000 7f36bd7fa640 10 client.15513 handle_command_reply: tid=0 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.589+0000 7f36de59e740 1 client.15513 shutdown 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.589+0000 7f36de59e740 1 -- 172.21.15.70:0/2506544849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 msgr2=0x55ea7059fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.589+0000 7f36de59e740 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea7059fbf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f36cc011fa0 tx=0x7f36cc004ab0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.589+0000 7f36de59e740 1 -- 172.21.15.70:0/2506544849 shutdown_connections 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.589+0000 7f36de59e740 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55ea705b36a0 0x55ea705b4b10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.590+0000 7f36de59e740 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea7059fbf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.590+0000 7f36bd7fa640 0 client.15513 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:20.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.590+0000 7f36de59e740 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705982f0 0x55ea7059f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.590+0000 7f36de59e740 1 --2- 172.21.15.70:0/2506544849 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705979d0 0x55ea705a2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.590+0000 7f36de59e740 1 -- 172.21.15.70:0/2506544849 >> 172.21.15.70:0/2506544849 conn(0x55ea70593f60 msgr2=0x55ea70599c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:20.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.590+0000 7f36de59e740 1 -- 172.21.15.70:0/2506544849 shutdown_connections 2024-09-12T01:52:20.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.590+0000 7f36de59e740 1 -- 172.21.15.70:0/2506544849 wait complete. 2024-09-12T01:52:20.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.590+0000 7f36de59e740 20 client.15513 trim_cache size 0 max 16384 2024-09-12T01:52:20.608 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:20 smithi070 ceph-mon[31177]: pgmap v342: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-12T01:52:20.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36de59e740 1 Processor -- start 2024-09-12T01:52:20.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36de59e740 1 -- start start 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36de59e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705979d0 0x55ea7059df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36de59e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705982f0 0x55ea7059e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36de59e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea705bcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36de59e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ea705b2e50 con 0x55ea705a2bb0 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36de59e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ea705b3520 con 0x55ea705979d0 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36de59e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ea705b3bf0 con 0x55ea705982f0 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36da762640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea705bcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36da762640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea705bcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35318/0 (socket says 172.21.15.70:35318) 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36da762640 1 -- 172.21.15.70:0/4241615034 learned_addr learned my addr 172.21.15.70:0/4241615034 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36d9f61640 1 --2- 172.21.15.70:0/4241615034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705979d0 0x55ea7059df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36d9760640 1 --2- 172.21.15.70:0/4241615034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705982f0 0x55ea7059e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36da762640 1 -- 172.21.15.70:0/4241615034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705982f0 msgr2=0x55ea7059e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:20.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36da762640 1 --2- 172.21.15.70:0/4241615034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705982f0 0x55ea7059e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36da762640 1 -- 172.21.15.70:0/4241615034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705979d0 msgr2=0x55ea7059df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:20.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36da762640 1 --2- 172.21.15.70:0/4241615034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705979d0 0x55ea7059df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36da762640 1 -- 172.21.15.70:0/4241615034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea705a5890 con 0x55ea705a2bb0 2024-09-12T01:52:20.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36d9760640 1 --2- 172.21.15.70:0/4241615034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705982f0 0x55ea7059e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:20.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.608+0000 7f36da762640 1 --2- 172.21.15.70:0/4241615034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea705bcdc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f36cc02ae00 tx=0x7f36cc011400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c7f6337ecce0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:20.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.609+0000 7f36bf7fe640 1 -- 172.21.15.70:0/4241615034 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc010d80 con 0x55ea705a2bb0 2024-09-12T01:52:20.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.609+0000 7f36bf7fe640 1 -- 172.21.15.70:0/4241615034 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f36cc034480 con 0x55ea705a2bb0 2024-09-12T01:52:20.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.609+0000 7f36bf7fe640 1 -- 172.21.15.70:0/4241615034 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0348e0 con 0x55ea705a2bb0 2024-09-12T01:52:20.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.609+0000 7f36de59e740 1 -- 172.21.15.70:0/4241615034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 msgr2=0x55ea705bcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.609+0000 7f36de59e740 1 --2- 172.21.15.70:0/4241615034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea705bcdc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f36cc02ae00 tx=0x7f36cc011400 comp rx=0 tx=0).stop 2024-09-12T01:52:20.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.609+0000 7f36de59e740 1 -- 172.21.15.70:0/4241615034 shutdown_connections 2024-09-12T01:52:20.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.609+0000 7f36de59e740 1 --2- 172.21.15.70:0/4241615034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705a2bb0 0x55ea705bcdc0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.609+0000 7f36de59e740 1 --2- 172.21.15.70:0/4241615034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705982f0 0x55ea7059e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.609+0000 7f36de59e740 1 --2- 172.21.15.70:0/4241615034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705979d0 0x55ea7059df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.609+0000 7f36de59e740 1 -- 172.21.15.70:0/4241615034 >> 172.21.15.70:0/4241615034 conn(0x55ea70593f60 msgr2=0x55ea7059f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.609+0000 7f36de59e740 1 -- 172.21.15.70:0/4241615034 shutdown_connections 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.609+0000 7f36de59e740 1 -- 172.21.15.70:0/4241615034 wait complete. 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.610+0000 7f36de59e740 1 -- start start 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.610+0000 7f36de59e740 1 Processor -- start 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.610+0000 7f36de59e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705979d0 0x55ea705bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.610+0000 7f36de59e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705982f0 0x55ea705bd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.610+0000 7f36de59e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705a2bb0 0x55ea705b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.610+0000 7f36de59e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ea705b4990 con 0x55ea705982f0 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.610+0000 7f36de59e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ea705b42c0 con 0x55ea705a2bb0 2024-09-12T01:52:20.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.610+0000 7f36de59e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ea705b5060 con 0x55ea705979d0 2024-09-12T01:52:20.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.610+0000 7f36de59e740 10 client.0 _ll_register_callbacks cb 0x7f36cc011580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:20.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.610+0000 7f36d9760640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705982f0 0x55ea705bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.610+0000 7f36d9760640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705982f0 0x55ea705bd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35326/0 (socket says 172.21.15.70:35326) 2024-09-12T01:52:20.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.610+0000 7f36d9760640 1 -- 172.21.15.70:0/1501166827 learned_addr learned my addr 172.21.15.70:0/1501166827 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:20.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36da762640 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705a2bb0 0x55ea705b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36d9f61640 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705979d0 0x55ea705bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36d9760640 1 -- 172.21.15.70:0/1501166827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705979d0 msgr2=0x55ea705bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:20.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36d9760640 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705979d0 0x55ea705bd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36d9760640 1 -- 172.21.15.70:0/1501166827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705a2bb0 msgr2=0x55ea705b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:20.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36d9760640 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705a2bb0 0x55ea705b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36d9760640 1 -- 172.21.15.70:0/1501166827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea705b6e80 con 0x55ea705982f0 2024-09-12T01:52:20.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36d9f61640 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705979d0 0x55ea705bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36da762640 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705a2bb0 0x55ea705b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36d9760640 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705982f0 0x55ea705bd6b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f36c4004650 tx=0x7f36c4031950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd2d55c5826db2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36bd7fa640 1 -- 172.21.15.70:0/1501166827 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c404c070 con 0x55ea705982f0 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36bd7fa640 1 -- 172.21.15.70:0/1501166827 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f36c4005450 con 0x55ea705982f0 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36de59e740 1 -- 172.21.15.70:0/1501166827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36cc034480 con 0x55ea705982f0 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36bd7fa640 1 -- 172.21.15.70:0/1501166827 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f36c4058050 con 0x55ea705982f0 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36de59e740 10 client.15519 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36de59e740 1 -- 172.21.15.70:0/1501166827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ea705bb960 con 0x55ea705982f0 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.611+0000 7f36bd7fa640 1 -- 172.21.15.70:0/1501166827 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f36cc034480 con 0x55ea705982f0 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.612+0000 7f36bd7fa640 1 -- 172.21.15.70:0/1501166827 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f36c403c690 con 0x55ea705982f0 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.612+0000 7f36de59e740 10 client.15519 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:20.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.612+0000 7f36de59e740 10 client.15519 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.612+0000 7f36de59e740 20 client.15519 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.612+0000 7f36de59e740 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55ea706221c0 0x55ea70620ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.612+0000 7f36de59e740 4 client.15519 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.612+0000 7f36de59e740 1 -- 172.21.15.70:0/1501166827 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "status"}) -- 0x55ea70505b10 con 0x55ea706221c0 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.612+0000 7f36d9f61640 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55ea706221c0 0x55ea70620ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.612+0000 7f36d9f61640 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55ea706221c0 0x55ea70620ed0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1503dc6a8ce88d7e server_cookie=c0dccec53da5ea43 in_seq=0 out_seq=0 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.612+0000 7f36bd7fa640 10 client.15519 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36bd7fa640 1 -- 172.21.15.70:0/1501166827 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ea70505b10 con 0x55ea706221c0 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36bd7fa640 10 client.15519 handle_command_reply: tid=0 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36de59e740 1 client.15519 shutdown 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36de59e740 1 -- 172.21.15.70:0/1501166827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705982f0 msgr2=0x55ea705bd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36de59e740 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705982f0 0x55ea705bd6b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f36c4004650 tx=0x7f36c4031950 comp rx=0 tx=0).stop 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36de59e740 1 -- 172.21.15.70:0/1501166827 shutdown_connections 2024-09-12T01:52:20.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36de59e740 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55ea706221c0 0x55ea70620ed0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36de59e740 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ea705a2bb0 0x55ea705b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36de59e740 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea705982f0 0x55ea705bd6b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36de59e740 1 --2- 172.21.15.70:0/1501166827 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ea705979d0 0x55ea705bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36bd7fa640 0 client.15519 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:20.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36de59e740 1 -- 172.21.15.70:0/1501166827 >> 172.21.15.70:0/1501166827 conn(0x55ea70593f60 msgr2=0x55ea7059a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:20.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36de59e740 1 -- 172.21.15.70:0/1501166827 shutdown_connections 2024-09-12T01:52:20.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36de59e740 1 -- 172.21.15.70:0/1501166827 wait complete. 2024-09-12T01:52:20.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36de59e740 20 client.15519 trim_cache size 0 max 16384 2024-09-12T01:52:20.620 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:52:20.621 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "2d8cad48-70a8-11ef-bcea-c7b262605968", 2024-09-12T01:52:20.621 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-12T01:52:20.621 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24452, 2024-09-12T01:52:20.621 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-12T01:52:20.621 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-12T01:52:20.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-12T01:52:20.621 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 142.30037834399999, 2024-09-12T01:52:20.621 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 28, 2024-09-12T01:52:20.621 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-12T01:52:20.621 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 83, 2024-09-12T01:52:20.621 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 153.01711391399999 2024-09-12T01:52:20.621 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:52:20.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36dc1c5640 1 -- 172.21.15.70:0/1442035834 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f36c00a2b80 msgr2=0x7f36c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36dc1c5640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f36c00a2b80 0x7f36c00a5040 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f36cc005fd0 tx=0x7f36cc009500 comp rx=0 tx=0).stop 2024-09-12T01:52:20.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36dc1c5640 1 -- 172.21.15.70:0/1442035834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d4100e20 msgr2=0x7f36d41993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.613+0000 7f36dc1c5640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d4100e20 0x7f36d41993f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f36d000e9f0 tx=0x7f36d000eeb0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.614+0000 7f36dc1c5640 1 -- 172.21.15.70:0/1442035834 shutdown_connections 2024-09-12T01:52:20.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.614+0000 7f36dc1c5640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f36c00a2b80 0x7f36c00a5040 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.614+0000 7f36dc1c5640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36d4102ef0 0x7f36d41a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.614+0000 7f36dc1c5640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4102570 0x7f36d4199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.614+0000 7f36dc1c5640 1 --2- 172.21.15.70:0/1442035834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d4100e20 0x7f36d41993f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.614+0000 7f36dc1c5640 1 -- 172.21.15.70:0/1442035834 >> 172.21.15.70:0/1442035834 conn(0x7f36d40fc7d0 msgr2=0x7f36d4106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:20.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.614+0000 7f36dc1c5640 1 -- 172.21.15.70:0/1442035834 shutdown_connections 2024-09-12T01:52:20.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:20.614+0000 7f36dc1c5640 1 -- 172.21.15.70:0/1442035834 wait complete. 2024-09-12T01:52:20.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:20 smithi191 ceph-mon[35770]: pgmap v342: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-12T01:52:21.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:20 smithi152 ceph-mon[35055]: pgmap v342: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-12T01:52:21.214 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-12T01:52:22.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:22 smithi070 ceph-mon[31177]: pgmap v343: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-12T01:52:22.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:22 smithi191 ceph-mon[35770]: pgmap v343: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-12T01:52:23.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:22 smithi152 ceph-mon[35055]: pgmap v343: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-12T01:52:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.883+0000 7f933690a640 1 -- 172.21.15.70:0/80732953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9330103710 msgr2=0x7f9330109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.883+0000 7f933690a640 1 --2- 172.21.15.70:0/80732953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9330103710 0x7f9330109fa0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9328009ca0 tx=0x7f932802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.883+0000 7f933690a640 1 -- 172.21.15.70:0/80732953 shutdown_connections 2024-09-12T01:52:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.883+0000 7f933690a640 1 --2- 172.21.15.70:0/80732953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9330103710 0x7f9330109fa0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.883+0000 7f933690a640 1 --2- 172.21.15.70:0/80732953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9330102d50 0x7f93301031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.883+0000 7f933690a640 1 --2- 172.21.15.70:0/80732953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9330101b60 0x7f9330101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.883+0000 7f933690a640 1 -- 172.21.15.70:0/80732953 >> 172.21.15.70:0/80732953 conn(0x7f93300fd2e0 msgr2=0x7f93300ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.883+0000 7f933690a640 1 -- 172.21.15.70:0/80732953 shutdown_connections 2024-09-12T01:52:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.883+0000 7f933690a640 1 -- 172.21.15.70:0/80732953 wait complete. 2024-09-12T01:52:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.883+0000 7f933690a640 1 Processor -- start 2024-09-12T01:52:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.883+0000 7f933690a640 1 -- start start 2024-09-12T01:52:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f933690a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9330101b60 0x7f9330197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f933690a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9330102d50 0x7f93301983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f933690a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9330103710 0x7f933019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f933690a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f933010d940 con 0x7f9330101b60 2024-09-12T01:52:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f933690a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f933010d7c0 con 0x7f9330103710 2024-09-12T01:52:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f933690a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f933010dac0 con 0x7f9330102d50 2024-09-12T01:52:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f932ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9330101b60 0x7f9330197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f932ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9330101b60 0x7f9330197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35354/0 (socket says 172.21.15.70:35354) 2024-09-12T01:52:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f932ffff640 1 -- 172.21.15.70:0/2545401342 learned_addr learned my addr 172.21.15.70:0/2545401342 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f9334ea7640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9330103710 0x7f933019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f932f7fe640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9330102d50 0x7f93301983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f932ffff640 1 -- 172.21.15.70:0/2545401342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9330102d50 msgr2=0x7f93301983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f932ffff640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9330102d50 0x7f93301983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f932ffff640 1 -- 172.21.15.70:0/2545401342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9330103710 msgr2=0x7f933019f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f932ffff640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9330103710 0x7f933019f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f932ffff640 1 -- 172.21.15.70:0/2545401342 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933019faa0 con 0x7f9330101b60 2024-09-12T01:52:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.884+0000 7f932ffff640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9330101b60 0x7f9330197e80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f932000c970 tx=0x7f932000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.885+0000 7f932d7fa640 1 -- 172.21.15.70:0/2545401342 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9320004220 con 0x7f9330101b60 2024-09-12T01:52:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.885+0000 7f932d7fa640 1 -- 172.21.15.70:0/2545401342 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f93200043c0 con 0x7f9330101b60 2024-09-12T01:52:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.885+0000 7f933690a640 1 -- 172.21.15.70:0/2545401342 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933019fd90 con 0x7f9330101b60 2024-09-12T01:52:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.885+0000 7f932d7fa640 1 -- 172.21.15.70:0/2545401342 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932000f6b0 con 0x7f9330101b60 2024-09-12T01:52:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.885+0000 7f933690a640 1 -- 172.21.15.70:0/2545401342 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93301a0220 con 0x7f9330101b60 2024-09-12T01:52:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.887+0000 7f932d7fa640 1 -- 172.21.15.70:0/2545401342 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f93200037a0 con 0x7f9330101b60 2024-09-12T01:52:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.887+0000 7f933969f740 1 Processor -- start 2024-09-12T01:52:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.887+0000 7f933969f740 1 -- start start 2024-09-12T01:52:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f933969f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4a21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f933969f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f933969f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a7780 0x55a1fe4a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f933969f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a1fe4012f0 con 0x55a1fe4a26f0 2024-09-12T01:52:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f933969f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a1fe3a9270 con 0x55a1fe4a1db0 2024-09-12T01:52:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f933969f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a1fe3fd2b0 con 0x55a1fe4a7780 2024-09-12T01:52:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4a71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35366/0 (socket says 172.21.15.70:35366) 2024-09-12T01:52:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932ffff640 1 -- 172.21.15.70:0/3261903066 learned_addr learned my addr 172.21.15.70:0/3261903066 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f9334ea7640 1 --2- 172.21.15.70:0/3261903066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4a21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932f7fe640 1 --2- 172.21.15.70:0/3261903066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a7780 0x55a1fe4a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932ffff640 1 -- 172.21.15.70:0/3261903066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a7780 msgr2=0x55a1fe4a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932ffff640 1 --2- 172.21.15.70:0/3261903066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a7780 0x55a1fe4a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932ffff640 1 -- 172.21.15.70:0/3261903066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a1db0 msgr2=0x55a1fe4a21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932ffff640 1 --2- 172.21.15.70:0/3261903066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4a21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932ffff640 1 -- 172.21.15.70:0/3261903066 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1fe3a8340 con 0x55a1fe4a26f0 2024-09-12T01:52:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932d7fa640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93180a2c30 0x7f93180a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f9334ea7640 1 --2- 172.21.15.70:0/3261903066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4a21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932f7fe640 1 --2- 172.21.15.70:0/3261903066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a7780 0x55a1fe4a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932f7fe640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93180a2c30 0x7f93180a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932ffff640 1 --2- 172.21.15.70:0/3261903066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4a71b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f93200d2ef0 tx=0x7f9320097880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ced8ffd6d5ab71a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f932d7fa640 1 -- 172.21.15.70:0/2545401342 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f93200cedc0 con 0x7f9330101b60 2024-09-12T01:52:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.888+0000 7f93167fc640 1 -- 172.21.15.70:0/3261903066 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932001d030 con 0x55a1fe4a26f0 2024-09-12T01:52:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.889+0000 7f93167fc640 1 -- 172.21.15.70:0/3261903066 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f93200a4250 con 0x55a1fe4a26f0 2024-09-12T01:52:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.889+0000 7f93167fc640 1 -- 172.21.15.70:0/3261903066 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932009b120 con 0x55a1fe4a26f0 2024-09-12T01:52:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.889+0000 7f933969f740 1 -- 172.21.15.70:0/3261903066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a26f0 msgr2=0x55a1fe4a71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.889+0000 7f932f7fe640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93180a2c30 0x7f93180a50f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9330199390 tx=0x7f9324005f30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.889+0000 7f933969f740 1 --2- 172.21.15.70:0/3261903066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4a71b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f93200d2ef0 tx=0x7f9320097880 comp rx=0 tx=0).stop 2024-09-12T01:52:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.889+0000 7f933969f740 1 -- 172.21.15.70:0/3261903066 shutdown_connections 2024-09-12T01:52:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.889+0000 7f933969f740 1 --2- 172.21.15.70:0/3261903066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a7780 0x55a1fe4a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.889+0000 7f933969f740 1 --2- 172.21.15.70:0/3261903066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4a71b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.889+0000 7f933969f740 1 --2- 172.21.15.70:0/3261903066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4a21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.889+0000 7f933969f740 1 -- 172.21.15.70:0/3261903066 >> 172.21.15.70:0/3261903066 conn(0x55a1fe499010 msgr2=0x55a1fe499410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.889+0000 7f933969f740 1 -- 172.21.15.70:0/3261903066 shutdown_connections 2024-09-12T01:52:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.889+0000 7f933969f740 1 -- 172.21.15.70:0/3261903066 wait complete. 2024-09-12T01:52:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.890+0000 7f933969f740 1 -- start start 2024-09-12T01:52:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.890+0000 7f933969f740 1 Processor -- start 2024-09-12T01:52:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.890+0000 7f933969f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4ac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.890+0000 7f933969f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4ac570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.890+0000 7f933969f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a7780 0x55a1fe4b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.890+0000 7f933969f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a1fe4aa750 con 0x55a1fe4a1db0 2024-09-12T01:52:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.890+0000 7f933969f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a1fe38a290 con 0x55a1fe4a7780 2024-09-12T01:52:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.890+0000 7f933969f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a1fe4aa8d0 con 0x55a1fe4a26f0 2024-09-12T01:52:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.890+0000 7f933969f740 10 client.0 _ll_register_callbacks cb 0x55a1fe3bb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.890+0000 7f932ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.890+0000 7f932ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4ac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35380/0 (socket says 172.21.15.70:35380) 2024-09-12T01:52:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.890+0000 7f932ffff640 1 -- 172.21.15.70:0/1856842105 learned_addr learned my addr 172.21.15.70:0/1856842105 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f932ffff640 1 -- 172.21.15.70:0/1856842105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a26f0 msgr2=0x55a1fe4ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f932ffff640 1 --2- 172.21.15.70:0/1856842105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f9334ea7640 1 --2- 172.21.15.70:0/1856842105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a7780 0x55a1fe4b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f932ffff640 1 -- 172.21.15.70:0/1856842105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a7780 msgr2=0x55a1fe4b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f932ffff640 1 --2- 172.21.15.70:0/1856842105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a7780 0x55a1fe4b35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f932ffff640 1 -- 172.21.15.70:0/1856842105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1fe114210 con 0x55a1fe4a1db0 2024-09-12T01:52:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f932ffff640 1 --2- 172.21.15.70:0/1856842105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4ac030 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f93200a4410 tx=0x7f9320003b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54804e8195445335 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f930f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f930f7fe640 1 -- 172.21.15.70:0/1856842105 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932001d070 con 0x55a1fe4a1db0 2024-09-12T01:52:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f930f7fe640 1 -- 172.21.15.70:0/1856842105 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f932009b840 con 0x55a1fe4a1db0 2024-09-12T01:52:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f933969f740 1 -- 172.21.15.70:0/1856842105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a1fe40ea20 con 0x55a1fe4a1db0 2024-09-12T01:52:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f930f7fe640 1 -- 172.21.15.70:0/1856842105 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f932009af40 con 0x55a1fe4a1db0 2024-09-12T01:52:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f933969f740 10 client.15531 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f933969f740 1 -- 172.21.15.70:0/1856842105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a1fe1e0620 con 0x55a1fe4a1db0 2024-09-12T01:52:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f930f7fe640 1 -- 172.21.15.70:0/1856842105 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55a1fe40ea20 con 0x55a1fe4a1db0 2024-09-12T01:52:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f930f7fe640 1 -- 172.21.15.70:0/1856842105 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f93200a3dc0 con 0x55a1fe4a1db0 2024-09-12T01:52:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f933969f740 10 client.15531 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f933969f740 10 client.15531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f933969f740 20 client.15531 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f933969f740 1 --2- 172.21.15.70:0/1856842105 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55a1fe4b7820 0x55a1fe4b9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.891+0000 7f933969f740 4 client.15531 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.892+0000 7f933969f740 1 -- 172.21.15.70:0/1856842105 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1fe408d70 con 0x55a1fe4b7820 2024-09-12T01:52:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.892+0000 7f932f7fe640 1 --2- 172.21.15.70:0/1856842105 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55a1fe4b7820 0x55a1fe4b9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.892+0000 7f932f7fe640 1 --2- 172.21.15.70:0/1856842105 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55a1fe4b7820 0x55a1fe4b9c10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45b410474a62579e server_cookie=fa3b5c6a35770919 in_seq=0 out_seq=0 2024-09-12T01:52:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.892+0000 7f930f7fe640 10 client.15531 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f930f7fe640 1 -- 172.21.15.70:0/1856842105 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a1fe408d70 con 0x55a1fe4b7820 2024-09-12T01:52:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f930f7fe640 10 client.15531 handle_command_reply: tid=0 2024-09-12T01:52:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f933969f740 1 client.15531 shutdown 2024-09-12T01:52:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f933969f740 1 -- 172.21.15.70:0/1856842105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 msgr2=0x55a1fe4ac030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f933969f740 1 --2- 172.21.15.70:0/1856842105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4ac030 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f93200a4410 tx=0x7f9320003b40 comp rx=0 tx=0).stop 2024-09-12T01:52:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f933969f740 1 -- 172.21.15.70:0/1856842105 shutdown_connections 2024-09-12T01:52:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f933969f740 1 --2- 172.21.15.70:0/1856842105 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55a1fe4b7820 0x55a1fe4b9c10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f933969f740 1 --2- 172.21.15.70:0/1856842105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a7780 0x55a1fe4b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f933969f740 1 --2- 172.21.15.70:0/1856842105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f933969f740 1 --2- 172.21.15.70:0/1856842105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4ac030 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f930f7fe640 0 client.15531 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f933969f740 1 -- 172.21.15.70:0/1856842105 >> 172.21.15.70:0/1856842105 conn(0x55a1fe499010 msgr2=0x55a1fe49a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f933969f740 1 -- 172.21.15.70:0/1856842105 shutdown_connections 2024-09-12T01:52:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.893+0000 7f933969f740 1 -- 172.21.15.70:0/1856842105 wait complete. 2024-09-12T01:52:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.894+0000 7f933969f740 20 client.15531 trim_cache size 0 max 16384 2024-09-12T01:52:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f933969f740 1 Processor -- start 2024-09-12T01:52:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f933969f740 1 -- start start 2024-09-12T01:52:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f933969f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe499010 0x55a1fe4ac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f933969f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f933969f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f933969f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f93301a6ee0 con 0x55a1fe499010 2024-09-12T01:52:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f933969f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f93301a8a20 con 0x55a1fe4a26f0 2024-09-12T01:52:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f933969f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f93301a75b0 con 0x55a1fe4a1db0 2024-09-12T01:52:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f932ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe499010 0x55a1fe4ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f932ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe499010 0x55a1fe4ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35388/0 (socket says 172.21.15.70:35388) 2024-09-12T01:52:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f932ffff640 1 -- 172.21.15.70:0/3435841743 learned_addr learned my addr 172.21.15.70:0/3435841743 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f9334ea7640 1 --2- 172.21.15.70:0/3435841743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f932f7fe640 1 --2- 172.21.15.70:0/3435841743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f932ffff640 1 -- 172.21.15.70:0/3435841743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a1db0 msgr2=0x55a1fe4b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f932ffff640 1 --2- 172.21.15.70:0/3435841743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.914 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f932ffff640 1 -- 172.21.15.70:0/3435841743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a26f0 msgr2=0x55a1fe4be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:24.915 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f932ffff640 1 --2- 172.21.15.70:0/3435841743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4be370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.915 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f932ffff640 1 -- 172.21.15.70:0/3435841743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1fe4942d0 con 0x55a1fe499010 2024-09-12T01:52:24.915 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f9334ea7640 1 --2- 172.21.15.70:0/3435841743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:24.915 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.908+0000 7f932ffff640 1 --2- 172.21.15.70:0/3435841743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe499010 0x55a1fe4ac450 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f932009b570 tx=0x7f9320000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12aee95a67f9187a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:24.915 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.909+0000 7f9315ffb640 1 -- 172.21.15.70:0/3435841743 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932001d070 con 0x55a1fe499010 2024-09-12T01:52:24.915 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.909+0000 7f9315ffb640 1 -- 172.21.15.70:0/3435841743 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f93200b4070 con 0x55a1fe499010 2024-09-12T01:52:24.915 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.909+0000 7f9315ffb640 1 -- 172.21.15.70:0/3435841743 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9320097330 con 0x55a1fe499010 2024-09-12T01:52:24.915 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.909+0000 7f933969f740 1 -- 172.21.15.70:0/3435841743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe499010 msgr2=0x55a1fe4ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.909+0000 7f933969f740 1 --2- 172.21.15.70:0/3435841743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe499010 0x55a1fe4ac450 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f932009b570 tx=0x7f9320000bc0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.909+0000 7f933969f740 1 -- 172.21.15.70:0/3435841743 shutdown_connections 2024-09-12T01:52:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.909+0000 7f933969f740 1 --2- 172.21.15.70:0/3435841743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.909+0000 7f933969f740 1 --2- 172.21.15.70:0/3435841743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.909+0000 7f933969f740 1 --2- 172.21.15.70:0/3435841743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe499010 0x55a1fe4ac450 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.909+0000 7f933969f740 1 -- 172.21.15.70:0/3435841743 >> 172.21.15.70:0/3435841743 conn(0x55a1fe4a72d0 msgr2=0x55a1fe49a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.909+0000 7f933969f740 1 -- 172.21.15.70:0/3435841743 shutdown_connections 2024-09-12T01:52:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.909+0000 7f933969f740 1 -- 172.21.15.70:0/3435841743 wait complete. 2024-09-12T01:52:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f933969f740 1 -- start start 2024-09-12T01:52:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f933969f740 1 Processor -- start 2024-09-12T01:52:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f933969f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe499010 0x55a1fe4b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f933969f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f933969f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f933969f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f93301a8350 con 0x55a1fe4a1db0 2024-09-12T01:52:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f933969f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f93301a7c80 con 0x55a1fe4a26f0 2024-09-12T01:52:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f933969f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f93301a4ea0 con 0x55a1fe499010 2024-09-12T01:52:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f933969f740 10 client.0 _ll_register_callbacks cb 0x7f93200d2d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f932f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f932f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35398/0 (socket says 172.21.15.70:35398) 2024-09-12T01:52:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f932f7fe640 1 -- 172.21.15.70:0/3644339070 learned_addr learned my addr 172.21.15.70:0/3644339070 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f932ffff640 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe499010 0x55a1fe4b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f9334ea7640 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f932f7fe640 1 -- 172.21.15.70:0/3644339070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe499010 msgr2=0x55a1fe4b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f932f7fe640 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe499010 0x55a1fe4b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f932f7fe640 1 -- 172.21.15.70:0/3644339070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a26f0 msgr2=0x55a1fe4b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f932f7fe640 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f932f7fe640 1 -- 172.21.15.70:0/3644339070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1fe4b2af0 con 0x55a1fe4a1db0 2024-09-12T01:52:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.910+0000 7f9334ea7640 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f932f7fe640 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4b14d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f932400bdf0 tx=0x7f9324004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3784022b19455dac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f930f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f930f7fe640 1 -- 172.21.15.70:0/3644339070 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932401f830 con 0x55a1fe4a1db0 2024-09-12T01:52:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f930f7fe640 1 -- 172.21.15.70:0/3644339070 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f932401f9d0 con 0x55a1fe4a1db0 2024-09-12T01:52:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f933969f740 1 -- 172.21.15.70:0/3644339070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93200b4070 con 0x55a1fe4a1db0 2024-09-12T01:52:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f930f7fe640 1 -- 172.21.15.70:0/3644339070 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f932401fbd0 con 0x55a1fe4a1db0 2024-09-12T01:52:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f933969f740 10 client.15537 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f933969f740 1 -- 172.21.15.70:0/3644339070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a1fe5226c0 con 0x55a1fe4a1db0 2024-09-12T01:52:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f930f7fe640 1 -- 172.21.15.70:0/3644339070 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f93200b4070 con 0x55a1fe4a1db0 2024-09-12T01:52:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f930f7fe640 1 -- 172.21.15.70:0/3644339070 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f932400f040 con 0x55a1fe4a1db0 2024-09-12T01:52:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f933969f740 10 client.15537 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f933969f740 10 client.15537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f933969f740 20 client.15537 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f933969f740 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55a1fe4a7780 0x55a1fe525090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f933969f740 4 client.15537 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:52:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.911+0000 7f933969f740 1 -- 172.21.15.70:0/3644339070 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a1fe385900 con 0x55a1fe4a7780 2024-09-12T01:52:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.912+0000 7f932ffff640 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55a1fe4a7780 0x55a1fe525090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.912+0000 7f932ffff640 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55a1fe4a7780 0x55a1fe525090 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7042a0808b9073b server_cookie=cf903304c9cdb3d8 in_seq=0 out_seq=0 2024-09-12T01:52:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.912+0000 7f930f7fe640 10 client.15537 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.919+0000 7f930f7fe640 1 -- 172.21.15.70:0/3644339070 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a1fe385900 con 0x55a1fe4a7780 2024-09-12T01:52:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.919+0000 7f930f7fe640 10 client.15537 handle_command_reply: tid=0 2024-09-12T01:52:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.919+0000 7f933969f740 1 client.15537 shutdown 2024-09-12T01:52:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933969f740 1 -- 172.21.15.70:0/3644339070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 msgr2=0x55a1fe4b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933969f740 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4b14d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f932400bdf0 tx=0x7f9324004730 comp rx=0 tx=0).stop 2024-09-12T01:52:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933969f740 1 -- 172.21.15.70:0/3644339070 shutdown_connections 2024-09-12T01:52:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933969f740 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55a1fe4a7780 0x55a1fe525090 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933969f740 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a1fe4a26f0 0x55a1fe4b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933969f740 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1fe4a1db0 0x55a1fe4b14d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f930f7fe640 0 client.15537 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933969f740 1 --2- 172.21.15.70:0/3644339070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a1fe499010 0x55a1fe4b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933969f740 1 -- 172.21.15.70:0/3644339070 >> 172.21.15.70:0/3644339070 conn(0x55a1fe4a72d0 msgr2=0x55a1fe4979a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933969f740 1 -- 172.21.15.70:0/3644339070 shutdown_connections 2024-09-12T01:52:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933969f740 1 -- 172.21.15.70:0/3644339070 wait complete. 2024-09-12T01:52:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933969f740 20 client.15537 trim_cache size 0 max 16384 2024-09-12T01:52:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:52:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:52:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:52:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:52:24.924 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933690a640 1 -- 172.21.15.70:0/2545401342 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93180a2c30 msgr2=0x7f93180a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:24.924 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933690a640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93180a2c30 0x7f93180a50f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9330199390 tx=0x7f9324005f30 comp rx=0 tx=0).stop 2024-09-12T01:52:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933690a640 1 -- 172.21.15.70:0/2545401342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9330101b60 msgr2=0x7f9330197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.920+0000 7f933690a640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9330101b60 0x7f9330197e80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f932000c970 tx=0x7f932000ce30 comp rx=0 tx=0).stop 2024-09-12T01:52:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.921+0000 7f933690a640 1 -- 172.21.15.70:0/2545401342 shutdown_connections 2024-09-12T01:52:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.921+0000 7f933690a640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93180a2c30 0x7f93180a50f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.921+0000 7f933690a640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9330103710 0x7f933019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.921+0000 7f933690a640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9330102d50 0x7f93301983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.921+0000 7f933690a640 1 --2- 172.21.15.70:0/2545401342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9330101b60 0x7f9330197e80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.921+0000 7f933690a640 1 -- 172.21.15.70:0/2545401342 >> 172.21.15.70:0/2545401342 conn(0x7f93300fd2e0 msgr2=0x7f9330105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.921+0000 7f933690a640 1 -- 172.21.15.70:0/2545401342 shutdown_connections 2024-09-12T01:52:24.925 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:24.921+0000 7f933690a640 1 -- 172.21.15.70:0/2545401342 wait complete. 2024-09-12T01:52:24.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:24 smithi191 ceph-mon[35770]: pgmap v344: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.6 KiB/s wr, 14 op/s 2024-09-12T01:52:25.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:24 smithi152 ceph-mon[35055]: pgmap v344: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.6 KiB/s wr, 14 op/s 2024-09-12T01:52:25.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:24 smithi070 ceph-mon[31177]: pgmap v344: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.6 KiB/s wr, 14 op/s 2024-09-12T01:52:26.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:26 smithi191 ceph-mon[35770]: pgmap v345: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-12T01:52:27.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:26 smithi152 ceph-mon[35055]: pgmap v345: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-12T01:52:27.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:26 smithi070 ceph-mon[31177]: pgmap v345: 97 pgs: 97 active+clean; 661 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-12T01:52:28.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:28 smithi191 ceph-mon[35770]: pgmap v346: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-12T01:52:29.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:28 smithi152 ceph-mon[35055]: pgmap v346: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-12T01:52:29.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:28 smithi070 ceph-mon[31177]: pgmap v346: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-12T01:52:30.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:30 smithi191 ceph-mon[35770]: pgmap v347: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T01:52:31.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:30 smithi152 ceph-mon[35055]: pgmap v347: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T01:52:31.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:30 smithi070 ceph-mon[31177]: pgmap v347: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T01:52:32.732 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:52:32.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:32 smithi070 ceph-mon[31177]: pgmap v348: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T01:52:32.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:32 smithi191 ceph-mon[35770]: pgmap v348: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T01:52:32.995 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:33.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:32 smithi152 ceph-mon[35055]: pgmap v348: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T01:52:33.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.480+0000 7f44a42c0640 1 -- 172.21.15.70:0/2238090316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449c102ef0 msgr2=0x7f449c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:33.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.480+0000 7f44a42c0640 1 --2- 172.21.15.70:0/2238090316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449c102ef0 0x7f449c10da40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4494009ca0 tx=0x7f449402a950 comp rx=0 tx=0).stop 2024-09-12T01:52:33.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 -- 172.21.15.70:0/2238090316 shutdown_connections 2024-09-12T01:52:33.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 --2- 172.21.15.70:0/2238090316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449c102ef0 0x7f449c10da40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 --2- 172.21.15.70:0/2238090316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c102570 0x7f449c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 --2- 172.21.15.70:0/2238090316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f449c100e20 0x7f449c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 -- 172.21.15.70:0/2238090316 >> 172.21.15.70:0/2238090316 conn(0x7f449c0fc7d0 msgr2=0x7f449c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:33.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 -- 172.21.15.70:0/2238090316 shutdown_connections 2024-09-12T01:52:33.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 -- 172.21.15.70:0/2238090316 wait complete. 2024-09-12T01:52:33.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 Processor -- start 2024-09-12T01:52:33.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 -- start start 2024-09-12T01:52:33.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449c100e20 0x7f449c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c102570 0x7f449c1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f449c102ef0 0x7f449c1a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1110a0 con 0x7f449c100e20 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f449c110f20 con 0x7f449c102570 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.481+0000 7f44a42c0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f449c111220 con 0x7f449c102ef0 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a205c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449c100e20 0x7f449c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a205c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449c100e20 0x7f449c199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41204/0 (socket says 172.21.15.70:41204) 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a205c640 1 -- 172.21.15.70:0/291944233 learned_addr learned my addr 172.21.15.70:0/291944233 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a185b640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c102570 0x7f449c1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a285d640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f449c102ef0 0x7f449c1a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a205c640 1 -- 172.21.15.70:0/291944233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f449c102ef0 msgr2=0x7f449c1a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a205c640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f449c102ef0 0x7f449c1a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a205c640 1 -- 172.21.15.70:0/291944233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c102570 msgr2=0x7f449c1998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:33.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a205c640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c102570 0x7f449c1998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a205c640 1 -- 172.21.15.70:0/291944233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c1a4950 con 0x7f449c100e20 2024-09-12T01:52:33.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a205c640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449c100e20 0x7f449c199390 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f449800d770 tx=0x7f449800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:33.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44937fe640 1 -- 172.21.15.70:0/291944233 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4498017070 con 0x7f449c100e20 2024-09-12T01:52:33.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44937fe640 1 -- 172.21.15.70:0/291944233 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4498005520 con 0x7f449c100e20 2024-09-12T01:52:33.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a42c0640 1 -- 172.21.15.70:0/291944233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449c197180 con 0x7f449c100e20 2024-09-12T01:52:33.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44937fe640 1 -- 172.21.15.70:0/291944233 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4498010460 con 0x7f449c100e20 2024-09-12T01:52:33.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.482+0000 7f44a42c0640 1 -- 172.21.15.70:0/291944233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449c197670 con 0x7f449c100e20 2024-09-12T01:52:33.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.485+0000 7f44937fe640 1 -- 172.21.15.70:0/291944233 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4498004ea0 con 0x7f449c100e20 2024-09-12T01:52:33.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.485+0000 7f44937fe640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f44880a2b80 0x7f44880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.485+0000 7f44a185b640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f44880a2b80 0x7f44880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.485+0000 7f44937fe640 1 -- 172.21.15.70:0/291944233 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f44980ceac0 con 0x7f449c100e20 2024-09-12T01:52:33.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.486+0000 7f44a6699740 1 Processor -- start 2024-09-12T01:52:33.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.486+0000 7f44a185b640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f44880a2b80 0x7f44880a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f449c06ab00 tx=0x7f448c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:33.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.486+0000 7f44a6699740 1 -- start start 2024-09-12T01:52:33.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.486+0000 7f44a6699740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a729880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.486+0000 7f44a6699740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a734140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.486+0000 7f44a6699740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a736a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.486+0000 7f44a6699740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f25a68f2e0 con 0x55f25a729dc0 2024-09-12T01:52:33.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.486+0000 7f44a6699740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f25a636ce0 con 0x55f25a7294a0 2024-09-12T01:52:33.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.486+0000 7f44a6699740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f25a68b2a0 con 0x55f25a734680 2024-09-12T01:52:33.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.486+0000 7f44a185b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a734140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.486+0000 7f44a185b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a734140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41216/0 (socket says 172.21.15.70:41216) 2024-09-12T01:52:33.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.486+0000 7f44a185b640 1 -- 172.21.15.70:0/3614794749 learned_addr learned my addr 172.21.15.70:0/3614794749 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:33.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.487+0000 7f44a285d640 1 --2- 172.21.15.70:0/3614794749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a736a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.487+0000 7f44a205c640 1 --2- 172.21.15.70:0/3614794749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a729880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.487+0000 7f44a185b640 1 -- 172.21.15.70:0/3614794749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 msgr2=0x55f25a736a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:33.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.487+0000 7f44a185b640 1 --2- 172.21.15.70:0/3614794749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a736a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.487+0000 7f44a185b640 1 -- 172.21.15.70:0/3614794749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 msgr2=0x55f25a729880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:33.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.487+0000 7f44a185b640 1 --2- 172.21.15.70:0/3614794749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a729880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.487+0000 7f44a185b640 1 -- 172.21.15.70:0/3614794749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f25a61b440 con 0x55f25a729dc0 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.487+0000 7f44a205c640 1 --2- 172.21.15.70:0/3614794749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a729880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.487+0000 7f44a185b640 1 --2- 172.21.15.70:0/3614794749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a734140 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f448c010f80 tx=0x7f448c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe09d50d76e1551e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.487+0000 7f4490dea640 1 -- 172.21.15.70:0/3614794749 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c01e620 con 0x55f25a729dc0 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.487+0000 7f4490dea640 1 -- 172.21.15.70:0/3614794749 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f448c01ecc0 con 0x55f25a729dc0 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.487+0000 7f4490dea640 1 -- 172.21.15.70:0/3614794749 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c026d80 con 0x55f25a729dc0 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.488+0000 7f44a6699740 1 -- 172.21.15.70:0/3614794749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 msgr2=0x55f25a734140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.488+0000 7f44a6699740 1 --2- 172.21.15.70:0/3614794749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a734140 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f448c010f80 tx=0x7f448c013000 comp rx=0 tx=0).stop 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.488+0000 7f44a6699740 1 -- 172.21.15.70:0/3614794749 shutdown_connections 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.488+0000 7f44a6699740 1 --2- 172.21.15.70:0/3614794749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a736a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.488+0000 7f44a6699740 1 --2- 172.21.15.70:0/3614794749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a734140 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.488+0000 7f44a6699740 1 --2- 172.21.15.70:0/3614794749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a729880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.488+0000 7f44a6699740 1 -- 172.21.15.70:0/3614794749 >> 172.21.15.70:0/3614794749 conn(0x55f25a725a30 msgr2=0x55f25a725e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:33.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.488+0000 7f44a6699740 1 -- 172.21.15.70:0/3614794749 shutdown_connections 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.488+0000 7f44a6699740 1 -- 172.21.15.70:0/3614794749 wait complete. 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a6699740 1 -- start start 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a6699740 1 Processor -- start 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a6699740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a7294a0 0x55f25a733fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a6699740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a729dc0 0x55f25a731250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a6699740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a731790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a6699740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f25a737250 con 0x55f25a7294a0 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a6699740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55f25a64a050 con 0x55f25a729dc0 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a6699740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55f25a7373d0 con 0x55f25a734680 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a6699740 10 client.0 _ll_register_callbacks cb 0x55f25a68a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a205c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a7294a0 0x55f25a733fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a205c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a7294a0 0x55f25a733fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41222/0 (socket says 172.21.15.70:41222) 2024-09-12T01:52:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a205c640 1 -- 172.21.15.70:0/2023394931 learned_addr learned my addr 172.21.15.70:0/2023394931 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:33.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a285d640 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a731790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a205c640 1 -- 172.21.15.70:0/2023394931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 msgr2=0x55f25a731790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:33.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a205c640 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a731790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a205c640 1 -- 172.21.15.70:0/2023394931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a729dc0 msgr2=0x55f25a731250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:33.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a185b640 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a729dc0 0x55f25a731250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a205c640 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a729dc0 0x55f25a731250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.489+0000 7f44a205c640 1 -- 172.21.15.70:0/2023394931 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f25a4003c0 con 0x55f25a7294a0 2024-09-12T01:52:33.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f44a185b640 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a729dc0 0x55f25a731250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:33.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f44a205c640 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a7294a0 0x55f25a733fa0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f449809b360 tx=0x7f449809afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a66352dcef373 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:33.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f4485ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:33.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f4485ffb640 1 -- 172.21.15.70:0/2023394931 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4498020040 con 0x55f25a7294a0 2024-09-12T01:52:33.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f4485ffb640 1 -- 172.21.15.70:0/2023394931 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f44980b4190 con 0x55f25a7294a0 2024-09-12T01:52:33.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f44a6699740 1 -- 172.21.15.70:0/2023394931 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f448c01ecc0 con 0x55f25a7294a0 2024-09-12T01:52:33.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f4485ffb640 1 -- 172.21.15.70:0/2023394931 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f449809f6d0 con 0x55f25a7294a0 2024-09-12T01:52:33.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f44a6699740 10 client.15549 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:33.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f44a6699740 1 -- 172.21.15.70:0/2023394931 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f25a742bd0 con 0x55f25a7294a0 2024-09-12T01:52:33.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f4485ffb640 1 -- 172.21.15.70:0/2023394931 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44980a3f90 con 0x55f25a7294a0 2024-09-12T01:52:33.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f4485ffb640 1 -- 172.21.15.70:0/2023394931 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f449809a820 con 0x55f25a7294a0 2024-09-12T01:52:33.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f44a6699740 10 client.15549 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:33.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f44a6699740 10 client.15549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:33.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f44a6699740 20 client.15549 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:33.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f44a6699740 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f25a744030 0x55f25a746460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f44a6699740 4 client.15549 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.490+0000 7f44a6699740 1 -- 172.21.15.70:0/2023394931 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f448c01ecc0 con 0x55f25a744030 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.491+0000 7f44a185b640 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f25a744030 0x55f25a746460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.491+0000 7f44a185b640 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f25a744030 0x55f25a746460 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62074a0210fc1760 server_cookie=17354af7fac4ed25 in_seq=0 out_seq=0 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.491+0000 7f4485ffb640 10 client.15549 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f4485ffb640 1 -- 172.21.15.70:0/2023394931 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f448c01ecc0 con 0x55f25a744030 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f4485ffb640 10 client.15549 handle_command_reply: tid=0 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f44a6699740 1 client.15549 shutdown 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f44a6699740 1 -- 172.21.15.70:0/2023394931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a7294a0 msgr2=0x55f25a733fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f44a6699740 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a7294a0 0x55f25a733fa0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f449809b360 tx=0x7f449809afe0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f44a6699740 1 -- 172.21.15.70:0/2023394931 shutdown_connections 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f44a6699740 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f25a744030 0x55f25a746460 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f44a6699740 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a731790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f44a6699740 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a729dc0 0x55f25a731250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f44a6699740 1 --2- 172.21.15.70:0/2023394931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a7294a0 0x55f25a733fa0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f4485ffb640 0 client.15549 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f44a6699740 1 -- 172.21.15.70:0/2023394931 >> 172.21.15.70:0/2023394931 conn(0x55f25a725a30 msgr2=0x55f25a724b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f44a6699740 1 -- 172.21.15.70:0/2023394931 shutdown_connections 2024-09-12T01:52:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f44a6699740 1 -- 172.21.15.70:0/2023394931 wait complete. 2024-09-12T01:52:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.492+0000 7f44a6699740 20 client.15549 trim_cache size 0 max 16384 2024-09-12T01:52:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.509+0000 7f44a6699740 1 Processor -- start 2024-09-12T01:52:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.509+0000 7f44a6699740 1 -- start start 2024-09-12T01:52:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a6699740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a7404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a6699740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a74bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a6699740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a74c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a6699740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1ab420 con 0x55f25a729dc0 2024-09-12T01:52:33.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a6699740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1acf60 con 0x55f25a7294a0 2024-09-12T01:52:33.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a6699740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1abaf0 con 0x55f25a734680 2024-09-12T01:52:33.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a185b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a74bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a185b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a74bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41230/0 (socket says 172.21.15.70:41230) 2024-09-12T01:52:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a185b640 1 -- 172.21.15.70:0/3644202315 learned_addr learned my addr 172.21.15.70:0/3644202315 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a205c640 1 --2- 172.21.15.70:0/3644202315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a7404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a285d640 1 --2- 172.21.15.70:0/3644202315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a74c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a185b640 1 -- 172.21.15.70:0/3644202315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 msgr2=0x55f25a74c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a185b640 1 --2- 172.21.15.70:0/3644202315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a74c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a185b640 1 -- 172.21.15.70:0/3644202315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 msgr2=0x55f25a7404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a185b640 1 --2- 172.21.15.70:0/3644202315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a7404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a185b640 1 -- 172.21.15.70:0/3644202315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f25a7266c0 con 0x55f25a729dc0 2024-09-12T01:52:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.510+0000 7f44a185b640 1 --2- 172.21.15.70:0/3644202315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a74bd30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f448c00b9a0 tx=0x7f448c0269a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4b80973ca21583 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.511+0000 7f4487fff640 1 -- 172.21.15.70:0/3644202315 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c026700 con 0x55f25a729dc0 2024-09-12T01:52:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.511+0000 7f4487fff640 1 -- 172.21.15.70:0/3644202315 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f448c01e420 con 0x55f25a729dc0 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.511+0000 7f4487fff640 1 -- 172.21.15.70:0/3644202315 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c032650 con 0x55f25a729dc0 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.511+0000 7f44a6699740 1 -- 172.21.15.70:0/3644202315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 msgr2=0x55f25a74bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.511+0000 7f44a6699740 1 --2- 172.21.15.70:0/3644202315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a74bd30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f448c00b9a0 tx=0x7f448c0269a0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.511+0000 7f44a6699740 1 -- 172.21.15.70:0/3644202315 shutdown_connections 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.511+0000 7f44a6699740 1 --2- 172.21.15.70:0/3644202315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a74c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.511+0000 7f44a6699740 1 --2- 172.21.15.70:0/3644202315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a74bd30 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.511+0000 7f44a6699740 1 --2- 172.21.15.70:0/3644202315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a7404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.511+0000 7f44a6699740 1 -- 172.21.15.70:0/3644202315 >> 172.21.15.70:0/3644202315 conn(0x55f25a725a30 msgr2=0x55f25a730340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.511+0000 7f44a6699740 1 -- 172.21.15.70:0/3644202315 shutdown_connections 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.511+0000 7f44a6699740 1 -- 172.21.15.70:0/3644202315 wait complete. 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a6699740 1 -- start start 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a6699740 1 Processor -- start 2024-09-12T01:52:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a6699740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a73ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a6699740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a73cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a6699740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a737f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a6699740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1ac890 con 0x55f25a729dc0 2024-09-12T01:52:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a6699740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1ac1c0 con 0x55f25a7294a0 2024-09-12T01:52:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a6699740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1a9400 con 0x55f25a734680 2024-09-12T01:52:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a6699740 10 client.0 _ll_register_callbacks cb 0x7f4498004840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a185b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a73cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a185b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a73cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41234/0 (socket says 172.21.15.70:41234) 2024-09-12T01:52:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a185b640 1 -- 172.21.15.70:0/2586023478 learned_addr learned my addr 172.21.15.70:0/2586023478 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a285d640 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a737f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.512+0000 7f44a205c640 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a73ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f44a185b640 1 -- 172.21.15.70:0/2586023478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 msgr2=0x55f25a737f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f44a185b640 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a737f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f44a185b640 1 -- 172.21.15.70:0/2586023478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 msgr2=0x55f25a73ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f44a185b640 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a73ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f44a185b640 1 -- 172.21.15.70:0/2586023478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f25a72aa20 con 0x55f25a729dc0 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f44a185b640 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a73cf40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f448c005b30 tx=0x7f448c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7dd88e6031b14de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f4485ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f4485ffb640 1 -- 172.21.15.70:0/2586023478 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c048060 con 0x55f25a729dc0 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f4485ffb640 1 -- 172.21.15.70:0/2586023478 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f448c026700 con 0x55f25a729dc0 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f44a6699740 1 -- 172.21.15.70:0/2586023478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f448c01e420 con 0x55f25a729dc0 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f4485ffb640 1 -- 172.21.15.70:0/2586023478 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f448c026a10 con 0x55f25a729dc0 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f44a6699740 10 client.15555 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:33.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.513+0000 7f44a6699740 1 -- 172.21.15.70:0/2586023478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f25a7ae7f0 con 0x55f25a729dc0 2024-09-12T01:52:33.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.514+0000 7f4485ffb640 1 -- 172.21.15.70:0/2586023478 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f448c01e420 con 0x55f25a729dc0 2024-09-12T01:52:33.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.514+0000 7f4485ffb640 1 -- 172.21.15.70:0/2586023478 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f448c04d070 con 0x55f25a729dc0 2024-09-12T01:52:33.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.514+0000 7f44a6699740 10 client.15555 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:33.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.514+0000 7f44a6699740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:33.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.514+0000 7f44a6699740 20 client.15555 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:33.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.514+0000 7f44a6699740 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f25a7aecb0 0x55f25a7b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:33.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.514+0000 7f44a6699740 4 client.15555 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:52:33.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.514+0000 7f44a6699740 1 -- 172.21.15.70:0/2586023478 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f25a69c850 con 0x55f25a7aecb0 2024-09-12T01:52:33.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.514+0000 7f44a205c640 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f25a7aecb0 0x55f25a7b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:33.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.514+0000 7f44a205c640 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f25a7aecb0 0x55f25a7b10a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13f8e91b253c88f1 server_cookie=93b848628051b70a in_seq=0 out_seq=0 2024-09-12T01:52:33.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.514+0000 7f4485ffb640 10 client.15555 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:33.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f4485ffb640 1 -- 172.21.15.70:0/2586023478 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f25a69c850 con 0x55f25a7aecb0 2024-09-12T01:52:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f4485ffb640 10 client.15555 handle_command_reply: tid=0 2024-09-12T01:52:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f44a6699740 1 client.15555 shutdown 2024-09-12T01:52:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f44a6699740 1 -- 172.21.15.70:0/2586023478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 msgr2=0x55f25a73cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f44a6699740 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a73cf40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f448c005b30 tx=0x7f448c005850 comp rx=0 tx=0).stop 2024-09-12T01:52:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f44a6699740 1 -- 172.21.15.70:0/2586023478 shutdown_connections 2024-09-12T01:52:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f44a6699740 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55f25a7aecb0 0x55f25a7b10a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f44a6699740 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55f25a734680 0x55f25a737f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f44a6699740 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f25a729dc0 0x55f25a73cf40 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f44a6699740 1 --2- 172.21.15.70:0/2586023478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55f25a7294a0 0x55f25a73ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f44a6699740 1 -- 172.21.15.70:0/2586023478 >> 172.21.15.70:0/2586023478 conn(0x55f25a725a30 msgr2=0x55f25a72c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f4485ffb640 0 client.15555 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f44a6699740 1 -- 172.21.15.70:0/2586023478 shutdown_connections 2024-09-12T01:52:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f44a6699740 1 -- 172.21.15.70:0/2586023478 wait complete. 2024-09-12T01:52:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.515+0000 7f44a6699740 20 client.15555 trim_cache size 0 max 16384 2024-09-12T01:52:33.534 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:52:33.534 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-12T01:52:33.535 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-12T01:52:33.535 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:52:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.516+0000 7f44a42c0640 1 -- 172.21.15.70:0/291944233 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f44880a2b80 msgr2=0x7f44880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.516+0000 7f44a42c0640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f44880a2b80 0x7f44880a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f449c06ab00 tx=0x7f448c00b410 comp rx=0 tx=0).stop 2024-09-12T01:52:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.516+0000 7f44a42c0640 1 -- 172.21.15.70:0/291944233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449c100e20 msgr2=0x7f449c199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.516+0000 7f44a42c0640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449c100e20 0x7f449c199390 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f449800d770 tx=0x7f449800dc30 comp rx=0 tx=0).stop 2024-09-12T01:52:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.516+0000 7f44a42c0640 1 -- 172.21.15.70:0/291944233 shutdown_connections 2024-09-12T01:52:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.516+0000 7f44a42c0640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f44880a2b80 0x7f44880a5040 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.516+0000 7f44a42c0640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f449c102ef0 0x7f449c1a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.516+0000 7f44a42c0640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c102570 0x7f449c1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.516+0000 7f44a42c0640 1 --2- 172.21.15.70:0/291944233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449c100e20 0x7f449c199390 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.516+0000 7f44a42c0640 1 -- 172.21.15.70:0/291944233 >> 172.21.15.70:0/291944233 conn(0x7f449c0fc7d0 msgr2=0x7f449c1067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.516+0000 7f44a42c0640 1 -- 172.21.15.70:0/291944233 shutdown_connections 2024-09-12T01:52:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:33.516+0000 7f44a42c0640 1 -- 172.21.15.70:0/291944233 wait complete. 2024-09-12T01:52:34.163 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:52:34.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:52:34.459 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:34.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:34 smithi070 ceph-mon[31177]: pgmap v349: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:52:34.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:34 smithi191 ceph-mon[35770]: pgmap v349: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:52:34.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.955+0000 7f8fda68d640 1 -- 172.21.15.70:0/1288033289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fd4100a70 msgr2=0x7f8fd4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.955+0000 7f8fda68d640 1 --2- 172.21.15.70:0/1288033289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fd4100a70 0x7f8fd4100ed0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009930 tx=0x7f8fc802a420 comp rx=0 tx=0).stop 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.955+0000 7f8fda68d640 1 -- 172.21.15.70:0/1288033289 shutdown_connections 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.955+0000 7f8fda68d640 1 --2- 172.21.15.70:0/1288033289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd4101410 0x7f8fd410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.955+0000 7f8fda68d640 1 --2- 172.21.15.70:0/1288033289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fd4100a70 0x7f8fd4100ed0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.955+0000 7f8fda68d640 1 --2- 172.21.15.70:0/1288033289 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fd4106a70 0x7f8fd4106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.955+0000 7f8fda68d640 1 -- 172.21.15.70:0/1288033289 >> 172.21.15.70:0/1288033289 conn(0x7f8fd40fc790 msgr2=0x7f8fd40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.955+0000 7f8fda68d640 1 -- 172.21.15.70:0/1288033289 shutdown_connections 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.955+0000 7f8fda68d640 1 -- 172.21.15.70:0/1288033289 wait complete. 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.955+0000 7f8fda68d640 1 Processor -- start 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.955+0000 7f8fda68d640 1 -- start start 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fda68d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fd4100a70 0x7f8fd41a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fda68d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd4101410 0x7f8fd41a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:34.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fda68d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fd4106a70 0x7f8fd419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fda68d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd4110f50 con 0x7f8fd4100a70 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fda68d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd4110dd0 con 0x7f8fd4106a70 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fda68d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd41110d0 con 0x7f8fd4101410 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fd3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fd4100a70 0x7f8fd41a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fd3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fd4100a70 0x7f8fd41a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41250/0 (socket says 172.21.15.70:41250) 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fd3fff640 1 -- 172.21.15.70:0/1095010848 learned_addr learned my addr 172.21.15.70:0/1095010848 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fd37fe640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd4101410 0x7f8fd41a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fd8c2a640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fd4106a70 0x7f8fd419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fd3fff640 1 -- 172.21.15.70:0/1095010848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd4101410 msgr2=0x7f8fd41a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fd3fff640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd4101410 0x7f8fd41a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fd3fff640 1 -- 172.21.15.70:0/1095010848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fd4106a70 msgr2=0x7f8fd419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fd3fff640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fd4106a70 0x7f8fd419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:34.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fd3fff640 1 -- 172.21.15.70:0/1095010848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd419acf0 con 0x7f8fd4100a70 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.956+0000 7f8fd3fff640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fd4100a70 0x7f8fd41a0400 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400c890 tx=0x7f8fc400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.957+0000 7f8fd17fa640 1 -- 172.21.15.70:0/1095010848 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4004220 con 0x7f8fd4100a70 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.957+0000 7f8fd17fa640 1 -- 172.21.15.70:0/1095010848 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fc40043c0 con 0x7f8fd4100a70 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.957+0000 7f8fd17fa640 1 -- 172.21.15.70:0/1095010848 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4004b10 con 0x7f8fd4100a70 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.957+0000 7f8fda68d640 1 -- 172.21.15.70:0/1095010848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd419afe0 con 0x7f8fd4100a70 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.957+0000 7f8fda68d640 1 -- 172.21.15.70:0/1095010848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd41a72d0 con 0x7f8fd4100a70 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.958+0000 7f8fda68d640 1 -- 172.21.15.70:0/1095010848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fd4100ed0 con 0x7f8fd4100a70 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.960+0000 7f8fd17fa640 1 -- 172.21.15.70:0/1095010848 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8fc40051b0 con 0x7f8fd4100a70 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.960+0000 7f8fd17fa640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8fbc0a2c00 0x7f8fbc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.961+0000 7f8fd37fe640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8fbc0a2c00 0x7f8fbc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.961+0000 7f8fd17fa640 1 -- 172.21.15.70:0/1095010848 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8fc40cefa0 con 0x7f8fd4100a70 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.961+0000 7f8fd37fe640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8fbc0a2c00 0x7f8fbc0a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009900 tx=0x7f8fc80058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:34.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:34.964+0000 7f8fd17fa640 1 -- 172.21.15.70:0/1095010848 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fc4014030 con 0x7f8fd4100a70 2024-09-12T01:52:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:34 smithi152 ceph-mon[35055]: pgmap v349: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:52:35.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.187+0000 7f8fda68d640 1 -- 172.21.15.70:0/1095010848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8fd419baf0 con 0x7f8fd4100a70 2024-09-12T01:52:35.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.188+0000 7f8fd17fa640 1 -- 172.21.15.70:0/1095010848 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f8fc409bf80 con 0x7f8fd4100a70 2024-09-12T01:52:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:52:35.188 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-12T01:51:51:564560+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:51:51.387340+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24427,24433,24437,24445,24452]},"id":1}]} 2024-09-12T01:52:35.189 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-12T01:52:35.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.190+0000 7f8fda68d640 1 -- 172.21.15.70:0/1095010848 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8fbc0a2c00 msgr2=0x7f8fbc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:35.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.190+0000 7f8fda68d640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8fbc0a2c00 0x7f8fbc0a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009900 tx=0x7f8fc80058d0 comp rx=0 tx=0).stop 2024-09-12T01:52:35.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.190+0000 7f8fda68d640 1 -- 172.21.15.70:0/1095010848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fd4100a70 msgr2=0x7f8fd41a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:35.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.190+0000 7f8fda68d640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fd4100a70 0x7f8fd41a0400 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400c890 tx=0x7f8fc400cd50 comp rx=0 tx=0).stop 2024-09-12T01:52:35.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.190+0000 7f8fda68d640 1 -- 172.21.15.70:0/1095010848 shutdown_connections 2024-09-12T01:52:35.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.190+0000 7f8fda68d640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8fbc0a2c00 0x7f8fbc0a50c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:35.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.190+0000 7f8fda68d640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fd4106a70 0x7f8fd419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.190+0000 7f8fda68d640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd4101410 0x7f8fd41a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.190+0000 7f8fda68d640 1 --2- 172.21.15.70:0/1095010848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fd4100a70 0x7f8fd41a0400 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.190+0000 7f8fda68d640 1 -- 172.21.15.70:0/1095010848 >> 172.21.15.70:0/1095010848 conn(0x7f8fd40fc790 msgr2=0x7f8fd406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.190+0000 7f8fda68d640 1 -- 172.21.15.70:0/1095010848 shutdown_connections 2024-09-12T01:52:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:35.190+0000 7f8fda68d640 1 -- 172.21.15.70:0/1095010848 wait complete. 2024-09-12T01:52:35.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:35 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1095010848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:35.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:52:35.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:35 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1095010848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:36.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:35 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1095010848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:36.080 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:36.215 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-12T01:52:36.216 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:52:36.842 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:36 smithi070 ceph-mon[31177]: pgmap v350: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:52:36.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:36 smithi191 ceph-mon[35770]: pgmap v350: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:52:37.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:36 smithi152 ceph-mon[35055]: pgmap v350: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:52:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.009+0000 7fee37f03640 1 -- 172.21.15.70:0/2341877177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee30100a40 msgr2=0x7fee30100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.009+0000 7fee37f03640 1 --2- 172.21.15.70:0/2341877177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee30100a40 0x7fee30100e40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009900 tx=0x7fee2c02a410 comp rx=0 tx=0).stop 2024-09-12T01:52:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.009+0000 7fee37f03640 1 -- 172.21.15.70:0/2341877177 shutdown_connections 2024-09-12T01:52:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.009+0000 7fee37f03640 1 --2- 172.21.15.70:0/2341877177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee301025f0 0x7fee30108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.009+0000 7fee37f03640 1 --2- 172.21.15.70:0/2341877177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee30101c30 0x7fee301020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.009+0000 7fee37f03640 1 --2- 172.21.15.70:0/2341877177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee30100a40 0x7fee30100e40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.009+0000 7fee37f03640 1 -- 172.21.15.70:0/2341877177 >> 172.21.15.70:0/2341877177 conn(0x7fee300fc1e0 msgr2=0x7fee300fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.009+0000 7fee37f03640 1 -- 172.21.15.70:0/2341877177 shutdown_connections 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.009+0000 7fee37f03640 1 -- 172.21.15.70:0/2341877177 wait complete. 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee37f03640 1 Processor -- start 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee37f03640 1 -- start start 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee37f03640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee30100a40 0x7fee30197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee37f03640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee30101c30 0x7fee301983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee37f03640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee301025f0 0x7fee3019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee37f03640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fee3010c820 con 0x7fee30101c30 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee37f03640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fee3010c6a0 con 0x7fee30100a40 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee37f03640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fee3010c9a0 con 0x7fee301025f0 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee3549e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee30101c30 0x7fee301983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee3549e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee30101c30 0x7fee301983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41340/0 (socket says 172.21.15.70:41340) 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee3549e640 1 -- 172.21.15.70:0/1052606971 learned_addr learned my addr 172.21.15.70:0/1052606971 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee35c9f640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee30100a40 0x7fee30197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee364a0640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee301025f0 0x7fee3019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee3549e640 1 -- 172.21.15.70:0/1052606971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee301025f0 msgr2=0x7fee3019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee3549e640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee301025f0 0x7fee3019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee3549e640 1 -- 172.21.15.70:0/1052606971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee30100a40 msgr2=0x7fee30197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee3549e640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee30100a40 0x7fee30197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee3549e640 1 -- 172.21.15.70:0/1052606971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3019fad0 con 0x7fee30101c30 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee364a0640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee301025f0 0x7fee3019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.010+0000 7fee3549e640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee30101c30 0x7fee301983f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fee2000d950 tx=0x7fee2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.011+0000 7fee26ffd640 1 -- 172.21.15.70:0/1052606971 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20017070 con 0x7fee30101c30 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.011+0000 7fee26ffd640 1 -- 172.21.15.70:0/1052606971 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee20009c30 con 0x7fee30101c30 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.011+0000 7fee37f03640 1 -- 172.21.15.70:0/1052606971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3019fdc0 con 0x7fee30101c30 2024-09-12T01:52:38.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.011+0000 7fee26ffd640 1 -- 172.21.15.70:0/1052606971 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2000f740 con 0x7fee30101c30 2024-09-12T01:52:38.014 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.011+0000 7fee37f03640 1 -- 172.21.15.70:0/1052606971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee301a0280 con 0x7fee30101c30 2024-09-12T01:52:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee26ffd640 1 -- 172.21.15.70:0/1052606971 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fee20010a80 con 0x7fee30101c30 2024-09-12T01:52:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee3ac9b740 1 Processor -- start 2024-09-12T01:52:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee3ac9b740 1 -- start start 2024-09-12T01:52:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee3ac9b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f2049a9a0 0x557f2049ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee3ac9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049b2e0 0x557f2049fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee3ac9b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f204a0370 0x557f204a2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee3ac9b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557f203fe2f0 con 0x557f204a0370 2024-09-12T01:52:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee3ac9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557f203a6270 con 0x557f2049b2e0 2024-09-12T01:52:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee3ac9b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557f203fa2b0 con 0x557f2049a9a0 2024-09-12T01:52:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee3549e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f204a0370 0x557f204a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.019 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee3549e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f204a0370 0x557f204a2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41342/0 (socket says 172.21.15.70:41342) 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee3549e640 1 -- 172.21.15.70:0/4030057541 learned_addr learned my addr 172.21.15.70:0/4030057541 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.014+0000 7fee364a0640 1 --2- 172.21.15.70:0/4030057541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f2049a9a0 0x557f2049ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee26ffd640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fee1c0a2c30 0x7fee1c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee35c9f640 1 --2- 172.21.15.70:0/4030057541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049b2e0 0x557f2049fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee3549e640 1 -- 172.21.15.70:0/4030057541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f2049a9a0 msgr2=0x557f2049ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee3549e640 1 --2- 172.21.15.70:0/4030057541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f2049a9a0 0x557f2049ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee3549e640 1 -- 172.21.15.70:0/4030057541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049b2e0 msgr2=0x557f2049fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee3549e640 1 --2- 172.21.15.70:0/4030057541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049b2e0 0x557f2049fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee3549e640 1 -- 172.21.15.70:0/4030057541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f203a5340 con 0x557f204a0370 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee35c9f640 1 --2- 172.21.15.70:0/4030057541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049b2e0 0x557f2049fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee364a0640 1 --2- 172.21.15.70:0/4030057541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f2049a9a0 0x557f2049ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee364a0640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fee1c0a2c30 0x7fee1c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee26ffd640 1 -- 172.21.15.70:0/1052606971 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fee200cec80 con 0x7fee30101c30 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee3549e640 1 --2- 172.21.15.70:0/4030057541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f204a0370 0x557f204a2830 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fee20049760 tx=0x7fee20022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4514bb3e13d02761 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee1bfff640 1 -- 172.21.15.70:0/4030057541 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2009b020 con 0x557f204a0370 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee1bfff640 1 -- 172.21.15.70:0/4030057541 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee2004a9d0 con 0x557f204a0370 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.015+0000 7fee1bfff640 1 -- 172.21.15.70:0/4030057541 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2009ae40 con 0x557f204a0370 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.016+0000 7fee3ac9b740 1 -- 172.21.15.70:0/4030057541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f204a0370 msgr2=0x557f204a2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.016+0000 7fee364a0640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fee1c0a2c30 0x7fee1c0a50f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fee28005fd0 tx=0x7fee28004a40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.016+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/4030057541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f204a0370 0x557f204a2830 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fee20049760 tx=0x7fee20022000 comp rx=0 tx=0).stop 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.016+0000 7fee3ac9b740 1 -- 172.21.15.70:0/4030057541 shutdown_connections 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.016+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/4030057541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f204a0370 0x557f204a2830 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.016+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/4030057541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049b2e0 0x557f2049fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.016+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/4030057541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f2049a9a0 0x557f2049ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.016+0000 7fee3ac9b740 1 -- 172.21.15.70:0/4030057541 >> 172.21.15.70:0/4030057541 conn(0x557f20496010 msgr2=0x557f20496410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.016+0000 7fee3ac9b740 1 -- 172.21.15.70:0/4030057541 shutdown_connections 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.016+0000 7fee3ac9b740 1 -- 172.21.15.70:0/4030057541 wait complete. 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.016+0000 7fee3ac9b740 1 -- start start 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.016+0000 7fee3ac9b740 1 Processor -- start 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee3ac9b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049a9a0 0x557f204a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee3ac9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049b2e0 0x557f204a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee3ac9b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f204a0370 0x557f204ac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee3ac9b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557f204a32e0 con 0x557f2049a9a0 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee3ac9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557f20387290 con 0x557f2049b2e0 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee3ac9b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557f204a3460 con 0x557f204a0370 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee3ac9b740 10 client.0 _ll_register_callbacks cb 0x557f203b8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee35c9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049a9a0 0x557f204a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee35c9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049a9a0 0x557f204a4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41352/0 (socket says 172.21.15.70:41352) 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee35c9f640 1 -- 172.21.15.70:0/3001642047 learned_addr learned my addr 172.21.15.70:0/3001642047 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee364a0640 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f204a0370 0x557f204ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee3549e640 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049b2e0 0x557f204a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee35c9f640 1 -- 172.21.15.70:0/3001642047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f204a0370 msgr2=0x557f204ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee35c9f640 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f204a0370 0x557f204ac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee35c9f640 1 -- 172.21.15.70:0/3001642047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049b2e0 msgr2=0x557f204a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee35c9f640 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049b2e0 0x557f204a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee35c9f640 1 -- 172.21.15.70:0/3001642047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f20111210 con 0x557f2049a9a0 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee35c9f640 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049a9a0 0x557f204a4ab0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fee2c006010 tx=0x7fee2c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c7b60c9be6d66f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.017+0000 7fee197fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee197fa640 1 -- 172.21.15.70:0/3001642047 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c035040 con 0x557f2049a9a0 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee197fa640 1 -- 172.21.15.70:0/3001642047 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fee2c004240 con 0x557f2049a9a0 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee3ac9b740 1 -- 172.21.15.70:0/3001642047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f2040ba20 con 0x557f2049a9a0 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee197fa640 1 -- 172.21.15.70:0/3001642047 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fee2c004440 con 0x557f2049a9a0 2024-09-12T01:52:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee3ac9b740 10 client.15588 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee3ac9b740 1 -- 172.21.15.70:0/3001642047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557f201dd620 con 0x557f2049a9a0 2024-09-12T01:52:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee197fa640 1 -- 172.21.15.70:0/3001642047 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x557f2040ba20 con 0x557f2049a9a0 2024-09-12T01:52:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee197fa640 1 -- 172.21.15.70:0/3001642047 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fee2c03c850 con 0x557f2049a9a0 2024-09-12T01:52:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee3ac9b740 10 client.15588 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee3ac9b740 10 client.15588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee3ac9b740 20 client.15588 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557f204b0790 0x557f204b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee3ac9b740 4 client.15588 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.018+0000 7fee3ac9b740 1 -- 172.21.15.70:0/3001642047 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f20405d70 con 0x557f204b0790 2024-09-12T01:52:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.019+0000 7fee3549e640 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557f204b0790 0x557f204b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.019+0000 7fee197fa640 10 client.15588 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.019+0000 7fee3549e640 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557f204b0790 0x557f204b2bc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b54669c76e80c03 server_cookie=386215b37d75dd85 in_seq=0 out_seq=0 2024-09-12T01:52:38.025 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee197fa640 1 -- 172.21.15.70:0/3001642047 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f20405d70 con 0x557f204b0790 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee197fa640 10 client.15588 handle_command_reply: tid=0 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee3ac9b740 1 client.15588 shutdown 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee3ac9b740 1 -- 172.21.15.70:0/3001642047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049a9a0 msgr2=0x557f204a4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049a9a0 0x557f204a4ab0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fee2c006010 tx=0x7fee2c0319f0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee3ac9b740 1 -- 172.21.15.70:0/3001642047 shutdown_connections 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557f204b0790 0x557f204b2bc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f204a0370 0x557f204ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee197fa640 0 client.15588 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049b2e0 0x557f204a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/3001642047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049a9a0 0x557f204a4ab0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee3ac9b740 1 -- 172.21.15.70:0/3001642047 >> 172.21.15.70:0/3001642047 conn(0x557f20496010 msgr2=0x557f20497820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee3ac9b740 1 -- 172.21.15.70:0/3001642047 shutdown_connections 2024-09-12T01:52:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee3ac9b740 1 -- 172.21.15.70:0/3001642047 wait complete. 2024-09-12T01:52:38.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.020+0000 7fee3ac9b740 20 client.15588 trim_cache size 0 max 16384 2024-09-12T01:52:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.034+0000 7fee3ac9b740 1 Processor -- start 2024-09-12T01:52:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.034+0000 7fee3ac9b740 1 -- start start 2024-09-12T01:52:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3ac9b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f2049a9a0 0x557f204a5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3ac9b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 0x557f204950b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3ac9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f204a0370 0x557f204b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3ac9b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fee301a9120 con 0x557f2049b2e0 2024-09-12T01:52:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3ac9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fee301aac60 con 0x557f204a0370 2024-09-12T01:52:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3ac9b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fee301a97f0 con 0x557f2049a9a0 2024-09-12T01:52:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3549e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 0x557f204950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3549e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 0x557f204950b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41366/0 (socket says 172.21.15.70:41366) 2024-09-12T01:52:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3549e640 1 -- 172.21.15.70:0/1607084034 learned_addr learned my addr 172.21.15.70:0/1607084034 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:38.039 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee35c9f640 1 --2- 172.21.15.70:0/1607084034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f2049a9a0 0x557f204a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee364a0640 1 --2- 172.21.15.70:0/1607084034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f204a0370 0x557f204b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3549e640 1 -- 172.21.15.70:0/1607084034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f2049a9a0 msgr2=0x557f204a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3549e640 1 --2- 172.21.15.70:0/1607084034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f2049a9a0 0x557f204a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3549e640 1 -- 172.21.15.70:0/1607084034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f204a0370 msgr2=0x557f204b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3549e640 1 --2- 172.21.15.70:0/1607084034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f204a0370 0x557f204b74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3549e640 1 -- 172.21.15.70:0/1607084034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f204af0f0 con 0x557f2049b2e0 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee3549e640 1 --2- 172.21.15.70:0/1607084034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 0x557f204950b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fee20009610 tx=0x7fee20000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457b4f972f609484 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee1b7fe640 1 -- 172.21.15.70:0/1607084034 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20020070 con 0x557f2049b2e0 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee1b7fe640 1 -- 172.21.15.70:0/1607084034 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee20009de0 con 0x557f2049b2e0 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.035+0000 7fee1b7fe640 1 -- 172.21.15.70:0/1607084034 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee200cc800 con 0x557f2049b2e0 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.036+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1607084034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 msgr2=0x557f204950b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.036+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/1607084034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 0x557f204950b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fee20009610 tx=0x7fee20000bc0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.036+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1607084034 shutdown_connections 2024-09-12T01:52:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.036+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/1607084034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f204a0370 0x557f204b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.036+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/1607084034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 0x557f204950b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.036+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/1607084034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f2049a9a0 0x557f204a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.036+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1607084034 >> 172.21.15.70:0/1607084034 conn(0x557f20496010 msgr2=0x557f204949a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.036+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1607084034 shutdown_connections 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.036+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1607084034 wait complete. 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.036+0000 7fee3ac9b740 1 -- start start 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3ac9b740 1 Processor -- start 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3ac9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049a9a0 0x557f20516ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3ac9b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 0x557f20517020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3ac9b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f204a0370 0x557f2051e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3ac9b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fee301aa590 con 0x557f2049b2e0 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3ac9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fee301a9ec0 con 0x557f2049a9a0 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3ac9b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fee301a70e0 con 0x557f204a0370 2024-09-12T01:52:38.041 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3ac9b740 10 client.0 _ll_register_callbacks cb 0x7fee2c005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3549e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 0x557f20517020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3549e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 0x557f20517020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41370/0 (socket says 172.21.15.70:41370) 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3549e640 1 -- 172.21.15.70:0/1560338481 learned_addr learned my addr 172.21.15.70:0/1560338481 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee364a0640 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f204a0370 0x557f2051e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee35c9f640 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049a9a0 0x557f20516ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3549e640 1 -- 172.21.15.70:0/1560338481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f204a0370 msgr2=0x557f2051e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3549e640 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f204a0370 0x557f2051e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3549e640 1 -- 172.21.15.70:0/1560338481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049a9a0 msgr2=0x557f20516ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3549e640 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049a9a0 0x557f20516ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3549e640 1 -- 172.21.15.70:0/1560338481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f2051e670 con 0x557f2049b2e0 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee3549e640 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 0x557f20517020 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fee20097eb0 tx=0x7fee20005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee719ef111630ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.037+0000 7fee197fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee197fa640 1 -- 172.21.15.70:0/1560338481 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20020070 con 0x557f2049b2e0 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee197fa640 1 -- 172.21.15.70:0/1560338481 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fee200cc800 con 0x557f2049b2e0 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1560338481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee20009de0 con 0x557f2049b2e0 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee197fa640 1 -- 172.21.15.70:0/1560338481 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fee200a4150 con 0x557f2049b2e0 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee3ac9b740 10 client.15594 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1560338481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557f2051f980 con 0x557f2049b2e0 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee197fa640 1 -- 172.21.15.70:0/1560338481 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee20009de0 con 0x557f2049b2e0 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee197fa640 1 -- 172.21.15.70:0/1560338481 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fee200a3cc0 con 0x557f2049b2e0 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee3ac9b740 10 client.15594 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee3ac9b740 10 client.15594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee3ac9b740 20 client.15594 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557f2051fe50 0x557f20522240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee3ac9b740 4 client.15594 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1560338481 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f20382900 con 0x557f2051fe50 2024-09-12T01:52:38.043 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.038+0000 7fee35c9f640 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557f2051fe50 0x557f20522240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.044 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.039+0000 7fee197fa640 10 client.15594 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:38.044 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.039+0000 7fee35c9f640 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557f2051fe50 0x557f20522240 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cfa7eea8f5c56e7 server_cookie=105ba4a61fbedc6a in_seq=0 out_seq=0 2024-09-12T01:52:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.042+0000 7fee197fa640 1 -- 172.21.15.70:0/1560338481 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f20382900 con 0x557f2051fe50 2024-09-12T01:52:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.042+0000 7fee197fa640 10 client.15594 handle_command_reply: tid=0 2024-09-12T01:52:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.042+0000 7fee3ac9b740 1 client.15594 shutdown 2024-09-12T01:52:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1560338481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 msgr2=0x557f20517020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 0x557f20517020 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fee20097eb0 tx=0x7fee20005f70 comp rx=0 tx=0).stop 2024-09-12T01:52:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1560338481 shutdown_connections 2024-09-12T01:52:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557f2051fe50 0x557f20522240 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557f204a0370 0x557f2051e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557f2049b2e0 0x557f20517020 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee197fa640 0 client.15594 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee3ac9b740 1 --2- 172.21.15.70:0/1560338481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f2049a9a0 0x557f20516ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1560338481 >> 172.21.15.70:0/1560338481 conn(0x557f20496010 msgr2=0x557f20497740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1560338481 shutdown_connections 2024-09-12T01:52:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee3ac9b740 1 -- 172.21.15.70:0/1560338481 wait complete. 2024-09-12T01:52:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee3ac9b740 20 client.15594 trim_cache size 0 max 16384 2024-09-12T01:52:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:52:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:52:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:52:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:52:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee37f03640 1 -- 172.21.15.70:0/1052606971 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fee1c0a2c30 msgr2=0x7fee1c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee37f03640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fee1c0a2c30 0x7fee1c0a50f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fee28005fd0 tx=0x7fee28004a40 comp rx=0 tx=0).stop 2024-09-12T01:52:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee37f03640 1 -- 172.21.15.70:0/1052606971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee30101c30 msgr2=0x7fee301983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee37f03640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee30101c30 0x7fee301983f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fee2000d950 tx=0x7fee2000de10 comp rx=0 tx=0).stop 2024-09-12T01:52:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee37f03640 1 -- 172.21.15.70:0/1052606971 shutdown_connections 2024-09-12T01:52:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee37f03640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fee1c0a2c30 0x7fee1c0a50f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee37f03640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee301025f0 0x7fee3019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee37f03640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee30101c30 0x7fee301983f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.043+0000 7fee37f03640 1 --2- 172.21.15.70:0/1052606971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee30100a40 0x7fee30197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.044+0000 7fee37f03640 1 -- 172.21.15.70:0/1052606971 >> 172.21.15.70:0/1052606971 conn(0x7fee300fc1e0 msgr2=0x7fee300fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.044+0000 7fee37f03640 1 -- 172.21.15.70:0/1052606971 shutdown_connections 2024-09-12T01:52:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:38.044+0000 7fee37f03640 1 -- 172.21.15.70:0/1052606971 wait complete. 2024-09-12T01:52:38.642 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:52:38.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.822+0000 7f171c088640 1 -- 172.21.15.70:0/809923509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1714102ef0 msgr2=0x7f171410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.822+0000 7f171c088640 1 --2- 172.21.15.70:0/809923509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1714102ef0 0x7f171410da40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f170c009ca0 tx=0x7f170c02a950 comp rx=0 tx=0).stop 2024-09-12T01:52:38.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.822+0000 7f171c088640 1 -- 172.21.15.70:0/809923509 shutdown_connections 2024-09-12T01:52:38.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.822+0000 7f171c088640 1 --2- 172.21.15.70:0/809923509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1714102ef0 0x7f171410da40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.822+0000 7f171c088640 1 --2- 172.21.15.70:0/809923509 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1714102570 0x7f17141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.822+0000 7f171c088640 1 --2- 172.21.15.70:0/809923509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1714100e20 0x7f1714101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.822+0000 7f171c088640 1 -- 172.21.15.70:0/809923509 >> 172.21.15.70:0/809923509 conn(0x7f17140fc7d0 msgr2=0x7f17140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.822+0000 7f171c088640 1 -- 172.21.15.70:0/809923509 shutdown_connections 2024-09-12T01:52:38.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.822+0000 7f171c088640 1 -- 172.21.15.70:0/809923509 wait complete. 2024-09-12T01:52:38.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.823+0000 7f171c088640 1 Processor -- start 2024-09-12T01:52:38.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.823+0000 7f171c088640 1 -- start start 2024-09-12T01:52:38.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.823+0000 7f171c088640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1714100e20 0x7f17141993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.823+0000 7f171c088640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1714102570 0x7f1714199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.823+0000 7f171c088640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1714102ef0 0x7f17141a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.823+0000 7f171c088640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f17141110a0 con 0x7f1714100e20 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.823+0000 7f171c088640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1714110f20 con 0x7f1714102570 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.823+0000 7f171c088640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1714111220 con 0x7f1714102ef0 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f1719e24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1714100e20 0x7f17141993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f1719e24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1714100e20 0x7f17141993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41270/0 (socket says 172.21.15.70:41270) 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f1719e24640 1 -- 172.21.15.70:0/3039169703 learned_addr learned my addr 172.21.15.70:0/3039169703 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f1719623640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1714102570 0x7f1714199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f171a625640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1714102ef0 0x7f17141a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f1719e24640 1 -- 172.21.15.70:0/3039169703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1714102ef0 msgr2=0x7f17141a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f1719e24640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1714102ef0 0x7f17141a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f1719e24640 1 -- 172.21.15.70:0/3039169703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1714102570 msgr2=0x7f1714199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f1719e24640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1714102570 0x7f1714199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f1719e24640 1 -- 172.21.15.70:0/3039169703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17141a4990 con 0x7f1714100e20 2024-09-12T01:52:38.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f1719623640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1714102570 0x7f1714199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:38.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f1719e24640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1714100e20 0x7f17141993d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f171000d770 tx=0x7f171000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f170affd640 1 -- 172.21.15.70:0/3039169703 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710017070 con 0x7f1714100e20 2024-09-12T01:52:38.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f170affd640 1 -- 172.21.15.70:0/3039169703 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1710005520 con 0x7f1714100e20 2024-09-12T01:52:38.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f170affd640 1 -- 172.21.15.70:0/3039169703 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710010460 con 0x7f1714100e20 2024-09-12T01:52:38.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f171c088640 1 -- 172.21.15.70:0/3039169703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17141a4b60 con 0x7f1714100e20 2024-09-12T01:52:38.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.824+0000 7f171c088640 1 -- 172.21.15.70:0/3039169703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17141a5070 con 0x7f1714100e20 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.827+0000 7f171e461740 1 Processor -- start 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.827+0000 7f171e461740 1 -- start start 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.827+0000 7f171e461740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5e6b40 0x56462d5e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.827+0000 7f171e461740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d5e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.827+0000 7f171e461740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5f4780 0x56462d5f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.827+0000 7f171e461740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56462d54b2f0 con 0x56462d5e55d0 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.827+0000 7f171e461740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56462d4f2cf0 con 0x56462d5e6b40 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.827+0000 7f171e461740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56462d5472b0 con 0x56462d5f4780 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.828+0000 7f1719623640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5f4780 0x56462d5f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.828+0000 7f1719623640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5f4780 0x56462d5f6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:33878/0 (socket says 172.21.15.70:33878) 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.828+0000 7f1719623640 1 -- 172.21.15.70:0/3963244091 learned_addr learned my addr 172.21.15.70:0/3963244091 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.828+0000 7f171a625640 1 --2- 172.21.15.70:0/3963244091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5e6b40 0x56462d5e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.828+0000 7f170affd640 1 -- 172.21.15.70:0/3039169703 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1710004ea0 con 0x7f1714100e20 2024-09-12T01:52:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.828+0000 7f1719623640 1 -- 172.21.15.70:0/3963244091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5e6b40 msgr2=0x56462d5e5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.828+0000 7f1719623640 1 --2- 172.21.15.70:0/3963244091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5e6b40 0x56462d5e5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.828+0000 7f1719623640 1 -- 172.21.15.70:0/3963244091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 msgr2=0x56462d5e5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.828+0000 7f1719623640 1 --2- 172.21.15.70:0/3963244091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d5e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.828+0000 7f1719623640 1 -- 172.21.15.70:0/3963244091 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56462d4d73a0 con 0x56462d5f4780 2024-09-12T01:52:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.828+0000 7f171a625640 1 --2- 172.21.15.70:0/3963244091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5e6b40 0x56462d5e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.828+0000 7f1719623640 1 --2- 172.21.15.70:0/3963244091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5f4780 0x56462d5f6b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f170400dc30 tx=0x7f170400f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90591521cf92e170 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.829+0000 7f16fffff640 1 -- 172.21.15.70:0/3963244091 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704005020 con 0x56462d5f4780 2024-09-12T01:52:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.829+0000 7f16fffff640 1 -- 172.21.15.70:0/3963244091 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17040047a0 con 0x56462d5f4780 2024-09-12T01:52:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.829+0000 7f16fffff640 1 -- 172.21.15.70:0/3963244091 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704011730 con 0x56462d5f4780 2024-09-12T01:52:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.829+0000 7f170affd640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f17000a2c00 0x7f17000a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.829+0000 7f171a625640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f17000a2c00 0x7f17000a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.829+0000 7f170affd640 1 -- 172.21.15.70:0/3039169703 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f17100ce7e0 con 0x7f1714100e20 2024-09-12T01:52:38.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.829+0000 7f171e461740 1 -- 172.21.15.70:0/3963244091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5f4780 msgr2=0x56462d5f6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.829+0000 7f171a625640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f17000a2c00 0x7f17000a50c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f170c004af0 tx=0x7f170c009840 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.829+0000 7f171e461740 1 --2- 172.21.15.70:0/3963244091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5f4780 0x56462d5f6b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f170400dc30 tx=0x7f170400f730 comp rx=0 tx=0).stop 2024-09-12T01:52:38.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.830+0000 7f171e461740 1 -- 172.21.15.70:0/3963244091 shutdown_connections 2024-09-12T01:52:38.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.830+0000 7f171e461740 1 --2- 172.21.15.70:0/3963244091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5f4780 0x56462d5f6b70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.830+0000 7f171e461740 1 --2- 172.21.15.70:0/3963244091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d5e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.830+0000 7f171e461740 1 --2- 172.21.15.70:0/3963244091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5e6b40 0x56462d5e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.830+0000 7f171e461740 1 -- 172.21.15.70:0/3963244091 >> 172.21.15.70:0/3963244091 conn(0x56462d5ae310 msgr2=0x56462d5e1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.830+0000 7f171e461740 1 -- 172.21.15.70:0/3963244091 shutdown_connections 2024-09-12T01:52:38.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.830+0000 7f171e461740 1 -- 172.21.15.70:0/3963244091 wait complete. 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.830+0000 7f171e461740 1 -- start start 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.830+0000 7f171e461740 1 Processor -- start 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f171e461740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5e55d0 0x56462d5f4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f171e461740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e6b40 0x56462d5f1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f171e461740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5f4780 0x56462d5f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f171e461740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56462d5f7480 con 0x56462d5e6b40 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f171e461740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56462d506060 con 0x56462d5f4780 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f171e461740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56462d5f7600 con 0x56462d5e55d0 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f171e461740 10 client.0 _ll_register_callbacks cb 0x56462d2598c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f1719623640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e6b40 0x56462d5f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f1719e24640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5e55d0 0x56462d5f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f1719623640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e6b40 0x56462d5f1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41302/0 (socket says 172.21.15.70:41302) 2024-09-12T01:52:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f1719623640 1 -- 172.21.15.70:0/2160278449 learned_addr learned my addr 172.21.15.70:0/2160278449 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f171a625640 1 --2- 172.21.15.70:0/2160278449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5f4780 0x56462d5f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f1719623640 1 -- 172.21.15.70:0/2160278449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5e55d0 msgr2=0x56462d5f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f1719623640 1 --2- 172.21.15.70:0/2160278449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5e55d0 0x56462d5f4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f1719623640 1 -- 172.21.15.70:0/2160278449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5f4780 msgr2=0x56462d5f19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f1719623640 1 --2- 172.21.15.70:0/2160278449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5f4780 0x56462d5f19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f1719623640 1 -- 172.21.15.70:0/2160278449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56462d2bc3c0 con 0x56462d5e6b40 2024-09-12T01:52:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f1719623640 1 --2- 172.21.15.70:0/2160278449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e6b40 0x56462d5f1400 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f170400fc30 tx=0x7f1704004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a16abd1a47a7d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.831+0000 7f16fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f16fd7fa640 1 -- 172.21.15.70:0/2160278449 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170402b060 con 0x56462d5e6b40 2024-09-12T01:52:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f16fd7fa640 1 -- 172.21.15.70:0/2160278449 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1704004a10 con 0x56462d5e6b40 2024-09-12T01:52:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f171e461740 1 -- 172.21.15.70:0/2160278449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17040047a0 con 0x56462d5e6b40 2024-09-12T01:52:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f16fd7fa640 1 -- 172.21.15.70:0/2160278449 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1704004c10 con 0x56462d5e6b40 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f171e461740 10 client.15570 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f171e461740 1 -- 172.21.15.70:0/2160278449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56462d602f20 con 0x56462d5e6b40 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f16fd7fa640 1 -- 172.21.15.70:0/2160278449 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17040047a0 con 0x56462d5e6b40 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f16fd7fa640 1 -- 172.21.15.70:0/2160278449 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1704030070 con 0x56462d5e6b40 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f171e461740 10 client.15570 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f171e461740 10 client.15570 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f171e461740 20 client.15570 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f171e461740 1 --2- 172.21.15.70:0/2160278449 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x56462d604270 0x56462d606660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f171e461740 4 client.15570 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.832+0000 7f171e461740 1 -- 172.21.15.70:0/2160278449 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56462d558860 con 0x56462d604270 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.833+0000 7f1719e24640 1 --2- 172.21.15.70:0/2160278449 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x56462d604270 0x56462d606660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.833+0000 7f1719e24640 1 --2- 172.21.15.70:0/2160278449 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x56462d604270 0x56462d606660 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c79f4392b3a0dd19 server_cookie=f72c5911a469c4e1 in_seq=0 out_seq=0 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.833+0000 7f16fd7fa640 10 client.15570 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:52:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f16fd7fa640 1 -- 172.21.15.70:0/2160278449 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56462d558860 con 0x56462d604270 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f16fd7fa640 10 client.15570 handle_command_reply: tid=0 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f171e461740 1 client.15570 shutdown 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f171e461740 1 -- 172.21.15.70:0/2160278449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e6b40 msgr2=0x56462d5f1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f171e461740 1 --2- 172.21.15.70:0/2160278449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e6b40 0x56462d5f1400 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f170400fc30 tx=0x7f1704004660 comp rx=0 tx=0).stop 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f171e461740 1 -- 172.21.15.70:0/2160278449 shutdown_connections 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f171e461740 1 --2- 172.21.15.70:0/2160278449 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x56462d604270 0x56462d606660 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f171e461740 1 --2- 172.21.15.70:0/2160278449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5f4780 0x56462d5f19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f171e461740 1 --2- 172.21.15.70:0/2160278449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e6b40 0x56462d5f1400 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f171e461740 1 --2- 172.21.15.70:0/2160278449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5e55d0 0x56462d5f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f16fd7fa640 0 client.15570 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f171e461740 1 -- 172.21.15.70:0/2160278449 >> 172.21.15.70:0/2160278449 conn(0x56462d5ae310 msgr2=0x56462d5e7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f171e461740 1 -- 172.21.15.70:0/2160278449 shutdown_connections 2024-09-12T01:52:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f171e461740 1 -- 172.21.15.70:0/2160278449 wait complete. 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.834+0000 7f171e461740 20 client.15570 trim_cache size 0 max 16384 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.848+0000 7f171e461740 1 Processor -- start 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.848+0000 7f171e461740 1 -- start start 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.848+0000 7f171e461740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d600750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.848+0000 7f171e461740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5e6b40 0x56462d5f3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.848+0000 7f171e461740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5f4780 0x56462d60bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.848+0000 7f171e461740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f17141ab560 con 0x56462d5e55d0 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.848+0000 7f171e461740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17141ad0a0 con 0x56462d5e6b40 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.848+0000 7f171e461740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f17141abc30 con 0x56462d5f4780 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.848+0000 7f1719e24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d600750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.848+0000 7f1719e24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d600750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41312/0 (socket says 172.21.15.70:41312) 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.849+0000 7f1719e24640 1 -- 172.21.15.70:0/2682725111 learned_addr learned my addr 172.21.15.70:0/2682725111 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.849+0000 7f1719623640 1 --2- 172.21.15.70:0/2682725111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5e6b40 0x56462d5f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.849+0000 7f1719e24640 1 -- 172.21.15.70:0/2682725111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5f4780 msgr2=0x56462d60bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.849+0000 7f1719e24640 1 --2- 172.21.15.70:0/2682725111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5f4780 0x56462d60bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.849+0000 7f1719e24640 1 -- 172.21.15.70:0/2682725111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5e6b40 msgr2=0x56462d5f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.849+0000 7f1719e24640 1 --2- 172.21.15.70:0/2682725111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5e6b40 0x56462d5f3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.849+0000 7f1719e24640 1 -- 172.21.15.70:0/2682725111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56462d5e1de0 con 0x56462d5e55d0 2024-09-12T01:52:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.849+0000 7f1719e24640 1 --2- 172.21.15.70:0/2682725111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d600750 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f17100974a0 tx=0x7f17100cea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673e58ccbf7802c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.849+0000 7f16ff7fe640 1 -- 172.21.15.70:0/2682725111 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710020040 con 0x56462d5e55d0 2024-09-12T01:52:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.849+0000 7f16ff7fe640 1 -- 172.21.15.70:0/2682725111 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f171009b040 con 0x56462d5e55d0 2024-09-12T01:52:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.849+0000 7f16ff7fe640 1 -- 172.21.15.70:0/2682725111 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710009d50 con 0x56462d5e55d0 2024-09-12T01:52:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.850+0000 7f171e461740 1 -- 172.21.15.70:0/2682725111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 msgr2=0x56462d600750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.850+0000 7f171e461740 1 --2- 172.21.15.70:0/2682725111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d600750 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f17100974a0 tx=0x7f17100cea60 comp rx=0 tx=0).stop 2024-09-12T01:52:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.850+0000 7f171e461740 1 -- 172.21.15.70:0/2682725111 shutdown_connections 2024-09-12T01:52:38.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.850+0000 7f171e461740 1 --2- 172.21.15.70:0/2682725111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5f4780 0x56462d60bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.850+0000 7f171e461740 1 --2- 172.21.15.70:0/2682725111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5e6b40 0x56462d5f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.850+0000 7f171e461740 1 --2- 172.21.15.70:0/2682725111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d600750 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.850+0000 7f171e461740 1 -- 172.21.15.70:0/2682725111 >> 172.21.15.70:0/2682725111 conn(0x56462d5ae310 msgr2=0x56462d5f2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.850+0000 7f171e461740 1 -- 172.21.15.70:0/2682725111 shutdown_connections 2024-09-12T01:52:38.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.850+0000 7f171e461740 1 -- 172.21.15.70:0/2682725111 wait complete. 2024-09-12T01:52:38.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.850+0000 7f171e461740 1 -- start start 2024-09-12T01:52:38.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f171e461740 1 Processor -- start 2024-09-12T01:52:38.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f171e461740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d666f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f171e461740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5e6b40 0x56462d667490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f171e461740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5f4780 0x56462d5f7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f171e461740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f17141ac9d0 con 0x56462d5e55d0 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f171e461740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17141ac300 con 0x56462d5f4780 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f171e461740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f17141a9520 con 0x56462d5e6b40 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f171e461740 10 client.0 _ll_register_callbacks cb 0x7f1704015050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f1719e24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d666f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f1719e24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d666f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41318/0 (socket says 172.21.15.70:41318) 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f171a625640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5f4780 0x56462d5f7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f1719e24640 1 -- 172.21.15.70:0/1428041627 learned_addr learned my addr 172.21.15.70:0/1428041627 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f1719623640 1 --2- 172.21.15.70:0/1428041627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5e6b40 0x56462d667490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f1719e24640 1 -- 172.21.15.70:0/1428041627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5e6b40 msgr2=0x56462d667490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f1719e24640 1 --2- 172.21.15.70:0/1428041627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5e6b40 0x56462d667490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f1719e24640 1 -- 172.21.15.70:0/1428041627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5f4780 msgr2=0x56462d5f7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f1719e24640 1 --2- 172.21.15.70:0/1428041627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5f4780 0x56462d5f7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.851+0000 7f1719e24640 1 -- 172.21.15.70:0/1428041627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56462d5f85d0 con 0x56462d5e55d0 2024-09-12T01:52:38.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f1719e24640 1 --2- 172.21.15.70:0/1428041627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d666f50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1710009610 tx=0x7f1710099480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcad2825a5d06db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:38.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f16fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:38.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f16fd7fa640 1 -- 172.21.15.70:0/1428041627 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710020030 con 0x56462d5e55d0 2024-09-12T01:52:38.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f16fd7fa640 1 -- 172.21.15.70:0/1428041627 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f17100976b0 con 0x56462d5e55d0 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f171e461740 1 -- 172.21.15.70:0/1428041627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f171009b040 con 0x56462d5e55d0 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f16fd7fa640 1 -- 172.21.15.70:0/1428041627 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1710005190 con 0x56462d5e55d0 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f171e461740 10 client.15576 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f171e461740 1 -- 172.21.15.70:0/1428041627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56462d66e7b0 con 0x56462d5e55d0 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f16fd7fa640 1 -- 172.21.15.70:0/1428041627 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f171009b040 con 0x56462d5e55d0 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f16fd7fa640 1 -- 172.21.15.70:0/1428041627 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1710095cb0 con 0x56462d5e55d0 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f171e461740 10 client.15576 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f171e461740 10 client.15576 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f171e461740 20 client.15576 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f171e461740 1 --2- 172.21.15.70:0/1428041627 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x56462d66ee60 0x56462d671280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f171e461740 4 client.15576 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.852+0000 7f171e461740 1 -- 172.21.15.70:0/1428041627 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56462d552d70 con 0x56462d66ee60 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f1719623640 1 --2- 172.21.15.70:0/1428041627 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x56462d66ee60 0x56462d671280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:38.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f1719623640 1 --2- 172.21.15.70:0/1428041627 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x56462d66ee60 0x56462d671280 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aa8b4b6013d8a5e0 server_cookie=4b03c0ea1aced52f in_seq=0 out_seq=0 2024-09-12T01:52:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f16fd7fa640 10 client.15576 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:52:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f16fd7fa640 1 -- 172.21.15.70:0/1428041627 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56462d552d70 con 0x56462d66ee60 2024-09-12T01:52:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f16fd7fa640 10 client.15576 handle_command_reply: tid=0 2024-09-12T01:52:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f171e461740 1 client.15576 shutdown 2024-09-12T01:52:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f171e461740 1 -- 172.21.15.70:0/1428041627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 msgr2=0x56462d666f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f171e461740 1 --2- 172.21.15.70:0/1428041627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d666f50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1710009610 tx=0x7f1710099480 comp rx=0 tx=0).stop 2024-09-12T01:52:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f171e461740 1 -- 172.21.15.70:0/1428041627 shutdown_connections 2024-09-12T01:52:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f171e461740 1 --2- 172.21.15.70:0/1428041627 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x56462d66ee60 0x56462d671280 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f171e461740 1 --2- 172.21.15.70:0/1428041627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56462d5f4780 0x56462d5f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f171e461740 1 --2- 172.21.15.70:0/1428041627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56462d5e6b40 0x56462d667490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f171e461740 1 --2- 172.21.15.70:0/1428041627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56462d5e55d0 0x56462d666f50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f16fd7fa640 0 client.15576 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:52:38.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.853+0000 7f171e461740 1 -- 172.21.15.70:0/1428041627 >> 172.21.15.70:0/1428041627 conn(0x56462d5ae310 msgr2=0x56462d5e0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171e461740 1 -- 172.21.15.70:0/1428041627 shutdown_connections 2024-09-12T01:52:38.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171e461740 1 -- 172.21.15.70:0/1428041627 wait complete. 2024-09-12T01:52:38.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171e461740 20 client.15576 trim_cache size 0 max 16384 2024-09-12T01:52:38.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171c088640 1 -- 172.21.15.70:0/3039169703 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f17000a2c00 msgr2=0x7f17000a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171c088640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f17000a2c00 0x7f17000a50c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f170c004af0 tx=0x7f170c009840 comp rx=0 tx=0).stop 2024-09-12T01:52:38.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171c088640 1 -- 172.21.15.70:0/3039169703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1714100e20 msgr2=0x7f17141993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:38.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171c088640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1714100e20 0x7f17141993d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f171000d770 tx=0x7f171000dc30 comp rx=0 tx=0).stop 2024-09-12T01:52:38.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171c088640 1 -- 172.21.15.70:0/3039169703 shutdown_connections 2024-09-12T01:52:38.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171c088640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f17000a2c00 0x7f17000a50c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171c088640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1714102ef0 0x7f17141a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171c088640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1714102570 0x7f1714199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171c088640 1 --2- 172.21.15.70:0/3039169703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1714100e20 0x7f17141993d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:38.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171c088640 1 -- 172.21.15.70:0/3039169703 >> 172.21.15.70:0/3039169703 conn(0x7f17140fc7d0 msgr2=0x7f17141067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:38.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171c088640 1 -- 172.21.15.70:0/3039169703 shutdown_connections 2024-09-12T01:52:38.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:37.854+0000 7f171c088640 1 -- 172.21.15.70:0/3039169703 wait complete. 2024-09-12T01:52:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:38 smithi191 ceph-mon[35770]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T01:52:39.015 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:38 smithi152 ceph-mon[35055]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T01:52:39.029 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:38 smithi070 ceph-mon[31177]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T01:52:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:40.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:40 smithi191 ceph-mon[35770]: pgmap v352: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-12T01:52:41.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:40 smithi152 ceph-mon[35055]: pgmap v352: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-12T01:52:41.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:40 smithi070 ceph-mon[31177]: pgmap v352: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-12T01:52:41.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:52:41.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.954+0000 7fbdfac8d640 1 -- 172.21.15.70:0/528110900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf4102ef0 msgr2=0x7fbdf410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:41.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.954+0000 7fbdfac8d640 1 --2- 172.21.15.70:0/528110900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf4102ef0 0x7fbdf410da40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009ca0 tx=0x7fbdec02a950 comp rx=0 tx=0).stop 2024-09-12T01:52:41.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.954+0000 7fbdfac8d640 1 -- 172.21.15.70:0/528110900 shutdown_connections 2024-09-12T01:52:41.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.954+0000 7fbdfac8d640 1 --2- 172.21.15.70:0/528110900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf4102ef0 0x7fbdf410da40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:41.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.954+0000 7fbdfac8d640 1 --2- 172.21.15.70:0/528110900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdf4102570 0x7fbdf41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:41.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.954+0000 7fbdfac8d640 1 --2- 172.21.15.70:0/528110900 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdf4100e20 0x7fbdf4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:41.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.954+0000 7fbdfac8d640 1 -- 172.21.15.70:0/528110900 >> 172.21.15.70:0/528110900 conn(0x7fbdf40fc7d0 msgr2=0x7fbdf40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:41.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.954+0000 7fbdfac8d640 1 -- 172.21.15.70:0/528110900 shutdown_connections 2024-09-12T01:52:41.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.954+0000 7fbdfac8d640 1 -- 172.21.15.70:0/528110900 wait complete. 2024-09-12T01:52:41.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.955+0000 7fbdfac8d640 1 Processor -- start 2024-09-12T01:52:41.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdfac8d640 1 -- start start 2024-09-12T01:52:41.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdfac8d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf4100e20 0x7fbdf41984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:41.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdfac8d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdf4102570 0x7fbdf4198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:41.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdf8a29640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf4100e20 0x7fbdf41984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:41.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdfac8d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdf4102ef0 0x7fbdf419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:41.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdf8a29640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf4100e20 0x7fbdf41984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38858/0 (socket says 172.21.15.70:38858) 2024-09-12T01:52:41.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdf3fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdf4102570 0x7fbdf4198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:41.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdf3fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdf4102570 0x7fbdf4198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:46364/0 (socket says 172.21.15.70:46364) 2024-09-12T01:52:41.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdf3fff640 1 -- 172.21.15.70:0/414798822 learned_addr learned my addr 172.21.15.70:0/414798822 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:41.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdfac8d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf41110f0 con 0x7fbdf4100e20 2024-09-12T01:52:41.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdfac8d640 1 -- 172.21.15.70:0/414798822 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf4110f70 con 0x7fbdf4102ef0 2024-09-12T01:52:41.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdfac8d640 1 -- 172.21.15.70:0/414798822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf4111270 con 0x7fbdf4102570 2024-09-12T01:52:41.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.956+0000 7fbdf922a640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdf4102ef0 0x7fbdf419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:41.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.957+0000 7fbdf3fff640 1 -- 172.21.15.70:0/414798822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdf4102ef0 msgr2=0x7fbdf419cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:41.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.957+0000 7fbdf3fff640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdf4102ef0 0x7fbdf419cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:41.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.957+0000 7fbdf3fff640 1 -- 172.21.15.70:0/414798822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf4100e20 msgr2=0x7fbdf41984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:41.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.957+0000 7fbdf3fff640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf4100e20 0x7fbdf41984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:41.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.957+0000 7fbdf3fff640 1 -- 172.21.15.70:0/414798822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf419d490 con 0x7fbdf4102570 2024-09-12T01:52:41.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.957+0000 7fbdf3fff640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdf4102570 0x7fbdf4198a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c890 tx=0x7fbde000cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:41.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.957+0000 7fbdf1ffb640 1 -- 172.21.15.70:0/414798822 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0004220 con 0x7fbdf4102570 2024-09-12T01:52:41.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.957+0000 7fbdf1ffb640 1 -- 172.21.15.70:0/414798822 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbde00043c0 con 0x7fbdf4102570 2024-09-12T01:52:41.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.957+0000 7fbdf1ffb640 1 -- 172.21.15.70:0/414798822 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0004b10 con 0x7fbdf4102570 2024-09-12T01:52:41.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.958+0000 7fbdfac8d640 1 -- 172.21.15.70:0/414798822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf419d780 con 0x7fbdf4102570 2024-09-12T01:52:41.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.958+0000 7fbdfac8d640 1 -- 172.21.15.70:0/414798822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf4107a10 con 0x7fbdf4102570 2024-09-12T01:52:41.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.960+0000 7fbdfac8d640 1 -- 172.21.15.70:0/414798822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf41021b0 con 0x7fbdf4102570 2024-09-12T01:52:41.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.961+0000 7fbdf1ffb640 1 -- 172.21.15.70:0/414798822 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbde0004cb0 con 0x7fbdf4102570 2024-09-12T01:52:41.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.962+0000 7fbdf1ffb640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbde40a2c00 0x7fbde40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:41.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.963+0000 7fbdf1ffb640 1 -- 172.21.15.70:0/414798822 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbde00ceb90 con 0x7fbdf4102570 2024-09-12T01:52:41.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.963+0000 7fbdf8a29640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbde40a2c00 0x7fbde40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:41.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.963+0000 7fbdf8a29640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbde40a2c00 0x7fbde40a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009bd0 tx=0x7fbde8005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:41.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:41.967+0000 7fbdf1ffb640 1 -- 172.21.15.70:0/414798822 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbde0014030 con 0x7fbdf4102570 2024-09-12T01:52:41.998 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:42.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.288+0000 7fbdfac8d640 1 -- 172.21.15.70:0/414798822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdf4108e50 con 0x7fbdf4102570 2024-09-12T01:52:42.290 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:52:42.290 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-12T01:51:51:564560+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:51:51.387340+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24427,24433,24437,24445,24452]},"id":1}]} 2024-09-12T01:52:42.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.289+0000 7fbdf1ffb640 1 -- 172.21.15.70:0/414798822 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7fbde009b4a0 con 0x7fbdf4102570 2024-09-12T01:52:42.290 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-12T01:52:42.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.293+0000 7fbdfac8d640 1 -- 172.21.15.70:0/414798822 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbde40a2c00 msgr2=0x7fbde40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:42.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.293+0000 7fbdfac8d640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbde40a2c00 0x7fbde40a50c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009bd0 tx=0x7fbde8005f90 comp rx=0 tx=0).stop 2024-09-12T01:52:42.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.293+0000 7fbdfac8d640 1 -- 172.21.15.70:0/414798822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdf4102570 msgr2=0x7fbdf4198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:42.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.293+0000 7fbdfac8d640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdf4102570 0x7fbdf4198a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c890 tx=0x7fbde000cd50 comp rx=0 tx=0).stop 2024-09-12T01:52:42.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.293+0000 7fbdfac8d640 1 -- 172.21.15.70:0/414798822 shutdown_connections 2024-09-12T01:52:42.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.293+0000 7fbdfac8d640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbde40a2c00 0x7fbde40a50c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.294+0000 7fbdfac8d640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbdf4102ef0 0x7fbdf419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.294+0000 7fbdfac8d640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdf4102570 0x7fbdf4198a20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.294+0000 7fbdfac8d640 1 --2- 172.21.15.70:0/414798822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf4100e20 0x7fbdf41984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.294+0000 7fbdfac8d640 1 -- 172.21.15.70:0/414798822 >> 172.21.15.70:0/414798822 conn(0x7fbdf40fc7d0 msgr2=0x7fbdf4103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:42.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.294+0000 7fbdfac8d640 1 -- 172.21.15.70:0/414798822 shutdown_connections 2024-09-12T01:52:42.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.294+0000 7fbdfac8d640 1 -- 172.21.15.70:0/414798822 wait complete. 2024-09-12T01:52:42.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.509+0000 7faa84d36640 1 -- 172.21.15.70:0/934247561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa80106f10 msgr2=0x7faa8010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:42.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.509+0000 7faa84d36640 1 --2- 172.21.15.70:0/934247561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa80106f10 0x7faa8010ea90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7faa78009ca0 tx=0x7faa7802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.509+0000 7faa84d36640 1 -- 172.21.15.70:0/934247561 shutdown_connections 2024-09-12T01:52:42.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.509+0000 7faa84d36640 1 --2- 172.21.15.70:0/934247561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa80106f10 0x7faa8010ea90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.509+0000 7faa84d36640 1 --2- 172.21.15.70:0/934247561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa80102790 0x7faa801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.509+0000 7faa84d36640 1 --2- 172.21.15.70:0/934247561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa80101de0 0x7faa801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.509+0000 7faa84d36640 1 -- 172.21.15.70:0/934247561 >> 172.21.15.70:0/934247561 conn(0x7faa800fd8e0 msgr2=0x7faa800ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:42.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.509+0000 7faa84d36640 1 -- 172.21.15.70:0/934247561 shutdown_connections 2024-09-12T01:52:42.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.509+0000 7faa84d36640 1 -- 172.21.15.70:0/934247561 wait complete. 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.510+0000 7faa84d36640 1 Processor -- start 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.510+0000 7faa84d36640 1 -- start start 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa84d36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa80101de0 0x7faa800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa84d36640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa80102790 0x7faa80074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa84d36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa80106f10 0x7faa80074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa84d36640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faa80112090 con 0x7faa80101de0 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa84d36640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faa80111f10 con 0x7faa80106f10 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa84d36640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faa80112210 con 0x7faa80102790 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa7e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa80101de0 0x7faa800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa7e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa80101de0 0x7faa800744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38876/0 (socket says 172.21.15.70:38876) 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa7e59c640 1 -- 172.21.15.70:0/4158438072 learned_addr learned my addr 172.21.15.70:0/4158438072 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa7ed9d640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa80106f10 0x7faa80074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa7dd9b640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa80102790 0x7faa80074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa7e59c640 1 -- 172.21.15.70:0/4158438072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa80102790 msgr2=0x7faa80074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa7e59c640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa80102790 0x7faa80074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa7e59c640 1 -- 172.21.15.70:0/4158438072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa80106f10 msgr2=0x7faa80074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa7e59c640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa80106f10 0x7faa80074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa7e59c640 1 -- 172.21.15.70:0/4158438072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa801aae80 con 0x7faa80101de0 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.511+0000 7faa7e59c640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa80101de0 0x7faa800744f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7faa7000d950 tx=0x7faa7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.512+0000 7faa6f7fe640 1 -- 172.21.15.70:0/4158438072 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70017030 con 0x7faa80101de0 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.512+0000 7faa6f7fe640 1 -- 172.21.15.70:0/4158438072 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa70004020 con 0x7faa80101de0 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.512+0000 7faa6f7fe640 1 -- 172.21.15.70:0/4158438072 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70004a00 con 0x7faa80101de0 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.512+0000 7faa84d36640 1 -- 172.21.15.70:0/4158438072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa801ab0b0 con 0x7faa80101de0 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.512+0000 7faa84d36640 1 -- 172.21.15.70:0/4158438072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa801ab5a0 con 0x7faa80101de0 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.515+0000 7faa6f7fe640 1 -- 172.21.15.70:0/4158438072 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7faa700041d0 con 0x7faa80101de0 2024-09-12T01:52:42.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.515+0000 7faa8710f740 1 Processor -- start 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.516+0000 7faa8710f740 1 -- start start 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.516+0000 7faa8710f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe7b40 0x55fd2bfe6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.516+0000 7faa8710f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bfe65d0 0x55fd2bfe6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.516+0000 7faa8710f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bff1370 0x55fd2bff3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.516+0000 7faa8710f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd2bf4c2f0 con 0x55fd2bfe65d0 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.516+0000 7faa8710f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fd2bef3cf0 con 0x55fd2bfe7b40 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.516+0000 7faa8710f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fd2bf482b0 con 0x55fd2bff1370 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.516+0000 7faa6f7fe640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faa680a2cd0 0x7faa680a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.516+0000 7faa7ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe7b40 0x55fd2bfe6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.516+0000 7faa7ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe7b40 0x55fd2bfe6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:55794/0 (socket says 172.21.15.70:55794) 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.516+0000 7faa7ed9d640 1 -- 172.21.15.70:0/3068038262 learned_addr learned my addr 172.21.15.70:0/3068038262 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.517+0000 7faa7dd9b640 1 --2- 172.21.15.70:0/3068038262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bff1370 0x55fd2bff3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.517+0000 7faa7ed9d640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faa680a2cd0 0x7faa680a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.517+0000 7faa7e59c640 1 --2- 172.21.15.70:0/3068038262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bfe65d0 0x55fd2bfe6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.517+0000 7faa7ed9d640 1 -- 172.21.15.70:0/3068038262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bff1370 msgr2=0x55fd2bff3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:42.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.517+0000 7faa7ed9d640 1 --2- 172.21.15.70:0/3068038262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bff1370 0x55fd2bff3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.517+0000 7faa7ed9d640 1 -- 172.21.15.70:0/3068038262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bfe65d0 msgr2=0x55fd2bfe6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:42.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.517+0000 7faa6f7fe640 1 -- 172.21.15.70:0/4158438072 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faa700cea50 con 0x7faa80101de0 2024-09-12T01:52:42.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.517+0000 7faa7ed9d640 1 --2- 172.21.15.70:0/3068038262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bfe65d0 0x55fd2bfe6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.517+0000 7faa7ed9d640 1 -- 172.21.15.70:0/3068038262 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd2bed83a0 con 0x55fd2bfe7b40 2024-09-12T01:52:42.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.517+0000 7faa7e59c640 1 --2- 172.21.15.70:0/3068038262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bfe65d0 0x55fd2bfe6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:42.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.517+0000 7faa7ed9d640 1 --2- 172.21.15.70:0/3068038262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe7b40 0x55fd2bfe6090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa78005cc0 tx=0x7faa78009980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f25e25153c348376 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:42.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.518+0000 7faa7ed9d640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faa680a2cd0 0x7faa680a5190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faa78047000 tx=0x7faa78049000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.518+0000 7faa6cff9640 1 -- 172.21.15.70:0/3068038262 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7804e070 con 0x55fd2bfe7b40 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.518+0000 7faa6cff9640 1 -- 172.21.15.70:0/3068038262 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa78036070 con 0x55fd2bfe7b40 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.518+0000 7faa6cff9640 1 -- 172.21.15.70:0/3068038262 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7802faf0 con 0x55fd2bfe7b40 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.519+0000 7faa8710f740 1 -- 172.21.15.70:0/3068038262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe7b40 msgr2=0x55fd2bfe6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.519+0000 7faa8710f740 1 --2- 172.21.15.70:0/3068038262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe7b40 0x55fd2bfe6090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa78005cc0 tx=0x7faa78009980 comp rx=0 tx=0).stop 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.519+0000 7faa8710f740 1 -- 172.21.15.70:0/3068038262 shutdown_connections 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.519+0000 7faa8710f740 1 --2- 172.21.15.70:0/3068038262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bff1370 0x55fd2bff3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.519+0000 7faa8710f740 1 --2- 172.21.15.70:0/3068038262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bfe65d0 0x55fd2bfe6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.519+0000 7faa8710f740 1 --2- 172.21.15.70:0/3068038262 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe7b40 0x55fd2bfe6090 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.519+0000 7faa8710f740 1 -- 172.21.15.70:0/3068038262 >> 172.21.15.70:0/3068038262 conn(0x55fd2bfaf310 msgr2=0x55fd2bfe2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.519+0000 7faa8710f740 1 -- 172.21.15.70:0/3068038262 shutdown_connections 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.519+0000 7faa8710f740 1 -- 172.21.15.70:0/3068038262 wait complete. 2024-09-12T01:52:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.520+0000 7faa8710f740 1 -- start start 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.520+0000 7faa8710f740 1 Processor -- start 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.520+0000 7faa8710f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bff0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.520+0000 7faa8710f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfe7b40 0x55fd2bfedf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.520+0000 7faa8710f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bfee480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.520+0000 7faa8710f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd2bff3ee0 con 0x55fd2bff1370 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.520+0000 7faa8710f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fd2bf07060 con 0x55fd2bfe65d0 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.520+0000 7faa8710f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fd2bff4060 con 0x55fd2bfe7b40 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.520+0000 7faa8710f740 10 client.0 _ll_register_callbacks cb 0x55fd2bc5a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa7dd9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfe7b40 0x55fd2bfedf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa7e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bff0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa7dd9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfe7b40 0x55fd2bfedf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:46398/0 (socket says 172.21.15.70:46398) 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa7dd9b640 1 -- 172.21.15.70:0/2477210924 learned_addr learned my addr 172.21.15.70:0/2477210924 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa7dd9b640 1 -- 172.21.15.70:0/2477210924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 msgr2=0x55fd2bff0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:42.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa7ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bfee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa7dd9b640 1 --2- 172.21.15.70:0/2477210924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bff0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa7dd9b640 1 -- 172.21.15.70:0/2477210924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 msgr2=0x55fd2bfee480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa7dd9b640 1 --2- 172.21.15.70:0/2477210924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bfee480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa7dd9b640 1 -- 172.21.15.70:0/2477210924 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd2bcbd3c0 con 0x55fd2bfe7b40 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa7ed9d640 1 --2- 172.21.15.70:0/2477210924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bfee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa7dd9b640 1 --2- 172.21.15.70:0/2477210924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfe7b40 0x55fd2bfedf40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa7400d960 tx=0x7faa7400de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfbbd7b32bb05850 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.521+0000 7faa65ffb640 1 -- 172.21.15.70:0/2477210924 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7401b440 con 0x55fd2bfe7b40 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.522+0000 7faa65ffb640 1 -- 172.21.15.70:0/2477210924 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faa7401b5e0 con 0x55fd2bfe7b40 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.522+0000 7faa8710f740 1 -- 172.21.15.70:0/2477210924 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa78036070 con 0x55fd2bfe7b40 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.522+0000 7faa65ffb640 1 -- 172.21.15.70:0/2477210924 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa7401b7e0 con 0x55fd2bfe7b40 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.522+0000 7faa8710f740 10 client.24961 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:42.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.522+0000 7faa8710f740 1 -- 172.21.15.70:0/2477210924 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd2bfff910 con 0x55fd2bfe7b40 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.522+0000 7faa65ffb640 1 -- 172.21.15.70:0/2477210924 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa78036070 con 0x55fd2bfe7b40 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.522+0000 7faa65ffb640 1 -- 172.21.15.70:0/2477210924 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faa74019020 con 0x55fd2bfe7b40 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.523+0000 7faa8710f740 10 client.24961 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.523+0000 7faa8710f740 10 client.24961 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.523+0000 7faa8710f740 20 client.24961 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.523+0000 7faa8710f740 1 --2- 172.21.15.70:0/2477210924 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fd2c000d70 0x55fd2c0031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.523+0000 7faa8710f740 4 client.24961 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.523+0000 7faa8710f740 1 -- 172.21.15.70:0/2477210924 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd2bf59860 con 0x55fd2c000d70 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.523+0000 7faa7e59c640 1 --2- 172.21.15.70:0/2477210924 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fd2c000d70 0x55fd2c0031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.524+0000 7faa65ffb640 10 client.24961 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.524+0000 7faa7e59c640 1 --2- 172.21.15.70:0/2477210924 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fd2c000d70 0x55fd2c0031b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5696719d83a1cf71 server_cookie=5be9c453310adf84 in_seq=0 out_seq=0 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.524+0000 7faa65ffb640 1 -- 172.21.15.70:0/2477210924 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd2bf59860 con 0x55fd2c000d70 2024-09-12T01:52:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.524+0000 7faa65ffb640 10 client.24961 handle_command_reply: tid=0 2024-09-12T01:52:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.524+0000 7faa8710f740 1 client.24961 shutdown 2024-09-12T01:52:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.524+0000 7faa8710f740 1 -- 172.21.15.70:0/2477210924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfe7b40 msgr2=0x55fd2bfedf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.524+0000 7faa8710f740 1 --2- 172.21.15.70:0/2477210924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfe7b40 0x55fd2bfedf40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa7400d960 tx=0x7faa7400de20 comp rx=0 tx=0).stop 2024-09-12T01:52:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.525+0000 7faa8710f740 1 -- 172.21.15.70:0/2477210924 shutdown_connections 2024-09-12T01:52:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.525+0000 7faa8710f740 1 --2- 172.21.15.70:0/2477210924 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fd2c000d70 0x55fd2c0031b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.525+0000 7faa65ffb640 0 client.24961 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:52:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.525+0000 7faa8710f740 1 --2- 172.21.15.70:0/2477210924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bfee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.525+0000 7faa8710f740 1 --2- 172.21.15.70:0/2477210924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfe7b40 0x55fd2bfedf40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.525+0000 7faa8710f740 1 --2- 172.21.15.70:0/2477210924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bff0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.525+0000 7faa8710f740 1 -- 172.21.15.70:0/2477210924 >> 172.21.15.70:0/2477210924 conn(0x55fd2bfaf310 msgr2=0x55fd2bfe8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.525+0000 7faa8710f740 1 -- 172.21.15.70:0/2477210924 shutdown_connections 2024-09-12T01:52:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.525+0000 7faa8710f740 1 -- 172.21.15.70:0/2477210924 wait complete. 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.525+0000 7faa8710f740 20 client.24961 trim_cache size 0 max 16384 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.542+0000 7faa8710f740 1 Processor -- start 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.542+0000 7faa8710f740 1 -- start start 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa8710f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bffd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa8710f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bfe9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa8710f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfee570 0x55fd2bfe9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa8710f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faa801b3da0 con 0x55fd2bff1370 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa8710f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faa801b58e0 con 0x55fd2bfe65d0 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa8710f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faa801b4470 con 0x55fd2bfee570 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa7ed9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfee570 0x55fd2bfe9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa7ed9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfee570 0x55fd2bfe9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:46402/0 (socket says 172.21.15.70:46402) 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa7ed9d640 1 -- 172.21.15.70:0/2281524056 learned_addr learned my addr 172.21.15.70:0/2281524056 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa7dd9b640 1 --2- 172.21.15.70:0/2281524056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bfe9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa7e59c640 1 --2- 172.21.15.70:0/2281524056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bffd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa7ed9d640 1 -- 172.21.15.70:0/2281524056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 msgr2=0x55fd2bffd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa7ed9d640 1 --2- 172.21.15.70:0/2281524056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bffd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa7ed9d640 1 -- 172.21.15.70:0/2281524056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 msgr2=0x55fd2bfe9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa7ed9d640 1 --2- 172.21.15.70:0/2281524056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bfe9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.543+0000 7faa7ed9d640 1 -- 172.21.15.70:0/2281524056 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd2bfeea80 con 0x55fd2bfee570 2024-09-12T01:52:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.544+0000 7faa7ed9d640 1 --2- 172.21.15.70:0/2281524056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfee570 0x55fd2bfe9660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faa78031b30 tx=0x7faa7802f4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccd98ddc8a7e39da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.544+0000 7faa67fff640 1 -- 172.21.15.70:0/2281524056 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78055070 con 0x55fd2bfee570 2024-09-12T01:52:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.544+0000 7faa67fff640 1 -- 172.21.15.70:0/2281524056 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa78036040 con 0x55fd2bfee570 2024-09-12T01:52:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.544+0000 7faa67fff640 1 -- 172.21.15.70:0/2281524056 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7804e050 con 0x55fd2bfee570 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.545+0000 7faa8710f740 1 -- 172.21.15.70:0/2281524056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfee570 msgr2=0x55fd2bfe9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.545+0000 7faa8710f740 1 --2- 172.21.15.70:0/2281524056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfee570 0x55fd2bfe9660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faa78031b30 tx=0x7faa7802f4a0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.545+0000 7faa8710f740 1 -- 172.21.15.70:0/2281524056 shutdown_connections 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.545+0000 7faa8710f740 1 --2- 172.21.15.70:0/2281524056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfee570 0x55fd2bfe9660 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.545+0000 7faa8710f740 1 --2- 172.21.15.70:0/2281524056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bfe9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.545+0000 7faa8710f740 1 --2- 172.21.15.70:0/2281524056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bffd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.545+0000 7faa8710f740 1 -- 172.21.15.70:0/2281524056 >> 172.21.15.70:0/2281524056 conn(0x55fd2bfaf310 msgr2=0x55fd2bfed030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.545+0000 7faa8710f740 1 -- 172.21.15.70:0/2281524056 shutdown_connections 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.545+0000 7faa8710f740 1 -- 172.21.15.70:0/2281524056 wait complete. 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.545+0000 7faa8710f740 1 -- start start 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.545+0000 7faa8710f740 1 Processor -- start 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.546+0000 7faa8710f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bff9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.546+0000 7faa8710f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfee570 0x55fd2bff4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.546+0000 7faa8710f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bff5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.546+0000 7faa8710f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faa801b5210 con 0x55fd2bff1370 2024-09-12T01:52:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.546+0000 7faa8710f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faa801b4b40 con 0x55fd2bfe65d0 2024-09-12T01:52:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.546+0000 7faa8710f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faa801b1d60 con 0x55fd2bfee570 2024-09-12T01:52:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.546+0000 7faa7e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bff9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.546+0000 7faa8710f740 10 client.0 _ll_register_callbacks cb 0x7faa740043d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.546+0000 7faa7e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bff9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:55816/0 (socket says 172.21.15.70:55816) 2024-09-12T01:52:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.546+0000 7faa7e59c640 1 -- 172.21.15.70:0/4023408992 learned_addr learned my addr 172.21.15.70:0/4023408992 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.546+0000 7faa7ed9d640 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bff5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.546+0000 7faa7dd9b640 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfee570 0x55fd2bff4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa7e59c640 1 -- 172.21.15.70:0/4023408992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfee570 msgr2=0x55fd2bff4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa7e59c640 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfee570 0x55fd2bff4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa7e59c640 1 -- 172.21.15.70:0/4023408992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 msgr2=0x55fd2bff5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:42.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa7e59c640 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bff5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa7e59c640 1 -- 172.21.15.70:0/4023408992 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd2bff5d90 con 0x55fd2bfe65d0 2024-09-12T01:52:42.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa7e59c640 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bff9c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa7009b240 tx=0x7faa700052d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2741b22ff768bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:42.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-12T01:52:42.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa65ffb640 1 -- 172.21.15.70:0/4023408992 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa700af030 con 0x55fd2bfe65d0 2024-09-12T01:52:42.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa65ffb640 1 -- 172.21.15.70:0/4023408992 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faa700cc660 con 0x55fd2bfe65d0 2024-09-12T01:52:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa8710f740 1 -- 172.21.15.70:0/4023408992 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa78036040 con 0x55fd2bfe65d0 2024-09-12T01:52:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa65ffb640 1 -- 172.21.15.70:0/4023408992 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa700aae80 con 0x55fd2bfe65d0 2024-09-12T01:52:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa8710f740 10 client.25052 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.547+0000 7faa8710f740 1 -- 172.21.15.70:0/4023408992 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd2c06bb80 con 0x55fd2bfe65d0 2024-09-12T01:52:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.548+0000 7faa65ffb640 1 -- 172.21.15.70:0/4023408992 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa700a3f20 con 0x55fd2bfe65d0 2024-09-12T01:52:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.548+0000 7faa65ffb640 1 -- 172.21.15.70:0/4023408992 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faa700a3b00 con 0x55fd2bfe65d0 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.548+0000 7faa8710f740 10 client.25052 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.548+0000 7faa8710f740 10 client.25052 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.548+0000 7faa8710f740 20 client.25052 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.548+0000 7faa8710f740 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fd2c06c250 0x55fd2c06e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.548+0000 7faa8710f740 4 client.25052 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.548+0000 7faa8710f740 1 -- 172.21.15.70:0/4023408992 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7faa78036040 con 0x55fd2c06c250 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.548+0000 7faa7dd9b640 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fd2c06c250 0x55fd2c06e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa65ffb640 10 client.25052 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa7dd9b640 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fd2c06c250 0x55fd2c06e640 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3b891d665faeb37f server_cookie=27a2960da7c8f45b in_seq=0 out_seq=0 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa65ffb640 1 -- 172.21.15.70:0/4023408992 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7faa78036040 con 0x55fd2c06c250 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa65ffb640 10 client.25052 handle_command_reply: tid=0 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa8710f740 1 client.25052 shutdown 2024-09-12T01:52:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa8710f740 1 -- 172.21.15.70:0/4023408992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 msgr2=0x55fd2bff9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:42.741 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:52:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa8710f740 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bff9c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faa7009b240 tx=0x7faa700052d0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa8710f740 1 -- 172.21.15.70:0/4023408992 shutdown_connections 2024-09-12T01:52:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa8710f740 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55fd2c06c250 0x55fd2c06e640 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa8710f740 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd2bff1370 0x55fd2bff5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa8710f740 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fd2bfee570 0x55fd2bff4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa8710f740 1 --2- 172.21.15.70:0/4023408992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fd2bfe65d0 0x55fd2bff9c20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa8710f740 1 -- 172.21.15.70:0/4023408992 >> 172.21.15.70:0/4023408992 conn(0x55fd2bfaf310 msgr2=0x55fd2bfef7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa65ffb640 0 client.25052 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa8710f740 1 -- 172.21.15.70:0/4023408992 shutdown_connections 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa8710f740 1 -- 172.21.15.70:0/4023408992 wait complete. 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.549+0000 7faa8710f740 20 client.25052 trim_cache size 0 max 16384 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.550+0000 7faa84d36640 1 -- 172.21.15.70:0/4158438072 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faa680a2cd0 msgr2=0x7faa680a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.550+0000 7faa84d36640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faa680a2cd0 0x7faa680a5190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faa78047000 tx=0x7faa78049000 comp rx=0 tx=0).stop 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.550+0000 7faa84d36640 1 -- 172.21.15.70:0/4158438072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa80101de0 msgr2=0x7faa800744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.550+0000 7faa84d36640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa80101de0 0x7faa800744f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7faa7000d950 tx=0x7faa7000de10 comp rx=0 tx=0).stop 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.550+0000 7faa84d36640 1 -- 172.21.15.70:0/4158438072 shutdown_connections 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.550+0000 7faa84d36640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faa680a2cd0 0x7faa680a5190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.550+0000 7faa84d36640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa80106f10 0x7faa80074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.550+0000 7faa84d36640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa80102790 0x7faa80074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.550+0000 7faa84d36640 1 --2- 172.21.15.70:0/4158438072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa80101de0 0x7faa800744f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.550+0000 7faa84d36640 1 -- 172.21.15.70:0/4158438072 >> 172.21.15.70:0/4158438072 conn(0x7faa800fd8e0 msgr2=0x7faa800feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.550+0000 7faa84d36640 1 -- 172.21.15.70:0/4158438072 shutdown_connections 2024-09-12T01:52:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:42.550+0000 7faa84d36640 1 -- 172.21.15.70:0/4158438072 wait complete. 2024-09-12T01:52:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:42 smithi070 ceph-mon[31177]: pgmap v353: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:52:42.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:42 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/414798822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:42.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:42 smithi191 ceph-mon[35770]: pgmap v353: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:52:42.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:42 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/414798822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:43.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:42 smithi152 ceph-mon[35055]: pgmap v353: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:52:43.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:42 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/414798822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:43.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:52:43.720 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24452 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-12T01:52:43.720 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24452 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-12T01:52:43.800 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:44.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.323+0000 7faebb3e9640 1 -- 172.21.15.70:0/2632928824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeb4102ef0 msgr2=0x7faeb410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:44.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.323+0000 7faebb3e9640 1 --2- 172.21.15.70:0/2632928824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeb4102ef0 0x7faeb410da40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faeac009ca0 tx=0x7faeac02a950 comp rx=0 tx=0).stop 2024-09-12T01:52:44.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.323+0000 7faebb3e9640 1 -- 172.21.15.70:0/2632928824 shutdown_connections 2024-09-12T01:52:44.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.323+0000 7faebb3e9640 1 --2- 172.21.15.70:0/2632928824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeb4102ef0 0x7faeb410da40 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.323+0000 7faebb3e9640 1 --2- 172.21.15.70:0/2632928824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faeb4102570 0x7faeb41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.323+0000 7faebb3e9640 1 --2- 172.21.15.70:0/2632928824 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeb4100e20 0x7faeb4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.323+0000 7faebb3e9640 1 -- 172.21.15.70:0/2632928824 >> 172.21.15.70:0/2632928824 conn(0x7faeb40fc7d0 msgr2=0x7faeb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:44.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.323+0000 7faebb3e9640 1 -- 172.21.15.70:0/2632928824 shutdown_connections 2024-09-12T01:52:44.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.323+0000 7faebb3e9640 1 -- 172.21.15.70:0/2632928824 wait complete. 2024-09-12T01:52:44.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faebb3e9640 1 Processor -- start 2024-09-12T01:52:44.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faebb3e9640 1 -- start start 2024-09-12T01:52:44.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faebb3e9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faeb4100e20 0x7faeb40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faebb3e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeb4102570 0x7faeb40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faebb3e9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeb4102ef0 0x7faeb40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faebb3e9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41110a0 con 0x7faeb4102570 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faebb3e9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faeb4110f20 con 0x7faeb4102ef0 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faebb3e9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faeb4111220 con 0x7faeb4100e20 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faeb8984640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeb4102570 0x7faeb40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faeb8984640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeb4102570 0x7faeb40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38894/0 (socket says 172.21.15.70:38894) 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faeb8984640 1 -- 172.21.15.70:0/2331893834 learned_addr learned my addr 172.21.15.70:0/2331893834 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faeb9185640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faeb4100e20 0x7faeb40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.324+0000 7faeb9986640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeb4102ef0 0x7faeb40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.325+0000 7faeb8984640 1 -- 172.21.15.70:0/2331893834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faeb4100e20 msgr2=0x7faeb40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.325+0000 7faeb8984640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faeb4100e20 0x7faeb40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.325+0000 7faeb8984640 1 -- 172.21.15.70:0/2331893834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeb4102ef0 msgr2=0x7faeb40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.325+0000 7faeb8984640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeb4102ef0 0x7faeb40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.325+0000 7faeb8984640 1 -- 172.21.15.70:0/2331893834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb41aafc0 con 0x7faeb4102570 2024-09-12T01:52:44.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.325+0000 7faeb8984640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeb4102570 0x7faeb40fd1c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faea400d770 tx=0x7faea400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:44.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.325+0000 7faeaa7fc640 1 -- 172.21.15.70:0/2331893834 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4017070 con 0x7faeb4102570 2024-09-12T01:52:44.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.325+0000 7faeaa7fc640 1 -- 172.21.15.70:0/2331893834 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faea4005520 con 0x7faeb4102570 2024-09-12T01:52:44.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.325+0000 7faebb3e9640 1 -- 172.21.15.70:0/2331893834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb41ab1f0 con 0x7faeb4102570 2024-09-12T01:52:44.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.325+0000 7faeaa7fc640 1 -- 172.21.15.70:0/2331893834 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4010460 con 0x7faeb4102570 2024-09-12T01:52:44.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.325+0000 7faebb3e9640 1 -- 172.21.15.70:0/2331893834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb41ab6e0 con 0x7faeb4102570 2024-09-12T01:52:44.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.329+0000 7faebd7c2740 1 Processor -- start 2024-09-12T01:52:44.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.329+0000 7faebd7c2740 1 -- start start 2024-09-12T01:52:44.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.329+0000 7faeaa7fc640 1 -- 172.21.15.70:0/2331893834 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7faea4004ea0 con 0x7faeb4102570 2024-09-12T01:52:44.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.329+0000 7faebd7c2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920eab40 0x5605920e9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.329+0000 7faebd7c2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920e9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.329+0000 7faeb9185640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920e9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.329+0000 7faeb9185640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920e9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:46430/0 (socket says 172.21.15.70:46430) 2024-09-12T01:52:44.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.330+0000 7faeb9986640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920eab40 0x5605920e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.330+0000 7faeb9986640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920eab40 0x5605920e9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38896/0 (socket says 172.21.15.70:38896) 2024-09-12T01:52:44.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.330+0000 7faebd7c2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920f4370 0x5605920f6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.330+0000 7faeb9185640 1 -- 172.21.15.70:0/1966284909 learned_addr learned my addr 172.21.15.70:0/1966284909 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:44.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.330+0000 7faeaa7fc640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faea00a2b80 0x7faea00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.330+0000 7faebd7c2740 1 -- 172.21.15.70:0/1966284909 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56059204f2f0 con 0x5605920eab40 2024-09-12T01:52:44.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.330+0000 7faebd7c2740 1 -- 172.21.15.70:0/1966284909 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560591ff6cf0 con 0x5605920f4370 2024-09-12T01:52:44.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.330+0000 7faebd7c2740 1 -- 172.21.15.70:0/1966284909 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56059204b2b0 con 0x5605920e95d0 2024-09-12T01:52:44.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.330+0000 7faeaa7fc640 1 -- 172.21.15.70:0/2331893834 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faea40cea80 con 0x7faeb4102570 2024-09-12T01:52:44.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.331+0000 7faeb8984640 1 --2- 172.21.15.70:0/1966284909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920f4370 0x5605920f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.331+0000 7faeb9185640 1 -- 172.21.15.70:0/1966284909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920f4370 msgr2=0x5605920f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:44.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.331+0000 7faeb9185640 1 --2- 172.21.15.70:0/1966284909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920f4370 0x5605920f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.331+0000 7faeb9185640 1 -- 172.21.15.70:0/1966284909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920eab40 msgr2=0x5605920e9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:44.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.331+0000 7faeb9185640 1 --2- 172.21.15.70:0/1966284909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920eab40 0x5605920e9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.331+0000 7faeb9185640 1 -- 172.21.15.70:0/1966284909 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560591fdb3a0 con 0x5605920e95d0 2024-09-12T01:52:44.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.331+0000 7faeb9986640 1 --2- 172.21.15.70:0/1966284909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920eab40 0x5605920e9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:44.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.332+0000 7faeb9185640 1 --2- 172.21.15.70:0/1966284909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920e9a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faeb000bd10 tx=0x7faeb00107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d804803e3ef07ba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:44.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.332+0000 7faeb9986640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faea00a2b80 0x7faea00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.332+0000 7fae9f7fe640 1 -- 172.21.15.70:0/1966284909 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0004030 con 0x5605920e95d0 2024-09-12T01:52:44.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.332+0000 7fae9f7fe640 1 -- 172.21.15.70:0/1966284909 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faeb00041d0 con 0x5605920e95d0 2024-09-12T01:52:44.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.332+0000 7fae9f7fe640 1 -- 172.21.15.70:0/1966284909 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb00118b0 con 0x5605920e95d0 2024-09-12T01:52:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.333+0000 7faebd7c2740 1 -- 172.21.15.70:0/1966284909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 msgr2=0x5605920e9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.333+0000 7faebd7c2740 1 --2- 172.21.15.70:0/1966284909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920e9a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faeb000bd10 tx=0x7faeb00107a0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.333+0000 7faeb9986640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faea00a2b80 0x7faea00a5040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faeac009430 tx=0x7faeac03c040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.333+0000 7faebd7c2740 1 -- 172.21.15.70:0/1966284909 shutdown_connections 2024-09-12T01:52:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.333+0000 7faebd7c2740 1 --2- 172.21.15.70:0/1966284909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920f4370 0x5605920f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.333+0000 7faebd7c2740 1 --2- 172.21.15.70:0/1966284909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920e9a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.333+0000 7faebd7c2740 1 --2- 172.21.15.70:0/1966284909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920eab40 0x5605920e9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.333+0000 7faebd7c2740 1 -- 172.21.15.70:0/1966284909 >> 172.21.15.70:0/1966284909 conn(0x5605920b2310 msgr2=0x5605920e5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.333+0000 7faebd7c2740 1 -- 172.21.15.70:0/1966284909 shutdown_connections 2024-09-12T01:52:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.333+0000 7faebd7c2740 1 -- 172.21.15.70:0/1966284909 wait complete. 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.334+0000 7faebd7c2740 1 -- start start 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.334+0000 7faebd7c2740 1 Processor -- start 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.334+0000 7faebd7c2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920e95d0 0x5605920f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.334+0000 7faebd7c2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920eab40 0x5605920f1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.334+0000 7faebd7c2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920f4370 0x5605920f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.334+0000 7faeb9185640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920e95d0 0x5605920f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.334+0000 7faeb9185640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920e95d0 0x5605920f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38902/0 (socket says 172.21.15.70:38902) 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faeb9185640 1 -- 172.21.15.70:0/1462363246 learned_addr learned my addr 172.21.15.70:0/1462363246 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faebd7c2740 1 -- 172.21.15.70:0/1462363246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5605920f7070 con 0x5605920e95d0 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faebd7c2740 1 -- 172.21.15.70:0/1462363246 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56059200a060 con 0x5605920f4370 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faebd7c2740 1 -- 172.21.15.70:0/1462363246 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5605920f71f0 con 0x5605920eab40 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faebd7c2740 10 client.0 _ll_register_callbacks cb 0x560591d5d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faeb8984640 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920eab40 0x5605920f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faeb9986640 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920f4370 0x5605920f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faeb9185640 1 -- 172.21.15.70:0/1462363246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920eab40 msgr2=0x5605920f1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faeb9185640 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920eab40 0x5605920f1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faeb9185640 1 -- 172.21.15.70:0/1462363246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920f4370 msgr2=0x5605920f1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faeb9185640 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920f4370 0x5605920f1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faeb9185640 1 -- 172.21.15.70:0/1462363246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560591dc03c0 con 0x5605920e95d0 2024-09-12T01:52:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faeb8984640 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920eab40 0x5605920f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7faeb9185640 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920e95d0 0x5605920f3dd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faeb0006010 tx=0x7faeb00045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9f3d37185c8d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.335+0000 7fae9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.336+0000 7fae9cff9640 1 -- 172.21.15.70:0/1462363246 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0029060 con 0x5605920e95d0 2024-09-12T01:52:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.336+0000 7fae9cff9640 1 -- 172.21.15.70:0/1462363246 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faeb0003800 con 0x5605920e95d0 2024-09-12T01:52:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.336+0000 7faebd7c2740 1 -- 172.21.15.70:0/1462363246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faeb00041d0 con 0x5605920e95d0 2024-09-12T01:52:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.336+0000 7fae9cff9640 1 -- 172.21.15.70:0/1462363246 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faeb000b8e0 con 0x5605920e95d0 2024-09-12T01:52:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.336+0000 7faebd7c2740 10 client.15624 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:44.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.336+0000 7faebd7c2740 1 -- 172.21.15.70:0/1462363246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560592102b70 con 0x5605920e95d0 2024-09-12T01:52:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.336+0000 7fae9cff9640 1 -- 172.21.15.70:0/1462363246 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faeb00041d0 con 0x5605920e95d0 2024-09-12T01:52:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.336+0000 7fae9cff9640 1 -- 172.21.15.70:0/1462363246 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faeb002e070 con 0x5605920e95d0 2024-09-12T01:52:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.337+0000 7faebd7c2740 10 client.15624 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.337+0000 7faebd7c2740 10 client.15624 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:52:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.337+0000 7faebd7c2740 20 client.15624 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.337+0000 7faebd7c2740 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x560592103ec0 0x5605921062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.337+0000 7faebd7c2740 4 client.15624 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.337+0000 7faebd7c2740 1 -- 172.21.15.70:0/1462363246 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56059205c860 con 0x560592103ec0 2024-09-12T01:52:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.337+0000 7faeb8984640 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x560592103ec0 0x5605921062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.338+0000 7fae9cff9640 10 client.15624 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:52:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.338+0000 7faeb8984640 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x560592103ec0 0x5605921062b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f3821a17f6f99eda server_cookie=252003519cf45370 in_seq=0 out_seq=0 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.338+0000 7fae9cff9640 1 -- 172.21.15.70:0/1462363246 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56059205c860 con 0x560592103ec0 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.338+0000 7fae9cff9640 10 client.15624 handle_command_reply: tid=0 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.338+0000 7faebd7c2740 1 client.15624 shutdown 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.338+0000 7faebd7c2740 1 -- 172.21.15.70:0/1462363246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920e95d0 msgr2=0x5605920f3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.338+0000 7faebd7c2740 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920e95d0 0x5605920f3dd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faeb0006010 tx=0x7faeb00045b0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.339+0000 7faebd7c2740 1 -- 172.21.15.70:0/1462363246 shutdown_connections 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.339+0000 7faebd7c2740 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x560592103ec0 0x5605921062b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.339+0000 7faebd7c2740 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920f4370 0x5605920f1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.339+0000 7faebd7c2740 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920eab40 0x5605920f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.339+0000 7fae9cff9640 0 client.15624 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.339+0000 7faebd7c2740 1 --2- 172.21.15.70:0/1462363246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920e95d0 0x5605920f3dd0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.339+0000 7faebd7c2740 1 -- 172.21.15.70:0/1462363246 >> 172.21.15.70:0/1462363246 conn(0x5605920b2310 msgr2=0x5605920eb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:44.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.339+0000 7faebd7c2740 1 -- 172.21.15.70:0/1462363246 shutdown_connections 2024-09-12T01:52:44.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.339+0000 7faebd7c2740 1 -- 172.21.15.70:0/1462363246 wait complete. 2024-09-12T01:52:44.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.339+0000 7faebd7c2740 20 client.15624 trim_cache size 0 max 16384 2024-09-12T01:52:44.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.352+0000 7faebd7c2740 1 Processor -- start 2024-09-12T01:52:44.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.353+0000 7faebd7c2740 1 -- start start 2024-09-12T01:52:44.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.353+0000 7faebd7c2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920ec120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.353+0000 7faebd7c2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920eab40 0x5605920ec660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.353+0000 7faebd7c2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 0x56059210b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.353+0000 7faebd7c2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b3d90 con 0x5605920f4370 2024-09-12T01:52:44.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.353+0000 7faebd7c2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b58d0 con 0x5605920eab40 2024-09-12T01:52:44.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.353+0000 7faebd7c2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b4460 con 0x5605920e95d0 2024-09-12T01:52:44.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.353+0000 7faeb9986640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 0x56059210b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.353+0000 7faeb9986640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 0x56059210b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38912/0 (socket says 172.21.15.70:38912) 2024-09-12T01:52:44.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.353+0000 7faeb9986640 1 -- 172.21.15.70:0/699918193 learned_addr learned my addr 172.21.15.70:0/699918193 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:44.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.353+0000 7faeb9185640 1 --2- 172.21.15.70:0/699918193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920ec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.354+0000 7faeb8984640 1 --2- 172.21.15.70:0/699918193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920eab40 0x5605920ec660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.354+0000 7faeb9986640 1 -- 172.21.15.70:0/699918193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 msgr2=0x5605920ec120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:44.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.354+0000 7faeb9986640 1 --2- 172.21.15.70:0/699918193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920ec120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.354+0000 7faeb9986640 1 -- 172.21.15.70:0/699918193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920eab40 msgr2=0x5605920ec660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:44.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.354+0000 7faeb9986640 1 --2- 172.21.15.70:0/699918193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920eab40 0x5605920ec660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.354+0000 7faeb9986640 1 -- 172.21.15.70:0/699918193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560592062e70 con 0x5605920f4370 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.354+0000 7faeb9986640 1 --2- 172.21.15.70:0/699918193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 0x56059210b8b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faeac02fe00 tx=0x7faeac044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129a9d867f4db11d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.354+0000 7fae9effd640 1 -- 172.21.15.70:0/699918193 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac056070 con 0x5605920f4370 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.355+0000 7fae9effd640 1 -- 172.21.15.70:0/699918193 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faeac004050 con 0x5605920f4370 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.355+0000 7fae9effd640 1 -- 172.21.15.70:0/699918193 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac034040 con 0x5605920f4370 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.355+0000 7faebd7c2740 1 -- 172.21.15.70:0/699918193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 msgr2=0x56059210b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.355+0000 7faebd7c2740 1 --2- 172.21.15.70:0/699918193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 0x56059210b8b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faeac02fe00 tx=0x7faeac044000 comp rx=0 tx=0).stop 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.356+0000 7faebd7c2740 1 -- 172.21.15.70:0/699918193 shutdown_connections 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.356+0000 7faebd7c2740 1 --2- 172.21.15.70:0/699918193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 0x56059210b8b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.356+0000 7faebd7c2740 1 --2- 172.21.15.70:0/699918193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920eab40 0x5605920ec660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.356+0000 7faebd7c2740 1 --2- 172.21.15.70:0/699918193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920ec120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.356+0000 7faebd7c2740 1 -- 172.21.15.70:0/699918193 >> 172.21.15.70:0/699918193 conn(0x5605920b2310 msgr2=0x5605920f0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.356+0000 7faebd7c2740 1 -- 172.21.15.70:0/699918193 shutdown_connections 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.356+0000 7faebd7c2740 1 -- 172.21.15.70:0/699918193 wait complete. 2024-09-12T01:52:44.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.356+0000 7faebd7c2740 1 -- start start 2024-09-12T01:52:44.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.357+0000 7faebd7c2740 1 Processor -- start 2024-09-12T01:52:44.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.358+0000 7faebd7c2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920fc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.358+0000 7faebd7c2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920eab40 0x5605920fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.358+0000 7faebd7c2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 0x5605920ed890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.358+0000 7faebd7c2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b5200 con 0x5605920f4370 2024-09-12T01:52:44.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.358+0000 7faebd7c2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b4b30 con 0x5605920eab40 2024-09-12T01:52:44.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.358+0000 7faebd7c2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b1d50 con 0x5605920e95d0 2024-09-12T01:52:44.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.358+0000 7faebd7c2740 10 client.0 _ll_register_callbacks cb 0x7faeac009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:44.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.358+0000 7faeb9986640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 0x5605920ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.358+0000 7faeb9986640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 0x5605920ed890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38928/0 (socket says 172.21.15.70:38928) 2024-09-12T01:52:44.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.358+0000 7faeb9986640 1 -- 172.21.15.70:0/2525177129 learned_addr learned my addr 172.21.15.70:0/2525177129 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:44.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7faeb8984640 1 --2- 172.21.15.70:0/2525177129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920eab40 0x5605920fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7faeb9986640 1 -- 172.21.15.70:0/2525177129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 msgr2=0x5605920fc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:44.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7faeb9986640 1 --2- 172.21.15.70:0/2525177129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920fc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7faeb9986640 1 -- 172.21.15.70:0/2525177129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920eab40 msgr2=0x5605920fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:44.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7faeb9986640 1 --2- 172.21.15.70:0/2525177129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920eab40 0x5605920fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7faeb9986640 1 -- 172.21.15.70:0/2525177129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605920ee0c0 con 0x5605920f4370 2024-09-12T01:52:44.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7faeb9986640 1 --2- 172.21.15.70:0/2525177129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 0x5605920ed890 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7faeac006010 tx=0x7faeac004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2cd8f837fe504c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:44.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7fae9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:44.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7fae9cff9640 1 -- 172.21.15.70:0/2525177129 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac05f060 con 0x5605920f4370 2024-09-12T01:52:44.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7fae9cff9640 1 -- 172.21.15.70:0/2525177129 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faeac004400 con 0x5605920f4370 2024-09-12T01:52:44.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7faebd7c2740 1 -- 172.21.15.70:0/2525177129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faeac004050 con 0x5605920f4370 2024-09-12T01:52:44.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7fae9cff9640 1 -- 172.21.15.70:0/2525177129 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faeac056040 con 0x5605920f4370 2024-09-12T01:52:44.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7faebd7c2740 10 client.15630 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:44.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.359+0000 7faebd7c2740 1 -- 172.21.15.70:0/2525177129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56059216e340 con 0x5605920f4370 2024-09-12T01:52:44.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.360+0000 7fae9cff9640 1 -- 172.21.15.70:0/2525177129 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faeac004050 con 0x5605920f4370 2024-09-12T01:52:44.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.360+0000 7fae9cff9640 1 -- 172.21.15.70:0/2525177129 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faeac064070 con 0x5605920f4370 2024-09-12T01:52:44.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.360+0000 7faebd7c2740 10 client.15630 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:44.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.360+0000 7faebd7c2740 10 client.15630 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:52:44.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.360+0000 7faebd7c2740 20 client.15630 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:44.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.360+0000 7faebd7c2740 1 --2- 172.21.15.70:0/2525177129 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x560592103ec0 0x560592170a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:44.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.360+0000 7faebd7c2740 4 client.15630 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:52:44.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.360+0000 7faebd7c2740 1 -- 172.21.15.70:0/2525177129 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560592056d70 con 0x560592103ec0 2024-09-12T01:52:44.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.360+0000 7faeb9185640 1 --2- 172.21.15.70:0/2525177129 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x560592103ec0 0x560592170a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7faeb9185640 1 --2- 172.21.15.70:0/2525177129 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x560592103ec0 0x560592170a10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b2f9177533046b97 server_cookie=e665074c4bf3be6e in_seq=0 out_seq=0 2024-09-12T01:52:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7fae9cff9640 10 client.15630 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:52:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7fae9cff9640 1 -- 172.21.15.70:0/2525177129 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560592056d70 con 0x560592103ec0 2024-09-12T01:52:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7fae9cff9640 10 client.15630 handle_command_reply: tid=0 2024-09-12T01:52:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7faebd7c2740 1 client.15630 shutdown 2024-09-12T01:52:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7faebd7c2740 1 -- 172.21.15.70:0/2525177129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 msgr2=0x5605920ed890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7faebd7c2740 1 --2- 172.21.15.70:0/2525177129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 0x5605920ed890 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7faeac006010 tx=0x7faeac004990 comp rx=0 tx=0).stop 2024-09-12T01:52:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7faebd7c2740 1 -- 172.21.15.70:0/2525177129 shutdown_connections 2024-09-12T01:52:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7faebd7c2740 1 --2- 172.21.15.70:0/2525177129 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x560592103ec0 0x560592170a10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7fae9cff9640 0 client.15630 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:52:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7faebd7c2740 1 --2- 172.21.15.70:0/2525177129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605920f4370 0x5605920ed890 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7faebd7c2740 1 --2- 172.21.15.70:0/2525177129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5605920eab40 0x5605920fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7faebd7c2740 1 --2- 172.21.15.70:0/2525177129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5605920e95d0 0x5605920fc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.361+0000 7faebd7c2740 1 -- 172.21.15.70:0/2525177129 >> 172.21.15.70:0/2525177129 conn(0x5605920b2310 msgr2=0x5605920ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.362+0000 7faebd7c2740 1 -- 172.21.15.70:0/2525177129 shutdown_connections 2024-09-12T01:52:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.362+0000 7faebd7c2740 1 -- 172.21.15.70:0/2525177129 wait complete. 2024-09-12T01:52:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.362+0000 7faebd7c2740 20 client.15630 trim_cache size 0 max 16384 2024-09-12T01:52:44.366 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:52:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.362+0000 7faebb3e9640 1 -- 172.21.15.70:0/2331893834 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faea00a2b80 msgr2=0x7faea00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.362+0000 7faebb3e9640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faea00a2b80 0x7faea00a5040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faeac009430 tx=0x7faeac03c040 comp rx=0 tx=0).stop 2024-09-12T01:52:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.362+0000 7faebb3e9640 1 -- 172.21.15.70:0/2331893834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeb4102570 msgr2=0x7faeb40fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.363+0000 7faebb3e9640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeb4102570 0x7faeb40fd1c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faea400d770 tx=0x7faea400dc30 comp rx=0 tx=0).stop 2024-09-12T01:52:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.363+0000 7faebb3e9640 1 -- 172.21.15.70:0/2331893834 shutdown_connections 2024-09-12T01:52:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.363+0000 7faebb3e9640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faea00a2b80 0x7faea00a5040 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.363+0000 7faebb3e9640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faeb4102ef0 0x7faeb40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.363+0000 7faebb3e9640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faeb4102570 0x7faeb40fd1c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.363+0000 7faebb3e9640 1 --2- 172.21.15.70:0/2331893834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faeb4100e20 0x7faeb40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.363+0000 7faebb3e9640 1 -- 172.21.15.70:0/2331893834 >> 172.21.15.70:0/2331893834 conn(0x7faeb40fc7d0 msgr2=0x7faeb406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.363+0000 7faebb3e9640 1 -- 172.21.15.70:0/2331893834 shutdown_connections 2024-09-12T01:52:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:44.363+0000 7faebb3e9640 1 -- 172.21.15.70:0/2331893834 wait complete. 2024-09-12T01:52:44.371 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:44.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:44 smithi070 ceph-mon[31177]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:52:44.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:44 smithi191 ceph-mon[35770]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:52:45.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:44 smithi152 ceph-mon[35055]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:52:45.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:52:45.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.608+0000 7f5e05b6b640 1 -- 172.21.15.70:0/816837692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e001009b0 msgr2=0x7f5e00100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:45.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.608+0000 7f5e05b6b640 1 --2- 172.21.15.70:0/816837692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e001009b0 0x7f5e00100d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009900 tx=0x7f5df002a410 comp rx=0 tx=0).stop 2024-09-12T01:52:45.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.609+0000 7f5e05b6b640 1 -- 172.21.15.70:0/816837692 shutdown_connections 2024-09-12T01:52:45.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.609+0000 7f5e05b6b640 1 --2- 172.21.15.70:0/816837692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e0010e4d0 0x7f5e001108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.609+0000 7f5e05b6b640 1 --2- 172.21.15.70:0/816837692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e00101360 0x7f5e0010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.609+0000 7f5e05b6b640 1 --2- 172.21.15.70:0/816837692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e001009b0 0x7f5e00100d90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.609+0000 7f5e05b6b640 1 -- 172.21.15.70:0/816837692 >> 172.21.15.70:0/816837692 conn(0x7f5e000fc7d0 msgr2=0x7f5e000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:45.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.609+0000 7f5e05b6b640 1 -- 172.21.15.70:0/816837692 shutdown_connections 2024-09-12T01:52:45.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.609+0000 7f5e05b6b640 1 -- 172.21.15.70:0/816837692 wait complete. 2024-09-12T01:52:45.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.610+0000 7f5e05b6b640 1 Processor -- start 2024-09-12T01:52:45.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.610+0000 7f5e05b6b640 1 -- start start 2024-09-12T01:52:45.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.611+0000 7f5e05b6b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e001009b0 0x7f5e001a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.611+0000 7f5e05b6b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e00101360 0x7f5e001a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.611+0000 7f5e05b6b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e0010e4d0 0x7f5e0019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.611+0000 7f5e05b6b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5e00114360 con 0x7f5e001009b0 2024-09-12T01:52:45.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.611+0000 7f5e05b6b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5e001141e0 con 0x7f5e0010e4d0 2024-09-12T01:52:45.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.611+0000 7f5e05b6b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5e001144e0 con 0x7f5e00101360 2024-09-12T01:52:45.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.611+0000 7f5dff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e001009b0 0x7f5e001a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.611+0000 7f5dff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e001009b0 0x7f5e001a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38942/0 (socket says 172.21.15.70:38942) 2024-09-12T01:52:45.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.611+0000 7f5dff7fe640 1 -- 172.21.15.70:0/1383536573 learned_addr learned my addr 172.21.15.70:0/1383536573 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:45.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.612+0000 7f5dff7fe640 1 -- 172.21.15.70:0/1383536573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e00101360 msgr2=0x7f5e001a0980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:52:45.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.612+0000 7f5dff7fe640 1 --2- 172.21.15.70:0/1383536573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e00101360 0x7f5e001a0980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.612+0000 7f5dff7fe640 1 -- 172.21.15.70:0/1383536573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e0010e4d0 msgr2=0x7f5e0019a600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:52:45.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.612+0000 7f5dff7fe640 1 --2- 172.21.15.70:0/1383536573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e0010e4d0 0x7f5e0019a600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.612+0000 7f5dff7fe640 1 -- 172.21.15.70:0/1383536573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0019ad30 con 0x7f5e001009b0 2024-09-12T01:52:45.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.612+0000 7f5dff7fe640 1 --2- 172.21.15.70:0/1383536573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e001009b0 0x7f5e001a0440 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5df0006010 tx=0x7f5df00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:45.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.612+0000 7f5dfcff9640 1 -- 172.21.15.70:0/1383536573 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df003f030 con 0x7f5e001009b0 2024-09-12T01:52:45.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.612+0000 7f5dfcff9640 1 -- 172.21.15.70:0/1383536573 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5df0003d00 con 0x7f5e001009b0 2024-09-12T01:52:45.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.612+0000 7f5dfcff9640 1 -- 172.21.15.70:0/1383536573 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0035070 con 0x7f5e001009b0 2024-09-12T01:52:45.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.612+0000 7f5e05b6b640 1 -- 172.21.15.70:0/1383536573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0019afc0 con 0x7f5e001009b0 2024-09-12T01:52:45.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.613+0000 7f5e05b6b640 1 -- 172.21.15.70:0/1383536573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e001a7310 con 0x7f5e001009b0 2024-09-12T01:52:45.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.616+0000 7f5e07f44740 1 Processor -- start 2024-09-12T01:52:45.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.616+0000 7f5e07f44740 1 -- start start 2024-09-12T01:52:45.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.616+0000 7f5e07f44740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fa760 0x5615a60fab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.616+0000 7f5e07f44740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fb080 0x5615a6105400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.616+0000 7f5e07f44740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 0x5615a6107d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.616+0000 7f5e07f44740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5615a60602a0 con 0x5615a6105940 2024-09-12T01:52:45.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.616+0000 7f5e07f44740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5615a6007b10 con 0x5615a60fa760 2024-09-12T01:52:45.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.616+0000 7f5e07f44740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5615a605c260 con 0x5615a60fb080 2024-09-12T01:52:45.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.617+0000 7f5dfeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 0x5615a6107d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.617+0000 7f5dfeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 0x5615a6107d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38944/0 (socket says 172.21.15.70:38944) 2024-09-12T01:52:45.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.617+0000 7f5dfeffd640 1 -- 172.21.15.70:0/186074623 learned_addr learned my addr 172.21.15.70:0/186074623 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:45.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.617+0000 7f5dfffff640 1 --2- 172.21.15.70:0/186074623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fa760 0x5615a60fab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.617+0000 7f5dfcff9640 1 -- 172.21.15.70:0/1383536573 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5df0042030 con 0x7f5e001009b0 2024-09-12T01:52:45.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.617+0000 7f5dfeffd640 1 -- 172.21.15.70:0/186074623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fb080 msgr2=0x5615a6105400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:52:45.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.617+0000 7f5dfeffd640 1 --2- 172.21.15.70:0/186074623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fb080 0x5615a6105400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.617+0000 7f5dfeffd640 1 -- 172.21.15.70:0/186074623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fa760 msgr2=0x5615a60fab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:45.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.617+0000 7f5dfeffd640 1 --2- 172.21.15.70:0/186074623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fa760 0x5615a60fab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.617+0000 7f5dfeffd640 1 -- 172.21.15.70:0/186074623 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a5dd1b90 con 0x5615a6105940 2024-09-12T01:52:45.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.617+0000 7f5dfffff640 1 --2- 172.21.15.70:0/186074623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fa760 0x5615a60fab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:45.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.618+0000 7f5dfeffd640 1 --2- 172.21.15.70:0/186074623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 0x5615a6107d30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5df400ab80 tx=0x7f5df400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e641d0ea3d5edd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:45.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.618+0000 7f5dfcff9640 1 --2- 172.21.15.70:0/1383536573 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5de80a2cd0 0x7f5de80a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.618+0000 7f5dfcff9640 1 -- 172.21.15.70:0/1383536573 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5df00ba110 con 0x7f5e001009b0 2024-09-12T01:52:45.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.618+0000 7f5dfffff640 1 --2- 172.21.15.70:0/1383536573 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5de80a2cd0 0x7f5de80a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.618+0000 7f5de5ffb640 1 -- 172.21.15.70:0/186074623 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df400f450 con 0x5615a6105940 2024-09-12T01:52:45.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.618+0000 7f5de5ffb640 1 -- 172.21.15.70:0/186074623 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5df400faf0 con 0x5615a6105940 2024-09-12T01:52:45.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.618+0000 7f5de5ffb640 1 -- 172.21.15.70:0/186074623 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4018aa0 con 0x5615a6105940 2024-09-12T01:52:45.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.619+0000 7f5e07f44740 1 -- 172.21.15.70:0/186074623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 msgr2=0x5615a6107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:45.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.619+0000 7f5dfffff640 1 --2- 172.21.15.70:0/1383536573 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5de80a2cd0 0x7f5de80a5190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5df8005fd0 tx=0x7f5df80094e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:45.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.619+0000 7f5e07f44740 1 --2- 172.21.15.70:0/186074623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 0x5615a6107d30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5df400ab80 tx=0x7f5df400c6a0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.620+0000 7f5e07f44740 1 -- 172.21.15.70:0/186074623 shutdown_connections 2024-09-12T01:52:45.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.620+0000 7f5e07f44740 1 --2- 172.21.15.70:0/186074623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 0x5615a6107d30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.620+0000 7f5e07f44740 1 --2- 172.21.15.70:0/186074623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fb080 0x5615a6105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.620+0000 7f5e07f44740 1 --2- 172.21.15.70:0/186074623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fa760 0x5615a60fab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.620+0000 7f5e07f44740 1 -- 172.21.15.70:0/186074623 >> 172.21.15.70:0/186074623 conn(0x5615a60f6cf0 msgr2=0x5615a60f70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:45.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.620+0000 7f5e07f44740 1 -- 172.21.15.70:0/186074623 shutdown_connections 2024-09-12T01:52:45.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.620+0000 7f5e07f44740 1 -- 172.21.15.70:0/186074623 wait complete. 2024-09-12T01:52:45.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.620+0000 7f5e07f44740 1 -- start start 2024-09-12T01:52:45.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.621+0000 7f5e07f44740 1 Processor -- start 2024-09-12T01:52:45.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.621+0000 7f5e07f44740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fa760 0x5615a6102880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.621+0000 7f5e07f44740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fb080 0x5615a6102dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.621+0000 7f5e07f44740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 0x5615a6103300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.621+0000 7f5e07f44740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5615a6108510 con 0x5615a6105940 2024-09-12T01:52:45.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.621+0000 7f5e07f44740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5615a5fe86e0 con 0x5615a60fb080 2024-09-12T01:52:45.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.621+0000 7f5e07f44740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5615a6108690 con 0x5615a60fa760 2024-09-12T01:52:45.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.621+0000 7f5e07f44740 10 client.0 _ll_register_callbacks cb 0x5615a600ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:45.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5dfffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 0x5615a6103300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5dfeffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fb080 0x5615a6102dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5dfeffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fb080 0x5615a6102dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:55916/0 (socket says 172.21.15.70:55916) 2024-09-12T01:52:45.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5dfeffd640 1 -- 172.21.15.70:0/1902154759 learned_addr learned my addr 172.21.15.70:0/1902154759 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:45.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5dfffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 0x5615a6103300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38960/0 (socket says 172.21.15.70:38960) 2024-09-12T01:52:45.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5dfeffd640 1 -- 172.21.15.70:0/1902154759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fa760 msgr2=0x5615a6102880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:45.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5dfeffd640 1 --2- 172.21.15.70:0/1902154759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fa760 0x5615a6102880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5dfeffd640 1 -- 172.21.15.70:0/1902154759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 msgr2=0x5615a6103300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:45.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5dfeffd640 1 --2- 172.21.15.70:0/1902154759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 0x5615a6103300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5dfeffd640 1 -- 172.21.15.70:0/1902154759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a6111ae0 con 0x5615a60fb080 2024-09-12T01:52:45.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5dfffff640 1 --2- 172.21.15.70:0/1902154759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 0x5615a6103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:45.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5dfeffd640 1 --2- 172.21.15.70:0/1902154759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fb080 0x5615a6102dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5df40058c0 tx=0x7f5df400a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=947d0f7eeb16db91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:45.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.622+0000 7f5ddeffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-12T01:52:45.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.623+0000 7f5ddeffd640 1 -- 172.21.15.70:0/1902154759 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4027060 con 0x5615a60fb080 2024-09-12T01:52:45.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.623+0000 7f5ddeffd640 1 -- 172.21.15.70:0/1902154759 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5df4005040 con 0x5615a60fb080 2024-09-12T01:52:45.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.623+0000 7f5e07f44740 1 -- 172.21.15.70:0/1902154759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df400faf0 con 0x5615a60fb080 2024-09-12T01:52:45.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.623+0000 7f5ddeffd640 1 -- 172.21.15.70:0/1902154759 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5df400f930 con 0x5615a60fb080 2024-09-12T01:52:45.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.623+0000 7f5e07f44740 10 client.25076 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:45.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.623+0000 7f5e07f44740 1 -- 172.21.15.70:0/1902154759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5615a6114470 con 0x5615a60fb080 2024-09-12T01:52:45.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.623+0000 7f5ddeffd640 1 -- 172.21.15.70:0/1902154759 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5df401e070 con 0x5615a60fb080 2024-09-12T01:52:45.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.623+0000 7f5ddeffd640 1 -- 172.21.15.70:0/1902154759 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5df402c070 con 0x5615a60fb080 2024-09-12T01:52:45.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.623+0000 7f5e07f44740 10 client.25076 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:45.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.623+0000 7f5e07f44740 10 client.25076 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:52:45.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.624+0000 7f5e07f44740 20 client.25076 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:45.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.624+0000 7f5e07f44740 1 --2- 172.21.15.70:0/1902154759 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5615a6115c70 0x5615a61180d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.624+0000 7f5e07f44740 4 client.25076 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.624+0000 7f5e07f44740 1 -- 172.21.15.70:0/1902154759 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5df400faf0 con 0x5615a6115c70 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.624+0000 7f5dff7fe640 1 --2- 172.21.15.70:0/1902154759 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5615a6115c70 0x5615a61180d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.624+0000 7f5dff7fe640 1 --2- 172.21.15.70:0/1902154759 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5615a6115c70 0x5615a61180d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0b537182f95e6f9 server_cookie=97d22c096f4bfe85 in_seq=0 out_seq=0 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.624+0000 7f5ddeffd640 10 client.25076 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.625+0000 7f5ddeffd640 1 -- 172.21.15.70:0/1902154759 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5df400faf0 con 0x5615a6115c70 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.625+0000 7f5ddeffd640 10 client.25076 handle_command_reply: tid=0 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.625+0000 7f5e07f44740 1 client.25076 shutdown 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.625+0000 7f5e07f44740 1 -- 172.21.15.70:0/1902154759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fb080 msgr2=0x5615a6102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.625+0000 7f5e07f44740 1 --2- 172.21.15.70:0/1902154759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fb080 0x5615a6102dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5df40058c0 tx=0x7f5df400a660 comp rx=0 tx=0).stop 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.625+0000 7f5e07f44740 1 -- 172.21.15.70:0/1902154759 shutdown_connections 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.625+0000 7f5e07f44740 1 --2- 172.21.15.70:0/1902154759 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5615a6115c70 0x5615a61180d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.625+0000 7f5e07f44740 1 --2- 172.21.15.70:0/1902154759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a6105940 0x5615a6103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.625+0000 7f5e07f44740 1 --2- 172.21.15.70:0/1902154759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fb080 0x5615a6102dc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.625+0000 7f5e07f44740 1 --2- 172.21.15.70:0/1902154759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fa760 0x5615a6102880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.625+0000 7f5e07f44740 1 -- 172.21.15.70:0/1902154759 >> 172.21.15.70:0/1902154759 conn(0x5615a60f6cf0 msgr2=0x5615a60fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:45.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.626+0000 7f5ddeffd640 0 client.25076 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:45.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.626+0000 7f5e07f44740 1 -- 172.21.15.70:0/1902154759 shutdown_connections 2024-09-12T01:52:45.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.626+0000 7f5e07f44740 1 -- 172.21.15.70:0/1902154759 wait complete. 2024-09-12T01:52:45.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.626+0000 7f5e07f44740 20 client.25076 trim_cache size 0 max 16384 2024-09-12T01:52:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.643+0000 7f5e07f44740 1 Processor -- start 2024-09-12T01:52:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.643+0000 7f5e07f44740 1 -- start start 2024-09-12T01:52:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5e07f44740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 0x5615a60f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5e07f44740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fb080 0x5615a611d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5e07f44740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a6105940 0x5615a611dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5e07f44740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec00e4a0 con 0x5615a60fa760 2024-09-12T01:52:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5e07f44740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec00ffe0 con 0x5615a6105940 2024-09-12T01:52:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5e07f44740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec00eb70 con 0x5615a60fb080 2024-09-12T01:52:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5dff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 0x5615a60f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5dff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 0x5615a60f5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38974/0 (socket says 172.21.15.70:38974) 2024-09-12T01:52:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5dff7fe640 1 -- 172.21.15.70:0/2110885283 learned_addr learned my addr 172.21.15.70:0/2110885283 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5dfffff640 1 --2- 172.21.15.70:0/2110885283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a6105940 0x5615a611dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5dfeffd640 1 --2- 172.21.15.70:0/2110885283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fb080 0x5615a611d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5dff7fe640 1 -- 172.21.15.70:0/2110885283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fb080 msgr2=0x5615a611d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5dff7fe640 1 --2- 172.21.15.70:0/2110885283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fb080 0x5615a611d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5dff7fe640 1 -- 172.21.15.70:0/2110885283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a6105940 msgr2=0x5615a611dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5dff7fe640 1 --2- 172.21.15.70:0/2110885283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a6105940 0x5615a611dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5dff7fe640 1 -- 172.21.15.70:0/2110885283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a6101830 con 0x5615a60fa760 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.644+0000 7f5dfeffd640 1 --2- 172.21.15.70:0/2110885283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fb080 0x5615a611d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.645+0000 7f5dff7fe640 1 --2- 172.21.15.70:0/2110885283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 0x5615a60f5d60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5df0049000 tx=0x7f5df0005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921f47ff3ee4efc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.645+0000 7f5de57fa640 1 -- 172.21.15.70:0/2110885283 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df00bc770 con 0x5615a60fa760 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.645+0000 7f5de57fa640 1 -- 172.21.15.70:0/2110885283 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5df00bc070 con 0x5615a60fa760 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.645+0000 7f5de57fa640 1 -- 172.21.15.70:0/2110885283 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df00b86e0 con 0x5615a60fa760 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.646+0000 7f5e07f44740 1 -- 172.21.15.70:0/2110885283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 msgr2=0x5615a60f5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.646+0000 7f5e07f44740 1 --2- 172.21.15.70:0/2110885283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 0x5615a60f5d60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5df0049000 tx=0x7f5df0005e00 comp rx=0 tx=0).stop 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.646+0000 7f5e07f44740 1 -- 172.21.15.70:0/2110885283 shutdown_connections 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.646+0000 7f5e07f44740 1 --2- 172.21.15.70:0/2110885283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a6105940 0x5615a611dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.646+0000 7f5e07f44740 1 --2- 172.21.15.70:0/2110885283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a60fb080 0x5615a611d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.646+0000 7f5e07f44740 1 --2- 172.21.15.70:0/2110885283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 0x5615a60f5d60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.646+0000 7f5e07f44740 1 -- 172.21.15.70:0/2110885283 >> 172.21.15.70:0/2110885283 conn(0x5615a60f6cf0 msgr2=0x5615a60f5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.646+0000 7f5e07f44740 1 -- 172.21.15.70:0/2110885283 shutdown_connections 2024-09-12T01:52:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.646+0000 7f5e07f44740 1 -- 172.21.15.70:0/2110885283 wait complete. 2024-09-12T01:52:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.646+0000 7f5e07f44740 1 -- start start 2024-09-12T01:52:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5e07f44740 1 Processor -- start 2024-09-12T01:52:45.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5e07f44740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 0x5615a610dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5e07f44740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fb080 0x5615a610e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5e07f44740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a6105940 0x5615a6109280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5e07f44740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec00f910 con 0x5615a60fa760 2024-09-12T01:52:45.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5e07f44740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec00f240 con 0x5615a60fb080 2024-09-12T01:52:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5dff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 0x5615a610dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5e07f44740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec00c460 con 0x5615a6105940 2024-09-12T01:52:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5dff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 0x5615a610dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38984/0 (socket says 172.21.15.70:38984) 2024-09-12T01:52:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5dff7fe640 1 -- 172.21.15.70:0/238699101 learned_addr learned my addr 172.21.15.70:0/238699101 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5dfeffd640 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fb080 0x5615a610e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5e07f44740 10 client.0 _ll_register_callbacks cb 0x7f5df400f7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.647+0000 7f5dfffff640 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a6105940 0x5615a6109280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.648+0000 7f5dff7fe640 1 -- 172.21.15.70:0/238699101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a6105940 msgr2=0x5615a6109280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.648+0000 7f5dff7fe640 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a6105940 0x5615a6109280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.648+0000 7f5dff7fe640 1 -- 172.21.15.70:0/238699101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fb080 msgr2=0x5615a610e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:45.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.648+0000 7f5dff7fe640 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fb080 0x5615a610e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.648+0000 7f5dff7fe640 1 -- 172.21.15.70:0/238699101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a6109ab0 con 0x5615a60fa760 2024-09-12T01:52:45.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.648+0000 7f5dff7fe640 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 0x5615a610dd00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5df00b8a40 tx=0x7f5df00044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd37b4a8b3c8b2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:45.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.648+0000 7f5ddeffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:45.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.648+0000 7f5ddeffd640 1 -- 172.21.15.70:0/238699101 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df00bc770 con 0x5615a60fa760 2024-09-12T01:52:45.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.648+0000 7f5ddeffd640 1 -- 172.21.15.70:0/238699101 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5df003bce0 con 0x5615a60fa760 2024-09-12T01:52:45.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.648+0000 7f5e07f44740 1 -- 172.21.15.70:0/238699101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df00bc070 con 0x5615a60fa760 2024-09-12T01:52:45.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.649+0000 7f5ddeffd640 1 -- 172.21.15.70:0/238699101 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5df00c0420 con 0x5615a60fa760 2024-09-12T01:52:45.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.649+0000 7f5e07f44740 10 client.15648 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:45.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.649+0000 7f5e07f44740 1 -- 172.21.15.70:0/238699101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5615a6180500 con 0x5615a60fa760 2024-09-12T01:52:45.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.649+0000 7f5ddeffd640 1 -- 172.21.15.70:0/238699101 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5df00bc070 con 0x5615a60fa760 2024-09-12T01:52:45.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.649+0000 7f5ddeffd640 1 -- 172.21.15.70:0/238699101 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5df00d8020 con 0x5615a60fa760 2024-09-12T01:52:45.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.649+0000 7f5e07f44740 10 client.15648 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:45.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.649+0000 7f5e07f44740 10 client.15648 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:52:45.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.649+0000 7f5e07f44740 20 client.15648 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:45.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.649+0000 7f5e07f44740 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5615a6180a50 0x5615a6182e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:45.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.649+0000 7f5e07f44740 4 client.15648 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-12T01:52:45.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.649+0000 7f5e07f44740 1 -- 172.21.15.70:0/238699101 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x5615a606d9d0 con 0x5615a6180a50 2024-09-12T01:52:45.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.650+0000 7f5dfeffd640 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5615a6180a50 0x5615a6182e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:45.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.650+0000 7f5dfeffd640 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5615a6180a50 0x5615a6182e40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=152b33bbb9f67fb6 server_cookie=36c28f8ce3b3613a in_seq=0 out_seq=0 2024-09-12T01:52:45.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.650+0000 7f5ddeffd640 10 client.15648 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:45.659 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:45.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.660+0000 7f5ddeffd640 1 -- 172.21.15.70:0/238699101 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5615a606d9d0 con 0x5615a6180a50 2024-09-12T01:52:45.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.660+0000 7f5ddeffd640 10 client.15648 handle_command_reply: tid=0 2024-09-12T01:52:45.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.660+0000 7f5e07f44740 1 client.15648 shutdown 2024-09-12T01:52:45.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.661+0000 7f5e07f44740 1 -- 172.21.15.70:0/238699101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 msgr2=0x5615a610dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:45.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.661+0000 7f5e07f44740 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 0x5615a610dd00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5df00b8a40 tx=0x7f5df00044d0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.661+0000 7f5e07f44740 1 -- 172.21.15.70:0/238699101 shutdown_connections 2024-09-12T01:52:45.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.661+0000 7f5e07f44740 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5615a6180a50 0x5615a6182e40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.661+0000 7f5e07f44740 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615a6105940 0x5615a6109280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.661+0000 7f5e07f44740 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5615a60fb080 0x5615a610e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.661+0000 7f5ddeffd640 0 client.15648 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:45.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.661+0000 7f5e07f44740 1 --2- 172.21.15.70:0/238699101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5615a60fa760 0x5615a610dd00 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.661+0000 7f5e07f44740 1 -- 172.21.15.70:0/238699101 >> 172.21.15.70:0/238699101 conn(0x5615a60f6cf0 msgr2=0x5615a60fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:45.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.661+0000 7f5e07f44740 1 -- 172.21.15.70:0/238699101 shutdown_connections 2024-09-12T01:52:45.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.661+0000 7f5e07f44740 1 -- 172.21.15.70:0/238699101 wait complete. 2024-09-12T01:52:45.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.661+0000 7f5e07f44740 20 client.15648 trim_cache size 0 max 16384 2024-09-12T01:52:45.663 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:52:45.663 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-09-12T01:52:45.663 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24452, 2024-09-12T01:52:45.663 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 2, 2024-09-12T01:52:45.663 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-12T01:52:45.663 INFO:teuthology.orchestra.run.smithi070.stdout: "c24bc2c2": { 2024-09-12T01:52:45.663 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 2, 2024-09-12T01:52:45.663 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-12T01:52:45.663 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-12T01:52:45.663 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-12T01:52:45.663 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-12T01:52:45.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 144.5, 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:52:45.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:52:45.665 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:52:45.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.662+0000 7f5e05b6b640 1 -- 172.21.15.70:0/1383536573 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5de80a2cd0 msgr2=0x7f5de80a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:45.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.662+0000 7f5e05b6b640 1 --2- 172.21.15.70:0/1383536573 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5de80a2cd0 0x7f5de80a5190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5df8005fd0 tx=0x7f5df80094e0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.662+0000 7f5e05b6b640 1 -- 172.21.15.70:0/1383536573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e001009b0 msgr2=0x7f5e001a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.662+0000 7f5e05b6b640 1 --2- 172.21.15.70:0/1383536573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e001009b0 0x7f5e001a0440 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5df0006010 tx=0x7f5df00042f0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.662+0000 7f5e05b6b640 1 -- 172.21.15.70:0/1383536573 shutdown_connections 2024-09-12T01:52:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.662+0000 7f5e05b6b640 1 --2- 172.21.15.70:0/1383536573 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5de80a2cd0 0x7f5de80a5190 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.662+0000 7f5e05b6b640 1 --2- 172.21.15.70:0/1383536573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e0010e4d0 0x7f5e0019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.662+0000 7f5e05b6b640 1 --2- 172.21.15.70:0/1383536573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e00101360 0x7f5e001a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.662+0000 7f5e05b6b640 1 --2- 172.21.15.70:0/1383536573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e001009b0 0x7f5e001a0440 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.662+0000 7f5e05b6b640 1 -- 172.21.15.70:0/1383536573 >> 172.21.15.70:0/1383536573 conn(0x7f5e000fc7d0 msgr2=0x7f5e000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.662+0000 7f5e05b6b640 1 -- 172.21.15.70:0/1383536573 shutdown_connections 2024-09-12T01:52:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:45.662+0000 7f5e05b6b640 1 -- 172.21.15.70:0/1383536573 wait complete. 2024-09-12T01:52:46.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.449+0000 7f7ebc467640 1 -- 172.21.15.70:0/461484763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7eb4100e20 msgr2=0x7f7eb4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:46.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.449+0000 7f7ebc467640 1 --2- 172.21.15.70:0/461484763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7eb4100e20 0x7f7eb4101200 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009900 tx=0x7f7eb002a480 comp rx=0 tx=0).stop 2024-09-12T01:52:46.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.449+0000 7f7ebc467640 1 -- 172.21.15.70:0/461484763 shutdown_connections 2024-09-12T01:52:46.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.449+0000 7f7ebc467640 1 --2- 172.21.15.70:0/461484763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7eb4102ef0 0x7f7eb410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.449+0000 7f7ebc467640 1 --2- 172.21.15.70:0/461484763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7eb4102570 0x7f7eb41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.449+0000 7f7ebc467640 1 --2- 172.21.15.70:0/461484763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7eb4100e20 0x7f7eb4101200 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.449+0000 7f7ebc467640 1 -- 172.21.15.70:0/461484763 >> 172.21.15.70:0/461484763 conn(0x7f7eb40fc7d0 msgr2=0x7f7eb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:46.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.449+0000 7f7ebc467640 1 -- 172.21.15.70:0/461484763 shutdown_connections 2024-09-12T01:52:46.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.449+0000 7f7ebc467640 1 -- 172.21.15.70:0/461484763 wait complete. 2024-09-12T01:52:46.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.450+0000 7f7ebc467640 1 Processor -- start 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.450+0000 7f7ebc467640 1 -- start start 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.450+0000 7f7ebc467640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7eb4100e20 0x7f7eb41993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.450+0000 7f7ebc467640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7eb4102570 0x7f7eb4199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.450+0000 7f7ebc467640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7eb4102ef0 0x7f7eb41a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.450+0000 7f7ebc467640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb41110f0 con 0x7f7eb4102570 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7ebc467640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb4110f70 con 0x7f7eb4102ef0 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7ebc467640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb4111270 con 0x7f7eb4100e20 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7eb9a02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7eb4102570 0x7f7eb4199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7eb9a02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7eb4102570 0x7f7eb4199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39004/0 (socket says 172.21.15.70:39004) 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7eb9a02640 1 -- 172.21.15.70:0/2350885195 learned_addr learned my addr 172.21.15.70:0/2350885195 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7eba203640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7eb4100e20 0x7f7eb41993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7ebaa04640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7eb4102ef0 0x7f7eb41a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7eb9a02640 1 -- 172.21.15.70:0/2350885195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7eb4100e20 msgr2=0x7f7eb41993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:46.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7eb9a02640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7eb4100e20 0x7f7eb41993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7eb9a02640 1 -- 172.21.15.70:0/2350885195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7eb4102ef0 msgr2=0x7f7eb41a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7eb9a02640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7eb4102ef0 0x7f7eb41a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7eb9a02640 1 -- 172.21.15.70:0/2350885195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb41a49b0 con 0x7f7eb4102570 2024-09-12T01:52:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7ebaa04640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7eb4102ef0 0x7f7eb41a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7eb9a02640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7eb4102570 0x7f7eb4199930 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400e9f0 tx=0x7f7ea400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.451+0000 7f7eab7fe640 1 -- 172.21.15.70:0/2350885195 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea400cd80 con 0x7f7eb4102570 2024-09-12T01:52:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.452+0000 7f7eab7fe640 1 -- 172.21.15.70:0/2350885195 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ea4010930 con 0x7f7eb4102570 2024-09-12T01:52:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.452+0000 7f7ebc467640 1 -- 172.21.15.70:0/2350885195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb41a4b80 con 0x7f7eb4102570 2024-09-12T01:52:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.452+0000 7f7eab7fe640 1 -- 172.21.15.70:0/2350885195 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4018a80 con 0x7f7eb4102570 2024-09-12T01:52:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.452+0000 7f7ebc467640 1 -- 172.21.15.70:0/2350885195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb41a5090 con 0x7f7eb4102570 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.454+0000 7f7ebe840740 1 Processor -- start 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.454+0000 7f7ebe840740 1 -- start start 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7ebe840740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 0x55bb7b8f0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7ebe840740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 0x55bb7b8f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7ebe840740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8ff780 0x55bb7b901b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7ebe840740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bb7b8562f0 con 0x55bb7b8f05d0 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7ebe840740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bb7b7fdcf0 con 0x55bb7b8f1b40 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7ebe840740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55bb7b8522b0 con 0x55bb7b8ff780 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7ebaa04640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 0x55bb7b8f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7eba203640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 0x55bb7b8f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7ebaa04640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 0x55bb7b8f0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:55964/0 (socket says 172.21.15.70:55964) 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7ebaa04640 1 -- 172.21.15.70:0/555278404 learned_addr learned my addr 172.21.15.70:0/555278404 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7eab7fe640 1 -- 172.21.15.70:0/2350885195 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7ea4018c20 con 0x7f7eb4102570 2024-09-12T01:52:46.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7ebaa04640 1 -- 172.21.15.70:0/555278404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8ff780 msgr2=0x55bb7b901b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:52:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.455+0000 7f7ebaa04640 1 --2- 172.21.15.70:0/555278404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8ff780 0x55bb7b901b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.456+0000 7f7ebaa04640 1 -- 172.21.15.70:0/555278404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 msgr2=0x55bb7b8f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.456+0000 7f7ebaa04640 1 --2- 172.21.15.70:0/555278404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 0x55bb7b8f0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.456+0000 7f7ebaa04640 1 -- 172.21.15.70:0/555278404 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb7b7e23a0 con 0x55bb7b8f1b40 2024-09-12T01:52:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.456+0000 7f7eba203640 1 --2- 172.21.15.70:0/555278404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 0x55bb7b8f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:46.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.456+0000 7f7ebaa04640 1 --2- 172.21.15.70:0/555278404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 0x55bb7b8f0090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009ea0 tx=0x7f7eac009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e2a5409813ee07e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:46.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.456+0000 7f7eab7fe640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7ea00a2b80 0x7f7ea00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.456+0000 7f7ea8dea640 1 -- 172.21.15.70:0/555278404 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac016070 con 0x55bb7b8f1b40 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.456+0000 7f7eba203640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7ea00a2b80 0x7f7ea00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.456+0000 7f7ea8dea640 1 -- 172.21.15.70:0/555278404 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7eac00ee80 con 0x55bb7b8f1b40 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.456+0000 7f7eab7fe640 1 -- 172.21.15.70:0/2350885195 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7ea40cf3f0 con 0x7f7eb4102570 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.457+0000 7f7ea8dea640 1 -- 172.21.15.70:0/555278404 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac011810 con 0x55bb7b8f1b40 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.457+0000 7f7ebe840740 1 -- 172.21.15.70:0/555278404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 msgr2=0x55bb7b8f0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.457+0000 7f7ebe840740 1 --2- 172.21.15.70:0/555278404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 0x55bb7b8f0090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009ea0 tx=0x7f7eac009f90 comp rx=0 tx=0).stop 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.457+0000 7f7eba203640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7ea00a2b80 0x7f7ea00a5040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0000c00 tx=0x7f7eb0005e80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.457+0000 7f7ebe840740 1 -- 172.21.15.70:0/555278404 shutdown_connections 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.457+0000 7f7ebe840740 1 --2- 172.21.15.70:0/555278404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8ff780 0x55bb7b901b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.457+0000 7f7ebe840740 1 --2- 172.21.15.70:0/555278404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 0x55bb7b8f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.457+0000 7f7ebe840740 1 --2- 172.21.15.70:0/555278404 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 0x55bb7b8f0090 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.457+0000 7f7ebe840740 1 -- 172.21.15.70:0/555278404 >> 172.21.15.70:0/555278404 conn(0x55bb7b8b9310 msgr2=0x55bb7b8ecc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:46.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.457+0000 7f7ebe840740 1 -- 172.21.15.70:0/555278404 shutdown_connections 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.457+0000 7f7ebe840740 1 -- 172.21.15.70:0/555278404 wait complete. 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.458+0000 7f7ebe840740 1 -- start start 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.458+0000 7f7ebe840740 1 Processor -- start 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.458+0000 7f7ebe840740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 0x55bb7b8ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.458+0000 7f7ebe840740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f1b40 0x55bb7b8fc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.458+0000 7f7ebe840740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8ff780 0x55bb7b8fc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.458+0000 7f7ebe840740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bb7b902520 con 0x55bb7b8f05d0 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.458+0000 7f7ebe840740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55bb7b811060 con 0x55bb7b8ff780 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.458+0000 7f7ebe840740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55bb7b9026a0 con 0x55bb7b8f1b40 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.458+0000 7f7eba203640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 0x55bb7b8ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.458+0000 7f7eba203640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 0x55bb7b8ff0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39022/0 (socket says 172.21.15.70:39022) 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.458+0000 7f7eba203640 1 -- 172.21.15.70:0/3500145438 learned_addr learned my addr 172.21.15.70:0/3500145438 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.458+0000 7f7ebe840740 10 client.0 _ll_register_callbacks cb 0x55bb7b5648c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:46.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7eb9a02640 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f1b40 0x55bb7b8fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7ebaa04640 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8ff780 0x55bb7b8fc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7eba203640 1 -- 172.21.15.70:0/3500145438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f1b40 msgr2=0x55bb7b8fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7eba203640 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f1b40 0x55bb7b8fc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7eba203640 1 -- 172.21.15.70:0/3500145438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8ff780 msgr2=0x55bb7b8fc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7eba203640 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8ff780 0x55bb7b8fc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7eba203640 1 -- 172.21.15.70:0/3500145438 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb7b5c73c0 con 0x55bb7b8f05d0 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7ebaa04640 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8ff780 0x55bb7b8fc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7eba203640 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 0x55bb7b8ff0d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009900 tx=0x7f7eb0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7731962ed45c8fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7e9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7e9dffb640 1 -- 172.21.15.70:0/3500145438 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb004e070 con 0x55bb7b8f05d0 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7e9dffb640 1 -- 172.21.15.70:0/3500145438 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7eb0004ad0 con 0x55bb7b8f05d0 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7ebe840740 1 -- 172.21.15.70:0/3500145438 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bb7b863860 con 0x55bb7b8f05d0 2024-09-12T01:52:46.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7e9dffb640 1 -- 172.21.15.70:0/3500145438 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7eb005a050 con 0x55bb7b8f05d0 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.459+0000 7f7ebe840740 10 client.15660 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.460+0000 7f7ebe840740 1 -- 172.21.15.70:0/3500145438 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb7b90df60 con 0x55bb7b8f05d0 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.460+0000 7f7e9dffb640 1 -- 172.21.15.70:0/3500145438 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7eb0004cd0 con 0x55bb7b8f05d0 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.460+0000 7f7e9dffb640 1 -- 172.21.15.70:0/3500145438 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7eb0003940 con 0x55bb7b8f05d0 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.460+0000 7f7ebe840740 10 client.15660 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.460+0000 7f7ebe840740 10 client.15660 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.460+0000 7f7ebe840740 20 client.15660 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.460+0000 7f7ebe840740 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55bb7b90f370 0x55bb7b9117d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.460+0000 7f7ebe840740 4 client.15660 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.460+0000 7f7ebe840740 1 -- 172.21.15.70:0/3500145438 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb7b863860 con 0x55bb7b90f370 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.460+0000 7f7eb9a02640 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55bb7b90f370 0x55bb7b9117d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.461+0000 7f7e9dffb640 10 client.15660 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:52:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.461+0000 7f7eb9a02640 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55bb7b90f370 0x55bb7b9117d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a70d0ef8787235e0 server_cookie=ee7b203e711b1453 in_seq=0 out_seq=0 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.462+0000 7f7e9dffb640 1 -- 172.21.15.70:0/3500145438 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb7b863860 con 0x55bb7b90f370 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.462+0000 7f7e9dffb640 10 client.15660 handle_command_reply: tid=0 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.462+0000 7f7ebe840740 1 client.15660 shutdown 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.462+0000 7f7ebe840740 1 -- 172.21.15.70:0/3500145438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 msgr2=0x55bb7b8ff0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.462+0000 7f7ebe840740 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 0x55bb7b8ff0d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009900 tx=0x7f7eb0009260 comp rx=0 tx=0).stop 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.462+0000 7f7ebe840740 1 -- 172.21.15.70:0/3500145438 shutdown_connections 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.462+0000 7f7ebe840740 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55bb7b90f370 0x55bb7b9117d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.462+0000 7f7ebe840740 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8ff780 0x55bb7b8fc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.462+0000 7f7e9dffb640 0 client.15660 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.462+0000 7f7ebe840740 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f1b40 0x55bb7b8fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.462+0000 7f7ebe840740 1 --2- 172.21.15.70:0/3500145438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f05d0 0x55bb7b8ff0d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.462+0000 7f7ebe840740 1 -- 172.21.15.70:0/3500145438 >> 172.21.15.70:0/3500145438 conn(0x55bb7b8b9310 msgr2=0x55bb7b8f2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.463+0000 7f7ebe840740 1 -- 172.21.15.70:0/3500145438 shutdown_connections 2024-09-12T01:52:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.463+0000 7f7ebe840740 1 -- 172.21.15.70:0/3500145438 wait complete. 2024-09-12T01:52:46.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.463+0000 7f7ebe840740 20 client.15660 trim_cache size 0 max 16384 2024-09-12T01:52:46.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.482+0000 7f7ebe840740 1 Processor -- start 2024-09-12T01:52:46.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7ebe840740 1 -- start start 2024-09-12T01:52:46.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7ebe840740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f05d0 0x55bb7b90b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7ebe840740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f1b40 0x55bb7b9170f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7ebe840740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8ff780 0x55bb7b917630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7ebe840740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb41ab5c0 con 0x55bb7b8f1b40 2024-09-12T01:52:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7ebe840740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb41ad100 con 0x55bb7b8ff780 2024-09-12T01:52:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7ebe840740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb41abc90 con 0x55bb7b8f05d0 2024-09-12T01:52:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7eb9a02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f1b40 0x55bb7b9170f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7eb9a02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f1b40 0x55bb7b9170f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39030/0 (socket says 172.21.15.70:39030) 2024-09-12T01:52:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7eb9a02640 1 -- 172.21.15.70:0/2405672265 learned_addr learned my addr 172.21.15.70:0/2405672265 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7eba203640 1 --2- 172.21.15.70:0/2405672265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f05d0 0x55bb7b90b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7eb9a02640 1 -- 172.21.15.70:0/2405672265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f05d0 msgr2=0x55bb7b90b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7eb9a02640 1 --2- 172.21.15.70:0/2405672265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f05d0 0x55bb7b90b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7ebaa04640 1 --2- 172.21.15.70:0/2405672265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8ff780 0x55bb7b917630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7eb9a02640 1 -- 172.21.15.70:0/2405672265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8ff780 msgr2=0x55bb7b917630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7eb9a02640 1 --2- 172.21.15.70:0/2405672265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8ff780 0x55bb7b917630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.483+0000 7f7eb9a02640 1 -- 172.21.15.70:0/2405672265 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb7b8ed960 con 0x55bb7b8f1b40 2024-09-12T01:52:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.484+0000 7f7ebaa04640 1 --2- 172.21.15.70:0/2405672265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8ff780 0x55bb7b917630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.484+0000 7f7eb9a02640 1 --2- 172.21.15.70:0/2405672265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f1b40 0x55bb7b9170f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4098620 tx=0x7f7ea40ccdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c1ef79b59e1e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.484+0000 7f7e9ffff640 1 -- 172.21.15.70:0/2405672265 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea40b1070 con 0x55bb7b8f1b40 2024-09-12T01:52:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.484+0000 7f7e9ffff640 1 -- 172.21.15.70:0/2405672265 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ea40b4e50 con 0x55bb7b8f1b40 2024-09-12T01:52:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.484+0000 7f7e9ffff640 1 -- 172.21.15.70:0/2405672265 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea409b0a0 con 0x55bb7b8f1b40 2024-09-12T01:52:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.485+0000 7f7ebe840740 1 -- 172.21.15.70:0/2405672265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f1b40 msgr2=0x55bb7b9170f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.485+0000 7f7ebe840740 1 --2- 172.21.15.70:0/2405672265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f1b40 0x55bb7b9170f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4098620 tx=0x7f7ea40ccdc0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.485+0000 7f7ebe840740 1 -- 172.21.15.70:0/2405672265 shutdown_connections 2024-09-12T01:52:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.485+0000 7f7ebe840740 1 --2- 172.21.15.70:0/2405672265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8ff780 0x55bb7b917630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.485+0000 7f7ebe840740 1 --2- 172.21.15.70:0/2405672265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8f1b40 0x55bb7b9170f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.485+0000 7f7ebe840740 1 --2- 172.21.15.70:0/2405672265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f05d0 0x55bb7b90b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.485+0000 7f7ebe840740 1 -- 172.21.15.70:0/2405672265 >> 172.21.15.70:0/2405672265 conn(0x55bb7b8b9310 msgr2=0x55bb7b8f7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.485+0000 7f7ebe840740 1 -- 172.21.15.70:0/2405672265 shutdown_connections 2024-09-12T01:52:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.485+0000 7f7ebe840740 1 -- 172.21.15.70:0/2405672265 wait complete. 2024-09-12T01:52:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.485+0000 7f7ebe840740 1 -- start start 2024-09-12T01:52:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.485+0000 7f7ebe840740 1 Processor -- start 2024-09-12T01:52:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7ebe840740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f05d0 0x55bb7b903a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7ebe840740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 0x55bb7b903fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7ebe840740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8ff780 0x55bb7b9790c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7ebe840740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb41aca30 con 0x55bb7b8ff780 2024-09-12T01:52:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7ebe840740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb41ac360 con 0x55bb7b8f1b40 2024-09-12T01:52:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7ebe840740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb41a9580 con 0x55bb7b8f05d0 2024-09-12T01:52:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7ebe840740 10 client.0 _ll_register_callbacks cb 0x7f7eb0005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7eb9a02640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 0x55bb7b903fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7eb9a02640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 0x55bb7b903fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:55992/0 (socket says 172.21.15.70:55992) 2024-09-12T01:52:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7eb9a02640 1 -- 172.21.15.70:0/1292233480 learned_addr learned my addr 172.21.15.70:0/1292233480 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7eba203640 1 --2- 172.21.15.70:0/1292233480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f05d0 0x55bb7b903a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7eb9a02640 1 -- 172.21.15.70:0/1292233480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f05d0 msgr2=0x55bb7b903a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7eb9a02640 1 --2- 172.21.15.70:0/1292233480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f05d0 0x55bb7b903a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7eb9a02640 1 -- 172.21.15.70:0/1292233480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8ff780 msgr2=0x55bb7b9790c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7eb9a02640 1 --2- 172.21.15.70:0/1292233480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8ff780 0x55bb7b9790c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.486+0000 7f7eb9a02640 1 -- 172.21.15.70:0/1292233480 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb7b8f3120 con 0x55bb7b8f1b40 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.487+0000 7f7eb9a02640 1 --2- 172.21.15.70:0/1292233480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 0x55bb7b903fd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7ea409b950 tx=0x7f7ea4098510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fa5b6d99279e223 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.487+0000 7f7e9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.487+0000 7f7e9dffb640 1 -- 172.21.15.70:0/1292233480 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea407e020 con 0x55bb7b8f1b40 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.487+0000 7f7e9dffb640 1 -- 172.21.15.70:0/1292233480 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7ea40cd000 con 0x55bb7b8f1b40 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.487+0000 7f7ebe840740 1 -- 172.21.15.70:0/1292233480 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ea40b4e50 con 0x55bb7b8f1b40 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.487+0000 7f7e9dffb640 1 -- 172.21.15.70:0/1292233480 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ea40a9050 con 0x55bb7b8f1b40 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.487+0000 7f7ebe840740 10 client.25091 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.487+0000 7f7ebe840740 1 -- 172.21.15.70:0/1292233480 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb7b97a490 con 0x55bb7b8f1b40 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.488+0000 7f7e9dffb640 1 -- 172.21.15.70:0/1292233480 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ea40982c0 con 0x55bb7b8f1b40 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.488+0000 7f7e9dffb640 1 -- 172.21.15.70:0/1292233480 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7ea409b1a0 con 0x55bb7b8f1b40 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.488+0000 7f7ebe840740 10 client.25091 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.488+0000 7f7ebe840740 10 client.25091 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:52:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.488+0000 7f7ebe840740 20 client.25091 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:46.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.489+0000 7f7ebe840740 1 --2- 172.21.15.70:0/1292233480 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55bb7b90f370 0x55bb7b97cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:46.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.489+0000 7f7ebe840740 4 client.25091 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:52:46.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.489+0000 7f7ebe840740 1 -- 172.21.15.70:0/1292233480 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7ea40b4e50 con 0x55bb7b90f370 2024-09-12T01:52:46.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.489+0000 7f7eba203640 1 --2- 172.21.15.70:0/1292233480 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55bb7b90f370 0x55bb7b97cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:46.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.489+0000 7f7eba203640 1 --2- 172.21.15.70:0/1292233480 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55bb7b90f370 0x55bb7b97cbc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=982c6c40b83ef56d server_cookie=1aa908b4b4518052 in_seq=0 out_seq=0 2024-09-12T01:52:46.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.489+0000 7f7e9dffb640 10 client.25091 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:52:46.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.489+0000 7f7e9dffb640 1 -- 172.21.15.70:0/1292233480 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7ea40b4e50 con 0x55bb7b90f370 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.489+0000 7f7e9dffb640 10 client.25091 handle_command_reply: tid=0 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.489+0000 7f7ebe840740 1 client.25091 shutdown 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebe840740 1 -- 172.21.15.70:0/1292233480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 msgr2=0x55bb7b903fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebe840740 1 --2- 172.21.15.70:0/1292233480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 0x55bb7b903fd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7ea409b950 tx=0x7f7ea4098510 comp rx=0 tx=0).stop 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebe840740 1 -- 172.21.15.70:0/1292233480 shutdown_connections 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebe840740 1 --2- 172.21.15.70:0/1292233480 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55bb7b90f370 0x55bb7b97cbc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebe840740 1 --2- 172.21.15.70:0/1292233480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bb7b8ff780 0x55bb7b9790c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7e9dffb640 0 client.25091 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebe840740 1 --2- 172.21.15.70:0/1292233480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55bb7b8f1b40 0x55bb7b903fd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebe840740 1 --2- 172.21.15.70:0/1292233480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55bb7b8f05d0 0x55bb7b903a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebe840740 1 -- 172.21.15.70:0/1292233480 >> 172.21.15.70:0/1292233480 conn(0x55bb7b8b9310 msgr2=0x55bb7b8eb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebe840740 1 -- 172.21.15.70:0/1292233480 shutdown_connections 2024-09-12T01:52:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebe840740 1 -- 172.21.15.70:0/1292233480 wait complete. 2024-09-12T01:52:46.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebe840740 20 client.25091 trim_cache size 0 max 16384 2024-09-12T01:52:46.495 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:52:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebc467640 1 -- 172.21.15.70:0/2350885195 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7ea00a2b80 msgr2=0x7f7ea00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.490+0000 7f7ebc467640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7ea00a2b80 0x7f7ea00a5040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0000c00 tx=0x7f7eb0005e80 comp rx=0 tx=0).stop 2024-09-12T01:52:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.491+0000 7f7ebc467640 1 -- 172.21.15.70:0/2350885195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7eb4102570 msgr2=0x7f7eb4199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.491+0000 7f7ebc467640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7eb4102570 0x7f7eb4199930 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400e9f0 tx=0x7f7ea400eeb0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.491+0000 7f7ebc467640 1 -- 172.21.15.70:0/2350885195 shutdown_connections 2024-09-12T01:52:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.491+0000 7f7ebc467640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7ea00a2b80 0x7f7ea00a5040 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.491+0000 7f7ebc467640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7eb4102ef0 0x7f7eb41a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.491+0000 7f7ebc467640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7eb4102570 0x7f7eb4199930 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.491+0000 7f7ebc467640 1 --2- 172.21.15.70:0/2350885195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7eb4100e20 0x7f7eb41993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.491+0000 7f7ebc467640 1 -- 172.21.15.70:0/2350885195 >> 172.21.15.70:0/2350885195 conn(0x7f7eb40fc7d0 msgr2=0x7f7eb40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.491+0000 7f7ebc467640 1 -- 172.21.15.70:0/2350885195 shutdown_connections 2024-09-12T01:52:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:46.491+0000 7f7ebc467640 1 -- 172.21.15.70:0/2350885195 wait complete. 2024-09-12T01:52:46.695 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:46 smithi070 ceph-mon[31177]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:52:46.930 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c24bc2c2', quiesce took 10.7 seconds. Will release after: 13.8 2024-09-12T01:52:46.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:46 smithi191 ceph-mon[35770]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:52:47.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:46 smithi152 ceph-mon[35055]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:52:47.654 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:52:47.979 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.489+0000 7fbb46bd4640 1 -- 172.21.15.70:0/2891996782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb401008e0 msgr2=0x7fbb40100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.489+0000 7fbb46bd4640 1 --2- 172.21.15.70:0/2891996782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb401008e0 0x7fbb40100cc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009930 tx=0x7fbb3402a420 comp rx=0 tx=0).stop 2024-09-12T01:52:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.490+0000 7fbb46bd4640 1 -- 172.21.15.70:0/2891996782 shutdown_connections 2024-09-12T01:52:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.490+0000 7fbb46bd4640 1 --2- 172.21.15.70:0/2891996782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb40108160 0x7fbb4010eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.490+0000 7fbb46bd4640 1 --2- 172.21.15.70:0/2891996782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb40101290 0x7fbb40107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.490+0000 7fbb46bd4640 1 --2- 172.21.15.70:0/2891996782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb401008e0 0x7fbb40100cc0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.490+0000 7fbb46bd4640 1 -- 172.21.15.70:0/2891996782 >> 172.21.15.70:0/2891996782 conn(0x7fbb40077210 msgr2=0x7fbb40077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.490+0000 7fbb46bd4640 1 -- 172.21.15.70:0/2891996782 shutdown_connections 2024-09-12T01:52:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.490+0000 7fbb46bd4640 1 -- 172.21.15.70:0/2891996782 wait complete. 2024-09-12T01:52:48.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.492+0000 7fbb46bd4640 1 Processor -- start 2024-09-12T01:52:48.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.492+0000 7fbb46bd4640 1 -- start start 2024-09-12T01:52:48.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.492+0000 7fbb46bd4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb40101290 0x7fbb4019e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.492+0000 7fbb46bd4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb40108160 0x7fbb4019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.492+0000 7fbb46bd4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb401985e0 0x7fbb40198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.492+0000 7fbb46bd4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40112110 con 0x7fbb401985e0 2024-09-12T01:52:48.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.492+0000 7fbb46bd4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40111f90 con 0x7fbb40101290 2024-09-12T01:52:48.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.492+0000 7fbb46bd4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40112290 con 0x7fbb40108160 2024-09-12T01:52:48.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.492+0000 7fbb45171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb401985e0 0x7fbb40198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.492+0000 7fbb45171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb401985e0 0x7fbb40198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39060/0 (socket says 172.21.15.70:39060) 2024-09-12T01:52:48.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.492+0000 7fbb45171640 1 -- 172.21.15.70:0/3734256373 learned_addr learned my addr 172.21.15.70:0/3734256373 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:48.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.493+0000 7fbb3ffff640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb40108160 0x7fbb4019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.493+0000 7fbb44970640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb40101290 0x7fbb4019e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.493+0000 7fbb45171640 1 -- 172.21.15.70:0/3734256373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb40108160 msgr2=0x7fbb4019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:48.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.493+0000 7fbb45171640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb40108160 0x7fbb4019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.493+0000 7fbb45171640 1 -- 172.21.15.70:0/3734256373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb40101290 msgr2=0x7fbb4019e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:48.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.493+0000 7fbb45171640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb40101290 0x7fbb4019e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.493+0000 7fbb45171640 1 -- 172.21.15.70:0/3734256373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb40199100 con 0x7fbb401985e0 2024-09-12T01:52:48.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.493+0000 7fbb44970640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb40101290 0x7fbb4019e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:48.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.493+0000 7fbb45171640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb401985e0 0x7fbb40198a90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009fd0 tx=0x7fbb3800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:48.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.494+0000 7fbb3dffb640 1 -- 172.21.15.70:0/3734256373 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38017070 con 0x7fbb401985e0 2024-09-12T01:52:48.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.494+0000 7fbb3dffb640 1 -- 172.21.15.70:0/3734256373 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb38004020 con 0x7fbb401985e0 2024-09-12T01:52:48.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.494+0000 7fbb3dffb640 1 -- 172.21.15.70:0/3734256373 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb380106a0 con 0x7fbb401985e0 2024-09-12T01:52:48.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.494+0000 7fbb46bd4640 1 -- 172.21.15.70:0/3734256373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb401993f0 con 0x7fbb401985e0 2024-09-12T01:52:48.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.494+0000 7fbb46bd4640 1 -- 172.21.15.70:0/3734256373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb40101ad0 con 0x7fbb401985e0 2024-09-12T01:52:48.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.496+0000 7fbb3dffb640 1 -- 172.21.15.70:0/3734256373 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbb380041d0 con 0x7fbb401985e0 2024-09-12T01:52:48.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.497+0000 7fbb3dffb640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb300a2cb0 0x7fbb300a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.497+0000 7fbb3dffb640 1 -- 172.21.15.70:0/3734256373 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbb380cecf0 con 0x7fbb401985e0 2024-09-12T01:52:48.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.497+0000 7fbb44970640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb300a2cb0 0x7fbb300a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.498+0000 7fbb48fad740 1 Processor -- start 2024-09-12T01:52:48.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.498+0000 7fbb48fad740 1 -- start start 2024-09-12T01:52:48.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.498+0000 7fbb48fad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 0x5572f060c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.498+0000 7fbb48fad740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060cde0 0x5572f060d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.498+0000 7fbb48fad740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 0x5572f0619f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.498+0000 7fbb48fad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5572f056a2f0 con 0x5572f060e350 2024-09-12T01:52:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.498+0000 7fbb48fad740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5572f0511cf0 con 0x5572f0617b80 2024-09-12T01:52:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.498+0000 7fbb48fad740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5572f05662b0 con 0x5572f060cde0 2024-09-12T01:52:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.499+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060cde0 0x5572f060d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.499+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060cde0 0x5572f060d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:46580/0 (socket says 172.21.15.70:46580) 2024-09-12T01:52:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.499+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2419663954 learned_addr learned my addr 172.21.15.70:0/2419663954 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.499+0000 7fbb45171640 1 --2- 172.21.15.70:0/2419663954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 0x5572f0619f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.499+0000 7fbb44970640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb300a2cb0 0x7fbb300a5170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbb34000c00 tx=0x7fbb34009680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.499+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2419663954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 msgr2=0x5572f0619f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.499+0000 7fbb3ffff640 1 --2- 172.21.15.70:0/2419663954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 0x5572f0619f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.499+0000 7fbb44970640 1 --2- 172.21.15.70:0/2419663954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 0x5572f060c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.499+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2419663954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 msgr2=0x5572f060c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.499+0000 7fbb3ffff640 1 --2- 172.21.15.70:0/2419663954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 0x5572f060c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.499+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2419663954 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f04f63a0 con 0x5572f060cde0 2024-09-12T01:52:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.499+0000 7fbb44970640 1 --2- 172.21.15.70:0/2419663954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 0x5572f060c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:52:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.500+0000 7fbb3ffff640 1 --2- 172.21.15.70:0/2419663954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060cde0 0x5572f060d220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb40078330 tx=0x7fbb2c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1f8c4df1eaabf63 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.500+0000 7fbb2affd640 1 -- 172.21.15.70:0/2419663954 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c01c480 con 0x5572f060cde0 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.500+0000 7fbb2affd640 1 -- 172.21.15.70:0/2419663954 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb2c01cb20 con 0x5572f060cde0 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.500+0000 7fbb2affd640 1 -- 172.21.15.70:0/2419663954 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c011c90 con 0x5572f060cde0 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.501+0000 7fbb48fad740 1 -- 172.21.15.70:0/2419663954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060cde0 msgr2=0x5572f060d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.501+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2419663954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060cde0 0x5572f060d220 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbb40078330 tx=0x7fbb2c0107a0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.501+0000 7fbb48fad740 1 -- 172.21.15.70:0/2419663954 shutdown_connections 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.501+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2419663954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 0x5572f0619f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.501+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2419663954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060cde0 0x5572f060d220 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.501+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2419663954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 0x5572f060c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.501+0000 7fbb48fad740 1 -- 172.21.15.70:0/2419663954 >> 172.21.15.70:0/2419663954 conn(0x5572f05cd310 msgr2=0x5572f0609470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.501+0000 7fbb48fad740 1 -- 172.21.15.70:0/2419663954 shutdown_connections 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.501+0000 7fbb48fad740 1 -- 172.21.15.70:0/2419663954 wait complete. 2024-09-12T01:52:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.502+0000 7fbb48fad740 1 -- start start 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.502+0000 7fbb48fad740 1 Processor -- start 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.502+0000 7fbb48fad740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060cde0 0x5572f0617550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.502+0000 7fbb48fad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 0x5572f0614800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.502+0000 7fbb48fad740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 0x5572f0614df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.502+0000 7fbb48fad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5572f061a880 con 0x5572f060e350 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.502+0000 7fbb48fad740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5572f0525060 con 0x5572f0617b80 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.502+0000 7fbb48fad740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5572f061aa00 con 0x5572f060cde0 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.502+0000 7fbb48fad740 10 client.0 _ll_register_callbacks cb 0x5572f02788c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.503+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 0x5572f0614800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.503+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 0x5572f0614800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39074/0 (socket says 172.21.15.70:39074) 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.503+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2741565253 learned_addr learned my addr 172.21.15.70:0/2741565253 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.503+0000 7fbb44970640 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060cde0 0x5572f0617550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.503+0000 7fbb45171640 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 0x5572f0614df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.503+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2741565253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060cde0 msgr2=0x5572f0617550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.503+0000 7fbb3ffff640 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060cde0 0x5572f0617550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.503+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2741565253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 msgr2=0x5572f0614df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.503+0000 7fbb3ffff640 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 0x5572f0614df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.503+0000 7fbb3ffff640 1 -- 172.21.15.70:0/2741565253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572f02db3c0 con 0x5572f060e350 2024-09-12T01:52:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.503+0000 7fbb3ffff640 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 0x5572f0614800 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00bf50 tx=0x7fbb2c00bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed9ec750f01fff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.503+0000 7fbb1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb1ffff640 1 -- 172.21.15.70:0/2741565253 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c02b060 con 0x5572f060e350 2024-09-12T01:52:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb1ffff640 1 -- 172.21.15.70:0/2741565253 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbb2c011ba0 con 0x5572f060e350 2024-09-12T01:52:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb48fad740 1 -- 172.21.15.70:0/2741565253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb2c01cb20 con 0x5572f060e350 2024-09-12T01:52:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb1ffff640 1 -- 172.21.15.70:0/2741565253 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb2c011da0 con 0x5572f060e350 2024-09-12T01:52:48.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb48fad740 10 client.15672 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:48.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb48fad740 1 -- 172.21.15.70:0/2741565253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5572f0626240 con 0x5572f060e350 2024-09-12T01:52:48.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb1ffff640 1 -- 172.21.15.70:0/2741565253 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb2c026470 con 0x5572f060e350 2024-09-12T01:52:48.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb1ffff640 1 -- 172.21.15.70:0/2741565253 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbb2c030070 con 0x5572f060e350 2024-09-12T01:52:48.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb48fad740 10 client.15672 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:48.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb48fad740 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:48.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb48fad740 20 client.15672 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:48.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5572f0627590 0x5572f0629980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb48fad740 4 client.15672 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:48.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.504+0000 7fbb48fad740 1 -- 172.21.15.70:0/2741565253 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbb2c01cb20 con 0x5572f0627590 2024-09-12T01:52:48.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.505+0000 7fbb44970640 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5572f0627590 0x5572f0629980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.505+0000 7fbb44970640 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5572f0627590 0x5572f0629980 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5329d694f2e7a1f9 server_cookie=2b419723114d48c9 in_seq=0 out_seq=0 2024-09-12T01:52:48.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.505+0000 7fbb1ffff640 10 client.15672 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:48.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb1ffff640 1 -- 172.21.15.70:0/2741565253 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fbb2c01cb20 con 0x5572f0627590 2024-09-12T01:52:48.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb1ffff640 10 client.15672 handle_command_reply: tid=0 2024-09-12T01:52:48.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb48fad740 1 client.15672 shutdown 2024-09-12T01:52:48.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb48fad740 1 -- 172.21.15.70:0/2741565253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 msgr2=0x5572f0614800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:48.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 0x5572f0614800 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00bf50 tx=0x7fbb2c00bf80 comp rx=0 tx=0).stop 2024-09-12T01:52:48.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb48fad740 1 -- 172.21.15.70:0/2741565253 shutdown_connections 2024-09-12T01:52:48.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5572f0627590 0x5572f0629980 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb1ffff640 0 client.15672 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:48.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 0x5572f0614df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060e350 0x5572f0614800 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2741565253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060cde0 0x5572f0617550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb48fad740 1 -- 172.21.15.70:0/2741565253 >> 172.21.15.70:0/2741565253 conn(0x5572f05cd310 msgr2=0x5572f060f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:48.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb48fad740 1 -- 172.21.15.70:0/2741565253 shutdown_connections 2024-09-12T01:52:48.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb48fad740 1 -- 172.21.15.70:0/2741565253 wait complete. 2024-09-12T01:52:48.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.506+0000 7fbb48fad740 20 client.15672 trim_cache size 0 max 16384 2024-09-12T01:52:48.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.532+0000 7fbb48fad740 1 Processor -- start 2024-09-12T01:52:48.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.532+0000 7fbb48fad740 1 -- start start 2024-09-12T01:52:48.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.532+0000 7fbb48fad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060cde0 0x5572f0623b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.532+0000 7fbb48fad740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060e350 0x5572f060f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.532+0000 7fbb48fad740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 0x5572f060fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.532+0000 7fbb48fad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401abb80 con 0x5572f060cde0 2024-09-12T01:52:48.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.532+0000 7fbb48fad740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401ad6c0 con 0x5572f0617b80 2024-09-12T01:52:48.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.532+0000 7fbb48fad740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401ac250 con 0x5572f060e350 2024-09-12T01:52:48.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.532+0000 7fbb44970640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060cde0 0x5572f0623b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.532+0000 7fbb44970640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060cde0 0x5572f0623b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39078/0 (socket says 172.21.15.70:39078) 2024-09-12T01:52:48.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.532+0000 7fbb44970640 1 -- 172.21.15.70:0/2195878343 learned_addr learned my addr 172.21.15.70:0/2195878343 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:48.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.532+0000 7fbb45171640 1 --2- 172.21.15.70:0/2195878343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 0x5572f060fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.533+0000 7fbb3ffff640 1 --2- 172.21.15.70:0/2195878343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060e350 0x5572f060f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.533+0000 7fbb44970640 1 -- 172.21.15.70:0/2195878343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060e350 msgr2=0x5572f060f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:48.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.533+0000 7fbb44970640 1 --2- 172.21.15.70:0/2195878343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060e350 0x5572f060f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.533+0000 7fbb44970640 1 -- 172.21.15.70:0/2195878343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 msgr2=0x5572f060fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:48.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.533+0000 7fbb44970640 1 --2- 172.21.15.70:0/2195878343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 0x5572f060fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.533+0000 7fbb44970640 1 -- 172.21.15.70:0/2195878343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f0615160 con 0x5572f060cde0 2024-09-12T01:52:48.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.533+0000 7fbb44970640 1 --2- 172.21.15.70:0/2195878343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060cde0 0x5572f0623b20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009930 tx=0x7fbb3403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39624529dff6c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:48.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.533+0000 7fbb2a7fc640 1 -- 172.21.15.70:0/2195878343 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34056070 con 0x5572f060cde0 2024-09-12T01:52:48.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.533+0000 7fbb2a7fc640 1 -- 172.21.15.70:0/2195878343 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb34004400 con 0x5572f060cde0 2024-09-12T01:52:48.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.533+0000 7fbb2a7fc640 1 -- 172.21.15.70:0/2195878343 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34035050 con 0x5572f060cde0 2024-09-12T01:52:48.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.534+0000 7fbb48fad740 1 -- 172.21.15.70:0/2195878343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060cde0 msgr2=0x5572f0623b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:48.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.534+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2195878343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060cde0 0x5572f0623b20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009930 tx=0x7fbb3403e000 comp rx=0 tx=0).stop 2024-09-12T01:52:48.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.534+0000 7fbb48fad740 1 -- 172.21.15.70:0/2195878343 shutdown_connections 2024-09-12T01:52:48.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.534+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2195878343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f0617b80 0x5572f060fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.534+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2195878343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060e350 0x5572f060f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.534+0000 7fbb48fad740 1 --2- 172.21.15.70:0/2195878343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f060cde0 0x5572f0623b20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.534+0000 7fbb48fad740 1 -- 172.21.15.70:0/2195878343 >> 172.21.15.70:0/2195878343 conn(0x5572f05cd310 msgr2=0x5572f0616880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.534+0000 7fbb48fad740 1 -- 172.21.15.70:0/2195878343 shutdown_connections 2024-09-12T01:52:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.535+0000 7fbb48fad740 1 -- 172.21.15.70:0/2195878343 wait complete. 2024-09-12T01:52:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.535+0000 7fbb48fad740 1 -- start start 2024-09-12T01:52:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.535+0000 7fbb48fad740 1 Processor -- start 2024-09-12T01:52:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.535+0000 7fbb48fad740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f060cde0 0x5572f0620380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb48fad740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060e350 0x5572f0611500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb48fad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f0617b80 0x5572f0611a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb48fad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401acff0 con 0x5572f0617b80 2024-09-12T01:52:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb48fad740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401ac920 con 0x5572f060cde0 2024-09-12T01:52:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb48fad740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401a9b40 con 0x5572f060e350 2024-09-12T01:52:48.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb48fad740 10 client.0 _ll_register_callbacks cb 0x7fbb2c00bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb45171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f0617b80 0x5572f0611a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb45171640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f0617b80 0x5572f0611a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39086/0 (socket says 172.21.15.70:39086) 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb45171640 1 -- 172.21.15.70:0/1077635644 learned_addr learned my addr 172.21.15.70:0/1077635644 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb3ffff640 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060e350 0x5572f0611500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb44970640 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f060cde0 0x5572f0620380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb45171640 1 -- 172.21.15.70:0/1077635644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060e350 msgr2=0x5572f0611500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb45171640 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060e350 0x5572f0611500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb45171640 1 -- 172.21.15.70:0/1077635644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f060cde0 msgr2=0x5572f0620380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb45171640 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f060cde0 0x5572f0620380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb45171640 1 -- 172.21.15.70:0/1077635644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572f0612220 con 0x5572f0617b80 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb3ffff640 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060e350 0x5572f0611500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb45171640 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f0617b80 0x5572f0611a40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800b760 tx=0x7fbb3809bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb51f065b3b6cee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:48.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.536+0000 7fbb1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.537+0000 7fbb1ffff640 1 -- 172.21.15.70:0/1077635644 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38020040 con 0x5572f0617b80 2024-09-12T01:52:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.537+0000 7fbb48fad740 1 -- 172.21.15.70:0/1077635644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb34004400 con 0x5572f0617b80 2024-09-12T01:52:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.537+0000 7fbb1ffff640 1 -- 172.21.15.70:0/1077635644 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbb380a3cf0 con 0x5572f0617b80 2024-09-12T01:52:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.537+0000 7fbb1ffff640 1 -- 172.21.15.70:0/1077635644 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb380a3ef0 con 0x5572f0617b80 2024-09-12T01:52:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.537+0000 7fbb48fad740 10 client.15678 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.537+0000 7fbb48fad740 1 -- 172.21.15.70:0/1077635644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5572f06006a0 con 0x5572f0617b80 2024-09-12T01:52:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.537+0000 7fbb1ffff640 1 -- 172.21.15.70:0/1077635644 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb34004400 con 0x5572f0617b80 2024-09-12T01:52:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.538+0000 7fbb1ffff640 1 -- 172.21.15.70:0/1077635644 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbb38097260 con 0x5572f0617b80 2024-09-12T01:52:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.538+0000 7fbb48fad740 10 client.15678 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:48.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.538+0000 7fbb48fad740 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:48.543 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:52:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.538+0000 7fbb48fad740 20 client.15678 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.538+0000 7fbb48fad740 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5572f0627590 0x5572f0602db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.538+0000 7fbb48fad740 4 client.15678 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:52:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.538+0000 7fbb48fad740 1 -- 172.21.15.70:0/1077635644 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5572f0577860 con 0x5572f0627590 2024-09-12T01:52:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.538+0000 7fbb44970640 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5572f0627590 0x5572f0602db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:48.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.538+0000 7fbb1ffff640 10 client.15678 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.538+0000 7fbb44970640 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5572f0627590 0x5572f0602db0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc16a7253617f396 server_cookie=e79091076a048255 in_seq=0 out_seq=0 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb1ffff640 1 -- 172.21.15.70:0/1077635644 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5572f0577860 con 0x5572f0627590 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb1ffff640 10 client.15678 handle_command_reply: tid=0 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb48fad740 1 client.15678 shutdown 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb48fad740 1 -- 172.21.15.70:0/1077635644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f0617b80 msgr2=0x5572f0611a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb48fad740 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f0617b80 0x5572f0611a40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800b760 tx=0x7fbb3809bd70 comp rx=0 tx=0).stop 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb48fad740 1 -- 172.21.15.70:0/1077635644 shutdown_connections 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb48fad740 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5572f0627590 0x5572f0602db0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb1ffff640 0 client.15678 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb48fad740 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572f0617b80 0x5572f0611a40 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb48fad740 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5572f060e350 0x5572f0611500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb48fad740 1 --2- 172.21.15.70:0/1077635644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5572f060cde0 0x5572f0620380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb48fad740 1 -- 172.21.15.70:0/1077635644 >> 172.21.15.70:0/1077635644 conn(0x5572f05cd310 msgr2=0x5572f05ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb48fad740 1 -- 172.21.15.70:0/1077635644 shutdown_connections 2024-09-12T01:52:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb48fad740 1 -- 172.21.15.70:0/1077635644 wait complete. 2024-09-12T01:52:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.539+0000 7fbb48fad740 20 client.15678 trim_cache size 0 max 16384 2024-09-12T01:52:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.540+0000 7fbb46bd4640 1 -- 172.21.15.70:0/3734256373 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb300a2cb0 msgr2=0x7fbb300a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.540+0000 7fbb46bd4640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb300a2cb0 0x7fbb300a5170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbb34000c00 tx=0x7fbb34009680 comp rx=0 tx=0).stop 2024-09-12T01:52:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.540+0000 7fbb46bd4640 1 -- 172.21.15.70:0/3734256373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb401985e0 msgr2=0x7fbb40198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.540+0000 7fbb46bd4640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb401985e0 0x7fbb40198a90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009fd0 tx=0x7fbb3800b260 comp rx=0 tx=0).stop 2024-09-12T01:52:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.540+0000 7fbb46bd4640 1 -- 172.21.15.70:0/3734256373 shutdown_connections 2024-09-12T01:52:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.540+0000 7fbb46bd4640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbb300a2cb0 0x7fbb300a5170 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.540+0000 7fbb46bd4640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb401985e0 0x7fbb40198a90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.540+0000 7fbb46bd4640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb40108160 0x7fbb4019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.540+0000 7fbb46bd4640 1 --2- 172.21.15.70:0/3734256373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb40101290 0x7fbb4019e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.540+0000 7fbb46bd4640 1 -- 172.21.15.70:0/3734256373 >> 172.21.15.70:0/3734256373 conn(0x7fbb40077210 msgr2=0x7fbb40105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.540+0000 7fbb46bd4640 1 -- 172.21.15.70:0/3734256373 shutdown_connections 2024-09-12T01:52:48.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:48.540+0000 7fbb46bd4640 1 -- 172.21.15.70:0/3734256373 wait complete. 2024-09-12T01:52:48.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:48 smithi070 ceph-mon[31177]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:52:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:48 smithi191 ceph-mon[35770]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:52:49.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:48 smithi152 ceph-mon[35055]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:52:50.239 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:52:50.239 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:52:50.619 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:50.888 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:50 smithi070 ceph-mon[31177]: pgmap v357: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:52:50.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:50 smithi191 ceph-mon[35770]: pgmap v357: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:52:51.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:50 smithi152 ceph-mon[35055]: pgmap v357: 97 pgs: 97 active+clean; 662 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:52:51.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.145+0000 7f5521cb9640 1 -- 172.21.15.70:0/958066868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f551c101410 msgr2=0x7f551c10d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.145+0000 7f5521cb9640 1 --2- 172.21.15.70:0/958066868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f551c101410 0x7f551c10d940 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5514009cd0 tx=0x7f551402a8e0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.145+0000 7f5521cb9640 1 -- 172.21.15.70:0/958066868 shutdown_connections 2024-09-12T01:52:51.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.145+0000 7f5521cb9640 1 --2- 172.21.15.70:0/958066868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f551c101410 0x7f551c10d940 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.145+0000 7f5521cb9640 1 --2- 172.21.15.70:0/958066868 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f551c100a70 0x7f551c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.145+0000 7f5521cb9640 1 --2- 172.21.15.70:0/958066868 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f551c106a70 0x7f551c106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.145+0000 7f5521cb9640 1 -- 172.21.15.70:0/958066868 >> 172.21.15.70:0/958066868 conn(0x7f551c0fc7d0 msgr2=0x7f551c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.146+0000 7f5521cb9640 1 -- 172.21.15.70:0/958066868 shutdown_connections 2024-09-12T01:52:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.146+0000 7f5521cb9640 1 -- 172.21.15.70:0/958066868 wait complete. 2024-09-12T01:52:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.147+0000 7f5521cb9640 1 Processor -- start 2024-09-12T01:52:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.147+0000 7f5521cb9640 1 -- start start 2024-09-12T01:52:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.148+0000 7f5521cb9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f551c100a70 0x7f551c197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.148+0000 7f5521cb9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f551c101410 0x7f551c197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.148+0000 7f5521cb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f551c106a70 0x7f551c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.148+0000 7f5521cb9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f551c110fd0 con 0x7f551c106a70 2024-09-12T01:52:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.148+0000 7f5521cb9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f551c110e50 con 0x7f551c100a70 2024-09-12T01:52:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.148+0000 7f5521cb9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f551c111150 con 0x7f551c101410 2024-09-12T01:52:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.148+0000 7f551bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f551c106a70 0x7f551c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.148+0000 7f551bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f551c106a70 0x7f551c19bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38412/0 (socket says 172.21.15.70:38412) 2024-09-12T01:52:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.148+0000 7f551bfff640 1 -- 172.21.15.70:0/4226925835 learned_addr learned my addr 172.21.15.70:0/4226925835 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.148+0000 7f551b7fe640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f551c100a70 0x7f551c197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.148+0000 7f551affd640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f551c101410 0x7f551c197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.149+0000 7f551bfff640 1 -- 172.21.15.70:0/4226925835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f551c101410 msgr2=0x7f551c197770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.149+0000 7f551bfff640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f551c101410 0x7f551c197770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.149+0000 7f551bfff640 1 -- 172.21.15.70:0/4226925835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f551c100a70 msgr2=0x7f551c197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.149+0000 7f551bfff640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f551c100a70 0x7f551c197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.149+0000 7f551bfff640 1 -- 172.21.15.70:0/4226925835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c19c1e0 con 0x7f551c106a70 2024-09-12T01:52:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.149+0000 7f551bfff640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f551c106a70 0x7f551c19bb00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5514009ca0 tx=0x7f5514032be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.149+0000 7f5518ff9640 1 -- 172.21.15.70:0/4226925835 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514004240 con 0x7f551c106a70 2024-09-12T01:52:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.150+0000 7f5518ff9640 1 -- 172.21.15.70:0/4226925835 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f55140305a0 con 0x7f551c106a70 2024-09-12T01:52:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.150+0000 7f5521cb9640 1 -- 172.21.15.70:0/4226925835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f551c19c470 con 0x7f551c106a70 2024-09-12T01:52:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.150+0000 7f5521cb9640 1 -- 172.21.15.70:0/4226925835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f551c19c940 con 0x7f551c106a70 2024-09-12T01:52:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.150+0000 7f5518ff9640 1 -- 172.21.15.70:0/4226925835 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55140466e0 con 0x7f551c106a70 2024-09-12T01:52:51.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.152+0000 7f5518ff9640 1 -- 172.21.15.70:0/4226925835 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f551403a400 con 0x7f551c106a70 2024-09-12T01:52:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.153+0000 7f5518ff9640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f55040a2c80 0x7f55040a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.153+0000 7f5518ff9640 1 -- 172.21.15.70:0/4226925835 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f55140f12e0 con 0x7f551c106a70 2024-09-12T01:52:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.153+0000 7f5524092740 1 Processor -- start 2024-09-12T01:52:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.153+0000 7f5524092740 1 -- start start 2024-09-12T01:52:51.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.154+0000 7f551b7fe640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f55040a2c80 0x7f55040a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.154+0000 7f5524092740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08aa00 0x55daee08ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.154+0000 7f5524092740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee08b320 0x55daee097a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.154+0000 7f5524092740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee097f50 0x55daee09a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.154+0000 7f5524092740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55daedff0280 con 0x55daee097f50 2024-09-12T01:52:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.154+0000 7f5524092740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55daedf97b10 con 0x55daee08aa00 2024-09-12T01:52:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.154+0000 7f5524092740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55daedfec240 con 0x55daee08b320 2024-09-12T01:52:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.154+0000 7f551bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee097f50 0x55daee09a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.154+0000 7f551bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee097f50 0x55daee09a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38424/0 (socket says 172.21.15.70:38424) 2024-09-12T01:52:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.154+0000 7f551bfff640 1 -- 172.21.15.70:0/3002535859 learned_addr learned my addr 172.21.15.70:0/3002535859 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.154+0000 7f551affd640 1 --2- 172.21.15.70:0/3002535859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee08b320 0x55daee097a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.155+0000 7f551affd640 1 -- 172.21.15.70:0/3002535859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08aa00 msgr2=0x55daee08ade0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:52:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.155+0000 7f551affd640 1 --2- 172.21.15.70:0/3002535859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08aa00 0x55daee08ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.155+0000 7f551affd640 1 -- 172.21.15.70:0/3002535859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee097f50 msgr2=0x55daee09a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.155+0000 7f551affd640 1 --2- 172.21.15.70:0/3002535859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee097f50 0x55daee09a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.155+0000 7f551affd640 1 -- 172.21.15.70:0/3002535859 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daedfa41f0 con 0x55daee08b320 2024-09-12T01:52:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.155+0000 7f551affd640 1 --2- 172.21.15.70:0/3002535859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee08b320 0x55daee097a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5510009970 tx=0x7f5510009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d727b00d0092f7f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.155+0000 7f551b7fe640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f55040a2c80 0x7f55040a5140 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f550c005fd0 tx=0x7f550c00b590 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.155+0000 7f5501ffb640 1 -- 172.21.15.70:0/3002535859 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510017070 con 0x55daee08b320 2024-09-12T01:52:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.155+0000 7f5501ffb640 1 -- 172.21.15.70:0/3002535859 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5510013470 con 0x55daee08b320 2024-09-12T01:52:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.155+0000 7f5501ffb640 1 -- 172.21.15.70:0/3002535859 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510012630 con 0x55daee08b320 2024-09-12T01:52:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.156+0000 7f551bfff640 1 --2- 172.21.15.70:0/3002535859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee097f50 0x55daee09a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.156+0000 7f5524092740 1 -- 172.21.15.70:0/3002535859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee08b320 msgr2=0x55daee097a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.156+0000 7f5524092740 1 --2- 172.21.15.70:0/3002535859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee08b320 0x55daee097a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5510009970 tx=0x7f5510009e30 comp rx=0 tx=0).stop 2024-09-12T01:52:51.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.156+0000 7f5524092740 1 -- 172.21.15.70:0/3002535859 shutdown_connections 2024-09-12T01:52:51.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.156+0000 7f5524092740 1 --2- 172.21.15.70:0/3002535859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee097f50 0x55daee09a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.156+0000 7f5524092740 1 --2- 172.21.15.70:0/3002535859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee08b320 0x55daee097a10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.156+0000 7f5524092740 1 --2- 172.21.15.70:0/3002535859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08aa00 0x55daee08ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.156+0000 7f5524092740 1 -- 172.21.15.70:0/3002535859 >> 172.21.15.70:0/3002535859 conn(0x55daee0870f0 msgr2=0x55daee0874d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:51.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.157+0000 7f5524092740 1 -- 172.21.15.70:0/3002535859 shutdown_connections 2024-09-12T01:52:51.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.157+0000 7f5524092740 1 -- 172.21.15.70:0/3002535859 wait complete. 2024-09-12T01:52:51.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.157+0000 7f5524092740 1 -- start start 2024-09-12T01:52:51.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.157+0000 7f5524092740 1 Processor -- start 2024-09-12T01:52:51.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.158+0000 7f5524092740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08aa00 0x55daee0978f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.158+0000 7f5524092740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08b320 0x55daee092c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.158+0000 7f551b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08aa00 0x55daee0978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.158+0000 7f551b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08aa00 0x55daee0978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38438/0 (socket says 172.21.15.70:38438) 2024-09-12T01:52:51.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.158+0000 7f551b7fe640 1 -- 172.21.15.70:0/1734642857 learned_addr learned my addr 172.21.15.70:0/1734642857 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:51.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.159+0000 7f5524092740 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee097f50 0x55daee0931c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.159+0000 7f5524092740 1 -- 172.21.15.70:0/1734642857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55daee09ab20 con 0x55daee08aa00 2024-09-12T01:52:51.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.159+0000 7f551affd640 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08b320 0x55daee092c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.159+0000 7f551bfff640 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee097f50 0x55daee0931c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.159+0000 7f5524092740 1 -- 172.21.15.70:0/1734642857 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55daedfaaf10 con 0x55daee08b320 2024-09-12T01:52:51.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.159+0000 7f5524092740 1 -- 172.21.15.70:0/1734642857 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55daee09aca0 con 0x55daee097f50 2024-09-12T01:52:51.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.160+0000 7f5524092740 10 client.0 _ll_register_callbacks cb 0x55daedf73a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:51.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.160+0000 7f551b7fe640 1 -- 172.21.15.70:0/1734642857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee097f50 msgr2=0x55daee0931c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.160+0000 7f551b7fe640 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee097f50 0x55daee0931c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.160+0000 7f551b7fe640 1 -- 172.21.15.70:0/1734642857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08b320 msgr2=0x55daee092c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.160+0000 7f551b7fe640 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08b320 0x55daee092c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.160+0000 7f551b7fe640 1 -- 172.21.15.70:0/1734642857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daedd616a0 con 0x55daee08aa00 2024-09-12T01:52:51.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.160+0000 7f551b7fe640 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08aa00 0x55daee0978f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f550c011460 tx=0x7f550c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11a49402517af5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:51.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.160+0000 7f54faffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:51.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.162+0000 7f54faffd640 1 -- 172.21.15.70:0/1734642857 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c022070 con 0x55daee08aa00 2024-09-12T01:52:51.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.162+0000 7f54faffd640 1 -- 172.21.15.70:0/1734642857 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f550c01e860 con 0x55daee08aa00 2024-09-12T01:52:51.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.162+0000 7f5524092740 1 -- 172.21.15.70:0/1734642857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5510013470 con 0x55daee08aa00 2024-09-12T01:52:51.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.162+0000 7f54faffd640 1 -- 172.21.15.70:0/1734642857 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f550c02c050 con 0x55daee08aa00 2024-09-12T01:52:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.162+0000 7f5524092740 10 client.15690 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.162+0000 7f5524092740 1 -- 172.21.15.70:0/1734642857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55daee0ace60 con 0x55daee08aa00 2024-09-12T01:52:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.163+0000 7f54faffd640 1 -- 172.21.15.70:0/1734642857 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5510013470 con 0x55daee08aa00 2024-09-12T01:52:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.163+0000 7f54faffd640 1 -- 172.21.15.70:0/1734642857 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f550c0263b0 con 0x55daee08aa00 2024-09-12T01:52:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.163+0000 7f5524092740 10 client.15690 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.163+0000 7f5524092740 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.163+0000 7f5524092740 20 client.15690 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.163+0000 7f5524092740 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55daee0ae410 0x55daee0b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.163+0000 7f5524092740 4 client.15690 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.163+0000 7f5524092740 1 -- 172.21.15.70:0/1734642857 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55daedffd7f0 con 0x55daee0ae410 2024-09-12T01:52:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.163+0000 7f551affd640 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55daee0ae410 0x55daee0b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.164+0000 7f54faffd640 10 client.15690 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:51.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.164+0000 7f551affd640 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55daee0ae410 0x55daee0b0870 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4852d52e4b097a14 server_cookie=ea43662b34c74bdc in_seq=0 out_seq=0 2024-09-12T01:52:51.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.165+0000 7f54faffd640 1 -- 172.21.15.70:0/1734642857 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55daedffd7f0 con 0x55daee0ae410 2024-09-12T01:52:51.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.165+0000 7f54faffd640 10 client.15690 handle_command_reply: tid=0 2024-09-12T01:52:51.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.165+0000 7f5524092740 1 client.15690 shutdown 2024-09-12T01:52:51.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.166+0000 7f5524092740 1 -- 172.21.15.70:0/1734642857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08aa00 msgr2=0x55daee0978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.166+0000 7f5524092740 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08aa00 0x55daee0978f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f550c011460 tx=0x7f550c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.166+0000 7f5524092740 1 -- 172.21.15.70:0/1734642857 shutdown_connections 2024-09-12T01:52:51.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.166+0000 7f5524092740 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55daee0ae410 0x55daee0b0870 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.166+0000 7f5524092740 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee097f50 0x55daee0931c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.166+0000 7f5524092740 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08b320 0x55daee092c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.166+0000 7f5524092740 1 --2- 172.21.15.70:0/1734642857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08aa00 0x55daee0978f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.166+0000 7f5524092740 1 -- 172.21.15.70:0/1734642857 >> 172.21.15.70:0/1734642857 conn(0x55daee0870f0 msgr2=0x55daee08ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.166+0000 7f54faffd640 0 client.15690 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.166+0000 7f5524092740 1 -- 172.21.15.70:0/1734642857 shutdown_connections 2024-09-12T01:52:51.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.168+0000 7f5524092740 1 -- 172.21.15.70:0/1734642857 wait complete. 2024-09-12T01:52:51.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.168+0000 7f5524092740 20 client.15690 trim_cache size 0 max 16384 2024-09-12T01:52:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.172+0000 7f2152ceb640 1 -- 172.21.15.70:0/105348753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f214c100a40 msgr2=0x7f214c100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.172+0000 7f2152ceb640 1 --2- 172.21.15.70:0/105348753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f214c100a40 0x7f214c100e40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2140009900 tx=0x7f214002a410 comp rx=0 tx=0).stop 2024-09-12T01:52:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.172+0000 7f2152ceb640 1 -- 172.21.15.70:0/105348753 shutdown_connections 2024-09-12T01:52:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.172+0000 7f2152ceb640 1 --2- 172.21.15.70:0/105348753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f214c1025f0 0x7f214c108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.172+0000 7f2152ceb640 1 --2- 172.21.15.70:0/105348753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f214c101c30 0x7f214c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.172+0000 7f2152ceb640 1 --2- 172.21.15.70:0/105348753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f214c100a40 0x7f214c100e40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.172+0000 7f2152ceb640 1 -- 172.21.15.70:0/105348753 >> 172.21.15.70:0/105348753 conn(0x7f214c0fc1e0 msgr2=0x7f214c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.172+0000 7f2152ceb640 1 -- 172.21.15.70:0/105348753 shutdown_connections 2024-09-12T01:52:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.172+0000 7f2152ceb640 1 -- 172.21.15.70:0/105348753 wait complete. 2024-09-12T01:52:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.173+0000 7f2152ceb640 1 Processor -- start 2024-09-12T01:52:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.173+0000 7f2152ceb640 1 -- start start 2024-09-12T01:52:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.173+0000 7f2152ceb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f214c100a40 0x7f214c197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.173+0000 7f2152ceb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f214c101c30 0x7f214c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.173+0000 7f2152ceb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f214c1025f0 0x7f214c19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.173+0000 7f2152ceb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f214c10c820 con 0x7f214c101c30 2024-09-12T01:52:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.173+0000 7f2152ceb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f214c10c6a0 con 0x7f214c1025f0 2024-09-12T01:52:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.173+0000 7f2152ceb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f214c10c9a0 con 0x7f214c100a40 2024-09-12T01:52:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.173+0000 7f214bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f214c101c30 0x7f214c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.173+0000 7f214bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f214c101c30 0x7f214c198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38470/0 (socket says 172.21.15.70:38470) 2024-09-12T01:52:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.173+0000 7f214bfff640 1 -- 172.21.15.70:0/1498524083 learned_addr learned my addr 172.21.15.70:0/1498524083 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.173+0000 7f2151288640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f214c1025f0 0x7f214c19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.174+0000 7f2150a87640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f214c100a40 0x7f214c197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.174+0000 7f214bfff640 1 -- 172.21.15.70:0/1498524083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f214c100a40 msgr2=0x7f214c197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.174+0000 7f214bfff640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f214c100a40 0x7f214c197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.174+0000 7f214bfff640 1 -- 172.21.15.70:0/1498524083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f214c1025f0 msgr2=0x7f214c19f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.174+0000 7f214bfff640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f214c1025f0 0x7f214c19f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.174+0000 7f214bfff640 1 -- 172.21.15.70:0/1498524083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c19fae0 con 0x7f214c101c30 2024-09-12T01:52:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.174+0000 7f214bfff640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f214c101c30 0x7f214c198400 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2138009f40 tx=0x7f213800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.174+0000 7f2149ffb640 1 -- 172.21.15.70:0/1498524083 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213800cd80 con 0x7f214c101c30 2024-09-12T01:52:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.174+0000 7f2152ceb640 1 -- 172.21.15.70:0/1498524083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214c102f80 con 0x7f214c101c30 2024-09-12T01:52:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.174+0000 7f2149ffb640 1 -- 172.21.15.70:0/1498524083 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2138005520 con 0x7f214c101c30 2024-09-12T01:52:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.174+0000 7f2149ffb640 1 -- 172.21.15.70:0/1498524083 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138004a00 con 0x7f214c101c30 2024-09-12T01:52:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.175+0000 7f2152ceb640 1 -- 172.21.15.70:0/1498524083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214c1034d0 con 0x7f214c101c30 2024-09-12T01:52:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.178+0000 7f2155a8a740 1 Processor -- start 2024-09-12T01:52:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.178+0000 7f2155a8a740 1 -- start start 2024-09-12T01:52:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.178+0000 7f2149ffb640 1 -- 172.21.15.70:0/1498524083 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2138004ba0 con 0x7f214c101c30 2024-09-12T01:52:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.178+0000 7f2155a8a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b71b0 0x55c1c80b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.178+0000 7f2155a8a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b7af0 0x55c1c80bc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.178+0000 7f2155a8a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80bcb80 0x55c1c80bf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.178+0000 7f2155a8a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c1c80122f0 con 0x55c1c80b71b0 2024-09-12T01:52:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.178+0000 7f2155a8a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c1c7fba270 con 0x55c1c80b7af0 2024-09-12T01:52:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.178+0000 7f2155a8a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c1c800e2b0 con 0x55c1c80bcb80 2024-09-12T01:52:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.179+0000 7f2151288640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b71b0 0x55c1c80b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.179+0000 7f2151288640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b71b0 0x55c1c80b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38480/0 (socket says 172.21.15.70:38480) 2024-09-12T01:52:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.179+0000 7f2151288640 1 -- 172.21.15.70:0/4095331376 learned_addr learned my addr 172.21.15.70:0/4095331376 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.179+0000 7f2150a87640 1 --2- 172.21.15.70:0/4095331376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b7af0 0x55c1c80bc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.179+0000 7f214bfff640 1 --2- 172.21.15.70:0/4095331376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80bcb80 0x55c1c80bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.179+0000 7f2150a87640 1 -- 172.21.15.70:0/4095331376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80bcb80 msgr2=0x55c1c80bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.179+0000 7f2150a87640 1 --2- 172.21.15.70:0/4095331376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80bcb80 0x55c1c80bf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.179+0000 7f2150a87640 1 -- 172.21.15.70:0/4095331376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b71b0 msgr2=0x55c1c80b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.179+0000 7f2150a87640 1 --2- 172.21.15.70:0/4095331376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b71b0 0x55c1c80b75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.179+0000 7f2150a87640 1 -- 172.21.15.70:0/4095331376 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1c7fb9340 con 0x55c1c80b7af0 2024-09-12T01:52:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.179+0000 7f2151288640 1 --2- 172.21.15.70:0/4095331376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b71b0 0x55c1c80b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.179+0000 7f2149ffb640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f213c0a2cb0 0x7f213c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.180+0000 7f2150a87640 1 --2- 172.21.15.70:0/4095331376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b7af0 0x55c1c80bc5b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2140009230 tx=0x7f2140005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81262459d9a29e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.180+0000 7f2149ffb640 1 -- 172.21.15.70:0/1498524083 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f21380131f0 con 0x7f214c101c30 2024-09-12T01:52:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.180+0000 7f2151288640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f213c0a2cb0 0x7f213c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.180+0000 7f2136ffd640 1 -- 172.21.15.70:0/4095331376 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140040070 con 0x55c1c80b7af0 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.180+0000 7f2136ffd640 1 -- 172.21.15.70:0/4095331376 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2140031a00 con 0x55c1c80b7af0 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.180+0000 7f2136ffd640 1 -- 172.21.15.70:0/4095331376 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140035040 con 0x55c1c80b7af0 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.181+0000 7f2155a8a740 1 -- 172.21.15.70:0/4095331376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b7af0 msgr2=0x55c1c80bc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.181+0000 7f2151288640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f213c0a2cb0 0x7f213c0a5170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2144011890 tx=0x7f2144009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.181+0000 7f2155a8a740 1 --2- 172.21.15.70:0/4095331376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b7af0 0x55c1c80bc5b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2140009230 tx=0x7f2140005bd0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.181+0000 7f2155a8a740 1 -- 172.21.15.70:0/4095331376 shutdown_connections 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.181+0000 7f2155a8a740 1 --2- 172.21.15.70:0/4095331376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80bcb80 0x55c1c80bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.181+0000 7f2155a8a740 1 --2- 172.21.15.70:0/4095331376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b7af0 0x55c1c80bc5b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.181+0000 7f2155a8a740 1 --2- 172.21.15.70:0/4095331376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b71b0 0x55c1c80b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.181+0000 7f2155a8a740 1 -- 172.21.15.70:0/4095331376 >> 172.21.15.70:0/4095331376 conn(0x55c1c80aa010 msgr2=0x55c1c80aa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.181+0000 7f2155a8a740 1 -- 172.21.15.70:0/4095331376 shutdown_connections 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.181+0000 7f2155a8a740 1 -- 172.21.15.70:0/4095331376 wait complete. 2024-09-12T01:52:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.181+0000 7f2155a8a740 1 -- start start 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.181+0000 7f2155a8a740 1 Processor -- start 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2155a8a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 0x55c1c80c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2155a8a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b7af0 0x55c1c80c1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2155a8a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 0x55c1c80c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2155a8a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c1c80bfaf0 con 0x55c1c80bcb80 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2155a8a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c1c7f9b290 con 0x55c1c80b71b0 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2155a8a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c1c80bfc70 con 0x55c1c80b7af0 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2155a8a740 10 client.0 _ll_register_callbacks cb 0x55c1c7fcc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2151288640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 0x55c1c80c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2150a87640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 0x55c1c80c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2151288640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 0x55c1c80c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38486/0 (socket says 172.21.15.70:38486) 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2151288640 1 -- 172.21.15.70:0/2892012206 learned_addr learned my addr 172.21.15.70:0/2892012206 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2150a87640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 0x55c1c80c12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41402/0 (socket says 172.21.15.70:41402) 2024-09-12T01:52:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f214bfff640 1 --2- 172.21.15.70:0/2892012206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b7af0 0x55c1c80c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2151288640 1 -- 172.21.15.70:0/2892012206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b7af0 msgr2=0x55c1c80c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2151288640 1 --2- 172.21.15.70:0/2892012206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b7af0 0x55c1c80c1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2151288640 1 -- 172.21.15.70:0/2892012206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 msgr2=0x55c1c80c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2151288640 1 --2- 172.21.15.70:0/2892012206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 0x55c1c80c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.182+0000 7f2151288640 1 -- 172.21.15.70:0/2892012206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1c7d25210 con 0x55c1c80bcb80 2024-09-12T01:52:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.183+0000 7f2151288640 1 --2- 172.21.15.70:0/2892012206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 0x55c1c80c8870 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f214400fbe0 tx=0x7f2144004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c45e3144f697cdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.183+0000 7f212bfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.183+0000 7f212bfff640 1 -- 172.21.15.70:0/2892012206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214400fe50 con 0x55c1c80bcb80 2024-09-12T01:52:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.183+0000 7f212bfff640 1 -- 172.21.15.70:0/2892012206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2144017030 con 0x55c1c80bcb80 2024-09-12T01:52:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.183+0000 7f2155a8a740 1 -- 172.21.15.70:0/2892012206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2140031a00 con 0x55c1c80bcb80 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.183+0000 7f212bfff640 1 -- 172.21.15.70:0/2892012206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2144004b20 con 0x55c1c80bcb80 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.183+0000 7f2155a8a740 10 client.15702 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.183+0000 7f2155a8a740 1 -- 172.21.15.70:0/2892012206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1c7df1620 con 0x55c1c80bcb80 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.183+0000 7f212bfff640 1 -- 172.21.15.70:0/2892012206 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2140031a00 con 0x55c1c80bcb80 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.183+0000 7f212bfff640 1 -- 172.21.15.70:0/2892012206 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f21440041f0 con 0x55c1c80bcb80 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.183+0000 7f2155a8a740 10 client.15702 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.183+0000 7f2155a8a740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.184+0000 7f2155a8a740 20 client.15702 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.184+0000 7f2155a8a740 1 --2- 172.21.15.70:0/2892012206 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c1c80ccfe0 0x55c1c80cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.184+0000 7f2155a8a740 4 client.15702 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.184+0000 7f2155a8a740 1 -- 172.21.15.70:0/2892012206 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1c801fa20 con 0x55c1c80ccfe0 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.184+0000 7f2150a87640 1 --2- 172.21.15.70:0/2892012206 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c1c80ccfe0 0x55c1c80cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.184+0000 7f212bfff640 10 client.15702 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.184+0000 7f2150a87640 1 --2- 172.21.15.70:0/2892012206 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c1c80ccfe0 0x55c1c80cf3f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f05556f6a42f0f69 server_cookie=89786a715b4931dd in_seq=0 out_seq=0 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f212bfff640 1 -- 172.21.15.70:0/2892012206 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1c801fa20 con 0x55c1c80ccfe0 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f212bfff640 10 client.15702 handle_command_reply: tid=0 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f2155a8a740 1 client.15702 shutdown 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f2155a8a740 1 -- 172.21.15.70:0/2892012206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 msgr2=0x55c1c80c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f2155a8a740 1 --2- 172.21.15.70:0/2892012206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 0x55c1c80c8870 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f214400fbe0 tx=0x7f2144004ab0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f2155a8a740 1 -- 172.21.15.70:0/2892012206 shutdown_connections 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f2155a8a740 1 --2- 172.21.15.70:0/2892012206 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c1c80ccfe0 0x55c1c80cf3f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f2155a8a740 1 --2- 172.21.15.70:0/2892012206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 0x55c1c80c8870 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f2155a8a740 1 --2- 172.21.15.70:0/2892012206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b7af0 0x55c1c80c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f2155a8a740 1 --2- 172.21.15.70:0/2892012206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 0x55c1c80c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f2155a8a740 1 -- 172.21.15.70:0/2892012206 >> 172.21.15.70:0/2892012206 conn(0x55c1c80aa010 msgr2=0x55c1c80ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f212bfff640 0 client.15702 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f2155a8a740 1 -- 172.21.15.70:0/2892012206 shutdown_connections 2024-09-12T01:52:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.185+0000 7f2155a8a740 1 -- 172.21.15.70:0/2892012206 wait complete. 2024-09-12T01:52:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.186+0000 7f2155a8a740 20 client.15702 trim_cache size 0 max 16384 2024-09-12T01:52:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f2155a8a740 1 Processor -- start 2024-09-12T01:52:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f2155a8a740 1 -- start start 2024-09-12T01:52:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f2155a8a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 0x55c1c80a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f2155a8a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b7af0 0x55c1c80c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f2155a8a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 0x55c1c80d3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f2155a8a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f214c1a6e60 con 0x55c1c80bcb80 2024-09-12T01:52:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f2155a8a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f214c1a89a0 con 0x55c1c80b71b0 2024-09-12T01:52:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f2155a8a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f214c1a7530 con 0x55c1c80b7af0 2024-09-12T01:52:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f2150a87640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 0x55c1c80a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f2151288640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 0x55c1c80d3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f2150a87640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 0x55c1c80a90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41410/0 (socket says 172.21.15.70:41410) 2024-09-12T01:52:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f2150a87640 1 -- 172.21.15.70:0/848127768 learned_addr learned my addr 172.21.15.70:0/848127768 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.200+0000 7f214bfff640 1 --2- 172.21.15.70:0/848127768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b7af0 0x55c1c80c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.201+0000 7f2150a87640 1 -- 172.21.15.70:0/848127768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b7af0 msgr2=0x55c1c80c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.201+0000 7f2150a87640 1 --2- 172.21.15.70:0/848127768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b7af0 0x55c1c80c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.201+0000 7f2150a87640 1 -- 172.21.15.70:0/848127768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 msgr2=0x55c1c80d3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.201+0000 7f2150a87640 1 --2- 172.21.15.70:0/848127768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 0x55c1c80d3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.201+0000 7f2150a87640 1 -- 172.21.15.70:0/848127768 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1c80a9e30 con 0x55c1c80b71b0 2024-09-12T01:52:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.201+0000 7f214bfff640 1 --2- 172.21.15.70:0/848127768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b7af0 0x55c1c80c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.201+0000 7f2151288640 1 --2- 172.21.15.70:0/848127768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 0x55c1c80d3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.201+0000 7f2150a87640 1 --2- 172.21.15.70:0/848127768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 0x55c1c80a90b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2140004730 tx=0x7f2140031640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd4616aa93deddc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.201+0000 7f21367fc640 1 -- 172.21.15.70:0/848127768 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140040040 con 0x55c1c80b71b0 2024-09-12T01:52:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.201+0000 7f21367fc640 1 -- 172.21.15.70:0/848127768 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f21400035f0 con 0x55c1c80b71b0 2024-09-12T01:52:51.203 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.201+0000 7f21367fc640 1 -- 172.21.15.70:0/848127768 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140035040 con 0x55c1c80b71b0 2024-09-12T01:52:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.202+0000 7f2155a8a740 1 -- 172.21.15.70:0/848127768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 msgr2=0x55c1c80a90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.202+0000 7f2155a8a740 1 --2- 172.21.15.70:0/848127768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 0x55c1c80a90b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2140004730 tx=0x7f2140031640 comp rx=0 tx=0).stop 2024-09-12T01:52:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.202+0000 7f2155a8a740 1 -- 172.21.15.70:0/848127768 shutdown_connections 2024-09-12T01:52:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.202+0000 7f2155a8a740 1 --2- 172.21.15.70:0/848127768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80bcb80 0x55c1c80d3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.202+0000 7f2155a8a740 1 --2- 172.21.15.70:0/848127768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b7af0 0x55c1c80c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.202+0000 7f2155a8a740 1 --2- 172.21.15.70:0/848127768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80b71b0 0x55c1c80a90b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.202+0000 7f2155a8a740 1 -- 172.21.15.70:0/848127768 >> 172.21.15.70:0/848127768 conn(0x55c1c80aa010 msgr2=0x55c1c80a89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.202+0000 7f2155a8a740 1 -- 172.21.15.70:0/848127768 shutdown_connections 2024-09-12T01:52:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.202+0000 7f2155a8a740 1 -- 172.21.15.70:0/848127768 wait complete. 2024-09-12T01:52:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.202+0000 7f2155a8a740 1 -- start start 2024-09-12T01:52:51.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.203+0000 7f5524092740 1 Processor -- start 2024-09-12T01:52:51.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.203+0000 7f5524092740 1 -- start start 2024-09-12T01:52:51.206 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.203+0000 7f2155a8a740 1 Processor -- start 2024-09-12T01:52:51.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.203+0000 7f5524092740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08aa00 0x55daee091c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.203+0000 7f5524092740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08b320 0x55daee0b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.203+0000 7f5524092740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee097f50 0x55daee0b6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.203+0000 7f5524092740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f550800e4c0 con 0x55daee08b320 2024-09-12T01:52:51.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f2155a8a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b71b0 0x55c1c80c6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.203+0000 7f551b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08aa00 0x55daee091c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f2155a8a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b7af0 0x55c1c80c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f2155a8a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80bcb80 0x55c1c80c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f2155a8a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f214c1a82d0 con 0x55c1c80b7af0 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f2155a8a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f214c1a7c00 con 0x55c1c80bcb80 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f2155a8a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f214c1a4e20 con 0x55c1c80b71b0 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f2150a87640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b71b0 0x55c1c80c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f214bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b7af0 0x55c1c80c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f2150a87640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b71b0 0x55c1c80c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:51412/0 (socket says 172.21.15.70:51412) 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f2150a87640 1 -- 172.21.15.70:0/651078335 learned_addr learned my addr 172.21.15.70:0/651078335 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f2155a8a740 10 client.0 _ll_register_callbacks cb 0x7f2144011e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f2151288640 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80bcb80 0x55c1c80c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f214bfff640 1 -- 172.21.15.70:0/651078335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b71b0 msgr2=0x55c1c80c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f214bfff640 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b71b0 0x55c1c80c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.210 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f214bfff640 1 -- 172.21.15.70:0/651078335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80bcb80 msgr2=0x55c1c80c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.211 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f214bfff640 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80bcb80 0x55c1c80c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.211 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f214bfff640 1 -- 172.21.15.70:0/651078335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1c80c7ff0 con 0x55c1c80b7af0 2024-09-12T01:52:51.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.203+0000 7f551affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08b320 0x55daee0b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.211 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f2151288640 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80bcb80 0x55c1c80c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:51.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f551b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08aa00 0x55daee091c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41418/0 (socket says 172.21.15.70:41418) 2024-09-12T01:52:51.212 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f214bfff640 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b7af0 0x55c1c80c6a70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f213809f950 tx=0x7f213809f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a50ee68058fd55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:51.212 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.205+0000 7f212bfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:51.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f551b7fe640 1 -- 172.21.15.70:0/2841477387 learned_addr learned my addr 172.21.15.70:0/2841477387 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:51.212 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.205+0000 7f212bfff640 1 -- 172.21.15.70:0/651078335 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21380a3f50 con 0x55c1c80b7af0 2024-09-12T01:52:51.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f551bfff640 1 --2- 172.21.15.70:0/2841477387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee097f50 0x55daee0b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.205+0000 7f212bfff640 1 -- 172.21.15.70:0/651078335 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f213809feb0 con 0x55c1c80b7af0 2024-09-12T01:52:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.205+0000 7f2155a8a740 1 -- 172.21.15.70:0/651078335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21400035f0 con 0x55c1c80b7af0 2024-09-12T01:52:51.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f5524092740 1 -- 172.21.15.70:0/2841477387 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5508010000 con 0x55daee08aa00 2024-09-12T01:52:51.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f5524092740 1 -- 172.21.15.70:0/2841477387 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f550800eb90 con 0x55daee097f50 2024-09-12T01:52:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.205+0000 7f212bfff640 1 -- 172.21.15.70:0/651078335 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21380a8810 con 0x55c1c80b7af0 2024-09-12T01:52:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.205+0000 7f2155a8a740 10 client.15708 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.205+0000 7f2155a8a740 1 -- 172.21.15.70:0/651078335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1c8138260 con 0x55c1c80b7af0 2024-09-12T01:52:51.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f551bfff640 1 -- 172.21.15.70:0/2841477387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08aa00 msgr2=0x55daee091c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f551bfff640 1 --2- 172.21.15.70:0/2841477387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08aa00 0x55daee091c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f551bfff640 1 -- 172.21.15.70:0/2841477387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08b320 msgr2=0x55daee0b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f551bfff640 1 --2- 172.21.15.70:0/2841477387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08b320 0x55daee0b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f212bfff640 1 -- 172.21.15.70:0/651078335 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f21380a00b0 con 0x55c1c80b7af0 2024-09-12T01:52:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f212bfff640 1 -- 172.21.15.70:0/651078335 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f213809f0a0 con 0x55c1c80b7af0 2024-09-12T01:52:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f2155a8a740 10 client.15708 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f2155a8a740 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f2155a8a740 20 client.15708 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f2155a8a740 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c1c8138b60 0x55c1c813af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f2155a8a740 4 client.15708 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:52:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f2155a8a740 1 -- 172.21.15.70:0/651078335 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f21400035f0 con 0x55c1c8138b60 2024-09-12T01:52:51.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.204+0000 7f551bfff640 1 -- 172.21.15.70:0/2841477387 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daee093530 con 0x55daee097f50 2024-09-12T01:52:51.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.205+0000 7f551bfff640 1 --2- 172.21.15.70:0/2841477387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee097f50 0x55daee0b6680 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5514032c50 tx=0x7f551403d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9dd0be096fcc05b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:51.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.205+0000 7f55017fa640 1 -- 172.21.15.70:0/2841477387 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55140db070 con 0x55daee097f50 2024-09-12T01:52:51.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.205+0000 7f55017fa640 1 -- 172.21.15.70:0/2841477387 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5514036040 con 0x55daee097f50 2024-09-12T01:52:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f2150a87640 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c1c8138b60 0x55c1c813af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.205+0000 7f55017fa640 1 -- 172.21.15.70:0/2841477387 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55140453e0 con 0x55daee097f50 2024-09-12T01:52:51.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f5524092740 1 -- 172.21.15.70:0/2841477387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee097f50 msgr2=0x55daee0b6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f5524092740 1 --2- 172.21.15.70:0/2841477387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee097f50 0x55daee0b6680 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5514032c50 tx=0x7f551403d040 comp rx=0 tx=0).stop 2024-09-12T01:52:51.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f5524092740 1 -- 172.21.15.70:0/2841477387 shutdown_connections 2024-09-12T01:52:51.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f5524092740 1 --2- 172.21.15.70:0/2841477387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee097f50 0x55daee0b6680 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f5524092740 1 --2- 172.21.15.70:0/2841477387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08b320 0x55daee0b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f5524092740 1 --2- 172.21.15.70:0/2841477387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee08aa00 0x55daee091c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f5524092740 1 -- 172.21.15.70:0/2841477387 >> 172.21.15.70:0/2841477387 conn(0x55daee0870f0 msgr2=0x55daee0914f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:51.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f5524092740 1 -- 172.21.15.70:0/2841477387 shutdown_connections 2024-09-12T01:52:51.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f5524092740 1 -- 172.21.15.70:0/2841477387 wait complete. 2024-09-12T01:52:51.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.206+0000 7f5524092740 1 -- start start 2024-09-12T01:52:51.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.207+0000 7f5524092740 1 Processor -- start 2024-09-12T01:52:51.219 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.208+0000 7f2150a87640 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c1c8138b60 0x55c1c813af50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e39e3673c19c9380 server_cookie=501b6cce309c3650 in_seq=0 out_seq=0 2024-09-12T01:52:51.219 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.208+0000 7f212bfff640 10 client.15708 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:51.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.207+0000 7f5524092740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee08aa00 0x55daee0a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.207+0000 7f5524092740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08b320 0x55daee0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.207+0000 7f5524092740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee097f50 0x55daee0a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.207+0000 7f5524092740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f550800f930 con 0x55daee08b320 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.207+0000 7f5524092740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f550800f260 con 0x55daee097f50 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.207+0000 7f5524092740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f550800c480 con 0x55daee08aa00 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.207+0000 7f551affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08b320 0x55daee0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.207+0000 7f551affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08b320 0x55daee0a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38526/0 (socket says 172.21.15.70:38526) 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.207+0000 7f5524092740 10 client.0 _ll_register_callbacks cb 0x7f550c015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.207+0000 7f551affd640 1 -- 172.21.15.70:0/482751893 learned_addr learned my addr 172.21.15.70:0/482751893 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.207+0000 7f551b7fe640 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee08aa00 0x55daee0a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.208+0000 7f551bfff640 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee097f50 0x55daee0a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.208+0000 7f551affd640 1 -- 172.21.15.70:0/482751893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee08aa00 msgr2=0x55daee0a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.208+0000 7f551affd640 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee08aa00 0x55daee0a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.208+0000 7f551affd640 1 -- 172.21.15.70:0/482751893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee097f50 msgr2=0x55daee0a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.208+0000 7f551affd640 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee097f50 0x55daee0a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.208+0000 7f551affd640 1 -- 172.21.15.70:0/482751893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daee097c60 con 0x55daee08b320 2024-09-12T01:52:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.208+0000 7f551affd640 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08b320 0x55daee0a6260 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5510000c00 tx=0x7f55100047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d082aabb2326716c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.208+0000 7f54faffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.208+0000 7f54faffd640 1 -- 172.21.15.70:0/482751893 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510017040 con 0x55daee08b320 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f54faffd640 1 -- 172.21.15.70:0/482751893 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5510005bc0 con 0x55daee08b320 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f5524092740 1 -- 172.21.15.70:0/482751893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5514036040 con 0x55daee08b320 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f54faffd640 1 -- 172.21.15.70:0/482751893 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5510005dc0 con 0x55daee08b320 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f5524092740 10 client.15714 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f5524092740 1 -- 172.21.15.70:0/482751893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55daee0a31d0 con 0x55daee08b320 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f54faffd640 1 -- 172.21.15.70:0/482751893 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5514036040 con 0x55daee08b320 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f54faffd640 1 -- 172.21.15.70:0/482751893 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f55100064d0 con 0x55daee08b320 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f5524092740 10 client.15714 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f5524092740 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f5524092740 20 client.15714 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f5524092740 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55daee1220e0 0x55daee1244d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f5524092740 4 client.15714 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.209+0000 7f5524092740 1 -- 172.21.15.70:0/482751893 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55daedff7d00 con 0x55daee1220e0 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.210+0000 7f551b7fe640 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55daee1220e0 0x55daee1244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.211+0000 7f551b7fe640 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55daee1220e0 0x55daee1244d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96df340dd42a9c59 server_cookie=50f1612a6a802f69 in_seq=0 out_seq=0 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.211+0000 7f54faffd640 10 client.15714 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.212+0000 7f54faffd640 1 -- 172.21.15.70:0/482751893 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55daedff7d00 con 0x55daee1220e0 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.212+0000 7f54faffd640 10 client.15714 handle_command_reply: tid=0 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.212+0000 7f5524092740 1 client.15714 shutdown 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.213+0000 7f5524092740 1 -- 172.21.15.70:0/482751893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08b320 msgr2=0x55daee0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.213+0000 7f5524092740 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08b320 0x55daee0a6260 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5510000c00 tx=0x7f55100047d0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.213+0000 7f5524092740 1 -- 172.21.15.70:0/482751893 shutdown_connections 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.213+0000 7f5524092740 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55daee1220e0 0x55daee1244d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.213+0000 7f54faffd640 0 client.15714 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.213+0000 7f5524092740 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55daee097f50 0x55daee0a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.213+0000 7f5524092740 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daee08b320 0x55daee0a6260 secure :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5510000c00 tx=0x7f55100047d0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.213+0000 7f5524092740 1 --2- 172.21.15.70:0/482751893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55daee08aa00 0x55daee0a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.213+0000 7f5524092740 1 -- 172.21.15.70:0/482751893 >> 172.21.15.70:0/482751893 conn(0x55daee0870f0 msgr2=0x55daee091d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.214+0000 7f5524092740 1 -- 172.21.15.70:0/482751893 shutdown_connections 2024-09-12T01:52:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.214+0000 7f5524092740 1 -- 172.21.15.70:0/482751893 wait complete. 2024-09-12T01:52:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.214+0000 7f5524092740 20 client.15714 trim_cache size 0 max 16384 2024-09-12T01:52:51.226 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:52:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-12T01:52:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "b3f594df-966a-436c-a827-67a36ca6c323", 2024-09-12T01:52:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-12T01:52:51.227 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:52:51.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.215+0000 7f5521cb9640 1 -- 172.21.15.70:0/4226925835 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f55040a2c80 msgr2=0x7f55040a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.215+0000 7f5521cb9640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f55040a2c80 0x7f55040a5140 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f550c005fd0 tx=0x7f550c00b590 comp rx=0 tx=0).stop 2024-09-12T01:52:51.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.215+0000 7f5521cb9640 1 -- 172.21.15.70:0/4226925835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f551c106a70 msgr2=0x7f551c19bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.215+0000 7f5521cb9640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f551c106a70 0x7f551c19bb00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5514009ca0 tx=0x7f5514032be0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.215+0000 7f5521cb9640 1 -- 172.21.15.70:0/4226925835 shutdown_connections 2024-09-12T01:52:51.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.215+0000 7f5521cb9640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f55040a2c80 0x7f55040a5140 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.215+0000 7f5521cb9640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f551c106a70 0x7f551c19bb00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.215+0000 7f5521cb9640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f551c101410 0x7f551c197770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.215+0000 7f5521cb9640 1 --2- 172.21.15.70:0/4226925835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f551c100a70 0x7f551c197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.215+0000 7f5521cb9640 1 -- 172.21.15.70:0/4226925835 >> 172.21.15.70:0/4226925835 conn(0x7f551c0fc7d0 msgr2=0x7f551c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:51.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.215+0000 7f5521cb9640 1 -- 172.21.15.70:0/4226925835 shutdown_connections 2024-09-12T01:52:51.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:51.215+0000 7f5521cb9640 1 -- 172.21.15.70:0/4226925835 wait complete. 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.217+0000 7f212bfff640 1 -- 172.21.15.70:0/651078335 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f21400035f0 con 0x55c1c8138b60 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.217+0000 7f212bfff640 10 client.15708 handle_command_reply: tid=0 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.217+0000 7f2155a8a740 1 client.15708 shutdown 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.217+0000 7f2155a8a740 1 -- 172.21.15.70:0/651078335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b7af0 msgr2=0x55c1c80c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.217+0000 7f2155a8a740 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b7af0 0x55c1c80c6a70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f213809f950 tx=0x7f213809f850 comp rx=0 tx=0).stop 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.218+0000 7f2155a8a740 1 -- 172.21.15.70:0/651078335 shutdown_connections 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.218+0000 7f2155a8a740 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c1c8138b60 0x55c1c813af50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.218+0000 7f212bfff640 0 client.15708 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.218+0000 7f2155a8a740 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c1c80bcb80 0x55c1c80c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.218+0000 7f2155a8a740 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1c80b7af0 0x55c1c80c6a70 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.218+0000 7f2155a8a740 1 --2- 172.21.15.70:0/651078335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1c80b71b0 0x55c1c80c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.218+0000 7f2155a8a740 1 -- 172.21.15.70:0/651078335 >> 172.21.15.70:0/651078335 conn(0x55c1c80aa010 msgr2=0x55c1c80ab6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.218+0000 7f2155a8a740 1 -- 172.21.15.70:0/651078335 shutdown_connections 2024-09-12T01:52:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.218+0000 7f2155a8a740 1 -- 172.21.15.70:0/651078335 wait complete. 2024-09-12T01:52:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.218+0000 7f2155a8a740 20 client.15708 trim_cache size 0 max 16384 2024-09-12T01:52:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:52:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:52:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:52:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:52:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.219+0000 7f2152ceb640 1 -- 172.21.15.70:0/1498524083 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f213c0a2cb0 msgr2=0x7f213c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.219+0000 7f2152ceb640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f213c0a2cb0 0x7f213c0a5170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2144011890 tx=0x7f2144009500 comp rx=0 tx=0).stop 2024-09-12T01:52:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.219+0000 7f2152ceb640 1 -- 172.21.15.70:0/1498524083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f214c101c30 msgr2=0x7f214c198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.219+0000 7f2152ceb640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f214c101c30 0x7f214c198400 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2138009f40 tx=0x7f213800ee80 comp rx=0 tx=0).stop 2024-09-12T01:52:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.219+0000 7f2152ceb640 1 -- 172.21.15.70:0/1498524083 shutdown_connections 2024-09-12T01:52:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.219+0000 7f2152ceb640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f213c0a2cb0 0x7f213c0a5170 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.219+0000 7f2152ceb640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f214c1025f0 0x7f214c19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.219+0000 7f2152ceb640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f214c101c30 0x7f214c198400 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.219+0000 7f2152ceb640 1 --2- 172.21.15.70:0/1498524083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f214c100a40 0x7f214c197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.219+0000 7f2152ceb640 1 -- 172.21.15.70:0/1498524083 >> 172.21.15.70:0/1498524083 conn(0x7f214c0fc1e0 msgr2=0x7f214c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.219+0000 7f2152ceb640 1 -- 172.21.15.70:0/1498524083 shutdown_connections 2024-09-12T01:52:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:52:51.219+0000 7f2152ceb640 1 -- 172.21.15.70:0/1498524083 wait complete. 2024-09-12T01:52:51.978 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:52:52.267 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:52.664 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:52 smithi070 ceph-mon[31177]: scrub queued for path: / 2024-09-12T01:52:52.664 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:52 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:52:52.664 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:52 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:52:52.664 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:52 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:52:52.664 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:52 smithi070 ceph-mon[31177]: pgmap v358: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-12T01:52:52.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.792+0000 7f115fd86640 1 -- 172.21.15.70:0/1636261746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11581082a0 msgr2=0x7f115810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.792+0000 7f115fd86640 1 --2- 172.21.15.70:0/1636261746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11581082a0 0x7f115810ec40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1150009cd0 tx=0x7f115002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.792+0000 7f115fd86640 1 -- 172.21.15.70:0/1636261746 shutdown_connections 2024-09-12T01:52:52.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.792+0000 7f115fd86640 1 --2- 172.21.15.70:0/1636261746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11581082a0 0x7f115810ec40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.792+0000 7f115fd86640 1 --2- 172.21.15.70:0/1636261746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11581036e0 0x7f1158107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.792+0000 7f115fd86640 1 --2- 172.21.15.70:0/1636261746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1158102d30 0x7f1158103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.792+0000 7f115fd86640 1 -- 172.21.15.70:0/1636261746 >> 172.21.15.70:0/1636261746 conn(0x7f11580fc7d0 msgr2=0x7f11580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.792+0000 7f115fd86640 1 -- 172.21.15.70:0/1636261746 shutdown_connections 2024-09-12T01:52:52.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.792+0000 7f115fd86640 1 -- 172.21.15.70:0/1636261746 wait complete. 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.793+0000 7f115fd86640 1 Processor -- start 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.793+0000 7f115fd86640 1 -- start start 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.793+0000 7f115fd86640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1158102d30 0x7f1158198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.793+0000 7f115fd86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11581036e0 0x7f1158198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.793+0000 7f115fd86640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11581082a0 0x7f115819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.793+0000 7f115fd86640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f11581121c0 con 0x7f11581036e0 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.793+0000 7f115fd86640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1158112040 con 0x7f11581082a0 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.793+0000 7f115fd86640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1158112340 con 0x7f1158102d30 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.793+0000 7f115e323640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11581082a0 0x7f115819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.793+0000 7f115e323640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11581082a0 0x7f115819ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41454/0 (socket says 172.21.15.70:41454) 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.793+0000 7f115e323640 1 -- 172.21.15.70:0/1009487135 learned_addr learned my addr 172.21.15.70:0/1009487135 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.794+0000 7f115db22640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1158102d30 0x7f1158198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.794+0000 7f115d321640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11581036e0 0x7f1158198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.794+0000 7f115e323640 1 -- 172.21.15.70:0/1009487135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1158102d30 msgr2=0x7f1158198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.794+0000 7f115e323640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1158102d30 0x7f1158198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.794+0000 7f115e323640 1 -- 172.21.15.70:0/1009487135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11581036e0 msgr2=0x7f1158198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.794+0000 7f115e323640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11581036e0 0x7f1158198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.794+0000 7f115e323640 1 -- 172.21.15.70:0/1009487135 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115819d5b0 con 0x7f11581082a0 2024-09-12T01:52:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.794+0000 7f115d321640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11581036e0 0x7f1158198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.794+0000 7f115e323640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11581082a0 0x7f115819ced0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1150009ca0 tx=0x7f1150003ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.795+0000 7f114effd640 1 -- 172.21.15.70:0/1009487135 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150031bc0 con 0x7f11581082a0 2024-09-12T01:52:52.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.795+0000 7f114effd640 1 -- 172.21.15.70:0/1009487135 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1150031d60 con 0x7f11581082a0 2024-09-12T01:52:52.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.795+0000 7f114effd640 1 -- 172.21.15.70:0/1009487135 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150030b90 con 0x7f11581082a0 2024-09-12T01:52:52.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.795+0000 7f115fd86640 1 -- 172.21.15.70:0/1009487135 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115819d840 con 0x7f11581082a0 2024-09-12T01:52:52.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.795+0000 7f115fd86640 1 -- 172.21.15.70:0/1009487135 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f115819dcc0 con 0x7f11581082a0 2024-09-12T01:52:52.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.798+0000 7f116215f740 1 Processor -- start 2024-09-12T01:52:52.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.800+0000 7f114effd640 1 -- 172.21.15.70:0/1009487135 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f11500046b0 con 0x7f11581082a0 2024-09-12T01:52:52.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.800+0000 7f116215f740 1 -- start start 2024-09-12T01:52:52.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.800+0000 7f116215f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 0x560b3bad1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.800+0000 7f116215f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3badc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.801+0000 7f116215f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3badea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.801+0000 7f116215f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560b3ba372e0 con 0x560b3badc680 2024-09-12T01:52:52.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.801+0000 7f116215f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560b3b9dece0 con 0x560b3bad1dc0 2024-09-12T01:52:52.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.801+0000 7f116215f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560b3ba332a0 con 0x560b3bad14a0 2024-09-12T01:52:52.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.801+0000 7f114effd640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f11440a2c00 0x7f11440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.801+0000 7f115db22640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3badc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.801+0000 7f114effd640 1 -- 172.21.15.70:0/1009487135 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f115002e030 con 0x7f11581082a0 2024-09-12T01:52:52.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.801+0000 7f115db22640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3badc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41456/0 (socket says 172.21.15.70:41456) 2024-09-12T01:52:52.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.801+0000 7f115db22640 1 -- 172.21.15.70:0/186089704 learned_addr learned my addr 172.21.15.70:0/186089704 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:52.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.801+0000 7f115d321640 1 --2- 172.21.15.70:0/186089704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3badea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.802+0000 7f115e323640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f11440a2c00 0x7f11440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.802+0000 7f115db22640 1 -- 172.21.15.70:0/186089704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 msgr2=0x560b3bad1880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:52:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.802+0000 7f115db22640 1 --2- 172.21.15.70:0/186089704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 0x560b3bad1880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.802+0000 7f115db22640 1 -- 172.21.15.70:0/186089704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 msgr2=0x560b3badea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.802+0000 7f115db22640 1 --2- 172.21.15.70:0/186089704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3badea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.802+0000 7f115db22640 1 -- 172.21.15.70:0/186089704 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3b9c3440 con 0x560b3bad1dc0 2024-09-12T01:52:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.802+0000 7f115d321640 1 --2- 172.21.15.70:0/186089704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3badea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.803+0000 7f115e323640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f11440a2c00 0x7f11440a50c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f11500b8ce0 tx=0x7f115003d040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.803+0000 7f115db22640 1 --2- 172.21.15.70:0/186089704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3badc140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1154009cf0 tx=0x7f1154011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0b5caf17ba2a34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.803+0000 7f1143fff640 1 -- 172.21.15.70:0/186089704 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154004230 con 0x560b3bad1dc0 2024-09-12T01:52:52.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.803+0000 7f1143fff640 1 -- 172.21.15.70:0/186089704 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11540043d0 con 0x560b3bad1dc0 2024-09-12T01:52:52.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.803+0000 7f1143fff640 1 -- 172.21.15.70:0/186089704 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154019a10 con 0x560b3bad1dc0 2024-09-12T01:52:52.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.804+0000 7f116215f740 1 -- 172.21.15.70:0/186089704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 msgr2=0x560b3badc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.804+0000 7f116215f740 1 --2- 172.21.15.70:0/186089704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3badc140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1154009cf0 tx=0x7f1154011810 comp rx=0 tx=0).stop 2024-09-12T01:52:52.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.804+0000 7f116215f740 1 -- 172.21.15.70:0/186089704 shutdown_connections 2024-09-12T01:52:52.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.804+0000 7f116215f740 1 --2- 172.21.15.70:0/186089704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3badea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.804+0000 7f116215f740 1 --2- 172.21.15.70:0/186089704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3badc140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.804+0000 7f116215f740 1 --2- 172.21.15.70:0/186089704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 0x560b3bad1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.804+0000 7f116215f740 1 -- 172.21.15.70:0/186089704 >> 172.21.15.70:0/186089704 conn(0x560b3bacda30 msgr2=0x560b3bacde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.805+0000 7f116215f740 1 -- 172.21.15.70:0/186089704 shutdown_connections 2024-09-12T01:52:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.805+0000 7f116215f740 1 -- 172.21.15.70:0/186089704 wait complete. 2024-09-12T01:52:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.805+0000 7f116215f740 1 -- start start 2024-09-12T01:52:52.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.806+0000 7f116215f740 1 Processor -- start 2024-09-12T01:52:52.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.806+0000 7f116215f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 0x560b3badc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.806+0000 7f116215f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3bad9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.807+0000 7f116215f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3bad9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.807+0000 7f116215f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560b3badf250 con 0x560b3badc680 2024-09-12T01:52:52.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.807+0000 7f116215f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560b3b9f2050 con 0x560b3bad1dc0 2024-09-12T01:52:52.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.807+0000 7f116215f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560b3badf3d0 con 0x560b3bad14a0 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.807+0000 7f116215f740 10 client.0 _ll_register_callbacks cb 0x560b3ba32160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.807+0000 7f115db22640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3bad9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.807+0000 7f115db22640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3bad9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41462/0 (socket says 172.21.15.70:41462) 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.807+0000 7f115db22640 1 -- 172.21.15.70:0/1986914529 learned_addr learned my addr 172.21.15.70:0/1986914529 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.807+0000 7f115d321640 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3bad9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.808+0000 7f115db22640 1 -- 172.21.15.70:0/1986914529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 msgr2=0x560b3badc070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.808+0000 7f115db22640 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 0x560b3badc070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.808+0000 7f115db22640 1 -- 172.21.15.70:0/1986914529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 msgr2=0x560b3bad9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.808+0000 7f115db22640 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3bad9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.808+0000 7f115db22640 1 -- 172.21.15.70:0/1986914529 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3b7a83c0 con 0x560b3bad1dc0 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.808+0000 7f115d321640 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3bad9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.808+0000 7f115db22640 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3bad9320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f115401b040 tx=0x7f1154005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66cd02331f646d6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.808+0000 7f11417fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.808+0000 7f11417fa640 1 -- 172.21.15.70:0/1986914529 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154027070 con 0x560b3bad1dc0 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.809+0000 7f11417fa640 1 -- 172.21.15.70:0/1986914529 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f11540037f0 con 0x560b3bad1dc0 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.809+0000 7f116215f740 1 -- 172.21.15.70:0/1986914529 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11540043d0 con 0x560b3bad1dc0 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.809+0000 7f11417fa640 1 -- 172.21.15.70:0/1986914529 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1154033050 con 0x560b3bad1dc0 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.809+0000 7f116215f740 10 client.25151 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.809+0000 7f116215f740 1 -- 172.21.15.70:0/1986914529 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560b3baeace0 con 0x560b3bad1dc0 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.809+0000 7f11417fa640 1 -- 172.21.15.70:0/1986914529 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11540043d0 con 0x560b3bad1dc0 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.809+0000 7f11417fa640 1 -- 172.21.15.70:0/1986914529 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1154003a80 con 0x560b3bad1dc0 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.809+0000 7f116215f740 10 client.25151 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.809+0000 7f116215f740 10 client.25151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.810+0000 7f116215f740 20 client.25151 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.810+0000 7f116215f740 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560b3baec090 0x560b3baee480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.810+0000 7f116215f740 4 client.25151 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.810+0000 7f116215f740 1 -- 172.21.15.70:0/1986914529 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b3ba44850 con 0x560b3baec090 2024-09-12T01:52:52.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.810+0000 7f115d321640 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560b3baec090 0x560b3baee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.811+0000 7f11417fa640 10 client.25151 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.811+0000 7f115d321640 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560b3baec090 0x560b3baee480 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e32fab671088ef1 server_cookie=99928149dc84a676 in_seq=0 out_seq=0 2024-09-12T01:52:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.811+0000 7f11417fa640 1 -- 172.21.15.70:0/1986914529 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560b3ba44850 con 0x560b3baec090 2024-09-12T01:52:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.811+0000 7f11417fa640 10 client.25151 handle_command_reply: tid=0 2024-09-12T01:52:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.811+0000 7f116215f740 1 client.25151 shutdown 2024-09-12T01:52:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.812+0000 7f116215f740 1 -- 172.21.15.70:0/1986914529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 msgr2=0x560b3bad9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.812+0000 7f116215f740 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3bad9320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f115401b040 tx=0x7f1154005270 comp rx=0 tx=0).stop 2024-09-12T01:52:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.812+0000 7f116215f740 1 -- 172.21.15.70:0/1986914529 shutdown_connections 2024-09-12T01:52:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.812+0000 7f116215f740 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560b3baec090 0x560b3baee480 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.812+0000 7f11417fa640 0 client.25151 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.812+0000 7f116215f740 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3bad9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.812+0000 7f116215f740 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3bad9320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.812+0000 7f116215f740 1 --2- 172.21.15.70:0/1986914529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 0x560b3badc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.812+0000 7f116215f740 1 -- 172.21.15.70:0/1986914529 >> 172.21.15.70:0/1986914529 conn(0x560b3bacda30 msgr2=0x560b3bad3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.812+0000 7f116215f740 1 -- 172.21.15.70:0/1986914529 shutdown_connections 2024-09-12T01:52:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.812+0000 7f116215f740 1 -- 172.21.15.70:0/1986914529 wait complete. 2024-09-12T01:52:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.812+0000 7f116215f740 20 client.25151 trim_cache size 0 max 16384 2024-09-12T01:52:52.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.846+0000 7f116215f740 1 Processor -- start 2024-09-12T01:52:52.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.846+0000 7f116215f740 1 -- start start 2024-09-12T01:52:52.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.846+0000 7f116215f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad14a0 0x560b3bae84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.846+0000 7f116215f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad1dc0 0x560b3bacca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.846+0000 7f116215f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3baf3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.846+0000 7f116215f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f11581af900 con 0x560b3badc680 2024-09-12T01:52:52.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.846+0000 7f116215f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f11581b1440 con 0x560b3bad14a0 2024-09-12T01:52:52.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.846+0000 7f116215f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f11581affd0 con 0x560b3bad1dc0 2024-09-12T01:52:52.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.846+0000 7f115d321640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3baf3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.846+0000 7f115d321640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3baf3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38576/0 (socket says 172.21.15.70:38576) 2024-09-12T01:52:52.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.846+0000 7f115d321640 1 -- 172.21.15.70:0/698803558 learned_addr learned my addr 172.21.15.70:0/698803558 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:52.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.847+0000 7f115d321640 1 --2- 172.21.15.70:0/698803558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad14a0 0x560b3bae84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.847+0000 7f115d321640 1 -- 172.21.15.70:0/698803558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad1dc0 msgr2=0x560b3bacca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.847+0000 7f115d321640 1 --2- 172.21.15.70:0/698803558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad1dc0 0x560b3bacca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.847+0000 7f115d321640 1 -- 172.21.15.70:0/698803558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad14a0 msgr2=0x560b3bae84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.847+0000 7f115d321640 1 --2- 172.21.15.70:0/698803558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad14a0 0x560b3bae84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.847+0000 7f115d321640 1 -- 172.21.15.70:0/698803558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3badc3e0 con 0x560b3badc680 2024-09-12T01:52:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.847+0000 7f115d321640 1 --2- 172.21.15.70:0/698803558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3baf3c10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f11580697d0 tx=0x7f1148000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e191615698d92004 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.848+0000 7f11437fe640 1 -- 172.21.15.70:0/698803558 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1148003e50 con 0x560b3badc680 2024-09-12T01:52:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.848+0000 7f11437fe640 1 -- 172.21.15.70:0/698803558 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f114802a950 con 0x560b3badc680 2024-09-12T01:52:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.848+0000 7f11437fe640 1 -- 172.21.15.70:0/698803558 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114801e8b0 con 0x560b3badc680 2024-09-12T01:52:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.849+0000 7f116215f740 1 -- 172.21.15.70:0/698803558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 msgr2=0x560b3baf3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.849+0000 7f116215f740 1 --2- 172.21.15.70:0/698803558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3baf3c10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f11580697d0 tx=0x7f1148000bc0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.849+0000 7f116215f740 1 -- 172.21.15.70:0/698803558 shutdown_connections 2024-09-12T01:52:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.849+0000 7f116215f740 1 --2- 172.21.15.70:0/698803558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3baf3c10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.849+0000 7f116215f740 1 --2- 172.21.15.70:0/698803558 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad1dc0 0x560b3bacca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.849+0000 7f116215f740 1 --2- 172.21.15.70:0/698803558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad14a0 0x560b3bae84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.849+0000 7f116215f740 1 -- 172.21.15.70:0/698803558 >> 172.21.15.70:0/698803558 conn(0x560b3bacda30 msgr2=0x560b3bacc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.849+0000 7f116215f740 1 -- 172.21.15.70:0/698803558 shutdown_connections 2024-09-12T01:52:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.849+0000 7f116215f740 1 -- 172.21.15.70:0/698803558 wait complete. 2024-09-12T01:52:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.849+0000 7f116215f740 1 -- start start 2024-09-12T01:52:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f116215f740 1 Processor -- start 2024-09-12T01:52:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f116215f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 0x560b3bae4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f116215f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3bae0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f116215f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3bae09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f116215f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f11581b0d70 con 0x560b3badc680 2024-09-12T01:52:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f116215f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f11581b06a0 con 0x560b3bad1dc0 2024-09-12T01:52:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f116215f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f11581ad8e0 con 0x560b3bad14a0 2024-09-12T01:52:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f116215f740 10 client.0 _ll_register_callbacks cb 0x7f11480095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f115d321640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3bae09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f115d321640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3bae09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38584/0 (socket says 172.21.15.70:38584) 2024-09-12T01:52:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f115d321640 1 -- 172.21.15.70:0/2704853921 learned_addr learned my addr 172.21.15.70:0/2704853921 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:52.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f115db22640 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3bae0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.850+0000 7f115d321640 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 0x560b3bae4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f115d321640 1 -- 172.21.15.70:0/2704853921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 msgr2=0x560b3bae4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:52.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f115d321640 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 0x560b3bae4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f115d321640 1 -- 172.21.15.70:0/2704853921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 msgr2=0x560b3bae0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:52.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f115d321640 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3bae0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f115d321640 1 -- 172.21.15.70:0/2704853921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3bb66bf0 con 0x560b3badc680 2024-09-12T01:52:52.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f115d321640 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3bae09c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1148003750 tx=0x7f1148015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1008498860066d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f11417fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:52.855 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:52:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-12T01:52:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-12T01:52:52.855 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:52:52.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f11417fa640 1 -- 172.21.15.70:0/2704853921 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114803b020 con 0x560b3badc680 2024-09-12T01:52:52.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f116215f740 1 -- 172.21.15.70:0/2704853921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f114802a950 con 0x560b3badc680 2024-09-12T01:52:52.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f11417fa640 1 -- 172.21.15.70:0/2704853921 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1148013960 con 0x560b3badc680 2024-09-12T01:52:52.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f11417fa640 1 -- 172.21.15.70:0/2704853921 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1148013b60 con 0x560b3badc680 2024-09-12T01:52:52.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f116215f740 10 client.15732 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:52.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.851+0000 7f116215f740 1 -- 172.21.15.70:0/2704853921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560b3bb67d60 con 0x560b3badc680 2024-09-12T01:52:52.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.852+0000 7f11417fa640 1 -- 172.21.15.70:0/2704853921 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f114802a950 con 0x560b3badc680 2024-09-12T01:52:52.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.852+0000 7f11417fa640 1 -- 172.21.15.70:0/2704853921 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1148037610 con 0x560b3badc680 2024-09-12T01:52:52.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.852+0000 7f116215f740 10 client.15732 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:52.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.852+0000 7f116215f740 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:52:52.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.852+0000 7f116215f740 20 client.15732 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:52.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.852+0000 7f116215f740 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560b3bb68380 0x560b3bb6a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.852+0000 7f116215f740 4 client.15732 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:52:52.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.852+0000 7f116215f740 1 -- 172.21.15.70:0/2704853921 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560b3ba3ed60 con 0x560b3bb68380 2024-09-12T01:52:52.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.852+0000 7f115db22640 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560b3bb68380 0x560b3bb6a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f115db22640 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560b3bb68380 0x560b3bb6a7a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d2142dc90d4dad4 server_cookie=e806c81e8a6341b in_seq=0 out_seq=0 2024-09-12T01:52:52.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f11417fa640 10 client.15732 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:52.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f11417fa640 1 -- 172.21.15.70:0/2704853921 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560b3ba3ed60 con 0x560b3bb68380 2024-09-12T01:52:52.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f11417fa640 10 client.15732 handle_command_reply: tid=0 2024-09-12T01:52:52.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f116215f740 1 client.15732 shutdown 2024-09-12T01:52:52.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f116215f740 1 -- 172.21.15.70:0/2704853921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 msgr2=0x560b3bae09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f116215f740 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3bae09c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1148003750 tx=0x7f1148015040 comp rx=0 tx=0).stop 2024-09-12T01:52:52.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f116215f740 1 -- 172.21.15.70:0/2704853921 shutdown_connections 2024-09-12T01:52:52.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f116215f740 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560b3bb68380 0x560b3bb6a7a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f116215f740 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b3badc680 0x560b3bae09c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f11417fa640 0 client.15732 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:52:52.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f116215f740 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b3bad1dc0 0x560b3bae0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f116215f740 1 --2- 172.21.15.70:0/2704853921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3bad14a0 0x560b3bae4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f116215f740 1 -- 172.21.15.70:0/2704853921 >> 172.21.15.70:0/2704853921 conn(0x560b3bacda30 msgr2=0x560b3badab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f116215f740 1 -- 172.21.15.70:0/2704853921 shutdown_connections 2024-09-12T01:52:52.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.853+0000 7f116215f740 1 -- 172.21.15.70:0/2704853921 wait complete. 2024-09-12T01:52:52.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.854+0000 7f116215f740 20 client.15732 trim_cache size 0 max 16384 2024-09-12T01:52:52.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.854+0000 7f115fd86640 1 -- 172.21.15.70:0/1009487135 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f11440a2c00 msgr2=0x7f11440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.854+0000 7f115fd86640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f11440a2c00 0x7f11440a50c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f11500b8ce0 tx=0x7f115003d040 comp rx=0 tx=0).stop 2024-09-12T01:52:52.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.854+0000 7f115fd86640 1 -- 172.21.15.70:0/1009487135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11581082a0 msgr2=0x7f115819ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.854+0000 7f115fd86640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11581082a0 0x7f115819ced0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1150009ca0 tx=0x7f1150003ea0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.854+0000 7f115fd86640 1 -- 172.21.15.70:0/1009487135 shutdown_connections 2024-09-12T01:52:52.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.854+0000 7f115fd86640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f11440a2c00 0x7f11440a50c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.854+0000 7f115fd86640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11581082a0 0x7f115819ced0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.854+0000 7f115fd86640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11581036e0 0x7f1158198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.854+0000 7f115fd86640 1 --2- 172.21.15.70:0/1009487135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1158102d30 0x7f1158198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.854+0000 7f115fd86640 1 -- 172.21.15.70:0/1009487135 >> 172.21.15.70:0/1009487135 conn(0x7f11580fc7d0 msgr2=0x7f1158105ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.855+0000 7f115fd86640 1 -- 172.21.15.70:0/1009487135 shutdown_connections 2024-09-12T01:52:52.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:52.855+0000 7f115fd86640 1 -- 172.21.15.70:0/1009487135 wait complete. 2024-09-12T01:52:52.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:52 smithi191 ceph-mon[35770]: scrub queued for path: / 2024-09-12T01:52:52.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:52 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:52:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:52 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:52:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:52 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:52:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:52 smithi191 ceph-mon[35770]: pgmap v358: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-12T01:52:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:52 smithi152 ceph-mon[35055]: scrub queued for path: / 2024-09-12T01:52:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:52 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:52:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:52 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:52:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:52 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:52:53.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:52 smithi152 ceph-mon[35055]: pgmap v358: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-12T01:52:53.584 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:52:53.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:52:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:53 smithi191 ceph-mon[35770]: scrub summary: idle 2024-09-12T01:52:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:54.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:53 smithi152 ceph-mon[35055]: scrub summary: idle 2024-09-12T01:52:54.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:53 smithi070 ceph-mon[31177]: scrub summary: idle 2024-09-12T01:52:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.402+0000 7f4412c4b640 1 -- 172.21.15.70:0/2143449149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c103760 msgr2=0x7f440c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.402+0000 7f4412c4b640 1 --2- 172.21.15.70:0/2143449149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c103760 0x7f440c107ba0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009930 tx=0x7f43f802a420 comp rx=0 tx=0).stop 2024-09-12T01:52:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.402+0000 7f4412c4b640 1 -- 172.21.15.70:0/2143449149 shutdown_connections 2024-09-12T01:52:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.402+0000 7f4412c4b640 1 --2- 172.21.15.70:0/2143449149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c1082e0 0x7f440c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.402+0000 7f4412c4b640 1 --2- 172.21.15.70:0/2143449149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c103760 0x7f440c107ba0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.402+0000 7f4412c4b640 1 --2- 172.21.15.70:0/2143449149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f440c102db0 0x7f440c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.402+0000 7f4412c4b640 1 -- 172.21.15.70:0/2143449149 >> 172.21.15.70:0/2143449149 conn(0x7f440c0fc7d0 msgr2=0x7f440c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.402+0000 7f4412c4b640 1 -- 172.21.15.70:0/2143449149 shutdown_connections 2024-09-12T01:52:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.402+0000 7f4412c4b640 1 -- 172.21.15.70:0/2143449149 wait complete. 2024-09-12T01:52:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f4412c4b640 1 Processor -- start 2024-09-12T01:52:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f4412c4b640 1 -- start start 2024-09-12T01:52:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f4412c4b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f440c102db0 0x7f440c100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f4412c4b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c103760 0x7f440c100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f4412c4b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1082e0 0x7f440c101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f44109e7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f440c102db0 0x7f440c100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f4412c4b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f440c112220 con 0x7f440c1082e0 2024-09-12T01:52:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f4412c4b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f440c1120a0 con 0x7f440c102db0 2024-09-12T01:52:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f4412c4b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f440c1123a0 con 0x7f440c103760 2024-09-12T01:52:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f44111e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1082e0 0x7f440c101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f44109e7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f440c102db0 0x7f440c100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41500/0 (socket says 172.21.15.70:41500) 2024-09-12T01:52:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f44109e7640 1 -- 172.21.15.70:0/607225838 learned_addr learned my addr 172.21.15.70:0/607225838 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.403+0000 7f440bfff640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c103760 0x7f440c100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.404+0000 7f44109e7640 1 -- 172.21.15.70:0/607225838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c103760 msgr2=0x7f440c100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.404+0000 7f44109e7640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c103760 0x7f440c100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.404+0000 7f44109e7640 1 -- 172.21.15.70:0/607225838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1082e0 msgr2=0x7f440c101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.404+0000 7f44109e7640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1082e0 0x7f440c101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.404+0000 7f44109e7640 1 -- 172.21.15.70:0/607225838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c1a6b80 con 0x7f440c102db0 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.404+0000 7f44111e8640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1082e0 0x7f440c101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.404+0000 7f44109e7640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f440c102db0 0x7f440c100a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f440000d950 tx=0x7f440000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.404+0000 7f4409ffb640 1 -- 172.21.15.70:0/607225838 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400017070 con 0x7f440c102db0 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.404+0000 7f4409ffb640 1 -- 172.21.15.70:0/607225838 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4400009c30 con 0x7f440c102db0 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.404+0000 7f4412c4b640 1 -- 172.21.15.70:0/607225838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440c1a6e70 con 0x7f440c102db0 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.404+0000 7f4409ffb640 1 -- 172.21.15.70:0/607225838 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440000f740 con 0x7f440c102db0 2024-09-12T01:52:54.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.405+0000 7f4412c4b640 1 -- 172.21.15.70:0/607225838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440c1a7210 con 0x7f440c102db0 2024-09-12T01:52:54.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.406+0000 7f4412c4b640 1 -- 172.21.15.70:0/607225838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440c103190 con 0x7f440c102db0 2024-09-12T01:52:54.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.407+0000 7f4409ffb640 1 -- 172.21.15.70:0/607225838 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4400010a80 con 0x7f440c102db0 2024-09-12T01:52:54.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.407+0000 7f4409ffb640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f43fc0a2b80 0x7f43fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:54.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.408+0000 7f440bfff640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f43fc0a2b80 0x7f43fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:54.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.408+0000 7f4409ffb640 1 -- 172.21.15.70:0/607225838 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f44000cefb0 con 0x7f440c102db0 2024-09-12T01:52:54.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.408+0000 7f440bfff640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f43fc0a2b80 0x7f43fc0a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f43f802a940 tx=0x7f43f8000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:54.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.411+0000 7f4409ffb640 1 -- 172.21.15.70:0/607225838 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4400009de0 con 0x7f440c102db0 2024-09-12T01:52:54.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.623+0000 7f4412c4b640 1 -- 172.21.15.70:0/607225838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f440c101f40 con 0x7f440c102db0 2024-09-12T01:52:54.625 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:52:54.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.623+0000 7f4409ffb640 1 -- 172.21.15.70:0/607225838 <== mon.2 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f440009bf10 con 0x7f440c102db0 2024-09-12T01:52:54.625 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-12T01:51:51:564560+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:51:51.387340+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24427,24433,24437,24445,24452]},"id":1}]} 2024-09-12T01:52:54.626 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-12T01:52:54.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.626+0000 7f4412c4b640 1 -- 172.21.15.70:0/607225838 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f43fc0a2b80 msgr2=0x7f43fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:54.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.626+0000 7f4412c4b640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f43fc0a2b80 0x7f43fc0a5040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f43f802a940 tx=0x7f43f8000bc0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.626+0000 7f4412c4b640 1 -- 172.21.15.70:0/607225838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f440c102db0 msgr2=0x7f440c100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:54.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.626+0000 7f4412c4b640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f440c102db0 0x7f440c100a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f440000d950 tx=0x7f440000de10 comp rx=0 tx=0).stop 2024-09-12T01:52:54.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.626+0000 7f4412c4b640 1 -- 172.21.15.70:0/607225838 shutdown_connections 2024-09-12T01:52:54.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.626+0000 7f4412c4b640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f43fc0a2b80 0x7f43fc0a5040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.626+0000 7f4412c4b640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440c1082e0 0x7f440c101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.626+0000 7f4412c4b640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f440c103760 0x7f440c100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.626+0000 7f4412c4b640 1 --2- 172.21.15.70:0/607225838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f440c102db0 0x7f440c100a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.626+0000 7f4412c4b640 1 -- 172.21.15.70:0/607225838 >> 172.21.15.70:0/607225838 conn(0x7f440c0fc7d0 msgr2=0x7f440c105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.627+0000 7f4412c4b640 1 -- 172.21.15.70:0/607225838 shutdown_connections 2024-09-12T01:52:54.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:54.627+0000 7f4412c4b640 1 -- 172.21.15.70:0/607225838 wait complete. 2024-09-12T01:52:54.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:54 smithi191 ceph-mon[35770]: pgmap v359: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:52:55.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:54 smithi152 ceph-mon[35055]: pgmap v359: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:52:55.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:54 smithi070 ceph-mon[31177]: pgmap v359: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:52:55.468 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:52:55.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:55 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/607225838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:55.857 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:55.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:55 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/607225838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:56.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:55 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/607225838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:52:56.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.397+0000 7f4f33eb7640 1 -- 172.21.15.70:0/2053642658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f2c102ef0 msgr2=0x7f4f2c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:56.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.397+0000 7f4f33eb7640 1 --2- 172.21.15.70:0/2053642658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f2c102ef0 0x7f4f2c10da40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009ca0 tx=0x7f4f2402a950 comp rx=0 tx=0).stop 2024-09-12T01:52:56.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.397+0000 7f4f33eb7640 1 -- 172.21.15.70:0/2053642658 shutdown_connections 2024-09-12T01:52:56.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.397+0000 7f4f33eb7640 1 --2- 172.21.15.70:0/2053642658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f2c102ef0 0x7f4f2c10da40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.397+0000 7f4f33eb7640 1 --2- 172.21.15.70:0/2053642658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f2c102570 0x7f4f2c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.397+0000 7f4f33eb7640 1 --2- 172.21.15.70:0/2053642658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c100e20 0x7f4f2c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.397+0000 7f4f33eb7640 1 -- 172.21.15.70:0/2053642658 >> 172.21.15.70:0/2053642658 conn(0x7f4f2c0fc7d0 msgr2=0x7f4f2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.398+0000 7f4f33eb7640 1 -- 172.21.15.70:0/2053642658 shutdown_connections 2024-09-12T01:52:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.398+0000 7f4f33eb7640 1 -- 172.21.15.70:0/2053642658 wait complete. 2024-09-12T01:52:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.398+0000 7f4f33eb7640 1 Processor -- start 2024-09-12T01:52:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.398+0000 7f4f33eb7640 1 -- start start 2024-09-12T01:52:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.399+0000 7f4f33eb7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f2c100e20 0x7f4f2c1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.399+0000 7f4f33eb7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c102570 0x7f4f2c198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.399+0000 7f4f33eb7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f2c102ef0 0x7f4f2c19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.399+0000 7f4f33eb7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c1110f0 con 0x7f4f2c102ef0 2024-09-12T01:52:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.399+0000 7f4f31452640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c102570 0x7f4f2c198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.399+0000 7f4f31452640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c102570 0x7f4f2c198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41512/0 (socket says 172.21.15.70:41512) 2024-09-12T01:52:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.399+0000 7f4f31452640 1 -- 172.21.15.70:0/1632825853 learned_addr learned my addr 172.21.15.70:0/1632825853 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.399+0000 7f4f32454640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f2c102ef0 0x7f4f2c19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.399+0000 7f4f31c53640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f2c100e20 0x7f4f2c1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.399+0000 7f4f33eb7640 1 -- 172.21.15.70:0/1632825853 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c110f70 con 0x7f4f2c102570 2024-09-12T01:52:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.399+0000 7f4f33eb7640 1 -- 172.21.15.70:0/1632825853 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c111270 con 0x7f4f2c100e20 2024-09-12T01:52:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.400+0000 7f4f32454640 1 -- 172.21.15.70:0/1632825853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f2c100e20 msgr2=0x7f4f2c1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.400+0000 7f4f32454640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f2c100e20 0x7f4f2c1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.400+0000 7f4f32454640 1 -- 172.21.15.70:0/1632825853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c102570 msgr2=0x7f4f2c198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.400+0000 7f4f32454640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c102570 0x7f4f2c198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.400+0000 7f4f32454640 1 -- 172.21.15.70:0/1632825853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2c19d580 con 0x7f4f2c102ef0 2024-09-12T01:52:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.400+0000 7f4f31c53640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f2c100e20 0x7f4f2c1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.400+0000 7f4f32454640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f2c102ef0 0x7f4f2c19cea0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4f2402af40 tx=0x7f4f2402fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.400+0000 7f4f22ffd640 1 -- 172.21.15.70:0/1632825853 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24034040 con 0x7f4f2c102ef0 2024-09-12T01:52:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.400+0000 7f4f33eb7640 1 -- 172.21.15.70:0/1632825853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2c19d810 con 0x7f4f2c102ef0 2024-09-12T01:52:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.400+0000 7f4f22ffd640 1 -- 172.21.15.70:0/1632825853 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f24030940 con 0x7f4f2c102ef0 2024-09-12T01:52:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.401+0000 7f4f33eb7640 1 -- 172.21.15.70:0/1632825853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2c107a10 con 0x7f4f2c102ef0 2024-09-12T01:52:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.401+0000 7f4f22ffd640 1 -- 172.21.15.70:0/1632825853 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24004830 con 0x7f4f2c102ef0 2024-09-12T01:52:56.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.403+0000 7f4f36290740 1 Processor -- start 2024-09-12T01:52:56.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.404+0000 7f4f22ffd640 1 -- 172.21.15.70:0/1632825853 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4f24037020 con 0x7f4f2c102ef0 2024-09-12T01:52:56.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.404+0000 7f4f36290740 1 -- start start 2024-09-12T01:52:56.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f36290740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258cb40 0x563a6258b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f36290740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a6258ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f36290740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62596370 0x563a62598760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f36290740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563a624f12f0 con 0x563a62596370 2024-09-12T01:52:56.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f36290740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563a62498cf0 con 0x563a6258b5d0 2024-09-12T01:52:56.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f36290740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563a624ed2b0 con 0x563a6258cb40 2024-09-12T01:52:56.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f31452640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62596370 0x563a62598760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f31452640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62596370 0x563a62598760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38612/0 (socket says 172.21.15.70:38612) 2024-09-12T01:52:56.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f31452640 1 -- 172.21.15.70:0/2946237696 learned_addr learned my addr 172.21.15.70:0/2946237696 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:56.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f31452640 1 --2- 172.21.15.70:0/2946237696 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258cb40 0x563a6258b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f31c53640 1 --2- 172.21.15.70:0/2946237696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a6258ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f31452640 1 -- 172.21.15.70:0/2946237696 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258cb40 msgr2=0x563a6258b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:56.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f31452640 1 --2- 172.21.15.70:0/2946237696 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258cb40 0x563a6258b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f31452640 1 -- 172.21.15.70:0/2946237696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 msgr2=0x563a6258ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:56.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f31452640 1 --2- 172.21.15.70:0/2946237696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a6258ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.405+0000 7f4f31452640 1 -- 172.21.15.70:0/2946237696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a6247d3a0 con 0x563a62596370 2024-09-12T01:52:56.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.406+0000 7f4f22ffd640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4f180a2c00 0x7f4f180a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.406+0000 7f4f31c53640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4f180a2c00 0x7f4f180a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.406+0000 7f4f22ffd640 1 -- 172.21.15.70:0/1632825853 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4f240ef940 con 0x7f4f2c102ef0 2024-09-12T01:52:56.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.406+0000 7f4f31452640 1 --2- 172.21.15.70:0/2946237696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62596370 0x563a62598760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0118a0 tx=0x7f4f1c009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef52589a512873c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.407+0000 7f4f31c53640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4f180a2c00 0x7f4f180a50c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800ffd0 tx=0x7f4f28011040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.407+0000 7f4f17fff640 1 -- 172.21.15.70:0/2946237696 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c00f7c0 con 0x563a62596370 2024-09-12T01:52:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.407+0000 7f4f17fff640 1 -- 172.21.15.70:0/2946237696 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f1c00fe60 con 0x563a62596370 2024-09-12T01:52:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.407+0000 7f4f17fff640 1 -- 172.21.15.70:0/2946237696 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c00e3b0 con 0x563a62596370 2024-09-12T01:52:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.408+0000 7f4f36290740 1 -- 172.21.15.70:0/2946237696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62596370 msgr2=0x563a62598760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.408+0000 7f4f36290740 1 --2- 172.21.15.70:0/2946237696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62596370 0x563a62598760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0118a0 tx=0x7f4f1c009590 comp rx=0 tx=0).stop 2024-09-12T01:52:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.408+0000 7f4f36290740 1 -- 172.21.15.70:0/2946237696 shutdown_connections 2024-09-12T01:52:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.408+0000 7f4f36290740 1 --2- 172.21.15.70:0/2946237696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62596370 0x563a62598760 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.408+0000 7f4f36290740 1 --2- 172.21.15.70:0/2946237696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a6258ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.408+0000 7f4f36290740 1 --2- 172.21.15.70:0/2946237696 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258cb40 0x563a6258b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.408+0000 7f4f36290740 1 -- 172.21.15.70:0/2946237696 >> 172.21.15.70:0/2946237696 conn(0x563a62554310 msgr2=0x563a62587c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.408+0000 7f4f36290740 1 -- 172.21.15.70:0/2946237696 shutdown_connections 2024-09-12T01:52:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.408+0000 7f4f36290740 1 -- 172.21.15.70:0/2946237696 wait complete. 2024-09-12T01:52:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.409+0000 7f4f36290740 1 -- start start 2024-09-12T01:52:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.409+0000 7f4f36290740 1 Processor -- start 2024-09-12T01:52:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.409+0000 7f4f36290740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258b5d0 0x563a62593240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.409+0000 7f4f36290740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258cb40 0x563a62593780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.409+0000 7f4f36290740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62593cc0 0x563a625aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f32454640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62593cc0 0x563a625aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f31c53640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258b5d0 0x563a62593240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f32454640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62593cc0 0x563a625aadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38616/0 (socket says 172.21.15.70:38616) 2024-09-12T01:52:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f32454640 1 -- 172.21.15.70:0/3315366864 learned_addr learned my addr 172.21.15.70:0/3315366864 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f36290740 1 -- 172.21.15.70:0/3315366864 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563a62599070 con 0x563a62593cc0 2024-09-12T01:52:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f36290740 1 -- 172.21.15.70:0/3315366864 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563a624ac060 con 0x563a6258cb40 2024-09-12T01:52:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f36290740 1 -- 172.21.15.70:0/3315366864 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563a625991f0 con 0x563a6258b5d0 2024-09-12T01:52:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f31452640 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258cb40 0x563a62593780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f36290740 10 client.0 _ll_register_callbacks cb 0x563a621ff8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:56.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f31452640 1 -- 172.21.15.70:0/3315366864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258b5d0 msgr2=0x563a62593240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:56.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f31452640 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258b5d0 0x563a62593240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f31452640 1 -- 172.21.15.70:0/3315366864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62593cc0 msgr2=0x563a625aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f31452640 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62593cc0 0x563a625aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f31452640 1 -- 172.21.15.70:0/3315366864 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a622623c0 con 0x563a6258cb40 2024-09-12T01:52:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f32454640 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62593cc0 0x563a625aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.410+0000 7f4f31c53640 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258b5d0 0x563a62593240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.411+0000 7f4f31452640 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258cb40 0x563a62593780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x563a6258cfb0 tx=0x7f4f1c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff45148c23a49b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:56.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.411+0000 7f4f157fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-12T01:52:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.411+0000 7f4f157fa640 1 -- 172.21.15.70:0/3315366864 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c00f790 con 0x563a6258cb40 2024-09-12T01:52:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.411+0000 7f4f36290740 1 -- 172.21.15.70:0/3315366864 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f1c00fe60 con 0x563a6258cb40 2024-09-12T01:52:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.411+0000 7f4f157fa640 1 -- 172.21.15.70:0/3315366864 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4f1c00f930 con 0x563a6258cb40 2024-09-12T01:52:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.411+0000 7f4f157fa640 1 -- 172.21.15.70:0/3315366864 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f1c00fb30 con 0x563a6258cb40 2024-09-12T01:52:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.411+0000 7f4f36290740 10 client.25175 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.411+0000 7f4f36290740 1 -- 172.21.15.70:0/3315366864 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563a625ad990 con 0x563a6258cb40 2024-09-12T01:52:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.412+0000 7f4f157fa640 1 -- 172.21.15.70:0/3315366864 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f1c00fe60 con 0x563a6258cb40 2024-09-12T01:52:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.412+0000 7f4f157fa640 1 -- 172.21.15.70:0/3315366864 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4f1c027070 con 0x563a6258cb40 2024-09-12T01:52:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.412+0000 7f4f36290740 10 client.25175 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.412+0000 7f4f36290740 10 client.25175 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T01:52:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.412+0000 7f4f36290740 20 client.25175 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.412+0000 7f4f36290740 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x563a625aece0 0x563a625b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.412+0000 7f4f36290740 4 client.25175 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.412+0000 7f4f36290740 1 -- 172.21.15.70:0/3315366864 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a624fe860 con 0x563a625aece0 2024-09-12T01:52:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.412+0000 7f4f31c53640 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x563a625aece0 0x563a625b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.413+0000 7f4f31c53640 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x563a625aece0 0x563a625b10d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d987a8bacc91e6ad server_cookie=3d2f8d66051ad38b in_seq=0 out_seq=0 2024-09-12T01:52:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.413+0000 7f4f157fa640 10 client.25175 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:52:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.413+0000 7f4f157fa640 1 -- 172.21.15.70:0/3315366864 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a624fe860 con 0x563a625aece0 2024-09-12T01:52:56.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.413+0000 7f4f157fa640 10 client.25175 handle_command_reply: tid=0 2024-09-12T01:52:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f36290740 1 client.25175 shutdown 2024-09-12T01:52:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f36290740 1 -- 172.21.15.70:0/3315366864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258cb40 msgr2=0x563a62593780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f36290740 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258cb40 0x563a62593780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x563a6258cfb0 tx=0x7f4f1c005fd0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f36290740 1 -- 172.21.15.70:0/3315366864 shutdown_connections 2024-09-12T01:52:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f36290740 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x563a625aece0 0x563a625b10d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f36290740 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62593cc0 0x563a625aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f36290740 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258cb40 0x563a62593780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f36290740 1 --2- 172.21.15.70:0/3315366864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258b5d0 0x563a62593240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f36290740 1 -- 172.21.15.70:0/3315366864 >> 172.21.15.70:0/3315366864 conn(0x563a62554310 msgr2=0x563a6258d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f157fa640 0 client.25175 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:52:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f36290740 1 -- 172.21.15.70:0/3315366864 shutdown_connections 2024-09-12T01:52:56.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f36290740 1 -- 172.21.15.70:0/3315366864 wait complete. 2024-09-12T01:52:56.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.414+0000 7f4f36290740 20 client.25175 trim_cache size 0 max 16384 2024-09-12T01:52:56.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.427+0000 7f4f36290740 1 Processor -- start 2024-09-12T01:52:56.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.427+0000 7f4f36290740 1 -- start start 2024-09-12T01:52:56.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.427+0000 7f4f36290740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62554310 0x563a625951b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.427+0000 7f4f36290740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a62597760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.427+0000 7f4f36290740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258cb40 0x563a62597ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f36290740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1000e4a0 con 0x563a62554310 2024-09-12T01:52:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f36290740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1000ffe0 con 0x563a6258b5d0 2024-09-12T01:52:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f36290740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1000eb70 con 0x563a6258cb40 2024-09-12T01:52:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f31c53640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62554310 0x563a625951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f31c53640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62554310 0x563a625951b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38618/0 (socket says 172.21.15.70:38618) 2024-09-12T01:52:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f31c53640 1 -- 172.21.15.70:0/859408025 learned_addr learned my addr 172.21.15.70:0/859408025 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f31452640 1 --2- 172.21.15.70:0/859408025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a62597760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f32454640 1 --2- 172.21.15.70:0/859408025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258cb40 0x563a62597ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f31c53640 1 -- 172.21.15.70:0/859408025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258cb40 msgr2=0x563a62597ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f31c53640 1 --2- 172.21.15.70:0/859408025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258cb40 0x563a62597ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f31c53640 1 -- 172.21.15.70:0/859408025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 msgr2=0x563a62597760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f31c53640 1 --2- 172.21.15.70:0/859408025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a62597760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f31c53640 1 -- 172.21.15.70:0/859408025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a6258c3a0 con 0x563a62554310 2024-09-12T01:52:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f32454640 1 --2- 172.21.15.70:0/859408025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258cb40 0x563a62597ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f31c53640 1 --2- 172.21.15.70:0/859408025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62554310 0x563a625951b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800ff90 tx=0x7f4f28019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd0a90e50d6bba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.428+0000 7f4f177fe640 1 -- 172.21.15.70:0/859408025 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2802c070 con 0x563a62554310 2024-09-12T01:52:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.429+0000 7f4f177fe640 1 -- 172.21.15.70:0/859408025 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f28008e60 con 0x563a62554310 2024-09-12T01:52:56.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.429+0000 7f4f177fe640 1 -- 172.21.15.70:0/859408025 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f28022040 con 0x563a62554310 2024-09-12T01:52:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.429+0000 7f4f36290740 1 -- 172.21.15.70:0/859408025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62554310 msgr2=0x563a625951b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.429+0000 7f4f36290740 1 --2- 172.21.15.70:0/859408025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62554310 0x563a625951b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800ff90 tx=0x7f4f28019000 comp rx=0 tx=0).stop 2024-09-12T01:52:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.429+0000 7f4f36290740 1 -- 172.21.15.70:0/859408025 shutdown_connections 2024-09-12T01:52:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.429+0000 7f4f36290740 1 --2- 172.21.15.70:0/859408025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a6258cb40 0x563a62597ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.429+0000 7f4f36290740 1 --2- 172.21.15.70:0/859408025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a62597760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.429+0000 7f4f36290740 1 --2- 172.21.15.70:0/859408025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a62554310 0x563a625951b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.430+0000 7f4f36290740 1 -- 172.21.15.70:0/859408025 >> 172.21.15.70:0/859408025 conn(0x563a625938e0 msgr2=0x563a62594aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.430+0000 7f4f36290740 1 -- 172.21.15.70:0/859408025 shutdown_connections 2024-09-12T01:52:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.430+0000 7f4f36290740 1 -- 172.21.15.70:0/859408025 wait complete. 2024-09-12T01:52:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.430+0000 7f4f36290740 1 -- start start 2024-09-12T01:52:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.430+0000 7f4f36290740 1 Processor -- start 2024-09-12T01:52:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.431+0000 7f4f36290740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a62554310 0x563a625a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.431+0000 7f4f36290740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a6258d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.431+0000 7f4f36290740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a6258cb40 0x563a6258dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.431+0000 7f4f36290740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1000f910 con 0x563a6258cb40 2024-09-12T01:52:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.431+0000 7f4f36290740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1000f240 con 0x563a6258b5d0 2024-09-12T01:52:56.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.431+0000 7f4f36290740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1000c460 con 0x563a62554310 2024-09-12T01:52:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.431+0000 7f4f31c53640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a62554310 0x563a625a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.431+0000 7f4f31c53640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a62554310 0x563a625a71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:51580/0 (socket says 172.21.15.70:51580) 2024-09-12T01:52:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.431+0000 7f4f31c53640 1 -- 172.21.15.70:0/2776787286 learned_addr learned my addr 172.21.15.70:0/2776787286 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.431+0000 7f4f32454640 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a6258cb40 0x563a6258dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.431+0000 7f4f31452640 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a6258d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.431+0000 7f4f36290740 10 client.0 _ll_register_callbacks cb 0x7f4f1c0117a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.432+0000 7f4f31452640 1 -- 172.21.15.70:0/2776787286 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a62554310 msgr2=0x563a625a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:56.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.432+0000 7f4f31452640 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a62554310 0x563a625a71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.432+0000 7f4f31452640 1 -- 172.21.15.70:0/2776787286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a6258cb40 msgr2=0x563a6258dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.432+0000 7f4f31452640 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a6258cb40 0x563a6258dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.432+0000 7f4f31452640 1 -- 172.21.15.70:0/2776787286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a6258e160 con 0x563a6258b5d0 2024-09-12T01:52:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.432+0000 7f4f31c53640 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a62554310 0x563a625a71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.432+0000 7f4f31452640 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a6258d6e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0098a0 tx=0x7f4f1c009d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8323de0342fc07ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.432+0000 7f4f157fa640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-12T01:52:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.432+0000 7f4f157fa640 1 -- 172.21.15.70:0/2776787286 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c038030 con 0x563a6258b5d0 2024-09-12T01:52:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.432+0000 7f4f157fa640 1 -- 172.21.15.70:0/2776787286 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4f1c00f790 con 0x563a6258b5d0 2024-09-12T01:52:56.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.432+0000 7f4f36290740 1 -- 172.21.15.70:0/2776787286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f28008e60 con 0x563a6258b5d0 2024-09-12T01:52:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.433+0000 7f4f157fa640 1 -- 172.21.15.70:0/2776787286 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f1c00f990 con 0x563a6258b5d0 2024-09-12T01:52:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.433+0000 7f4f36290740 10 client.25181 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.433+0000 7f4f36290740 1 -- 172.21.15.70:0/2776787286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563a625a5a80 con 0x563a6258b5d0 2024-09-12T01:52:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.433+0000 7f4f157fa640 1 -- 172.21.15.70:0/2776787286 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f28008e60 con 0x563a6258b5d0 2024-09-12T01:52:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.434+0000 7f4f157fa640 1 -- 172.21.15.70:0/2776787286 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4f1c027040 con 0x563a6258b5d0 2024-09-12T01:52:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.434+0000 7f4f36290740 10 client.25181 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.434+0000 7f4f36290740 10 client.25181 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T01:52:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.434+0000 7f4f36290740 20 client.25181 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:56.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.434+0000 7f4f36290740 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x563a62593cc0 0x563a6261bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.434+0000 7f4f36290740 4 client.25181 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.434+0000 7f4f36290740 1 -- 172.21.15.70:0/2776787286 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563a624f8d70 con 0x563a62593cc0 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.435+0000 7f4f31c53640 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x563a62593cc0 0x563a6261bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.435+0000 7f4f31c53640 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x563a62593cc0 0x563a6261bbf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=33951cb5b6cc26d2 server_cookie=332c86f713f02030 in_seq=0 out_seq=0 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.435+0000 7f4f157fa640 10 client.25181 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.435+0000 7f4f157fa640 1 -- 172.21.15.70:0/2776787286 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563a624f8d70 con 0x563a62593cc0 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.435+0000 7f4f157fa640 10 client.25181 handle_command_reply: tid=0 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.435+0000 7f4f36290740 1 client.25181 shutdown 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.435+0000 7f4f36290740 1 -- 172.21.15.70:0/2776787286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 msgr2=0x563a6258d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.435+0000 7f4f36290740 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a6258d6e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0098a0 tx=0x7f4f1c009d60 comp rx=0 tx=0).stop 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.436+0000 7f4f36290740 1 -- 172.21.15.70:0/2776787286 shutdown_connections 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.436+0000 7f4f36290740 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x563a62593cc0 0x563a6261bbf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.436+0000 7f4f36290740 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563a6258cb40 0x563a6258dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.436+0000 7f4f36290740 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563a6258b5d0 0x563a6258d6e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.436+0000 7f4f36290740 1 --2- 172.21.15.70:0/2776787286 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563a62554310 0x563a625a71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.436+0000 7f4f36290740 1 -- 172.21.15.70:0/2776787286 >> 172.21.15.70:0/2776787286 conn(0x563a625938e0 msgr2=0x563a625952c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:56.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.436+0000 7f4f157fa640 0 client.25181 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:52:56.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.436+0000 7f4f36290740 1 -- 172.21.15.70:0/2776787286 shutdown_connections 2024-09-12T01:52:56.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.436+0000 7f4f36290740 1 -- 172.21.15.70:0/2776787286 wait complete. 2024-09-12T01:52:56.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.436+0000 7f4f36290740 20 client.25181 trim_cache size 0 max 16384 2024-09-12T01:52:56.440 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:52:56.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.436+0000 7f4f33eb7640 1 -- 172.21.15.70:0/1632825853 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4f180a2c00 msgr2=0x7f4f180a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:56.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.437+0000 7f4f33eb7640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4f180a2c00 0x7f4f180a50c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800ffd0 tx=0x7f4f28011040 comp rx=0 tx=0).stop 2024-09-12T01:52:56.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.437+0000 7f4f33eb7640 1 -- 172.21.15.70:0/1632825853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f2c102ef0 msgr2=0x7f4f2c19cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:56.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.437+0000 7f4f33eb7640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f2c102ef0 0x7f4f2c19cea0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4f2402af40 tx=0x7f4f2402fd60 comp rx=0 tx=0).stop 2024-09-12T01:52:56.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.437+0000 7f4f33eb7640 1 -- 172.21.15.70:0/1632825853 shutdown_connections 2024-09-12T01:52:56.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.437+0000 7f4f33eb7640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f4f180a2c00 0x7f4f180a50c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.437+0000 7f4f33eb7640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f2c102ef0 0x7f4f2c19cea0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.437+0000 7f4f33eb7640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f2c102570 0x7f4f2c198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.437+0000 7f4f33eb7640 1 --2- 172.21.15.70:0/1632825853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f2c100e20 0x7f4f2c1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:56.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.437+0000 7f4f33eb7640 1 -- 172.21.15.70:0/1632825853 >> 172.21.15.70:0/1632825853 conn(0x7f4f2c0fc7d0 msgr2=0x7f4f2c103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:56.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.437+0000 7f4f33eb7640 1 -- 172.21.15.70:0/1632825853 shutdown_connections 2024-09-12T01:52:56.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:56.437+0000 7f4f33eb7640 1 -- 172.21.15.70:0/1632825853 wait complete. 2024-09-12T01:52:56.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:56 smithi191 ceph-mon[35770]: pgmap v360: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-12T01:52:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:56 smithi152 ceph-mon[35055]: pgmap v360: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-12T01:52:57.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:56 smithi070 ceph-mon[31177]: pgmap v360: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-12T01:52:57.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:52:57.348 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:57.729 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:52:57 smithi070 ceph-mon[31177]: pgmap v361: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-09-12T01:52:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.850+0000 7fa16ec43640 1 -- 172.21.15.70:0/2581664939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa168102570 msgr2=0x7fa1681029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:57.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.850+0000 7fa16ec43640 1 --2- 172.21.15.70:0/2581664939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa168102570 0x7fa1681029b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa154009900 tx=0x7fa15402a480 comp rx=0 tx=0).stop 2024-09-12T01:52:57.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.850+0000 7fa16ec43640 1 -- 172.21.15.70:0/2581664939 shutdown_connections 2024-09-12T01:52:57.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.850+0000 7fa16ec43640 1 --2- 172.21.15.70:0/2581664939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa168102ef0 0x7fa16810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.850+0000 7fa16ec43640 1 --2- 172.21.15.70:0/2581664939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa168102570 0x7fa1681029b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.850+0000 7fa16ec43640 1 --2- 172.21.15.70:0/2581664939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa168100e20 0x7fa168101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.850+0000 7fa16ec43640 1 -- 172.21.15.70:0/2581664939 >> 172.21.15.70:0/2581664939 conn(0x7fa1680fc7d0 msgr2=0x7fa1680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:57.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.850+0000 7fa16ec43640 1 -- 172.21.15.70:0/2581664939 shutdown_connections 2024-09-12T01:52:57.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.850+0000 7fa16ec43640 1 -- 172.21.15.70:0/2581664939 wait complete. 2024-09-12T01:52:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.851+0000 7fa16ec43640 1 Processor -- start 2024-09-12T01:52:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.851+0000 7fa16ec43640 1 -- start start 2024-09-12T01:52:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16ec43640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa168100e20 0x7fa1680fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16ec43640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa168102570 0x7fa1680fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16ec43640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa168102ef0 0x7fa1680fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16ec43640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681110a0 con 0x7fa168102570 2024-09-12T01:52:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16ec43640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa168110f20 con 0x7fa168102ef0 2024-09-12T01:52:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16ec43640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa168111220 con 0x7fa168100e20 2024-09-12T01:52:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa167fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa168102570 0x7fa1680fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16c9df640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa168100e20 0x7fa1680fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16d1e0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa168102ef0 0x7fa1680fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16d1e0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa168102ef0 0x7fa1680fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41558/0 (socket says 172.21.15.70:41558) 2024-09-12T01:52:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16d1e0640 1 -- 172.21.15.70:0/3719783049 learned_addr learned my addr 172.21.15.70:0/3719783049 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16d1e0640 1 -- 172.21.15.70:0/3719783049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa168100e20 msgr2=0x7fa1680fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16d1e0640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa168100e20 0x7fa1680fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.852+0000 7fa16d1e0640 1 -- 172.21.15.70:0/3719783049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa168102570 msgr2=0x7fa1680fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.853+0000 7fa16d1e0640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa168102570 0x7fa1680fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.853+0000 7fa16d1e0640 1 -- 172.21.15.70:0/3719783049 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1681ab010 con 0x7fa168102ef0 2024-09-12T01:52:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.853+0000 7fa167fff640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa168102570 0x7fa1680fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.853+0000 7fa16d1e0640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa168102ef0 0x7fa1680fd700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa16000eaa0 tx=0x7fa16000ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.853+0000 7fa165ffb640 1 -- 172.21.15.70:0/3719783049 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16000cdb0 con 0x7fa168102ef0 2024-09-12T01:52:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.853+0000 7fa165ffb640 1 -- 172.21.15.70:0/3719783049 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa160004b20 con 0x7fa168102ef0 2024-09-12T01:52:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.853+0000 7fa165ffb640 1 -- 172.21.15.70:0/3719783049 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160011760 con 0x7fa168102ef0 2024-09-12T01:52:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.853+0000 7fa16ec43640 1 -- 172.21.15.70:0/3719783049 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1681ab240 con 0x7fa168102ef0 2024-09-12T01:52:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.854+0000 7fa16ec43640 1 -- 172.21.15.70:0/3719783049 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1681ab700 con 0x7fa168102ef0 2024-09-12T01:52:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.856+0000 7fa165ffb640 1 -- 172.21.15.70:0/3719783049 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa160011900 con 0x7fa168102ef0 2024-09-12T01:52:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.857+0000 7fa17101c740 1 Processor -- start 2024-09-12T01:52:57.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.857+0000 7fa17101c740 1 -- start start 2024-09-12T01:52:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.857+0000 7fa17101c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12dd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.857+0000 7fa17101c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12dd5d0 0x55a3a12dda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.857+0000 7fa17101c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12e8370 0x55a3a12ea760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.857+0000 7fa17101c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a3a12432f0 con 0x55a3a12deb40 2024-09-12T01:52:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.857+0000 7fa17101c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a3a11eacf0 con 0x55a3a12dd5d0 2024-09-12T01:52:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.857+0000 7fa17101c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a3a123f2b0 con 0x55a3a12e8370 2024-09-12T01:52:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa165ffb640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa1580a2c80 0x7fa1580a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa167fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12dd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa167fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12dd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38664/0 (socket says 172.21.15.70:38664) 2024-09-12T01:52:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa167fff640 1 -- 172.21.15.70:0/3879386000 learned_addr learned my addr 172.21.15.70:0/3879386000 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa16c9df640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12dd5d0 0x55a3a12dda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa16d1e0640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa1580a2c80 0x7fa1580a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa165ffb640 1 -- 172.21.15.70:0/3719783049 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa1600cf2b0 con 0x7fa168102ef0 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa167fff640 1 -- 172.21.15.70:0/3879386000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12e8370 msgr2=0x55a3a12ea760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa167fff640 1 --2- 172.21.15.70:0/3879386000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12e8370 0x55a3a12ea760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa167fff640 1 -- 172.21.15.70:0/3879386000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12dd5d0 msgr2=0x55a3a12dda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa167fff640 1 --2- 172.21.15.70:0/3879386000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12dd5d0 0x55a3a12dda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa167fff640 1 -- 172.21.15.70:0/3879386000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a11cf3a0 con 0x55a3a12deb40 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.858+0000 7fa16d1e0640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa1580a2c80 0x7fa1580a5140 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa16009b7d0 tx=0x7fa16006b980 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.859+0000 7fa167fff640 1 --2- 172.21.15.70:0/3879386000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12dd090 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa154009230 tx=0x7fa1540314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a48941e9cd2c60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.859+0000 7fa152ffd640 1 -- 172.21.15.70:0/3879386000 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa154035040 con 0x55a3a12deb40 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.859+0000 7fa152ffd640 1 -- 172.21.15.70:0/3879386000 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa1540319a0 con 0x55a3a12deb40 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.859+0000 7fa152ffd640 1 -- 172.21.15.70:0/3879386000 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1540049e0 con 0x55a3a12deb40 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.860+0000 7fa17101c740 1 -- 172.21.15.70:0/3879386000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 msgr2=0x55a3a12dd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:57.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.860+0000 7fa17101c740 1 --2- 172.21.15.70:0/3879386000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12dd090 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa154009230 tx=0x7fa1540314b0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.861+0000 7fa17101c740 1 -- 172.21.15.70:0/3879386000 shutdown_connections 2024-09-12T01:52:57.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.861+0000 7fa17101c740 1 --2- 172.21.15.70:0/3879386000 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12e8370 0x55a3a12ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.861+0000 7fa17101c740 1 --2- 172.21.15.70:0/3879386000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12dd5d0 0x55a3a12dda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.861+0000 7fa17101c740 1 --2- 172.21.15.70:0/3879386000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12dd090 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.861+0000 7fa17101c740 1 -- 172.21.15.70:0/3879386000 >> 172.21.15.70:0/3879386000 conn(0x55a3a12a6310 msgr2=0x55a3a12d9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.861+0000 7fa17101c740 1 -- 172.21.15.70:0/3879386000 shutdown_connections 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.861+0000 7fa17101c740 1 -- 172.21.15.70:0/3879386000 wait complete. 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.861+0000 7fa17101c740 1 -- start start 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.861+0000 7fa17101c740 1 Processor -- start 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa17101c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12dd5d0 0x55a3a12e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa17101c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12e4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa17101c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12e8370 0x55a3a12e55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa16c9df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12e4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa16c9df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12e4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38668/0 (socket says 172.21.15.70:38668) 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa16c9df640 1 -- 172.21.15.70:0/819559873 learned_addr learned my addr 172.21.15.70:0/819559873 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa17101c740 1 -- 172.21.15.70:0/819559873 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a3a12eb010 con 0x55a3a12deb40 2024-09-12T01:52:57.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa17101c740 1 -- 172.21.15.70:0/819559873 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a3a11fe060 con 0x55a3a12dd5d0 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa17101c740 1 -- 172.21.15.70:0/819559873 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a3a12eb190 con 0x55a3a12e8370 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa167fff640 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12dd5d0 0x55a3a12e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa167fff640 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12e8370 0x55a3a12e55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa16c9df640 1 -- 172.21.15.70:0/819559873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12e8370 msgr2=0x55a3a12e55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa16c9df640 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12e8370 0x55a3a12e55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa16c9df640 1 -- 172.21.15.70:0/819559873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12dd5d0 msgr2=0x55a3a12e7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa16c9df640 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12dd5d0 0x55a3a12e7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa16c9df640 1 -- 172.21.15.70:0/819559873 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3a0fb43c0 con 0x55a3a12deb40 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa167fff640 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12e8370 0x55a3a12e55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.862+0000 7fa17101c740 10 client.0 _ll_register_callbacks cb 0x55a3a0f518c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.863+0000 7fa16c9df640 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12e4fe0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa15c005890 tx=0x7fa15c0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c53a020fb21e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.863+0000 7fa147fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:57.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.863+0000 7fa17101c740 1 -- 172.21.15.70:0/819559873 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1540319a0 con 0x55a3a12deb40 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.863+0000 7fa147fff640 1 -- 172.21.15.70:0/819559873 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15c030060 con 0x55a3a12deb40 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.863+0000 7fa147fff640 1 -- 172.21.15.70:0/819559873 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa15c010900 con 0x55a3a12deb40 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.863+0000 7fa147fff640 1 -- 172.21.15.70:0/819559873 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa15c010b20 con 0x55a3a12deb40 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.863+0000 7fa17101c740 10 client.15768 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.863+0000 7fa17101c740 1 -- 172.21.15.70:0/819559873 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a3a12f69d0 con 0x55a3a12deb40 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.864+0000 7fa147fff640 1 -- 172.21.15.70:0/819559873 <== mon.0 v2:172.21.15.70:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa15c010cc0 con 0x55a3a12deb40 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.864+0000 7fa17101c740 10 client.15768 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.864+0000 7fa17101c740 10 client.15768 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.864+0000 7fa17101c740 20 client.15768 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.864+0000 7fa17101c740 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a3a12f7de0 0x55a3a12fa210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.864+0000 7fa17101c740 4 client.15768 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.864+0000 7fa17101c740 1 -- 172.21.15.70:0/819559873 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa1540319a0 con 0x55a3a12f7de0 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.864+0000 7fa167fff640 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a3a12f7de0 0x55a3a12fa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.865+0000 7fa147fff640 10 client.15768 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:52:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.865+0000 7fa167fff640 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a3a12f7de0 0x55a3a12fa210 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=14871a0f11638c0b server_cookie=27f340cc867a0ce4 in_seq=0 out_seq=0 2024-09-12T01:52:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.865+0000 7fa147fff640 1 -- 172.21.15.70:0/819559873 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa1540319a0 con 0x55a3a12f7de0 2024-09-12T01:52:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.865+0000 7fa147fff640 10 client.15768 handle_command_reply: tid=0 2024-09-12T01:52:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.865+0000 7fa17101c740 1 client.15768 shutdown 2024-09-12T01:52:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.865+0000 7fa17101c740 1 -- 172.21.15.70:0/819559873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 msgr2=0x55a3a12e4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.865+0000 7fa17101c740 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12e4fe0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa15c005890 tx=0x7fa15c0128e0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.865+0000 7fa17101c740 1 -- 172.21.15.70:0/819559873 shutdown_connections 2024-09-12T01:52:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.865+0000 7fa17101c740 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a3a12f7de0 0x55a3a12fa210 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.865+0000 7fa17101c740 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12e8370 0x55a3a12e55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.865+0000 7fa17101c740 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12e4fe0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.865+0000 7fa17101c740 1 --2- 172.21.15.70:0/819559873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12dd5d0 0x55a3a12e7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.866+0000 7fa17101c740 1 -- 172.21.15.70:0/819559873 >> 172.21.15.70:0/819559873 conn(0x55a3a12a6310 msgr2=0x55a3a12df930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.866+0000 7fa147fff640 0 client.15768 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:52:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.866+0000 7fa17101c740 1 -- 172.21.15.70:0/819559873 shutdown_connections 2024-09-12T01:52:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.866+0000 7fa17101c740 1 -- 172.21.15.70:0/819559873 wait complete. 2024-09-12T01:52:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.866+0000 7fa17101c740 20 client.15768 trim_cache size 0 max 16384 2024-09-12T01:52:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.891+0000 7fa17101c740 1 Processor -- start 2024-09-12T01:52:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.891+0000 7fa17101c740 1 -- start start 2024-09-12T01:52:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.891+0000 7fa17101c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12dd5d0 0x55a3a12f4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.891+0000 7fa17101c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12ffa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.891+0000 7fa17101c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12e8370 0x55a3a12fffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.891+0000 7fa17101c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa168073f40 con 0x55a3a12deb40 2024-09-12T01:52:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.891+0000 7fa17101c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681acf90 con 0x55a3a12e8370 2024-09-12T01:52:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.891+0000 7fa17101c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681abb20 con 0x55a3a12dd5d0 2024-09-12T01:52:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.892+0000 7fa16c9df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12ffa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.892+0000 7fa16c9df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12ffa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38672/0 (socket says 172.21.15.70:38672) 2024-09-12T01:52:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.892+0000 7fa16c9df640 1 -- 172.21.15.70:0/787146785 learned_addr learned my addr 172.21.15.70:0/787146785 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.892+0000 7fa167fff640 1 --2- 172.21.15.70:0/787146785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12dd5d0 0x55a3a12f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.892+0000 7fa167fff640 1 --2- 172.21.15.70:0/787146785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12e8370 0x55a3a12fffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.892+0000 7fa167fff640 1 -- 172.21.15.70:0/787146785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12e8370 msgr2=0x55a3a12fffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.892+0000 7fa167fff640 1 --2- 172.21.15.70:0/787146785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12e8370 0x55a3a12fffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.892+0000 7fa167fff640 1 -- 172.21.15.70:0/787146785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 msgr2=0x55a3a12ffa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.892+0000 7fa167fff640 1 --2- 172.21.15.70:0/787146785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12ffa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.892+0000 7fa167fff640 1 -- 172.21.15.70:0/787146785 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a12da960 con 0x55a3a12dd5d0 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.892+0000 7fa167fff640 1 --2- 172.21.15.70:0/787146785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12dd5d0 0x55a3a12f4300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa15402a9a0 tx=0x7fa154031b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecccf019521e38e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.892+0000 7fa1527fc640 1 -- 172.21.15.70:0/787146785 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa154035040 con 0x55a3a12dd5d0 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.893+0000 7fa1527fc640 1 -- 172.21.15.70:0/787146785 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa154050040 con 0x55a3a12dd5d0 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.893+0000 7fa1527fc640 1 -- 172.21.15.70:0/787146785 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15404f040 con 0x55a3a12dd5d0 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.894+0000 7fa17101c740 1 -- 172.21.15.70:0/787146785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12dd5d0 msgr2=0x55a3a12f4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.894+0000 7fa17101c740 1 --2- 172.21.15.70:0/787146785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12dd5d0 0x55a3a12f4300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa15402a9a0 tx=0x7fa154031b50 comp rx=0 tx=0).stop 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.894+0000 7fa17101c740 1 -- 172.21.15.70:0/787146785 shutdown_connections 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.894+0000 7fa17101c740 1 --2- 172.21.15.70:0/787146785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12e8370 0x55a3a12fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.894+0000 7fa17101c740 1 --2- 172.21.15.70:0/787146785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12deb40 0x55a3a12ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.894+0000 7fa17101c740 1 --2- 172.21.15.70:0/787146785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12dd5d0 0x55a3a12f4300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.894+0000 7fa17101c740 1 -- 172.21.15.70:0/787146785 >> 172.21.15.70:0/787146785 conn(0x55a3a12a6310 msgr2=0x55a3a12e0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.894+0000 7fa17101c740 1 -- 172.21.15.70:0/787146785 shutdown_connections 2024-09-12T01:52:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.894+0000 7fa17101c740 1 -- 172.21.15.70:0/787146785 wait complete. 2024-09-12T01:52:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.894+0000 7fa17101c740 1 -- start start 2024-09-12T01:52:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.894+0000 7fa17101c740 1 Processor -- start 2024-09-12T01:52:57.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.895+0000 7fa17101c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12dd5d0 0x55a3a12ec890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.895+0000 7fa17101c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12deb40 0x55a3a12ecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.895+0000 7fa17101c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12e8370 0x55a3a1361a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.895+0000 7fa17101c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681ac8c0 con 0x55a3a12e8370 2024-09-12T01:52:57.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.895+0000 7fa16c9df640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12deb40 0x55a3a12ecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.895+0000 7fa16c9df640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12deb40 0x55a3a12ecdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41604/0 (socket says 172.21.15.70:41604) 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.895+0000 7fa16c9df640 1 -- 172.21.15.70:0/3829072878 learned_addr learned my addr 172.21.15.70:0/3829072878 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.895+0000 7fa167fff640 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12dd5d0 0x55a3a12ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.896+0000 7fa17101c740 1 -- 172.21.15.70:0/3829072878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa1681ac1f0 con 0x55a3a12deb40 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.896+0000 7fa17101c740 1 -- 172.21.15.70:0/3829072878 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa168071f00 con 0x55a3a12dd5d0 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.896+0000 7fa167fff640 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12e8370 0x55a3a1361a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.896+0000 7fa16c9df640 1 -- 172.21.15.70:0/3829072878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12dd5d0 msgr2=0x55a3a12ec890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.896+0000 7fa16c9df640 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12dd5d0 0x55a3a12ec890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.896+0000 7fa16c9df640 1 -- 172.21.15.70:0/3829072878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12e8370 msgr2=0x55a3a1361a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.896+0000 7fa16c9df640 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12e8370 0x55a3a1361a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.896+0000 7fa16c9df640 1 -- 172.21.15.70:0/3829072878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3a1361f90 con 0x55a3a12deb40 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.896+0000 7fa167fff640 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12e8370 0x55a3a1361a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.896+0000 7fa16c9df640 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12deb40 0x55a3a12ecdd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa15c000c00 tx=0x7fa15c012f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fb66a1a63079386 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.896+0000 7fa17101c740 10 client.0 _ll_register_callbacks cb 0x7fa15c00bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.897+0000 7fa147fff640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.897+0000 7fa147fff640 1 -- 172.21.15.70:0/3829072878 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15c044060 con 0x55a3a12deb40 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.897+0000 7fa17101c740 1 -- 172.21.15.70:0/3829072878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa154050040 con 0x55a3a12deb40 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.897+0000 7fa147fff640 1 -- 172.21.15.70:0/3829072878 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa15c034cd0 con 0x55a3a12deb40 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.897+0000 7fa147fff640 1 -- 172.21.15.70:0/3829072878 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa15c030070 con 0x55a3a12deb40 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.897+0000 7fa17101c740 10 client.25199 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.897+0000 7fa17101c740 1 -- 172.21.15.70:0/3829072878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a3a13630f0 con 0x55a3a12deb40 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.898+0000 7fa147fff640 1 -- 172.21.15.70:0/3829072878 <== mon.2 v2:172.21.15.152:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa15c049070 con 0x55a3a12deb40 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.898+0000 7fa17101c740 10 client.25199 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.898+0000 7fa17101c740 10 client.25199 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.898+0000 7fa17101c740 20 client.25199 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.898+0000 7fa17101c740 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a3a13636b0 0x55a3a1365aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:57.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.898+0000 7fa17101c740 4 client.25199 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:52:57.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.898+0000 7fa17101c740 1 -- 172.21.15.70:0/3829072878 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a3a1250860 con 0x55a3a13636b0 2024-09-12T01:52:57.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.898+0000 7fa167fff640 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a3a13636b0 0x55a3a1365aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:57.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa147fff640 10 client.25199 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:52:57.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa167fff640 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a3a13636b0 0x55a3a1365aa0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fd298111eb0f5b05 server_cookie=dd2448497d7eba1 in_seq=0 out_seq=0 2024-09-12T01:52:57.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa147fff640 1 -- 172.21.15.70:0/3829072878 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a3a1250860 con 0x55a3a13636b0 2024-09-12T01:52:57.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa147fff640 10 client.25199 handle_command_reply: tid=0 2024-09-12T01:52:57.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa17101c740 1 client.25199 shutdown 2024-09-12T01:52:57.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa17101c740 1 -- 172.21.15.70:0/3829072878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12deb40 msgr2=0x55a3a12ecdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:57.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa17101c740 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12deb40 0x55a3a12ecdd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa15c000c00 tx=0x7fa15c012f90 comp rx=0 tx=0).stop 2024-09-12T01:52:57.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa17101c740 1 -- 172.21.15.70:0/3829072878 shutdown_connections 2024-09-12T01:52:57.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa17101c740 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a3a13636b0 0x55a3a1365aa0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa17101c740 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3a12e8370 0x55a3a1361a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.904 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:52:57.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa17101c740 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a3a12deb40 0x55a3a12ecdd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa17101c740 1 --2- 172.21.15.70:0/3829072878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a3a12dd5d0 0x55a3a12ec890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa17101c740 1 -- 172.21.15.70:0/3829072878 >> 172.21.15.70:0/3829072878 conn(0x55a3a12a6310 msgr2=0x55a3a12e6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:57.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa147fff640 0 client.25199 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:52:57.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa17101c740 1 -- 172.21.15.70:0/3829072878 shutdown_connections 2024-09-12T01:52:57.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa17101c740 1 -- 172.21.15.70:0/3829072878 wait complete. 2024-09-12T01:52:57.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.899+0000 7fa17101c740 20 client.25199 trim_cache size 0 max 16384 2024-09-12T01:52:57.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.900+0000 7fa16ec43640 1 -- 172.21.15.70:0/3719783049 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa1580a2c80 msgr2=0x7fa1580a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:57.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.900+0000 7fa16ec43640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa1580a2c80 0x7fa1580a5140 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa16009b7d0 tx=0x7fa16006b980 comp rx=0 tx=0).stop 2024-09-12T01:52:57.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.900+0000 7fa16ec43640 1 -- 172.21.15.70:0/3719783049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa168102ef0 msgr2=0x7fa1680fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:57.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.900+0000 7fa16ec43640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa168102ef0 0x7fa1680fd700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa16000eaa0 tx=0x7fa16000ef60 comp rx=0 tx=0).stop 2024-09-12T01:52:57.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.900+0000 7fa16ec43640 1 -- 172.21.15.70:0/3719783049 shutdown_connections 2024-09-12T01:52:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.900+0000 7fa16ec43640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa1580a2c80 0x7fa1580a5140 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.900+0000 7fa16ec43640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa168102ef0 0x7fa1680fd700 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.900+0000 7fa16ec43640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa168102570 0x7fa1680fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.900+0000 7fa16ec43640 1 --2- 172.21.15.70:0/3719783049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa168100e20 0x7fa1680fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.900+0000 7fa16ec43640 1 -- 172.21.15.70:0/3719783049 >> 172.21.15.70:0/3719783049 conn(0x7fa1680fc7d0 msgr2=0x7fa16806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.901+0000 7fa16ec43640 1 -- 172.21.15.70:0/3719783049 shutdown_connections 2024-09-12T01:52:57.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:57.901+0000 7fa16ec43640 1 -- 172.21.15.70:0/3719783049 wait complete. 2024-09-12T01:52:57.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:52:57 smithi191 ceph-mon[35770]: pgmap v361: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-09-12T01:52:58.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:52:57 smithi152 ceph-mon[35055]: pgmap v361: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-09-12T01:52:58.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:52:59.040 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:52:59.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.524+0000 7f211acfd640 1 -- 172.21.15.70:0/1587492277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2114102ef0 msgr2=0x7f211410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:59.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.524+0000 7f211acfd640 1 --2- 172.21.15.70:0/1587492277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2114102ef0 0x7f211410da40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f210c009ca0 tx=0x7f210c02a950 comp rx=0 tx=0).stop 2024-09-12T01:52:59.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.525+0000 7f211acfd640 1 -- 172.21.15.70:0/1587492277 shutdown_connections 2024-09-12T01:52:59.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.525+0000 7f211acfd640 1 --2- 172.21.15.70:0/1587492277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2114102ef0 0x7f211410da40 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.525+0000 7f211acfd640 1 --2- 172.21.15.70:0/1587492277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2114102570 0x7f21141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.525+0000 7f211acfd640 1 --2- 172.21.15.70:0/1587492277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2114100e20 0x7f2114101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.525+0000 7f211acfd640 1 -- 172.21.15.70:0/1587492277 >> 172.21.15.70:0/1587492277 conn(0x7f21140fc7d0 msgr2=0x7f21140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:59.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.525+0000 7f211acfd640 1 -- 172.21.15.70:0/1587492277 shutdown_connections 2024-09-12T01:52:59.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.525+0000 7f211acfd640 1 -- 172.21.15.70:0/1587492277 wait complete. 2024-09-12T01:52:59.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.525+0000 7f211acfd640 1 Processor -- start 2024-09-12T01:52:59.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.525+0000 7f211acfd640 1 -- start start 2024-09-12T01:52:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.526+0000 7f211acfd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2114100e20 0x7f2114197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.526+0000 7f211acfd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2114102570 0x7f2114197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.526+0000 7f211acfd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2114102ef0 0x7f211419bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.526+0000 7f211acfd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f21141110a0 con 0x7f2114102ef0 2024-09-12T01:52:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.526+0000 7f211acfd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2114110f20 con 0x7f2114100e20 2024-09-12T01:52:59.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.526+0000 7f211acfd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2114111220 con 0x7f2114102570 2024-09-12T01:52:59.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.526+0000 7f2118a99640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2114100e20 0x7f2114197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.526+0000 7f2118a99640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2114100e20 0x7f2114197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41608/0 (socket says 172.21.15.70:41608) 2024-09-12T01:52:59.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.526+0000 7f2118a99640 1 -- 172.21.15.70:0/2481362987 learned_addr learned my addr 172.21.15.70:0/2481362987 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:59.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.526+0000 7f211929a640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2114102ef0 0x7f211419bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.526+0000 7f2113fff640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2114102570 0x7f2114197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.527+0000 7f211929a640 1 -- 172.21.15.70:0/2481362987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2114102570 msgr2=0x7f2114197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:59.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.527+0000 7f211929a640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2114102570 0x7f2114197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.527+0000 7f211929a640 1 -- 172.21.15.70:0/2481362987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2114100e20 msgr2=0x7f2114197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:59.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.527+0000 7f211929a640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2114100e20 0x7f2114197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.527+0000 7f211929a640 1 -- 172.21.15.70:0/2481362987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211419c2f0 con 0x7f2114102ef0 2024-09-12T01:52:59.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.527+0000 7f2113fff640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2114102570 0x7f2114197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:59.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.527+0000 7f211929a640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2114102ef0 0x7f211419bc10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f210c005e30 tx=0x7f210c02f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:59.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.527+0000 7f2111ffb640 1 -- 172.21.15.70:0/2481362987 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c034040 con 0x7f2114102ef0 2024-09-12T01:52:59.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.527+0000 7f2111ffb640 1 -- 172.21.15.70:0/2481362987 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f210c030940 con 0x7f2114102ef0 2024-09-12T01:52:59.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.527+0000 7f2111ffb640 1 -- 172.21.15.70:0/2481362987 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c039690 con 0x7f2114102ef0 2024-09-12T01:52:59.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.527+0000 7f211acfd640 1 -- 172.21.15.70:0/2481362987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211419c580 con 0x7f2114102ef0 2024-09-12T01:52:59.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.528+0000 7f211acfd640 1 -- 172.21.15.70:0/2481362987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211419c950 con 0x7f2114102ef0 2024-09-12T01:52:59.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.530+0000 7f2111ffb640 1 -- 172.21.15.70:0/2481362987 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f210c037020 con 0x7f2114102ef0 2024-09-12T01:52:59.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.531+0000 7f2111ffb640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f21040a2c00 0x7f21040a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.531+0000 7f2111ffb640 1 -- 172.21.15.70:0/2481362987 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f210c0efec0 con 0x7f2114102ef0 2024-09-12T01:52:59.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.531+0000 7f2118a99640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f21040a2c00 0x7f21040a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.531+0000 7f2118a99640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f21040a2c00 0x7f21040a50c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2108005fd0 tx=0x7f21080095f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:59.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.532+0000 7f211d0d6740 1 Processor -- start 2024-09-12T01:52:59.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.532+0000 7f211d0d6740 1 -- start start 2024-09-12T01:52:59.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.532+0000 7f211d0d6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055afb40 0x556b055ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.532+0000 7f211d0d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055ae5d0 0x556b055aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.532+0000 7f211d0d6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055bd780 0x556b055bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.532+0000 7f211d0d6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b055142f0 con 0x556b055afb40 2024-09-12T01:52:59.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.532+0000 7f211d0d6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556b054bbcf0 con 0x556b055bd780 2024-09-12T01:52:59.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.532+0000 7f211d0d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556b055102b0 con 0x556b055ae5d0 2024-09-12T01:52:59.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.532+0000 7f2118a99640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055afb40 0x556b055ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.532+0000 7f2118a99640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055afb40 0x556b055ae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38698/0 (socket says 172.21.15.70:38698) 2024-09-12T01:52:59.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.532+0000 7f2118a99640 1 -- 172.21.15.70:0/3270548725 learned_addr learned my addr 172.21.15.70:0/3270548725 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:59.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.532+0000 7f211929a640 1 --2- 172.21.15.70:0/3270548725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055bd780 0x556b055bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.533+0000 7f2113fff640 1 --2- 172.21.15.70:0/3270548725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055ae5d0 0x556b055aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.533+0000 7f2118a99640 1 -- 172.21.15.70:0/3270548725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055ae5d0 msgr2=0x556b055aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:59.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.533+0000 7f2118a99640 1 --2- 172.21.15.70:0/3270548725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055ae5d0 0x556b055aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.533+0000 7f2118a99640 1 -- 172.21.15.70:0/3270548725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055bd780 msgr2=0x556b055bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:59.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.533+0000 7f2118a99640 1 --2- 172.21.15.70:0/3270548725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055bd780 0x556b055bfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.533+0000 7f2118a99640 1 -- 172.21.15.70:0/3270548725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b054a03a0 con 0x556b055afb40 2024-09-12T01:52:59.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.533+0000 7f2118a99640 1 --2- 172.21.15.70:0/3270548725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055afb40 0x556b055ae090 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f210800f410 tx=0x7f2108015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a245e2f2ab58653d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:59.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.533+0000 7f20feffd640 1 -- 172.21.15.70:0/3270548725 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108022030 con 0x556b055afb40 2024-09-12T01:52:59.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.533+0000 7f20feffd640 1 -- 172.21.15.70:0/3270548725 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2108005520 con 0x556b055afb40 2024-09-12T01:52:59.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.533+0000 7f20feffd640 1 -- 172.21.15.70:0/3270548725 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210801e670 con 0x556b055afb40 2024-09-12T01:52:59.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.534+0000 7f211d0d6740 1 -- 172.21.15.70:0/3270548725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055afb40 msgr2=0x556b055ae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:59.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.534+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3270548725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055afb40 0x556b055ae090 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f210800f410 tx=0x7f2108015000 comp rx=0 tx=0).stop 2024-09-12T01:52:59.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.534+0000 7f211d0d6740 1 -- 172.21.15.70:0/3270548725 shutdown_connections 2024-09-12T01:52:59.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.534+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3270548725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055bd780 0x556b055bfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.534+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3270548725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055ae5d0 0x556b055aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.534+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3270548725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055afb40 0x556b055ae090 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.534+0000 7f211d0d6740 1 -- 172.21.15.70:0/3270548725 >> 172.21.15.70:0/3270548725 conn(0x556b05577310 msgr2=0x556b055aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:59.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.534+0000 7f211d0d6740 1 -- 172.21.15.70:0/3270548725 shutdown_connections 2024-09-12T01:52:59.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.534+0000 7f211d0d6740 1 -- 172.21.15.70:0/3270548725 wait complete. 2024-09-12T01:52:59.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.535+0000 7f211d0d6740 1 -- start start 2024-09-12T01:52:59.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.535+0000 7f211d0d6740 1 Processor -- start 2024-09-12T01:52:59.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.535+0000 7f211d0d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055ae5d0 0x556b055bd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.535+0000 7f211d0d6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055ba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.535+0000 7f211d0d6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055bd780 0x556b055baa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f211d0d6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b055c0480 con 0x556b055bd780 2024-09-12T01:52:59.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f211d0d6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x556b054cf060 con 0x556b055afb40 2024-09-12T01:52:59.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f211d0d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x556b055c0600 con 0x556b055ae5d0 2024-09-12T01:52:59.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f211d0d6740 10 client.0 _ll_register_callbacks cb 0x556b052228c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:59.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f211929a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055bd780 0x556b055baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f2118a99640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055ae5d0 0x556b055bd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f2118a99640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055ae5d0 0x556b055bd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:51642/0 (socket says 172.21.15.70:51642) 2024-09-12T01:52:59.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f2118a99640 1 -- 172.21.15.70:0/3954299416 learned_addr learned my addr 172.21.15.70:0/3954299416 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:59.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f2113fff640 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f211929a640 1 -- 172.21.15.70:0/3954299416 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055ae5d0 msgr2=0x556b055bd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:59.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f211929a640 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055ae5d0 0x556b055bd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f211929a640 1 -- 172.21.15.70:0/3954299416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 msgr2=0x556b055ba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:59.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f211929a640 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055ba450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f211929a640 1 -- 172.21.15.70:0/3954299416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b052853c0 con 0x556b055bd780 2024-09-12T01:52:59.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f2113fff640 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055ba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:59.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.536+0000 7f211929a640 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055bd780 0x556b055baa60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f210c0ed980 tx=0x7f210c004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4397d5a1bc36b11d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:59.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.537+0000 7f20f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:59.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.537+0000 7f20f3fff640 1 -- 172.21.15.70:0/3954299416 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c0d4070 con 0x556b055bd780 2024-09-12T01:52:59.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.537+0000 7f20f3fff640 1 -- 172.21.15.70:0/3954299416 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f210c0eda90 con 0x556b055bd780 2024-09-12T01:52:59.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.537+0000 7f211d0d6740 1 -- 172.21.15.70:0/3954299416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2108005520 con 0x556b055bd780 2024-09-12T01:52:59.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.537+0000 7f20f3fff640 1 -- 172.21.15.70:0/3954299416 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f210c02c040 con 0x556b055bd780 2024-09-12T01:52:59.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.537+0000 7f211d0d6740 10 client.15786 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:59.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.537+0000 7f211d0d6740 1 -- 172.21.15.70:0/3954299416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b055b1310 con 0x556b055bd780 2024-09-12T01:52:59.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.537+0000 7f20f3fff640 1 -- 172.21.15.70:0/3954299416 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2108005520 con 0x556b055bd780 2024-09-12T01:52:59.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.538+0000 7f20f3fff640 1 -- 172.21.15.70:0/3954299416 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f210c0041b0 con 0x556b055bd780 2024-09-12T01:52:59.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.538+0000 7f211d0d6740 10 client.15786 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:59.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.538+0000 7f211d0d6740 10 client.15786 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:52:59.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.538+0000 7f211d0d6740 20 client.15786 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:59.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.538+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556b055b27c0 0x556b055b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.538+0000 7f211d0d6740 4 client.15786 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:52:59.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.538+0000 7f211d0d6740 1 -- 172.21.15.70:0/3954299416 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b05521860 con 0x556b055b27c0 2024-09-12T01:52:59.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.538+0000 7f2118a99640 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556b055b27c0 0x556b055b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.538+0000 7f20f3fff640 10 client.15786 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:52:59.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.538+0000 7f2118a99640 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556b055b27c0 0x556b055b4bf0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b52e33d803e54b79 server_cookie=a5e6d71d94d0fe64 in_seq=0 out_seq=0 2024-09-12T01:52:59.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.539+0000 7f20f3fff640 1 -- 172.21.15.70:0/3954299416 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b05521860 con 0x556b055b27c0 2024-09-12T01:52:59.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.539+0000 7f20f3fff640 10 client.15786 handle_command_reply: tid=0 2024-09-12T01:52:59.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.539+0000 7f211d0d6740 1 client.15786 shutdown 2024-09-12T01:52:59.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.540+0000 7f211d0d6740 1 -- 172.21.15.70:0/3954299416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055bd780 msgr2=0x556b055baa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:59.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.540+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055bd780 0x556b055baa60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f210c0ed980 tx=0x7f210c004550 comp rx=0 tx=0).stop 2024-09-12T01:52:59.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.540+0000 7f211d0d6740 1 -- 172.21.15.70:0/3954299416 shutdown_connections 2024-09-12T01:52:59.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.540+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556b055b27c0 0x556b055b4bf0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.540+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055bd780 0x556b055baa60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.540+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055ba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.540+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3954299416 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055ae5d0 0x556b055bd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.540+0000 7f211d0d6740 1 -- 172.21.15.70:0/3954299416 >> 172.21.15.70:0/3954299416 conn(0x556b05577310 msgr2=0x556b055b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:59.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.540+0000 7f20f3fff640 0 client.15786 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:52:59.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.540+0000 7f211d0d6740 1 -- 172.21.15.70:0/3954299416 shutdown_connections 2024-09-12T01:52:59.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.540+0000 7f211d0d6740 1 -- 172.21.15.70:0/3954299416 wait complete. 2024-09-12T01:52:59.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.540+0000 7f211d0d6740 20 client.15786 trim_cache size 0 max 16384 2024-09-12T01:52:59.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.564+0000 7f211d0d6740 1 Processor -- start 2024-09-12T01:52:59.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f211d0d6740 1 -- start start 2024-09-12T01:52:59.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f211d0d6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 0x556b055c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f211d0d6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f211d0d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055bd780 0x556b055b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f211d0d6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f21141ab470 con 0x556b055ae5d0 2024-09-12T01:52:59.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f211d0d6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f21141acfb0 con 0x556b055afb40 2024-09-12T01:52:59.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f211d0d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f21141abb40 con 0x556b055bd780 2024-09-12T01:52:59.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f2118a99640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 0x556b055c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f2118a99640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 0x556b055c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38718/0 (socket says 172.21.15.70:38718) 2024-09-12T01:52:59.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f2118a99640 1 -- 172.21.15.70:0/2180760548 learned_addr learned my addr 172.21.15.70:0/2180760548 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:59.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f2113fff640 1 --2- 172.21.15.70:0/2180760548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f2118a99640 1 -- 172.21.15.70:0/2180760548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055bd780 msgr2=0x556b055b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:59.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f2118a99640 1 --2- 172.21.15.70:0/2180760548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055bd780 0x556b055b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f2118a99640 1 -- 172.21.15.70:0/2180760548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 msgr2=0x556b055b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:59.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f2118a99640 1 --2- 172.21.15.70:0/2180760548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f2118a99640 1 -- 172.21.15.70:0/2180760548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b055aaed0 con 0x556b055ae5d0 2024-09-12T01:52:59.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.565+0000 7f2113fff640 1 --2- 172.21.15.70:0/2180760548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:59.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.566+0000 7f2118a99640 1 --2- 172.21.15.70:0/2180760548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 0x556b055c98a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2108004d20 tx=0x7f2108004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfe26abb9419223 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:59.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.566+0000 7f20fe7fc640 1 -- 172.21.15.70:0/2180760548 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210802b070 con 0x556b055ae5d0 2024-09-12T01:52:59.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.566+0000 7f20fe7fc640 1 -- 172.21.15.70:0/2180760548 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2108023040 con 0x556b055ae5d0 2024-09-12T01:52:59.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.566+0000 7f20fe7fc640 1 -- 172.21.15.70:0/2180760548 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108022030 con 0x556b055ae5d0 2024-09-12T01:52:59.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.567+0000 7f211d0d6740 1 -- 172.21.15.70:0/2180760548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 msgr2=0x556b055c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:59.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.567+0000 7f211d0d6740 1 --2- 172.21.15.70:0/2180760548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 0x556b055c98a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2108004d20 tx=0x7f2108004d50 comp rx=0 tx=0).stop 2024-09-12T01:52:59.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.567+0000 7f211d0d6740 1 -- 172.21.15.70:0/2180760548 shutdown_connections 2024-09-12T01:52:59.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.567+0000 7f211d0d6740 1 --2- 172.21.15.70:0/2180760548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055bd780 0x556b055b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.567+0000 7f211d0d6740 1 --2- 172.21.15.70:0/2180760548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.567+0000 7f211d0d6740 1 --2- 172.21.15.70:0/2180760548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 0x556b055c98a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.567+0000 7f211d0d6740 1 -- 172.21.15.70:0/2180760548 >> 172.21.15.70:0/2180760548 conn(0x556b05577310 msgr2=0x556b055ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:59.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.567+0000 7f211d0d6740 1 -- 172.21.15.70:0/2180760548 shutdown_connections 2024-09-12T01:52:59.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.567+0000 7f211d0d6740 1 -- 172.21.15.70:0/2180760548 wait complete. 2024-09-12T01:52:59.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.567+0000 7f211d0d6740 1 -- start start 2024-09-12T01:52:59.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.567+0000 7f211d0d6740 1 Processor -- start 2024-09-12T01:52:59.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.568+0000 7f211d0d6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 0x556b055ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.568+0000 7f2118a99640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 0x556b055ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.568+0000 7f2118a99640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 0x556b055ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38724/0 (socket says 172.21.15.70:38724) 2024-09-12T01:52:59.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.568+0000 7f2118a99640 1 -- 172.21.15.70:0/3046860175 learned_addr learned my addr 172.21.15.70:0/3046860175 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:52:59.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.568+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.568+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055bd780 0x556b05642f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.568+0000 7f211d0d6740 1 -- 172.21.15.70:0/3046860175 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f21141ac8e0 con 0x556b055ae5d0 2024-09-12T01:52:59.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.568+0000 7f211d0d6740 1 -- 172.21.15.70:0/3046860175 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f21141ac210 con 0x556b055afb40 2024-09-12T01:52:59.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.568+0000 7f211d0d6740 1 -- 172.21.15.70:0/3046860175 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f21141a9430 con 0x556b055bd780 2024-09-12T01:52:59.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.568+0000 7f211d0d6740 10 client.0 _ll_register_callbacks cb 0x7f210c009bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:52:59.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.568+0000 7f211929a640 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055bd780 0x556b05642f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.568+0000 7f2113fff640 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.569+0000 7f2118a99640 1 -- 172.21.15.70:0/3046860175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055bd780 msgr2=0x556b05642f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.569+0000 7f2118a99640 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055bd780 0x556b05642f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.569+0000 7f2118a99640 1 -- 172.21.15.70:0/3046860175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 msgr2=0x556b055ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:52:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.569+0000 7f2118a99640 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.569+0000 7f2118a99640 1 -- 172.21.15.70:0/3046860175 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b05643520 con 0x556b055ae5d0 2024-09-12T01:52:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.569+0000 7f2113fff640 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.569+0000 7f2118a99640 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 0x556b055ce440 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2108005090 tx=0x7f21080050c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8194f600af2d1f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.569+0000 7f20f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:52:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.569+0000 7f20f3fff640 1 -- 172.21.15.70:0/3046860175 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108022070 con 0x556b055ae5d0 2024-09-12T01:52:59.577 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:52:59.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.570+0000 7f20f3fff640 1 -- 172.21.15.70:0/3046860175 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f21080054c0 con 0x556b055ae5d0 2024-09-12T01:52:59.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.570+0000 7f211d0d6740 1 -- 172.21.15.70:0/3046860175 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2108023040 con 0x556b055ae5d0 2024-09-12T01:52:59.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.570+0000 7f20f3fff640 1 -- 172.21.15.70:0/3046860175 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f210802b040 con 0x556b055ae5d0 2024-09-12T01:52:59.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.570+0000 7f211d0d6740 10 client.15792 fetch_fsmap learned FSMap version 28 2024-09-12T01:52:59.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.570+0000 7f211d0d6740 1 -- 172.21.15.70:0/3046860175 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b056447c0 con 0x556b055ae5d0 2024-09-12T01:52:59.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.570+0000 7f20f3fff640 1 -- 172.21.15.70:0/3046860175 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2108023040 con 0x556b055ae5d0 2024-09-12T01:52:59.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.570+0000 7f20f3fff640 1 -- 172.21.15.70:0/3046860175 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2108027460 con 0x556b055ae5d0 2024-09-12T01:52:59.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.570+0000 7f211d0d6740 10 client.15792 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:52:59.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.570+0000 7f211d0d6740 10 client.15792 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:52:59.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.570+0000 7f211d0d6740 20 client.15792 populate_metadata read hostname 'smithi070' 2024-09-12T01:52:59.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.571+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556b05644b50 0x556b05646f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:59.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.571+0000 7f211d0d6740 4 client.15792 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:52:59.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.571+0000 7f211d0d6740 1 -- 172.21.15.70:0/3046860175 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b0551bd70 con 0x556b05644b50 2024-09-12T01:52:59.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.571+0000 7f2113fff640 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556b05644b50 0x556b05646f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.571+0000 7f20f3fff640 10 client.15792 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:52:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.571+0000 7f2113fff640 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556b05644b50 0x556b05646f40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=378f6e6e74f9757 server_cookie=2ecec402d612e52e in_seq=0 out_seq=0 2024-09-12T01:52:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.571+0000 7f20f3fff640 1 -- 172.21.15.70:0/3046860175 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b0551bd70 con 0x556b05644b50 2024-09-12T01:52:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.571+0000 7f20f3fff640 10 client.15792 handle_command_reply: tid=0 2024-09-12T01:52:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.571+0000 7f211d0d6740 1 client.15792 shutdown 2024-09-12T01:52:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.572+0000 7f211d0d6740 1 -- 172.21.15.70:0/3046860175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 msgr2=0x556b055ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.572+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 0x556b055ce440 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2108005090 tx=0x7f21080050c0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.572+0000 7f211d0d6740 1 -- 172.21.15.70:0/3046860175 shutdown_connections 2024-09-12T01:52:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.572+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x556b05644b50 0x556b05646f40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.572+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556b055bd780 0x556b05642f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.572+0000 7f20f3fff640 0 client.15792 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:52:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.572+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x556b055afb40 0x556b055ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.572+0000 7f211d0d6740 1 --2- 172.21.15.70:0/3046860175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b055ae5d0 0x556b055ce440 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.572+0000 7f211d0d6740 1 -- 172.21.15.70:0/3046860175 >> 172.21.15.70:0/3046860175 conn(0x556b05577310 msgr2=0x556b055b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.572+0000 7f211d0d6740 1 -- 172.21.15.70:0/3046860175 shutdown_connections 2024-09-12T01:52:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.572+0000 7f211d0d6740 1 -- 172.21.15.70:0/3046860175 wait complete. 2024-09-12T01:52:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.572+0000 7f211d0d6740 20 client.15792 trim_cache size 0 max 16384 2024-09-12T01:52:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.573+0000 7f211acfd640 1 -- 172.21.15.70:0/2481362987 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f21040a2c00 msgr2=0x7f21040a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.573+0000 7f211acfd640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f21040a2c00 0x7f21040a50c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2108005fd0 tx=0x7f21080095f0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.573+0000 7f211acfd640 1 -- 172.21.15.70:0/2481362987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2114102ef0 msgr2=0x7f211419bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.573+0000 7f211acfd640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2114102ef0 0x7f211419bc10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f210c005e30 tx=0x7f210c02f950 comp rx=0 tx=0).stop 2024-09-12T01:52:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.574+0000 7f211acfd640 1 -- 172.21.15.70:0/2481362987 shutdown_connections 2024-09-12T01:52:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.574+0000 7f211acfd640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f21040a2c00 0x7f21040a50c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.574+0000 7f211acfd640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2114102ef0 0x7f211419bc10 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.574+0000 7f211acfd640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2114102570 0x7f2114197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.574+0000 7f211acfd640 1 --2- 172.21.15.70:0/2481362987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2114100e20 0x7f2114197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.574+0000 7f211acfd640 1 -- 172.21.15.70:0/2481362987 >> 172.21.15.70:0/2481362987 conn(0x7f21140fc7d0 msgr2=0x7f21141056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.574+0000 7f211acfd640 1 -- 172.21.15.70:0/2481362987 shutdown_connections 2024-09-12T01:52:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:52:59.574+0000 7f211acfd640 1 -- 172.21.15.70:0/2481362987 wait complete. 2024-09-12T01:53:00.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:53:00.460 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:00.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:53:00.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:00 smithi070 ceph-mon[31177]: pgmap v362: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-12T01:53:00.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:00 smithi191 ceph-mon[35770]: pgmap v362: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-12T01:53:00.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.995+0000 7faf4c813640 1 -- 172.21.15.70:0/2303890867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf48101250 msgr2=0x7faf4810d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:00.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.995+0000 7faf4c813640 1 --2- 172.21.15.70:0/2303890867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf48101250 0x7faf4810d780 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faf40009cd0 tx=0x7faf4002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:53:00.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.995+0000 7faf4c813640 1 -- 172.21.15.70:0/2303890867 shutdown_connections 2024-09-12T01:53:00.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.995+0000 7faf4c813640 1 --2- 172.21.15.70:0/2303890867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf48101250 0x7faf4810d780 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:00.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.995+0000 7faf4c813640 1 --2- 172.21.15.70:0/2303890867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf481008b0 0x7faf48100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:00.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.995+0000 7faf4c813640 1 --2- 172.21.15.70:0/2303890867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf481068b0 0x7faf48106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.995+0000 7faf4c813640 1 -- 172.21.15.70:0/2303890867 >> 172.21.15.70:0/2303890867 conn(0x7faf480fc5d0 msgr2=0x7faf480fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.995+0000 7faf4c813640 1 -- 172.21.15.70:0/2303890867 shutdown_connections 2024-09-12T01:53:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.995+0000 7faf4c813640 1 -- 172.21.15.70:0/2303890867 wait complete. 2024-09-12T01:53:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.996+0000 7faf4c813640 1 Processor -- start 2024-09-12T01:53:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.996+0000 7faf4c813640 1 -- start start 2024-09-12T01:53:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.997+0000 7faf4c813640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf481008b0 0x7faf48198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.997+0000 7faf4c813640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf48101250 0x7faf48198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.997+0000 7faf4c813640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf481068b0 0x7faf4819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.997+0000 7faf4659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf48101250 0x7faf48198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.997+0000 7faf4659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf48101250 0x7faf48198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:52248/0 (socket says 172.21.15.70:52248) 2024-09-12T01:53:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.997+0000 7faf4759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf481068b0 0x7faf4819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.997+0000 7faf4759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf481068b0 0x7faf4819cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44076/0 (socket says 172.21.15.70:44076) 2024-09-12T01:53:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.997+0000 7faf46d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf481008b0 0x7faf48198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.998+0000 7faf46d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf481008b0 0x7faf48198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:32848/0 (socket says 172.21.15.70:32848) 2024-09-12T01:53:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.998+0000 7faf4659c640 1 -- 172.21.15.70:0/3825412965 learned_addr learned my addr 172.21.15.70:0/3825412965 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.998+0000 7faf4c813640 1 -- 172.21.15.70:0/3825412965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faf48111ed0 con 0x7faf481068b0 2024-09-12T01:53:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.998+0000 7faf4c813640 1 -- 172.21.15.70:0/3825412965 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faf48111d50 con 0x7faf48101250 2024-09-12T01:53:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.998+0000 7faf4c813640 1 -- 172.21.15.70:0/3825412965 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faf48112050 con 0x7faf481008b0 2024-09-12T01:53:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.998+0000 7faf4659c640 1 -- 172.21.15.70:0/3825412965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf481008b0 msgr2=0x7faf48198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.998+0000 7faf4659c640 1 --2- 172.21.15.70:0/3825412965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf481008b0 0x7faf48198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.998+0000 7faf4659c640 1 -- 172.21.15.70:0/3825412965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf481068b0 msgr2=0x7faf4819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.998+0000 7faf4659c640 1 --2- 172.21.15.70:0/3825412965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf481068b0 0x7faf4819cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.998+0000 7faf4659c640 1 -- 172.21.15.70:0/3825412965 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4819d2b0 con 0x7faf48101250 2024-09-12T01:53:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.999+0000 7faf4659c640 1 --2- 172.21.15.70:0/3825412965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf48101250 0x7faf48198840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00d950 tx=0x7faf3c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.999+0000 7faf2ffff640 1 -- 172.21.15.70:0/3825412965 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c017070 con 0x7faf48101250 2024-09-12T01:53:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.999+0000 7faf4c813640 1 -- 172.21.15.70:0/3825412965 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf4819d5a0 con 0x7faf48101250 2024-09-12T01:53:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.999+0000 7faf2ffff640 1 -- 172.21.15.70:0/3825412965 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf3c009c30 con 0x7faf48101250 2024-09-12T01:53:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.999+0000 7faf2ffff640 1 -- 172.21.15.70:0/3825412965 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c00f740 con 0x7faf48101250 2024-09-12T01:53:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:00.999+0000 7faf4c813640 1 -- 172.21.15.70:0/3825412965 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf481a4e80 con 0x7faf48101250 2024-09-12T01:53:01.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.002+0000 7faf2ffff640 1 -- 172.21.15.70:0/3825412965 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7faf3c010a80 con 0x7faf48101250 2024-09-12T01:53:01.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.003+0000 7faf4f3ed740 1 Processor -- start 2024-09-12T01:53:01.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.003+0000 7faf2ffff640 1 --2- 172.21.15.70:0/3825412965 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faf300a2c00 0x7faf300a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.003+0000 7faf2ffff640 1 -- 172.21.15.70:0/3825412965 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faf3c0cecd0 con 0x7faf48101250 2024-09-12T01:53:01.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.004+0000 7faf4759e640 1 --2- 172.21.15.70:0/3825412965 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faf300a2c00 0x7faf300a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.004+0000 7faf4f3ed740 1 -- start start 2024-09-12T01:53:01.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.004+0000 7faf4f3ed740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09de620 0x55b5a09dea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.004+0000 7faf4f3ed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 0x55b5a09e3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.004+0000 7faf4f3ed740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09e3c20 0x55b5a09e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.004+0000 7faf4f3ed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b5a093a2f0 con 0x55b5a09defd0 2024-09-12T01:53:01.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.004+0000 7faf4f3ed740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b5a08e1cf0 con 0x55b5a09de620 2024-09-12T01:53:01.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.004+0000 7faf4f3ed740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b5a09362b0 con 0x55b5a09e3c20 2024-09-12T01:53:01.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.004+0000 7faf4659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 0x55b5a09e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.004+0000 7faf4659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 0x55b5a09e3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44082/0 (socket says 172.21.15.70:44082) 2024-09-12T01:53:01.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.004+0000 7faf4659c640 1 -- 172.21.15.70:0/139311337 learned_addr learned my addr 172.21.15.70:0/139311337 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:01.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.004+0000 7faf4759e640 1 --2- 172.21.15.70:0/139311337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09e3c20 0x55b5a09e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.005+0000 7faf4659c640 1 -- 172.21.15.70:0/139311337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09e3c20 msgr2=0x55b5a09e40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:01.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.005+0000 7faf4659c640 1 --2- 172.21.15.70:0/139311337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09e3c20 0x55b5a09e40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.005+0000 7faf46d9d640 1 --2- 172.21.15.70:0/139311337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09de620 0x55b5a09dea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.005+0000 7faf4659c640 1 -- 172.21.15.70:0/139311337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09de620 msgr2=0x55b5a09dea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:01.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.005+0000 7faf4759e640 1 --2- 172.21.15.70:0/3825412965 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faf300a2c00 0x7faf300a50c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faf40006010 tx=0x7faf40009360 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:01.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.005+0000 7faf4659c640 1 --2- 172.21.15.70:0/139311337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09de620 0x55b5a09dea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.005+0000 7faf4659c640 1 -- 172.21.15.70:0/139311337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5a08c63a0 con 0x55b5a09defd0 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.005+0000 7faf46d9d640 1 --2- 172.21.15.70:0/139311337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09de620 0x55b5a09dea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.005+0000 7faf4659c640 1 --2- 172.21.15.70:0/139311337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 0x55b5a09e3650 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faf3c097950 tx=0x7faf3c009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9032d0ffafdf7c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.005+0000 7faf2d7fa640 1 -- 172.21.15.70:0/139311337 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c020040 con 0x55b5a09defd0 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.005+0000 7faf2d7fa640 1 -- 172.21.15.70:0/139311337 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf3c09f8a0 con 0x55b5a09defd0 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.006+0000 7faf2d7fa640 1 -- 172.21.15.70:0/139311337 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c09a3b0 con 0x55b5a09defd0 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.006+0000 7faf4f3ed740 1 -- 172.21.15.70:0/139311337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 msgr2=0x55b5a09e3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.006+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/139311337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 0x55b5a09e3650 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7faf3c097950 tx=0x7faf3c009de0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.006+0000 7faf4f3ed740 1 -- 172.21.15.70:0/139311337 shutdown_connections 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.006+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/139311337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09e3c20 0x55b5a09e40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.006+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/139311337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 0x55b5a09e3650 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.006+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/139311337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09de620 0x55b5a09dea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.006+0000 7faf4f3ed740 1 -- 172.21.15.70:0/139311337 >> 172.21.15.70:0/139311337 conn(0x55b5a099d310 msgr2=0x55b5a09d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:01.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.007+0000 7faf4f3ed740 1 -- 172.21.15.70:0/139311337 shutdown_connections 2024-09-12T01:53:01.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.007+0000 7faf4f3ed740 1 -- 172.21.15.70:0/139311337 wait complete. 2024-09-12T01:53:01.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.007+0000 7faf4f3ed740 1 -- start start 2024-09-12T01:53:01.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.007+0000 7faf4f3ed740 1 Processor -- start 2024-09-12T01:53:01.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.007+0000 7faf4f3ed740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09de620 0x55b5a09ea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.007+0000 7faf4f3ed740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09defd0 0x55b5a09e7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.007+0000 7faf4f3ed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09e3c20 0x55b5a09e78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.007+0000 7faf4f3ed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b5a09fbb60 con 0x55b5a09e3c20 2024-09-12T01:53:01.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.007+0000 7faf4f3ed740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b5a08f5060 con 0x55b5a09de620 2024-09-12T01:53:01.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.007+0000 7faf4f3ed740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b5a09fbce0 con 0x55b5a09defd0 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.007+0000 7faf4f3ed740 10 client.0 _ll_register_callbacks cb 0x55b5a06488c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.008+0000 7faf4759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09e3c20 0x55b5a09e78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.008+0000 7faf46d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09de620 0x55b5a09ea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.008+0000 7faf4759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09e3c20 0x55b5a09e78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44086/0 (socket says 172.21.15.70:44086) 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.008+0000 7faf4759e640 1 -- 172.21.15.70:0/2364017322 learned_addr learned my addr 172.21.15.70:0/2364017322 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.008+0000 7faf4759e640 1 -- 172.21.15.70:0/2364017322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09defd0 msgr2=0x55b5a09e7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.008+0000 7faf4659c640 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09defd0 0x55b5a09e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.008+0000 7faf4759e640 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09defd0 0x55b5a09e7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.008+0000 7faf4759e640 1 -- 172.21.15.70:0/2364017322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09de620 msgr2=0x55b5a09ea0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.008+0000 7faf4759e640 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09de620 0x55b5a09ea0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.008+0000 7faf4759e640 1 -- 172.21.15.70:0/2364017322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5a06ab3c0 con 0x55b5a09e3c20 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.008+0000 7faf46d9d640 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09de620 0x55b5a09ea0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:01.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.008+0000 7faf4659c640 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09defd0 0x55b5a09e7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:01.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.009+0000 7faf4759e640 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09e3c20 0x55b5a09e78f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faf4002ae00 tx=0x7faf4002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc43d5b3a1f9b056 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:01.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.009+0000 7faf2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:01.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.009+0000 7faf2aff5640 1 -- 172.21.15.70:0/2364017322 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf400045d0 con 0x55b5a09e3c20 2024-09-12T01:53:01.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.009+0000 7faf2aff5640 1 -- 172.21.15.70:0/2364017322 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faf40004770 con 0x55b5a09e3c20 2024-09-12T01:53:01.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.009+0000 7faf4f3ed740 1 -- 172.21.15.70:0/2364017322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf3c09f8a0 con 0x55b5a09e3c20 2024-09-12T01:53:01.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.009+0000 7faf2aff5640 1 -- 172.21.15.70:0/2364017322 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faf400305a0 con 0x55b5a09e3c20 2024-09-12T01:53:01.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.009+0000 7faf4f3ed740 10 client.15804 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:01.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.009+0000 7faf4f3ed740 1 -- 172.21.15.70:0/2364017322 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b5a0a07520 con 0x55b5a09e3c20 2024-09-12T01:53:01.014 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:00 smithi152 ceph-mon[35055]: pgmap v362: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-12T01:53:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.010+0000 7faf2aff5640 1 -- 172.21.15.70:0/2364017322 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf3c09f8a0 con 0x55b5a09e3c20 2024-09-12T01:53:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.010+0000 7faf2aff5640 1 -- 172.21.15.70:0/2364017322 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faf4004e070 con 0x55b5a09e3c20 2024-09-12T01:53:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.010+0000 7faf4f3ed740 10 client.15804 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.010+0000 7faf4f3ed740 10 client.15804 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:53:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.010+0000 7faf4f3ed740 20 client.15804 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.010+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55b5a0a08980 0x55b5a0a0ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.010+0000 7faf4f3ed740 4 client.15804 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.010+0000 7faf4f3ed740 1 -- 172.21.15.70:0/2364017322 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5a0947860 con 0x55b5a0a08980 2024-09-12T01:53:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.011+0000 7faf46d9d640 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55b5a0a08980 0x55b5a0a0ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.011+0000 7faf46d9d640 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55b5a0a08980 0x55b5a0a0ade0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad818bb6f1f3c710 server_cookie=905dc0c1b4c0a60 in_seq=0 out_seq=0 2024-09-12T01:53:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.011+0000 7faf2aff5640 10 client.15804 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:53:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf2aff5640 1 -- 172.21.15.70:0/2364017322 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5a0947860 con 0x55b5a0a08980 2024-09-12T01:53:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf2aff5640 10 client.15804 handle_command_reply: tid=0 2024-09-12T01:53:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf4f3ed740 1 client.15804 shutdown 2024-09-12T01:53:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf4f3ed740 1 -- 172.21.15.70:0/2364017322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09e3c20 msgr2=0x55b5a09e78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09e3c20 0x55b5a09e78f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faf4002ae00 tx=0x7faf4002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf4f3ed740 1 -- 172.21.15.70:0/2364017322 shutdown_connections 2024-09-12T01:53:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55b5a0a08980 0x55b5a0a0ade0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09e3c20 0x55b5a09e78f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09defd0 0x55b5a09e7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/2364017322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09de620 0x55b5a09ea0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf4f3ed740 1 -- 172.21.15.70:0/2364017322 >> 172.21.15.70:0/2364017322 conn(0x55b5a099d310 msgr2=0x55b5a09ddc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf2aff5640 0 client.15804 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:53:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf4f3ed740 1 -- 172.21.15.70:0/2364017322 shutdown_connections 2024-09-12T01:53:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.016+0000 7faf4f3ed740 1 -- 172.21.15.70:0/2364017322 wait complete. 2024-09-12T01:53:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.017+0000 7faf4f3ed740 20 client.15804 trim_cache size 0 max 16384 2024-09-12T01:53:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.035+0000 7faf4f3ed740 1 Processor -- start 2024-09-12T01:53:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.035+0000 7faf4f3ed740 1 -- start start 2024-09-12T01:53:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.035+0000 7faf4f3ed740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09de620 0x55b5a0a04e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.035+0000 7faf4f3ed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 0x55b5a09cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.035+0000 7faf4f3ed740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09e3c20 0x55b5a09cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.035+0000 7faf4f3ed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faf48071ee0 con 0x55b5a09defd0 2024-09-12T01:53:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.035+0000 7faf4f3ed740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faf48073a20 con 0x55b5a09e3c20 2024-09-12T01:53:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.035+0000 7faf4f3ed740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faf480725b0 con 0x55b5a09de620 2024-09-12T01:53:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf4659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 0x55b5a09cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf4659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 0x55b5a09cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44102/0 (socket says 172.21.15.70:44102) 2024-09-12T01:53:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf4659c640 1 -- 172.21.15.70:0/4145437536 learned_addr learned my addr 172.21.15.70:0/4145437536 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf46d9d640 1 --2- 172.21.15.70:0/4145437536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09de620 0x55b5a0a04e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf4659c640 1 -- 172.21.15.70:0/4145437536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09de620 msgr2=0x55b5a0a04e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf4659c640 1 --2- 172.21.15.70:0/4145437536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09de620 0x55b5a0a04e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf4659c640 1 -- 172.21.15.70:0/4145437536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09e3c20 msgr2=0x55b5a09cfcc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf4659c640 1 --2- 172.21.15.70:0/4145437536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09e3c20 0x55b5a09cfcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf4659c640 1 -- 172.21.15.70:0/4145437536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5a09e58a0 con 0x55b5a09defd0 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf4659c640 1 --2- 172.21.15.70:0/4145437536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 0x55b5a09cf780 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0860b0 tx=0x7faf3c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392710fe82fde2fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf2cff9640 1 -- 172.21.15.70:0/4145437536 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c020040 con 0x55b5a09defd0 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf2cff9640 1 -- 172.21.15.70:0/4145437536 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf3c097040 con 0x55b5a09defd0 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.036+0000 7faf2cff9640 1 -- 172.21.15.70:0/4145437536 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c09aba0 con 0x55b5a09defd0 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.037+0000 7faf4f3ed740 1 -- 172.21.15.70:0/4145437536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 msgr2=0x55b5a09cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.037+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/4145437536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 0x55b5a09cf780 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0860b0 tx=0x7faf3c000bc0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.037+0000 7faf4f3ed740 1 -- 172.21.15.70:0/4145437536 shutdown_connections 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.037+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/4145437536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09e3c20 0x55b5a09cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.037+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/4145437536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09defd0 0x55b5a09cf780 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.037+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/4145437536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09de620 0x55b5a0a04e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.037+0000 7faf4f3ed740 1 -- 172.21.15.70:0/4145437536 >> 172.21.15.70:0/4145437536 conn(0x55b5a099d310 msgr2=0x55b5a09ddc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.037+0000 7faf4f3ed740 1 -- 172.21.15.70:0/4145437536 shutdown_connections 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.037+0000 7faf4f3ed740 1 -- 172.21.15.70:0/4145437536 wait complete. 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.038+0000 7faf4f3ed740 1 -- start start 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.038+0000 7faf4f3ed740 1 Processor -- start 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.038+0000 7faf4f3ed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09de620 0x55b5a0a01550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.038+0000 7faf4f3ed740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09defd0 0x55b5a0a0fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.038+0000 7faf4f3ed740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09e3c20 0x55b5a0a10360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.038+0000 7faf4f3ed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faf48073350 con 0x55b5a09de620 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.038+0000 7faf4f3ed740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7faf48072c80 con 0x55b5a09e3c20 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.038+0000 7faf4f3ed740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faf4806fea0 con 0x55b5a09defd0 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.038+0000 7faf4f3ed740 10 client.0 _ll_register_callbacks cb 0x7faf40031500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.038+0000 7faf46d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09de620 0x55b5a0a01550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.038+0000 7faf46d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09de620 0x55b5a0a01550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44104/0 (socket says 172.21.15.70:44104) 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.038+0000 7faf46d9d640 1 -- 172.21.15.70:0/13407535 learned_addr learned my addr 172.21.15.70:0/13407535 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.039+0000 7faf4659c640 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09defd0 0x55b5a0a0fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.039+0000 7faf46d9d640 1 -- 172.21.15.70:0/13407535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09defd0 msgr2=0x55b5a0a0fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.039+0000 7faf46d9d640 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09defd0 0x55b5a0a0fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.039+0000 7faf46d9d640 1 -- 172.21.15.70:0/13407535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09e3c20 msgr2=0x55b5a0a10360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.039+0000 7faf46d9d640 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09e3c20 0x55b5a0a10360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.039+0000 7faf46d9d640 1 -- 172.21.15.70:0/13407535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5a0a109d0 con 0x55b5a09de620 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.039+0000 7faf4659c640 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09defd0 0x55b5a0a0fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.039+0000 7faf46d9d640 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09de620 0x55b5a0a01550 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x55b5a0a0b620 tx=0x7faf38005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7e37a070f3fa52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.039+0000 7faf2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.039+0000 7faf2aff5640 1 -- 172.21.15.70:0/13407535 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf38013810 con 0x55b5a09de620 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.039+0000 7faf2aff5640 1 -- 172.21.15.70:0/13407535 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faf380139b0 con 0x55b5a09de620 2024-09-12T01:53:01.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.039+0000 7faf4f3ed740 1 -- 172.21.15.70:0/13407535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b5a0941d70 con 0x55b5a09de620 2024-09-12T01:53:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.040+0000 7faf2aff5640 1 -- 172.21.15.70:0/13407535 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faf38013bb0 con 0x55b5a09de620 2024-09-12T01:53:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.040+0000 7faf4f3ed740 10 client.15810 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:01.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.040+0000 7faf4f3ed740 1 -- 172.21.15.70:0/13407535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b5a0a73680 con 0x55b5a09de620 2024-09-12T01:53:01.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.040+0000 7faf2aff5640 1 -- 172.21.15.70:0/13407535 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55b5a0941d70 con 0x55b5a09de620 2024-09-12T01:53:01.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.040+0000 7faf2aff5640 1 -- 172.21.15.70:0/13407535 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7faf3801c040 con 0x55b5a09de620 2024-09-12T01:53:01.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.040+0000 7faf4f3ed740 10 client.15810 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:01.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.040+0000 7faf4f3ed740 10 client.15810 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:53:01.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.040+0000 7faf4f3ed740 20 client.15810 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:01.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.040+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55b5a0a73d10 0x55b5a0a76130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:01.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.041+0000 7faf4f3ed740 4 client.15810 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:53:01.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.041+0000 7faf4f3ed740 1 -- 172.21.15.70:0/13407535 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b5a08be170 con 0x55b5a0a73d10 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.041+0000 7faf4659c640 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55b5a0a73d10 0x55b5a0a76130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.041+0000 7faf2aff5640 10 client.15810 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.041+0000 7faf4659c640 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55b5a0a73d10 0x55b5a0a76130 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=935ce256a0ae1334 server_cookie=5990c42ef83e250e in_seq=0 out_seq=0 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.041+0000 7faf2aff5640 1 -- 172.21.15.70:0/13407535 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b5a08be170 con 0x55b5a0a73d10 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.041+0000 7faf2aff5640 10 client.15810 handle_command_reply: tid=0 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.041+0000 7faf4f3ed740 1 client.15810 shutdown 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.042+0000 7faf4f3ed740 1 -- 172.21.15.70:0/13407535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09de620 msgr2=0x55b5a0a01550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.042+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09de620 0x55b5a0a01550 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x55b5a0a0b620 tx=0x7faf38005680 comp rx=0 tx=0).stop 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.042+0000 7faf4f3ed740 1 -- 172.21.15.70:0/13407535 shutdown_connections 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.042+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55b5a0a73d10 0x55b5a0a76130 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.042+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b5a09e3c20 0x55b5a0a10360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.042+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b5a09defd0 0x55b5a0a0fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.042+0000 7faf4f3ed740 1 --2- 172.21.15.70:0/13407535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5a09de620 0x55b5a0a01550 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.042+0000 7faf4f3ed740 1 -- 172.21.15.70:0/13407535 >> 172.21.15.70:0/13407535 conn(0x55b5a099d310 msgr2=0x55b5a09cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:01.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.042+0000 7faf2aff5640 0 client.15810 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:53:01.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.042+0000 7faf4f3ed740 1 -- 172.21.15.70:0/13407535 shutdown_connections 2024-09-12T01:53:01.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.042+0000 7faf4f3ed740 1 -- 172.21.15.70:0/13407535 wait complete. 2024-09-12T01:53:01.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.042+0000 7faf4f3ed740 20 client.15810 trim_cache size 0 max 16384 2024-09-12T01:53:01.047 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:53:01.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.044+0000 7faf4c813640 1 -- 172.21.15.70:0/3825412965 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faf300a2c00 msgr2=0x7faf300a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:01.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.044+0000 7faf4c813640 1 --2- 172.21.15.70:0/3825412965 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faf300a2c00 0x7faf300a50c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faf40006010 tx=0x7faf40009360 comp rx=0 tx=0).stop 2024-09-12T01:53:01.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.044+0000 7faf4c813640 1 -- 172.21.15.70:0/3825412965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf48101250 msgr2=0x7faf48198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:01.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.044+0000 7faf4c813640 1 --2- 172.21.15.70:0/3825412965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf48101250 0x7faf48198840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00d950 tx=0x7faf3c00de10 comp rx=0 tx=0).stop 2024-09-12T01:53:01.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.044+0000 7faf4c813640 1 -- 172.21.15.70:0/3825412965 shutdown_connections 2024-09-12T01:53:01.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.044+0000 7faf4c813640 1 --2- 172.21.15.70:0/3825412965 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7faf300a2c00 0x7faf300a50c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.044+0000 7faf4c813640 1 --2- 172.21.15.70:0/3825412965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf481068b0 0x7faf4819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.044+0000 7faf4c813640 1 --2- 172.21.15.70:0/3825412965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf48101250 0x7faf48198840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.044+0000 7faf4c813640 1 --2- 172.21.15.70:0/3825412965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf481008b0 0x7faf48198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:01.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.044+0000 7faf4c813640 1 -- 172.21.15.70:0/3825412965 >> 172.21.15.70:0/3825412965 conn(0x7faf480fc5d0 msgr2=0x7faf480fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:01.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.044+0000 7faf4c813640 1 -- 172.21.15.70:0/3825412965 shutdown_connections 2024-09-12T01:53:01.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:01.044+0000 7faf4c813640 1 -- 172.21.15.70:0/3825412965 wait complete. 2024-09-12T01:53:01.279 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:01.895 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:53:02.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.320+0000 7f92b4b2f640 1 -- 172.21.15.70:0/3578640890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b0100a60 msgr2=0x7f92b0100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:02.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.320+0000 7f92b4b2f640 1 --2- 172.21.15.70:0/3578640890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b0100a60 0x7f92b0100ec0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009930 tx=0x7f92a402a420 comp rx=0 tx=0).stop 2024-09-12T01:53:02.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.320+0000 7f92b4b2f640 1 -- 172.21.15.70:0/3578640890 shutdown_connections 2024-09-12T01:53:02.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.320+0000 7f92b4b2f640 1 --2- 172.21.15.70:0/3578640890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92b0101400 0x7f92b010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.320+0000 7f92b4b2f640 1 --2- 172.21.15.70:0/3578640890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b0100a60 0x7f92b0100ec0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.320+0000 7f92b4b2f640 1 --2- 172.21.15.70:0/3578640890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92b0106a60 0x7f92b0106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.320+0000 7f92b4b2f640 1 -- 172.21.15.70:0/3578640890 >> 172.21.15.70:0/3578640890 conn(0x7f92b00fc780 msgr2=0x7f92b00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.320+0000 7f92b4b2f640 1 -- 172.21.15.70:0/3578640890 shutdown_connections 2024-09-12T01:53:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.320+0000 7f92b4b2f640 1 -- 172.21.15.70:0/3578640890 wait complete. 2024-09-12T01:53:02.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.321+0000 7f92b4b2f640 1 Processor -- start 2024-09-12T01:53:02.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.321+0000 7f92b4b2f640 1 -- start start 2024-09-12T01:53:02.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.321+0000 7f92b4b2f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92b0100a60 0x7f92b0073970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:02.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.321+0000 7f92b4b2f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92b0101400 0x7f92b0073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:02.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.321+0000 7f92b4b2f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b0106a60 0x7f92b006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:02.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.321+0000 7f92b4b2f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f92b0110fd0 con 0x7f92b0106a60 2024-09-12T01:53:02.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.321+0000 7f92b4b2f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f92b0110e50 con 0x7f92b0100a60 2024-09-12T01:53:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.321+0000 7f92b4b2f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f92b0111150 con 0x7f92b0101400 2024-09-12T01:53:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.321+0000 7f92aed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b0106a60 0x7f92b006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.322+0000 7f92aed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b0106a60 0x7f92b006cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44136/0 (socket says 172.21.15.70:44136) 2024-09-12T01:53:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.322+0000 7f92aed9d640 1 -- 172.21.15.70:0/804642004 learned_addr learned my addr 172.21.15.70:0/804642004 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.322+0000 7f92ae59c640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92b0100a60 0x7f92b0073970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.322+0000 7f92add9b640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92b0101400 0x7f92b0073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.322+0000 7f92aed9d640 1 -- 172.21.15.70:0/804642004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92b0101400 msgr2=0x7f92b0073eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.322+0000 7f92aed9d640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92b0101400 0x7f92b0073eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.322+0000 7f92aed9d640 1 -- 172.21.15.70:0/804642004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92b0100a60 msgr2=0x7f92b0073970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.322+0000 7f92aed9d640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92b0100a60 0x7f92b0073970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.322+0000 7f92aed9d640 1 -- 172.21.15.70:0/804642004 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b006d510 con 0x7f92b0106a60 2024-09-12T01:53:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.322+0000 7f92aed9d640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b0106a60 0x7f92b006cc50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f92a800ebb0 tx=0x7f92a8007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.323+0000 7f929f7fe640 1 -- 172.21.15.70:0/804642004 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8007ca0 con 0x7f92b0106a60 2024-09-12T01:53:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.323+0000 7f92b4b2f640 1 -- 172.21.15.70:0/804642004 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b006d7a0 con 0x7f92b0106a60 2024-09-12T01:53:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.323+0000 7f92b4b2f640 1 -- 172.21.15.70:0/804642004 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b0071720 con 0x7f92b0106a60 2024-09-12T01:53:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.323+0000 7f929f7fe640 1 -- 172.21.15.70:0/804642004 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f92a8007e40 con 0x7f92b0106a60 2024-09-12T01:53:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.323+0000 7f929f7fe640 1 -- 172.21.15.70:0/804642004 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8005940 con 0x7f92b0106a60 2024-09-12T01:53:02.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.324+0000 7f92b4b2f640 1 -- 172.21.15.70:0/804642004 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9290005290 con 0x7f92b0106a60 2024-09-12T01:53:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.326+0000 7f929f7fe640 1 -- 172.21.15.70:0/804642004 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f92a800e0d0 con 0x7f92b0106a60 2024-09-12T01:53:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.327+0000 7f929f7fe640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f92980a2c80 0x7f92980a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.327+0000 7f929f7fe640 1 -- 172.21.15.70:0/804642004 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f92a80d0870 con 0x7f92b0106a60 2024-09-12T01:53:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.327+0000 7f92ae59c640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f92980a2c80 0x7f92980a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:02.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.328+0000 7f92ae59c640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f92980a2c80 0x7f92980a5140 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92a0005fd0 tx=0x7f92a000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:02.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.331+0000 7f929f7fe640 1 -- 172.21.15.70:0/804642004 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f92a809d140 con 0x7f92b0106a60 2024-09-12T01:53:02.374 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:02.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.623+0000 7f92b4b2f640 1 -- 172.21.15.70:0/804642004 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9290005580 con 0x7f92b0106a60 2024-09-12T01:53:02.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.624+0000 7f929f7fe640 1 -- 172.21.15.70:0/804642004 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f92a80a1440 con 0x7f92b0106a60 2024-09-12T01:53:02.625 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:53:02.625 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-12T01:51:51:564560+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:51:51.387340+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24427,24433,24437,24445,24452]},"id":1}]} 2024-09-12T01:53:02.626 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-12T01:53:02.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.626+0000 7f92b4b2f640 1 -- 172.21.15.70:0/804642004 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f92980a2c80 msgr2=0x7f92980a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:02.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.626+0000 7f92b4b2f640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f92980a2c80 0x7f92980a5140 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92a0005fd0 tx=0x7f92a000b390 comp rx=0 tx=0).stop 2024-09-12T01:53:02.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.626+0000 7f92b4b2f640 1 -- 172.21.15.70:0/804642004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b0106a60 msgr2=0x7f92b006cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:02.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.626+0000 7f92b4b2f640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b0106a60 0x7f92b006cc50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f92a800ebb0 tx=0x7f92a8007590 comp rx=0 tx=0).stop 2024-09-12T01:53:02.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.626+0000 7f92b4b2f640 1 -- 172.21.15.70:0/804642004 shutdown_connections 2024-09-12T01:53:02.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.626+0000 7f92b4b2f640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f92980a2c80 0x7f92980a5140 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:02.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.626+0000 7f92b4b2f640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b0106a60 0x7f92b006cc50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:02.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.626+0000 7f92b4b2f640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92b0101400 0x7f92b0073eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:02.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.626+0000 7f92b4b2f640 1 --2- 172.21.15.70:0/804642004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92b0100a60 0x7f92b0073970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:02.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.626+0000 7f92b4b2f640 1 -- 172.21.15.70:0/804642004 >> 172.21.15.70:0/804642004 conn(0x7f92b00fc780 msgr2=0x7f92b00fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:02.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.626+0000 7f92b4b2f640 1 -- 172.21.15.70:0/804642004 shutdown_connections 2024-09-12T01:53:02.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:02.626+0000 7f92b4b2f640 1 -- 172.21.15.70:0/804642004 wait complete. 2024-09-12T01:53:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:02 smithi070 ceph-mon[31177]: pgmap v363: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-12T01:53:02.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:02 smithi191 ceph-mon[35770]: pgmap v363: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-12T01:53:03.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:02 smithi152 ceph-mon[35055]: pgmap v363: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-09-12T01:53:03.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.126+0000 7f8fa5091640 1 -- 172.21.15.70:0/2479214442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa0100e20 msgr2=0x7f8fa0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.126+0000 7f8fa5091640 1 --2- 172.21.15.70:0/2479214442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa0100e20 0x7f8fa0101200 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009900 tx=0x7f8f9002a480 comp rx=0 tx=0).stop 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.126+0000 7f8fa5091640 1 -- 172.21.15.70:0/2479214442 shutdown_connections 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.126+0000 7f8fa5091640 1 --2- 172.21.15.70:0/2479214442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa0102ef0 0x7f8fa010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.126+0000 7f8fa5091640 1 --2- 172.21.15.70:0/2479214442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fa0102570 0x7f8fa01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.126+0000 7f8fa5091640 1 --2- 172.21.15.70:0/2479214442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa0100e20 0x7f8fa0101200 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.126+0000 7f8fa5091640 1 -- 172.21.15.70:0/2479214442 >> 172.21.15.70:0/2479214442 conn(0x7f8fa00fc7d0 msgr2=0x7f8fa00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.126+0000 7f8fa5091640 1 -- 172.21.15.70:0/2479214442 shutdown_connections 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.126+0000 7f8fa5091640 1 -- 172.21.15.70:0/2479214442 wait complete. 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.127+0000 7f8fa5091640 1 Processor -- start 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.128+0000 7f8fa5091640 1 -- start start 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.128+0000 7f8fa5091640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa0102570 0x7f8fa0196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.128+0000 7f8fa5091640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fa0102ef0 0x7f8fa0196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.128+0000 7f8fa5091640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa019af00 0x7f8fa019b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.128+0000 7f8fa5091640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa0110010 con 0x7f8fa019af00 2024-09-12T01:53:03.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.128+0000 7f8f9e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fa0102ef0 0x7f8fa0196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.129+0000 7f8f9e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fa0102ef0 0x7f8fa0196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:52328/0 (socket says 172.21.15.70:52328) 2024-09-12T01:53:03.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.129+0000 7f8f9e59c640 1 -- 172.21.15.70:0/1560745751 learned_addr learned my addr 172.21.15.70:0/1560745751 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:03.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.129+0000 7f8f9f59e640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa019af00 0x7f8fa019b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.129+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa0102570 0x7f8fa0196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.129+0000 7f8fa5091640 1 -- 172.21.15.70:0/1560745751 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa010fe90 con 0x7f8fa0102ef0 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.129+0000 7f8fa5091640 1 -- 172.21.15.70:0/1560745751 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa0110190 con 0x7f8fa0102570 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.129+0000 7f8f9f59e640 1 -- 172.21.15.70:0/1560745751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa0102570 msgr2=0x7f8fa0196630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.129+0000 7f8f9f59e640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa0102570 0x7f8fa0196630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.129+0000 7f8f9f59e640 1 -- 172.21.15.70:0/1560745751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fa0102ef0 msgr2=0x7f8fa0196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.129+0000 7f8f9f59e640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fa0102ef0 0x7f8fa0196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.129+0000 7f8f9f59e640 1 -- 172.21.15.70:0/1560745751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa019b9c0 con 0x7f8fa019af00 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.129+0000 7f8f9f59e640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa019af00 0x7f8fa019b3b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8f98012f90 tx=0x7f8f98010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.130+0000 7f8f87fff640 1 -- 172.21.15.70:0/1560745751 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f98010df0 con 0x7f8fa019af00 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.130+0000 7f8f87fff640 1 -- 172.21.15.70:0/1560745751 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f98004b20 con 0x7f8fa019af00 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.130+0000 7f8f87fff640 1 -- 172.21.15.70:0/1560745751 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9800be60 con 0x7f8fa019af00 2024-09-12T01:53:03.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.130+0000 7f8fa5091640 1 -- 172.21.15.70:0/1560745751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa019bc50 con 0x7f8fa019af00 2024-09-12T01:53:03.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.130+0000 7f8fa5091640 1 -- 172.21.15.70:0/1560745751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa01a33e0 con 0x7f8fa019af00 2024-09-12T01:53:03.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.134+0000 7f8fa746a740 1 Processor -- start 2024-09-12T01:53:03.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.134+0000 7f8f87fff640 1 -- 172.21.15.70:0/1560745751 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8f9801f020 con 0x7f8fa019af00 2024-09-12T01:53:03.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.134+0000 7f8fa746a740 1 -- start start 2024-09-12T01:53:03.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.134+0000 7f8fa746a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 0x55822743c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8f9e59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 0x55822743c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8f9e59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 0x55822743c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:32912/0 (socket says 172.21.15.70:32912) 2024-09-12T01:53:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8fa746a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 0x55822743ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8fa746a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558227447370 0x558227449760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8fa746a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5582273a22f0 con 0x558227447370 2024-09-12T01:53:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8fa746a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558227349cf0 con 0x55822743c5d0 2024-09-12T01:53:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8fa746a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55822739e2b0 con 0x55822743db40 2024-09-12T01:53:03.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8f9e59c640 1 -- 172.21.15.70:0/956398181 learned_addr learned my addr 172.21.15.70:0/956398181 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:03.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/956398181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558227447370 0x558227449760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/956398181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 0x55822743ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8f9e59c640 1 -- 172.21.15.70:0/956398181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 msgr2=0x55822743ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:03.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/956398181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 0x55822743ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8f9e59c640 1 -- 172.21.15.70:0/956398181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558227447370 msgr2=0x558227449760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:03.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/956398181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558227447370 0x558227449760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8f9e59c640 1 -- 172.21.15.70:0/956398181 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55822732e3a0 con 0x55822743db40 2024-09-12T01:53:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.135+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/956398181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 0x55822743ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.136+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/956398181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 0x55822743c090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009620 tx=0x7f8f94009910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85543ef0a693a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.136+0000 7f8f87fff640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8f880a2c00 0x7f8f880a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.136+0000 7f8f857fa640 1 -- 172.21.15.70:0/956398181 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400f8c0 con 0x55822743db40 2024-09-12T01:53:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.136+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8f880a2c00 0x7f8f880a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.136+0000 7f8f857fa640 1 -- 172.21.15.70:0/956398181 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f94010430 con 0x55822743db40 2024-09-12T01:53:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.136+0000 7f8f87fff640 1 -- 172.21.15.70:0/1560745751 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8f980d2890 con 0x7f8fa019af00 2024-09-12T01:53:03.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.136+0000 7f8f857fa640 1 -- 172.21.15.70:0/956398181 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400e610 con 0x55822743db40 2024-09-12T01:53:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.137+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8f880a2c00 0x7f8f880a50c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8f90006010 tx=0x7f8f90005b50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.137+0000 7f8fa746a740 1 -- 172.21.15.70:0/956398181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 msgr2=0x55822743c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.137+0000 7f8fa746a740 1 --2- 172.21.15.70:0/956398181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 0x55822743c090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009620 tx=0x7f8f94009910 comp rx=0 tx=0).stop 2024-09-12T01:53:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.137+0000 7f8fa746a740 1 -- 172.21.15.70:0/956398181 shutdown_connections 2024-09-12T01:53:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.137+0000 7f8fa746a740 1 --2- 172.21.15.70:0/956398181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558227447370 0x558227449760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.137+0000 7f8fa746a740 1 --2- 172.21.15.70:0/956398181 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 0x55822743ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.137+0000 7f8fa746a740 1 --2- 172.21.15.70:0/956398181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 0x55822743c090 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.137+0000 7f8fa746a740 1 -- 172.21.15.70:0/956398181 >> 172.21.15.70:0/956398181 conn(0x558227405310 msgr2=0x558227438c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.137+0000 7f8fa746a740 1 -- 172.21.15.70:0/956398181 shutdown_connections 2024-09-12T01:53:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.137+0000 7f8fa746a740 1 -- 172.21.15.70:0/956398181 wait complete. 2024-09-12T01:53:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.138+0000 7f8fa746a740 1 -- start start 2024-09-12T01:53:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.138+0000 7f8fa746a740 1 Processor -- start 2024-09-12T01:53:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8fa746a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 0x558227446d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8fa746a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 0x558227444010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8fa746a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558227447370 0x558227444600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8fa746a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55822744a070 con 0x558227447370 2024-09-12T01:53:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8fa746a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55822735d060 con 0x55822743c5d0 2024-09-12T01:53:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8fa746a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55822744a1f0 con 0x55822743db40 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8fa746a740 10 client.0 _ll_register_callbacks cb 0x5582270b08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8f9ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 0x558227446d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8f9ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 0x558227446d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:52344/0 (socket says 172.21.15.70:52344) 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8f9ed9d640 1 -- 172.21.15.70:0/836638514 learned_addr learned my addr 172.21.15.70:0/836638514 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 0x558227444010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8f9f59e640 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558227447370 0x558227444600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8f9ed9d640 1 -- 172.21.15.70:0/836638514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 msgr2=0x558227444010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 0x558227444010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8f9ed9d640 1 -- 172.21.15.70:0/836638514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558227447370 msgr2=0x558227444600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558227447370 0x558227444600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8f9ed9d640 1 -- 172.21.15.70:0/836638514 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582271133c0 con 0x55822743c5d0 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 0x558227444010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.139+0000 7f8f9f59e640 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558227447370 0x558227444600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.140+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 0x558227446d60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f90005c40 tx=0x7f8f90009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c047c3de4e20f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.140+0000 7f8f82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-12T01:53:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.140+0000 7f8f82ff5640 1 -- 172.21.15.70:0/836638514 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9004c070 con 0x55822743c5d0 2024-09-12T01:53:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.140+0000 7f8fa746a740 1 -- 172.21.15.70:0/836638514 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f94010430 con 0x55822743c5d0 2024-09-12T01:53:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.140+0000 7f8f82ff5640 1 -- 172.21.15.70:0/836638514 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8f90004d90 con 0x55822743c5d0 2024-09-12T01:53:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.140+0000 7f8f82ff5640 1 -- 172.21.15.70:0/836638514 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f90058050 con 0x55822743c5d0 2024-09-12T01:53:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.140+0000 7f8fa746a740 10 client.25244 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.141+0000 7f8fa746a740 1 -- 172.21.15.70:0/836638514 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558227455b60 con 0x55822743c5d0 2024-09-12T01:53:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.141+0000 7f8f82ff5640 1 -- 172.21.15.70:0/836638514 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f94010430 con 0x55822743c5d0 2024-09-12T01:53:03.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.141+0000 7f8f82ff5640 1 -- 172.21.15.70:0/836638514 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f90003ae0 con 0x55822743c5d0 2024-09-12T01:53:03.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.141+0000 7f8fa746a740 10 client.25244 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:03.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.141+0000 7f8fa746a740 10 client.25244 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:03.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.141+0000 7f8fa746a740 20 client.25244 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:03.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.141+0000 7f8fa746a740 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558227457340 0x5582274597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.141+0000 7f8fa746a740 4 client.25244 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:03.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.142+0000 7f8fa746a740 1 -- 172.21.15.70:0/836638514 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582273af860 con 0x558227457340 2024-09-12T01:53:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.142+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558227457340 0x5582274597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.142+0000 7f8f82ff5640 10 client.25244 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.142+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558227457340 0x5582274597c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c06be818d6f8f672 server_cookie=a002492bec1d1a64 in_seq=0 out_seq=0 2024-09-12T01:53:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8f82ff5640 1 -- 172.21.15.70:0/836638514 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582273af860 con 0x558227457340 2024-09-12T01:53:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8f82ff5640 10 client.25244 handle_command_reply: tid=0 2024-09-12T01:53:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8fa746a740 1 client.25244 shutdown 2024-09-12T01:53:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8fa746a740 1 -- 172.21.15.70:0/836638514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 msgr2=0x558227446d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8fa746a740 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 0x558227446d60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f90005c40 tx=0x7f8f90009260 comp rx=0 tx=0).stop 2024-09-12T01:53:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8fa746a740 1 -- 172.21.15.70:0/836638514 shutdown_connections 2024-09-12T01:53:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8fa746a740 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558227457340 0x5582274597c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8fa746a740 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558227447370 0x558227444600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8fa746a740 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743db40 0x558227444010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8fa746a740 1 --2- 172.21.15.70:0/836638514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743c5d0 0x558227446d60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8fa746a740 1 -- 172.21.15.70:0/836638514 >> 172.21.15.70:0/836638514 conn(0x558227405310 msgr2=0x55822743e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8f82ff5640 0 client.25244 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.143+0000 7f8fa746a740 1 -- 172.21.15.70:0/836638514 shutdown_connections 2024-09-12T01:53:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.144+0000 7f8fa746a740 1 -- 172.21.15.70:0/836638514 wait complete. 2024-09-12T01:53:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.144+0000 7f8fa746a740 20 client.25244 trim_cache size 0 max 16384 2024-09-12T01:53:03.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.169+0000 7f8fa746a740 1 Processor -- start 2024-09-12T01:53:03.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.169+0000 7f8fa746a740 1 -- start start 2024-09-12T01:53:03.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.169+0000 7f8fa746a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743c5d0 0x558227453310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.169+0000 7f8fa746a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743db40 0x55822743f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.169+0000 7f8f9e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743db40 0x55822743f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.169+0000 7f8fa746a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558227447370 0x55822743f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.169+0000 7f8f9e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743db40 0x55822743f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44200/0 (socket says 172.21.15.70:44200) 2024-09-12T01:53:03.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.169+0000 7f8f9e59c640 1 -- 172.21.15.70:0/1912180390 learned_addr learned my addr 172.21.15.70:0/1912180390 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:03.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.169+0000 7f8f9ed9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743c5d0 0x558227453310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.169+0000 7f8fa746a740 1 -- 172.21.15.70:0/1912180390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01abb00 con 0x55822743db40 2024-09-12T01:53:03.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.169+0000 7f8fa746a740 1 -- 172.21.15.70:0/1912180390 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01ad640 con 0x558227447370 2024-09-12T01:53:03.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.169+0000 7f8fa746a740 1 -- 172.21.15.70:0/1912180390 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01ac1d0 con 0x55822743c5d0 2024-09-12T01:53:03.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.170+0000 7f8f9ed9d640 1 -- 172.21.15.70:0/1912180390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558227447370 msgr2=0x55822743f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:03.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.170+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/1912180390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558227447370 0x55822743f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.170+0000 7f8f9ed9d640 1 -- 172.21.15.70:0/1912180390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743db40 msgr2=0x55822743f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.170+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/1912180390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743db40 0x55822743f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.170+0000 7f8f9ed9d640 1 -- 172.21.15.70:0/1912180390 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558227442560 con 0x55822743c5d0 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.170+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/1912180390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743db40 0x55822743f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.170+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/1912180390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743c5d0 0x558227453310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009230 tx=0x7f8f900485e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb033034909a8fe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.170+0000 7f8f84ff9640 1 -- 172.21.15.70:0/1912180390 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9004c070 con 0x55822743c5d0 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.170+0000 7f8f84ff9640 1 -- 172.21.15.70:0/1912180390 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f90061070 con 0x55822743c5d0 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.170+0000 7f8f84ff9640 1 -- 172.21.15.70:0/1912180390 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90035050 con 0x55822743c5d0 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.171+0000 7f8fa746a740 1 -- 172.21.15.70:0/1912180390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743c5d0 msgr2=0x558227453310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.171+0000 7f8fa746a740 1 --2- 172.21.15.70:0/1912180390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743c5d0 0x558227453310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009230 tx=0x7f8f900485e0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.171+0000 7f8fa746a740 1 -- 172.21.15.70:0/1912180390 shutdown_connections 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.171+0000 7f8fa746a740 1 --2- 172.21.15.70:0/1912180390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558227447370 0x55822743f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.171+0000 7f8fa746a740 1 --2- 172.21.15.70:0/1912180390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743db40 0x55822743f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.171+0000 7f8fa746a740 1 --2- 172.21.15.70:0/1912180390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55822743c5d0 0x558227453310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.171+0000 7f8fa746a740 1 -- 172.21.15.70:0/1912180390 >> 172.21.15.70:0/1912180390 conn(0x558227405310 msgr2=0x558227443550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:03.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.171+0000 7f8fa746a740 1 -- 172.21.15.70:0/1912180390 shutdown_connections 2024-09-12T01:53:03.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.171+0000 7f8fa746a740 1 -- 172.21.15.70:0/1912180390 wait complete. 2024-09-12T01:53:03.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.172+0000 7f8fa746a740 1 -- start start 2024-09-12T01:53:03.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.172+0000 7f8fa746a740 1 Processor -- start 2024-09-12T01:53:03.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.172+0000 7f8fa746a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743c5d0 0x55822744f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.172+0000 7f8fa746a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743db40 0x55822744fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.172+0000 7f8f9ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743c5d0 0x55822744f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.172+0000 7f8fa746a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558227447370 0x558227440820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.172+0000 7f8f9ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743c5d0 0x55822744f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44208/0 (socket says 172.21.15.70:44208) 2024-09-12T01:53:03.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.172+0000 7f8fa746a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01acf70 con 0x55822743c5d0 2024-09-12T01:53:03.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.172+0000 7f8fa746a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01ac8a0 con 0x55822743db40 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.172+0000 7f8fa746a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa01a9ac0 con 0x558227447370 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.172+0000 7f8fa746a740 10 client.0 _ll_register_callbacks cb 0x7f8f94005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.172+0000 7f8f9ed9d640 1 -- 172.21.15.70:0/4127016430 learned_addr learned my addr 172.21.15.70:0/4127016430 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743db40 0x55822744fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f9f59e640 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558227447370 0x558227440820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f9ed9d640 1 -- 172.21.15.70:0/4127016430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558227447370 msgr2=0x558227440820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558227447370 0x558227440820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f9ed9d640 1 -- 172.21.15.70:0/4127016430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743db40 msgr2=0x55822744fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743db40 0x55822744fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f9ed9d640 1 -- 172.21.15.70:0/4127016430 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558227440f60 con 0x55822743c5d0 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743db40 0x55822744fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f9f59e640 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558227447370 0x558227440820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:03.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f9ed9d640 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743c5d0 0x55822744f660 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8f90004f30 tx=0x7f8f90032800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9488dfacfa398dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:03.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:03.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f82ff5640 1 -- 172.21.15.70:0/4127016430 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9006a060 con 0x55822743c5d0 2024-09-12T01:53:03.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8fa746a740 1 -- 172.21.15.70:0/4127016430 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f90061070 con 0x55822743c5d0 2024-09-12T01:53:03.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f82ff5640 1 -- 172.21.15.70:0/4127016430 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8f90032df0 con 0x55822743c5d0 2024-09-12T01:53:03.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.173+0000 7f8f82ff5640 1 -- 172.21.15.70:0/4127016430 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8f90035040 con 0x55822743c5d0 2024-09-12T01:53:03.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.174+0000 7f8fa746a740 10 client.15834 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:03.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.174+0000 7f8fa746a740 1 -- 172.21.15.70:0/4127016430 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5582274ca2f0 con 0x55822743c5d0 2024-09-12T01:53:03.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.174+0000 7f8f82ff5640 1 -- 172.21.15.70:0/4127016430 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f900035f0 con 0x55822743c5d0 2024-09-12T01:53:03.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8f82ff5640 1 -- 172.21.15.70:0/4127016430 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8f9006f070 con 0x55822743c5d0 2024-09-12T01:53:03.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8fa746a740 10 client.15834 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8fa746a740 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8fa746a740 20 client.15834 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8fa746a740 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5582274ca950 0x5582274ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8fa746a740 4 client.15834 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:53:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8fa746a740 1 -- 172.21.15.70:0/4127016430 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f8f90061070 con 0x5582274ca950 2024-09-12T01:53:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5582274ca950 0x5582274ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8f9e59c640 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5582274ca950 0x5582274ccd40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc95ec5bdb4c45b server_cookie=84f7c57ab9af18d8 in_seq=0 out_seq=0 2024-09-12T01:53:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8f82ff5640 10 client.15834 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8f82ff5640 1 -- 172.21.15.70:0/4127016430 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f8f90061070 con 0x5582274ca950 2024-09-12T01:53:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8f82ff5640 10 client.15834 handle_command_reply: tid=0 2024-09-12T01:53:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.175+0000 7f8fa746a740 1 client.15834 shutdown 2024-09-12T01:53:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa746a740 1 -- 172.21.15.70:0/4127016430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743c5d0 msgr2=0x55822744f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:03.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa746a740 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743c5d0 0x55822744f660 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8f90004f30 tx=0x7f8f90032800 comp rx=0 tx=0).stop 2024-09-12T01:53:03.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa746a740 1 -- 172.21.15.70:0/4127016430 shutdown_connections 2024-09-12T01:53:03.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa746a740 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5582274ca950 0x5582274ccd40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa746a740 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558227447370 0x558227440820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa746a740 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55822743db40 0x55822744fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa746a740 1 --2- 172.21.15.70:0/4127016430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55822743c5d0 0x55822744f660 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa746a740 1 -- 172.21.15.70:0/4127016430 >> 172.21.15.70:0/4127016430 conn(0x558227405310 msgr2=0x5582274374e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:03.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8f82ff5640 0 client.15834 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:03.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa746a740 1 -- 172.21.15.70:0/4127016430 shutdown_connections 2024-09-12T01:53:03.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa746a740 1 -- 172.21.15.70:0/4127016430 wait complete. 2024-09-12T01:53:03.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa746a740 20 client.15834 trim_cache size 0 max 16384 2024-09-12T01:53:03.181 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:53:03.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa5091640 1 -- 172.21.15.70:0/1560745751 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8f880a2c00 msgr2=0x7f8f880a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:03.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.176+0000 7f8fa5091640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8f880a2c00 0x7f8f880a50c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8f90006010 tx=0x7f8f90005b50 comp rx=0 tx=0).stop 2024-09-12T01:53:03.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.177+0000 7f8fa5091640 1 -- 172.21.15.70:0/1560745751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa019af00 msgr2=0x7f8fa019b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:03.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.177+0000 7f8fa5091640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa019af00 0x7f8fa019b3b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8f98012f90 tx=0x7f8f98010490 comp rx=0 tx=0).stop 2024-09-12T01:53:03.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.177+0000 7f8fa5091640 1 -- 172.21.15.70:0/1560745751 shutdown_connections 2024-09-12T01:53:03.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.177+0000 7f8fa5091640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f8f880a2c00 0x7f8f880a50c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.177+0000 7f8fa5091640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8fa019af00 0x7f8fa019b3b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.177+0000 7f8fa5091640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fa0102ef0 0x7f8fa0196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.177+0000 7f8fa5091640 1 --2- 172.21.15.70:0/1560745751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fa0102570 0x7f8fa0196630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:03.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.177+0000 7f8fa5091640 1 -- 172.21.15.70:0/1560745751 >> 172.21.15.70:0/1560745751 conn(0x7f8fa00fc7d0 msgr2=0x7f8fa00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:03.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.177+0000 7f8fa5091640 1 -- 172.21.15.70:0/1560745751 shutdown_connections 2024-09-12T01:53:03.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:03.177+0000 7f8fa5091640 1 -- 172.21.15.70:0/1560745751 wait complete. 2024-09-12T01:53:03.763 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24452 quiesce db --set-id c24bc2c2 --release --await' 2024-09-12T01:53:03.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24452 quiesce db --set-id c24bc2c2 --release --await 2024-09-12T01:53:03.867 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:03 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/804642004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:53:03.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:03 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/804642004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:53:04.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:03 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/804642004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:53:04.249 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.340+0000 7fafdaf91640 1 -- 172.21.15.70:0/772181799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd4100d50 msgr2=0x7fafd41011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.340+0000 7fafdaf91640 1 --2- 172.21.15.70:0/772181799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd4100d50 0x7fafd41011b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009900 tx=0x7fafc002a410 comp rx=0 tx=0).stop 2024-09-12T01:53:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.341+0000 7fafdaf91640 1 -- 172.21.15.70:0/772181799 shutdown_connections 2024-09-12T01:53:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.341+0000 7fafdaf91640 1 --2- 172.21.15.70:0/772181799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafd41016f0 0x7fafd4101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.341+0000 7fafdaf91640 1 --2- 172.21.15.70:0/772181799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd4100d50 0x7fafd41011b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.341+0000 7fafdaf91640 1 --2- 172.21.15.70:0/772181799 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafd4100410 0x7fafd4100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.341+0000 7fafdaf91640 1 -- 172.21.15.70:0/772181799 >> 172.21.15.70:0/772181799 conn(0x7fafd40fc1e0 msgr2=0x7fafd40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.341+0000 7fafdaf91640 1 -- 172.21.15.70:0/772181799 shutdown_connections 2024-09-12T01:53:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.341+0000 7fafdaf91640 1 -- 172.21.15.70:0/772181799 wait complete. 2024-09-12T01:53:04.344 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.341+0000 7fafdaf91640 1 Processor -- start 2024-09-12T01:53:04.344 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.341+0000 7fafdaf91640 1 -- start start 2024-09-12T01:53:04.344 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafdaf91640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafd4100410 0x7fafd419a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.344 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafdaf91640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafd4100d50 0x7fafd419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.344 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafdaf91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd41016f0 0x7fafd41a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafdaf91640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fafd410fab0 con 0x7fafd41016f0 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafdaf91640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fafd410f930 con 0x7fafd4100d50 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafdaf91640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fafd410fc30 con 0x7fafd4100410 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafd952e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd41016f0 0x7fafd41a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafd952e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd41016f0 0x7fafd41a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44228/0 (socket says 172.21.15.70:44228) 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafd952e640 1 -- 172.21.15.70:0/3205985767 learned_addr learned my addr 172.21.15.70:0/3205985767 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafd3fff640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafd4100d50 0x7fafd419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafd8d2d640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafd4100410 0x7fafd419a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafd952e640 1 -- 172.21.15.70:0/3205985767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafd4100410 msgr2=0x7fafd419a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafd952e640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafd4100410 0x7fafd419a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafd952e640 1 -- 172.21.15.70:0/3205985767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafd4100d50 msgr2=0x7fafd419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafd952e640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafd4100d50 0x7fafd419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafd952e640 1 -- 172.21.15.70:0/3205985767 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd41a1c40 con 0x7fafd41016f0 2024-09-12T01:53:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.342+0000 7fafd952e640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd41016f0 0x7fafd41a15d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00eb10 tx=0x7fafcc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.343+0000 7fafd1ffb640 1 -- 172.21.15.70:0/3205985767 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc004b20 con 0x7fafd41016f0 2024-09-12T01:53:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.343+0000 7fafdaf91640 1 -- 172.21.15.70:0/3205985767 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd41a1f30 con 0x7fafd41016f0 2024-09-12T01:53:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.343+0000 7fafd1ffb640 1 -- 172.21.15.70:0/3205985767 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fafcc004cc0 con 0x7fafd41016f0 2024-09-12T01:53:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.343+0000 7fafd1ffb640 1 -- 172.21.15.70:0/3205985767 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0107f0 con 0x7fafd41016f0 2024-09-12T01:53:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.343+0000 7fafdaf91640 1 -- 172.21.15.70:0/3205985767 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd41a2440 con 0x7fafd41016f0 2024-09-12T01:53:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.346+0000 7fafd1ffb640 1 -- 172.21.15.70:0/3205985767 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fafcc005020 con 0x7fafd41016f0 2024-09-12T01:53:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.346+0000 7fafdde0b740 1 Processor -- start 2024-09-12T01:53:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.346+0000 7fafdde0b740 1 -- start start 2024-09-12T01:53:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.346+0000 7fafdde0b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 0x55e9241ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.346+0000 7fafdde0b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 0x55e9241d3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.346+0000 7fafdde0b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241d6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafdde0b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e9241322f0 con 0x55e9241d4370 2024-09-12T01:53:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafdde0b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e9240da270 con 0x55e9241cf2e0 2024-09-12T01:53:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafdde0b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e92412e2b0 con 0x55e9241ce9a0 2024-09-12T01:53:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241d6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241d6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44234/0 (socket says 172.21.15.70:44234) 2024-09-12T01:53:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd3fff640 1 -- 172.21.15.70:0/227886685 learned_addr learned my addr 172.21.15.70:0/227886685 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd8d2d640 1 --2- 172.21.15.70:0/227886685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 0x55e9241d3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd1ffb640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fafc40a2cb0 0x7fafc40a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd3fff640 1 --2- 172.21.15.70:0/227886685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 0x55e9241ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd1ffb640 1 -- 172.21.15.70:0/3205985767 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fafcc0cf500 con 0x7fafd41016f0 2024-09-12T01:53:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd3fff640 1 -- 172.21.15.70:0/227886685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 msgr2=0x55e9241ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd3fff640 1 --2- 172.21.15.70:0/227886685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 0x55e9241ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd3fff640 1 -- 172.21.15.70:0/227886685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 msgr2=0x55e9241d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd3fff640 1 --2- 172.21.15.70:0/227886685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 0x55e9241d3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd952e640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fafc40a2cb0 0x7fafc40a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.347+0000 7fafd3fff640 1 -- 172.21.15.70:0/227886685 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9240d9340 con 0x55e9241d4370 2024-09-12T01:53:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.348+0000 7fafd3fff640 1 --2- 172.21.15.70:0/227886685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241d6830 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fafc002a930 tx=0x7fafc0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd54cf7660b985b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.348+0000 7fafbeffd640 1 -- 172.21.15.70:0/227886685 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0035040 con 0x55e9241d4370 2024-09-12T01:53:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.348+0000 7fafbeffd640 1 -- 172.21.15.70:0/227886685 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fafc0005530 con 0x55e9241d4370 2024-09-12T01:53:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.348+0000 7fafbeffd640 1 -- 172.21.15.70:0/227886685 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0004cf0 con 0x55e9241d4370 2024-09-12T01:53:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.348+0000 7fafdde0b740 1 -- 172.21.15.70:0/227886685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 msgr2=0x55e9241d6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.348+0000 7fafdde0b740 1 --2- 172.21.15.70:0/227886685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241d6830 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fafc002a930 tx=0x7fafc0000bc0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.348+0000 7fafd952e640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fafc40a2cb0 0x7fafc40a5170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fafcc09ba60 tx=0x7fafcc005990 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.349+0000 7fafdde0b740 1 -- 172.21.15.70:0/227886685 shutdown_connections 2024-09-12T01:53:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.349+0000 7fafdde0b740 1 --2- 172.21.15.70:0/227886685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241d6830 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.349+0000 7fafdde0b740 1 --2- 172.21.15.70:0/227886685 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 0x55e9241d3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.349+0000 7fafdde0b740 1 --2- 172.21.15.70:0/227886685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 0x55e9241ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.349+0000 7fafdde0b740 1 -- 172.21.15.70:0/227886685 >> 172.21.15.70:0/227886685 conn(0x55e9241ca010 msgr2=0x55e9241ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.349+0000 7fafdde0b740 1 -- 172.21.15.70:0/227886685 shutdown_connections 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.349+0000 7fafdde0b740 1 -- 172.21.15.70:0/227886685 wait complete. 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.349+0000 7fafdde0b740 1 -- start start 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.349+0000 7fafdde0b740 1 Processor -- start 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafdde0b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 0x55e9241d8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafdde0b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 0x55e9241d9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafdde0b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafdde0b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e9241d7340 con 0x55e9241d4370 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafdde0b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e9240bb290 con 0x55e9241cf2e0 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafdde0b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e9241d74c0 con 0x55e9241ce9a0 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafdde0b740 10 client.0 _ll_register_callbacks cb 0x55e9240ec140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafd3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafd3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241e01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44242/0 (socket says 172.21.15.70:44242) 2024-09-12T01:53:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafd3fff640 1 -- 172.21.15.70:0/1751406251 learned_addr learned my addr 172.21.15.70:0/1751406251 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafd8d2d640 1 --2- 172.21.15.70:0/1751406251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 0x55e9241d9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafd3fff640 1 -- 172.21.15.70:0/1751406251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 msgr2=0x55e9241d8c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:53:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafd3fff640 1 --2- 172.21.15.70:0/1751406251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 0x55e9241d8c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafd3fff640 1 -- 172.21.15.70:0/1751406251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 msgr2=0x55e9241d9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafd3fff640 1 --2- 172.21.15.70:0/1751406251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 0x55e9241d9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafd3fff640 1 -- 172.21.15.70:0/1751406251 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e923e45210 con 0x55e9241d4370 2024-09-12T01:53:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafd3fff640 1 --2- 172.21.15.70:0/1751406251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241e01a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fafc00314d0 tx=0x7fafc0031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780bdc4d452b1a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.350+0000 7fafb3fff640 1 -- 172.21.15.70:0/1751406251 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0035070 con 0x55e9241d4370 2024-09-12T01:53:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafb3fff640 1 -- 172.21.15.70:0/1751406251 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fafc00037f0 con 0x55e9241d4370 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafdde0b740 1 -- 172.21.15.70:0/1751406251 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafc0005530 con 0x55e9241d4370 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafb3fff640 1 -- 172.21.15.70:0/1751406251 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fafc0031920 con 0x55e9241d4370 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafdde0b740 10 client.15846 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafdde0b740 1 -- 172.21.15.70:0/1751406251 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e923f11620 con 0x55e9241d4370 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafb3fff640 1 -- 172.21.15.70:0/1751406251 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fafc0005530 con 0x55e9241d4370 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafb3fff640 1 -- 172.21.15.70:0/1751406251 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fafc0005090 con 0x55e9241d4370 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafdde0b740 10 client.15846 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafdde0b740 10 client.15846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafdde0b740 20 client.15846 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafdde0b740 1 --2- 172.21.15.70:0/1751406251 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e9241e44a0 0x55e9241e6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafdde0b740 4 client.15846 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.351+0000 7fafdde0b740 1 -- 172.21.15.70:0/1751406251 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e92413fa20 con 0x55e9241e44a0 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.352+0000 7fafd8d2d640 1 --2- 172.21.15.70:0/1751406251 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e9241e44a0 0x55e9241e6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.352+0000 7fafb3fff640 10 client.15846 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.352+0000 7fafd8d2d640 1 --2- 172.21.15.70:0/1751406251 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e9241e44a0 0x55e9241e6890 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7ff99475b545d09 server_cookie=4041b1b5b0ee8779 in_seq=0 out_seq=0 2024-09-12T01:53:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafb3fff640 1 -- 172.21.15.70:0/1751406251 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e92413fa20 con 0x55e9241e44a0 2024-09-12T01:53:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafb3fff640 10 client.15846 handle_command_reply: tid=0 2024-09-12T01:53:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafdde0b740 1 client.15846 shutdown 2024-09-12T01:53:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafdde0b740 1 -- 172.21.15.70:0/1751406251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 msgr2=0x55e9241e01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafdde0b740 1 --2- 172.21.15.70:0/1751406251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241e01a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fafc00314d0 tx=0x7fafc0031640 comp rx=0 tx=0).stop 2024-09-12T01:53:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafdde0b740 1 -- 172.21.15.70:0/1751406251 shutdown_connections 2024-09-12T01:53:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafdde0b740 1 --2- 172.21.15.70:0/1751406251 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e9241e44a0 0x55e9241e6890 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafdde0b740 1 --2- 172.21.15.70:0/1751406251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241e01a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafdde0b740 1 --2- 172.21.15.70:0/1751406251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 0x55e9241d9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafdde0b740 1 --2- 172.21.15.70:0/1751406251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 0x55e9241d8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafdde0b740 1 -- 172.21.15.70:0/1751406251 >> 172.21.15.70:0/1751406251 conn(0x55e9241ca010 msgr2=0x55e9241cb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafb3fff640 0 client.15846 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafdde0b740 1 -- 172.21.15.70:0/1751406251 shutdown_connections 2024-09-12T01:53:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.353+0000 7fafdde0b740 1 -- 172.21.15.70:0/1751406251 wait complete. 2024-09-12T01:53:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.354+0000 7fafdde0b740 20 client.15846 trim_cache size 0 max 16384 2024-09-12T01:53:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafdde0b740 1 Processor -- start 2024-09-12T01:53:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafdde0b740 1 -- start start 2024-09-12T01:53:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafdde0b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 0x55e9241e0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafdde0b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 0x55e9241e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafdde0b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241e1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafdde0b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41ab1d0 con 0x55e9241d4370 2024-09-12T01:53:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafdde0b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41acd10 con 0x55e9241cf2e0 2024-09-12T01:53:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafdde0b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41ab8a0 con 0x55e9241ce9a0 2024-09-12T01:53:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafd3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241e1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafd3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241e1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44248/0 (socket says 172.21.15.70:44248) 2024-09-12T01:53:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafd3fff640 1 -- 172.21.15.70:0/2441193054 learned_addr learned my addr 172.21.15.70:0/2441193054 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafd3fff640 1 --2- 172.21.15.70:0/2441193054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 0x55e9241e0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.368+0000 7fafd8d2d640 1 --2- 172.21.15.70:0/2441193054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 0x55e9241e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.369+0000 7fafd3fff640 1 -- 172.21.15.70:0/2441193054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 msgr2=0x55e9241e0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.369+0000 7fafd3fff640 1 --2- 172.21.15.70:0/2441193054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 0x55e9241e0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.369+0000 7fafd3fff640 1 -- 172.21.15.70:0/2441193054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 msgr2=0x55e9241e00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.369+0000 7fafd3fff640 1 --2- 172.21.15.70:0/2441193054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 0x55e9241e00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.369+0000 7fafd3fff640 1 -- 172.21.15.70:0/2441193054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9241d37b0 con 0x55e9241d4370 2024-09-12T01:53:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.369+0000 7fafd3fff640 1 --2- 172.21.15.70:0/2441193054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241e1150 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fafc00045d0 tx=0x7fafc002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0963cc74c92d08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.369+0000 7fafbe7fc640 1 -- 172.21.15.70:0/2441193054 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0035040 con 0x55e9241d4370 2024-09-12T01:53:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.369+0000 7fafbe7fc640 1 -- 172.21.15.70:0/2441193054 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fafc0005850 con 0x55e9241d4370 2024-09-12T01:53:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.369+0000 7fafbe7fc640 1 -- 172.21.15.70:0/2441193054 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0005200 con 0x55e9241d4370 2024-09-12T01:53:04.373 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.370+0000 7fafdde0b740 1 -- 172.21.15.70:0/2441193054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 msgr2=0x55e9241e1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.374 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.370+0000 7fafdde0b740 1 --2- 172.21.15.70:0/2441193054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241e1150 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fafc00045d0 tx=0x7fafc002a410 comp rx=0 tx=0).stop 2024-09-12T01:53:04.374 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.370+0000 7fafdde0b740 1 -- 172.21.15.70:0/2441193054 shutdown_connections 2024-09-12T01:53:04.374 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.370+0000 7fafdde0b740 1 --2- 172.21.15.70:0/2441193054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241d4370 0x55e9241e1150 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.374 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.370+0000 7fafdde0b740 1 --2- 172.21.15.70:0/2441193054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241cf2e0 0x55e9241e00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.374 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.370+0000 7fafdde0b740 1 --2- 172.21.15.70:0/2441193054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241ce9a0 0x55e9241e0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.374 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.370+0000 7fafdde0b740 1 -- 172.21.15.70:0/2441193054 >> 172.21.15.70:0/2441193054 conn(0x55e9241ca010 msgr2=0x55e9241d8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.374 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.371+0000 7fafdde0b740 1 -- 172.21.15.70:0/2441193054 shutdown_connections 2024-09-12T01:53:04.375 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.371+0000 7fafdde0b740 1 -- 172.21.15.70:0/2441193054 wait complete. 2024-09-12T01:53:04.377 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.371+0000 7fafdde0b740 1 -- start start 2024-09-12T01:53:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.371+0000 7fafdde0b740 1 Processor -- start 2024-09-12T01:53:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.372+0000 7fafdde0b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241ce9a0 0x55e9241dd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.372+0000 7fafdde0b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241cf2e0 0x55e9241dd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.372+0000 7fafd3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241ce9a0 0x55e9241dd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.372+0000 7fafd8d2d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241cf2e0 0x55e9241dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.372+0000 7fafd8d2d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241cf2e0 0x55e9241dd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44258/0 (socket says 172.21.15.70:44258) 2024-09-12T01:53:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.372+0000 7fafd8d2d640 1 -- 172.21.15.70:0/3428965537 learned_addr learned my addr 172.21.15.70:0/3428965537 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.372+0000 7fafdde0b740 1 --2- 172.21.15.70:0/3428965537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241d4370 0x55e9241de810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.372+0000 7fafdde0b740 1 -- 172.21.15.70:0/3428965537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41ac640 con 0x55e9241cf2e0 2024-09-12T01:53:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.372+0000 7fafdde0b740 1 -- 172.21.15.70:0/3428965537 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41abf70 con 0x55e9241ce9a0 2024-09-12T01:53:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.372+0000 7fafdde0b740 1 -- 172.21.15.70:0/3428965537 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41a9190 con 0x55e9241d4370 2024-09-12T01:53:04.378 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafdde0b740 10 client.0 _ll_register_callbacks cb 0x7fafc8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafd8d2d640 1 -- 172.21.15.70:0/3428965537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241d4370 msgr2=0x55e9241de810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafd8d2d640 1 --2- 172.21.15.70:0/3428965537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241d4370 0x55e9241de810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafd8d2d640 1 -- 172.21.15.70:0/3428965537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241ce9a0 msgr2=0x55e9241dd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafd8d2d640 1 --2- 172.21.15.70:0/3428965537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241ce9a0 0x55e9241dd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafd8d2d640 1 -- 172.21.15.70:0/3428965537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9241dee20 con 0x55e9241cf2e0 2024-09-12T01:53:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafdde0b740 1 -- 172.21.15.70:0/3428965537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafc0005850 con 0x55e9241cf2e0 2024-09-12T01:53:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafd8d2d640 1 --2- 172.21.15.70:0/3428965537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241cf2e0 0x55e9241dd800 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55e9241cae90 tx=0x7fafc801f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a267edff20d6fc7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafb3fff640 10 client.15852 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafb3fff640 1 -- 172.21.15.70:0/3428965537 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc8005220 con 0x55e9241cf2e0 2024-09-12T01:53:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafb3fff640 1 -- 172.21.15.70:0/3428965537 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fafc80053c0 con 0x55e9241cf2e0 2024-09-12T01:53:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafb3fff640 1 -- 172.21.15.70:0/3428965537 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fafc80055c0 con 0x55e9241cf2e0 2024-09-12T01:53:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafdde0b740 10 client.15852 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.373+0000 7fafdde0b740 1 -- 172.21.15.70:0/3428965537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e9241e00e0 con 0x55e9241cf2e0 2024-09-12T01:53:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.374+0000 7fafb3fff640 1 -- 172.21.15.70:0/3428965537 <== mon.0 v2:172.21.15.70:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fafc80047a0 con 0x55e9241cf2e0 2024-09-12T01:53:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.374+0000 7fafdde0b740 10 client.15852 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.374+0000 7fafdde0b740 10 client.15852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.374+0000 7fafdde0b740 20 client.15852 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.374+0000 7fafdde0b740 1 --2- 172.21.15.70:0/3428965537 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e92424f560 0x55e924251950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.374+0000 7fafdde0b740 4 client.15852 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:53:04.381 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.374+0000 7fafdde0b740 1 -- 172.21.15.70:0/3428965537 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e924139d70 con 0x55e92424f560 2024-09-12T01:53:04.381 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.374+0000 7fafd3fff640 1 --2- 172.21.15.70:0/3428965537 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e92424f560 0x55e924251950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.381 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.375+0000 7fafd3fff640 1 --2- 172.21.15.70:0/3428965537 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e92424f560 0x55e924251950 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7d2d304e4ef47c8 server_cookie=e5d0e87fd5603139 in_seq=0 out_seq=0 2024-09-12T01:53:04.381 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.375+0000 7fafb3fff640 10 client.15852 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.378+0000 7fafb3fff640 1 -- 172.21.15.70:0/3428965537 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e924139d70 con 0x55e92424f560 2024-09-12T01:53:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.378+0000 7fafb3fff640 10 client.15852 handle_command_reply: tid=0 2024-09-12T01:53:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.378+0000 7fafdde0b740 1 client.15852 shutdown 2024-09-12T01:53:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.379+0000 7fafdde0b740 1 -- 172.21.15.70:0/3428965537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241cf2e0 msgr2=0x55e9241dd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.379+0000 7fafdde0b740 1 --2- 172.21.15.70:0/3428965537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241cf2e0 0x55e9241dd800 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55e9241cae90 tx=0x7fafc801f770 comp rx=0 tx=0).stop 2024-09-12T01:53:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.379+0000 7fafdde0b740 1 -- 172.21.15.70:0/3428965537 shutdown_connections 2024-09-12T01:53:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.379+0000 7fafdde0b740 1 --2- 172.21.15.70:0/3428965537 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e92424f560 0x55e924251950 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.379+0000 7fafdde0b740 1 --2- 172.21.15.70:0/3428965537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9241d4370 0x55e9241de810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.379+0000 7fafb3fff640 0 client.15852 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.379+0000 7fafdde0b740 1 --2- 172.21.15.70:0/3428965537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e9241cf2e0 0x55e9241dd800 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.379+0000 7fafdde0b740 1 --2- 172.21.15.70:0/3428965537 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e9241ce9a0 0x55e9241dd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.379+0000 7fafdde0b740 1 -- 172.21.15.70:0/3428965537 >> 172.21.15.70:0/3428965537 conn(0x55e9241ca010 msgr2=0x55e9241e0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.379+0000 7fafdde0b740 1 -- 172.21.15.70:0/3428965537 shutdown_connections 2024-09-12T01:53:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.379+0000 7fafdde0b740 1 -- 172.21.15.70:0/3428965537 wait complete. 2024-09-12T01:53:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.379+0000 7fafdde0b740 20 client.15852 trim_cache size 0 max 16384 2024-09-12T01:53:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:53:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:53:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:53:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:53:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.380+0000 7fafdaf91640 1 -- 172.21.15.70:0/3205985767 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fafc40a2cb0 msgr2=0x7fafc40a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.380+0000 7fafdaf91640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fafc40a2cb0 0x7fafc40a5170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fafcc09ba60 tx=0x7fafcc005990 comp rx=0 tx=0).stop 2024-09-12T01:53:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.380+0000 7fafdaf91640 1 -- 172.21.15.70:0/3205985767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd41016f0 msgr2=0x7fafd41a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.380+0000 7fafdaf91640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd41016f0 0x7fafd41a15d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00eb10 tx=0x7fafcc00c2d0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.380+0000 7fafdaf91640 1 -- 172.21.15.70:0/3205985767 shutdown_connections 2024-09-12T01:53:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.380+0000 7fafdaf91640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fafc40a2cb0 0x7fafc40a5170 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.380+0000 7fafdaf91640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd41016f0 0x7fafd41a15d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.380+0000 7fafdaf91640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafd4100d50 0x7fafd419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.380+0000 7fafdaf91640 1 --2- 172.21.15.70:0/3205985767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafd4100410 0x7fafd419a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.380+0000 7fafdaf91640 1 -- 172.21.15.70:0/3205985767 >> 172.21.15.70:0/3205985767 conn(0x7fafd40fc1e0 msgr2=0x7fafd40fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.380+0000 7fafdaf91640 1 -- 172.21.15.70:0/3205985767 shutdown_connections 2024-09-12T01:53:04.386 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:04.380+0000 7fafdaf91640 1 -- 172.21.15.70:0/3205985767 wait complete. 2024-09-12T01:53:04.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:04 smithi070 ceph-mon[31177]: pgmap v364: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T01:53:04.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.772+0000 7fce1b4ed640 1 -- 172.21.15.70:0/4022926787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce141049a0 msgr2=0x7fce141089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.772+0000 7fce1b4ed640 1 --2- 172.21.15.70:0/4022926787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce141049a0 0x7fce141089f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fce04009900 tx=0x7fce0402a3f0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.772+0000 7fce1b4ed640 1 -- 172.21.15.70:0/4022926787 shutdown_connections 2024-09-12T01:53:04.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.772+0000 7fce1b4ed640 1 --2- 172.21.15.70:0/4022926787 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce14109120 0x7fce14110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.772+0000 7fce1b4ed640 1 --2- 172.21.15.70:0/4022926787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce141049a0 0x7fce141089f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.772+0000 7fce1b4ed640 1 --2- 172.21.15.70:0/4022926787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce14103ff0 0x7fce141043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.772+0000 7fce1b4ed640 1 -- 172.21.15.70:0/4022926787 >> 172.21.15.70:0/4022926787 conn(0x7fce140ffab0 msgr2=0x7fce14101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.772+0000 7fce1b4ed640 1 -- 172.21.15.70:0/4022926787 shutdown_connections 2024-09-12T01:53:04.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.772+0000 7fce1b4ed640 1 -- 172.21.15.70:0/4022926787 wait complete. 2024-09-12T01:53:04.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.773+0000 7fce1b4ed640 1 Processor -- start 2024-09-12T01:53:04.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.773+0000 7fce1b4ed640 1 -- start start 2024-09-12T01:53:04.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.773+0000 7fce1b4ed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce14103ff0 0x7fce141a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.773+0000 7fce1b4ed640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce14109120 0x7fce141a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.773+0000 7fce1b4ed640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1419a720 0x7fce1419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.773+0000 7fce1b4ed640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fce141142f0 con 0x7fce14103ff0 2024-09-12T01:53:04.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.773+0000 7fce1b4ed640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fce14114170 con 0x7fce1419a720 2024-09-12T01:53:04.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.773+0000 7fce1b4ed640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fce14114470 con 0x7fce14109120 2024-09-12T01:53:04.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.773+0000 7fce19a8a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1419a720 0x7fce1419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.773+0000 7fce19289640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce14103ff0 0x7fce141a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.773+0000 7fce19a8a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1419a720 0x7fce1419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:52414/0 (socket says 172.21.15.70:52414) 2024-09-12T01:53:04.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.773+0000 7fce19a8a640 1 -- 172.21.15.70:0/3798742999 learned_addr learned my addr 172.21.15.70:0/3798742999 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:04.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.774+0000 7fce18a88640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce14109120 0x7fce141a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.774+0000 7fce19a8a640 1 -- 172.21.15.70:0/3798742999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce14109120 msgr2=0x7fce141a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.774+0000 7fce19a8a640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce14109120 0x7fce141a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.774+0000 7fce19a8a640 1 -- 172.21.15.70:0/3798742999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce14103ff0 msgr2=0x7fce141a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.774+0000 7fce19a8a640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce14103ff0 0x7fce141a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.774+0000 7fce19a8a640 1 -- 172.21.15.70:0/3798742999 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1419b2d0 con 0x7fce1419a720 2024-09-12T01:53:04.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.774+0000 7fce18a88640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce14109120 0x7fce141a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:04.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.774+0000 7fce19a8a640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1419a720 0x7fce1419aba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00eaa0 tx=0x7fce0c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.774+0000 7fce0a7fc640 1 -- 172.21.15.70:0/3798742999 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c00cdb0 con 0x7fce1419a720 2024-09-12T01:53:04.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.774+0000 7fce1b4ed640 1 -- 172.21.15.70:0/3798742999 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce141a7400 con 0x7fce1419a720 2024-09-12T01:53:04.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.774+0000 7fce0a7fc640 1 -- 172.21.15.70:0/3798742999 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce0c004b20 con 0x7fce1419a720 2024-09-12T01:53:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.775+0000 7fce0a7fc640 1 -- 172.21.15.70:0/3798742999 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c011760 con 0x7fce1419a720 2024-09-12T01:53:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.775+0000 7fce1b4ed640 1 -- 172.21.15.70:0/3798742999 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce141a77a0 con 0x7fce1419a720 2024-09-12T01:53:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.778+0000 7fce0a7fc640 1 -- 172.21.15.70:0/3798742999 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fce0c0119a0 con 0x7fce1419a720 2024-09-12T01:53:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.779+0000 7fce1d8c6740 1 Processor -- start 2024-09-12T01:53:04.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.779+0000 7fce1d8c6740 1 -- start start 2024-09-12T01:53:04.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.779+0000 7fce0a7fc640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fce000a2c80 0x7fce000a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.779+0000 7fce1d8c6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 0x560cf1d9a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.779+0000 7fce1d8c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1d9a980 0x560cf1da4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.779+0000 7fce18a88640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fce000a2c80 0x7fce000a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.779+0000 7fce1d8c6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1da5240 0x560cf1da7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.779+0000 7fce1d8c6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560cf1cff620 con 0x560cf1da5240 2024-09-12T01:53:04.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.779+0000 7fce1d8c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560cf1ca6e50 con 0x560cf1d9a980 2024-09-12T01:53:04.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce1d8c6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560cf1cfb5e0 con 0x560cf1d9a060 2024-09-12T01:53:04.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce19289640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 0x560cf1d9a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce19289640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 0x560cf1d9a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:33042/0 (socket says 172.21.15.70:33042) 2024-09-12T01:53:04.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce19289640 1 -- 172.21.15.70:0/3006394405 learned_addr learned my addr 172.21.15.70:0/3006394405 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:04.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce18a88640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fce000a2c80 0x7fce000a5140 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fce04006010 tx=0x7fce04000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce19a8a640 1 --2- 172.21.15.70:0/3006394405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1da5240 0x560cf1da7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce19289640 1 -- 172.21.15.70:0/3006394405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1d9a980 msgr2=0x560cf1da4d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:53:04.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce19289640 1 --2- 172.21.15.70:0/3006394405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1d9a980 0x560cf1da4d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce19289640 1 -- 172.21.15.70:0/3006394405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1da5240 msgr2=0x560cf1da7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce19289640 1 --2- 172.21.15.70:0/3006394405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1da5240 0x560cf1da7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce19289640 1 -- 172.21.15.70:0/3006394405 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cf1c97d40 con 0x560cf1d9a060 2024-09-12T01:53:04.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce19a8a640 1 --2- 172.21.15.70:0/3006394405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1da5240 0x560cf1da7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:04.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.780+0000 7fce0a7fc640 1 -- 172.21.15.70:0/3798742999 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fce0c0cf1e0 con 0x7fce1419a720 2024-09-12T01:53:04.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.781+0000 7fce19289640 1 --2- 172.21.15.70:0/3006394405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 0x560cf1d9a440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fce10009cf0 tx=0x7fce10011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33cc1f7a6d1d8157 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.781+0000 7fcdff7fe640 1 -- 172.21.15.70:0/3006394405 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10004230 con 0x560cf1d9a060 2024-09-12T01:53:04.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.781+0000 7fcdff7fe640 1 -- 172.21.15.70:0/3006394405 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce100043d0 con 0x560cf1d9a060 2024-09-12T01:53:04.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.781+0000 7fcdff7fe640 1 -- 172.21.15.70:0/3006394405 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10004230 con 0x560cf1d9a060 2024-09-12T01:53:04.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.782+0000 7fce1d8c6740 1 -- 172.21.15.70:0/3006394405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 msgr2=0x560cf1d9a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.782+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/3006394405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 0x560cf1d9a440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fce10009cf0 tx=0x7fce10011810 comp rx=0 tx=0).stop 2024-09-12T01:53:04.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.782+0000 7fce1d8c6740 1 -- 172.21.15.70:0/3006394405 shutdown_connections 2024-09-12T01:53:04.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.782+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/3006394405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1da5240 0x560cf1da7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.782+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/3006394405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1d9a980 0x560cf1da4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.782+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/3006394405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 0x560cf1d9a440 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.782+0000 7fce1d8c6740 1 -- 172.21.15.70:0/3006394405 >> 172.21.15.70:0/3006394405 conn(0x560cf1d965f0 msgr2=0x560cf1d969d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.782+0000 7fce1d8c6740 1 -- 172.21.15.70:0/3006394405 shutdown_connections 2024-09-12T01:53:04.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.782+0000 7fce1d8c6740 1 -- 172.21.15.70:0/3006394405 wait complete. 2024-09-12T01:53:04.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.783+0000 7fce1d8c6740 1 -- start start 2024-09-12T01:53:04.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.783+0000 7fce1d8c6740 1 Processor -- start 2024-09-12T01:53:04.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.784+0000 7fce1d8c6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 0x560cf1da20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.784+0000 7fce1d8c6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a980 0x560cf1da2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.784+0000 7fce1d8c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1da5240 0x560cf1da2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.784+0000 7fce19289640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 0x560cf1da20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.784+0000 7fce1d8c6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560cf1da7e10 con 0x560cf1d9a060 2024-09-12T01:53:04.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.784+0000 7fce19289640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 0x560cf1da20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44292/0 (socket says 172.21.15.70:44292) 2024-09-12T01:53:04.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.784+0000 7fce19289640 1 -- 172.21.15.70:0/2134344407 learned_addr learned my addr 172.21.15.70:0/2134344407 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:04.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.784+0000 7fce1d8c6740 1 -- 172.21.15.70:0/2134344407 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560cf1c87f10 con 0x560cf1da5240 2024-09-12T01:53:04.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.784+0000 7fce1d8c6740 1 -- 172.21.15.70:0/2134344407 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560cf1da7f90 con 0x560cf1d9a980 2024-09-12T01:53:04.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.784+0000 7fce18a88640 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a980 0x560cf1da2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.785+0000 7fce19a8a640 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1da5240 0x560cf1da2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.785+0000 7fce18a88640 1 -- 172.21.15.70:0/2134344407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1da5240 msgr2=0x560cf1da2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.785+0000 7fce18a88640 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1da5240 0x560cf1da2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.785+0000 7fce18a88640 1 -- 172.21.15.70:0/2134344407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 msgr2=0x560cf1da20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.785+0000 7fce1d8c6740 10 client.0 _ll_register_callbacks cb 0x560cf1cabdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:04.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.785+0000 7fce18a88640 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 0x560cf1da20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.785+0000 7fce18a88640 1 -- 172.21.15.70:0/2134344407 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cf1a0e580 con 0x560cf1d9a980 2024-09-12T01:53:04.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.785+0000 7fce1d8c6740 1 -- 172.21.15.70:0/2134344407 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce100043d0 con 0x560cf1d9a980 2024-09-12T01:53:04.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.785+0000 7fce18a88640 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a980 0x560cf1da2610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fce04008000 tx=0x7fce04009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0dcd17f3f0be207 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.785+0000 7fcdfcff9640 10 client.25159 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-12T01:53:04.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.786+0000 7fcdfcff9640 1 -- 172.21.15.70:0/2134344407 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04035050 con 0x560cf1d9a980 2024-09-12T01:53:04.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.786+0000 7fcdfcff9640 1 -- 172.21.15.70:0/2134344407 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fce040046c0 con 0x560cf1d9a980 2024-09-12T01:53:04.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.786+0000 7fcdfcff9640 1 -- 172.21.15.70:0/2134344407 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fce040048c0 con 0x560cf1d9a980 2024-09-12T01:53:04.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.786+0000 7fce1d8c6740 10 client.25159 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:04.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.786+0000 7fce1d8c6740 1 -- 172.21.15.70:0/2134344407 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({fsmap=28}) -- 0x560cf1ad8960 con 0x560cf1d9a980 2024-09-12T01:53:04.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.786+0000 7fcdfcff9640 1 -- 172.21.15.70:0/2134344407 <== mon.1 v2:172.21.15.191:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fce04004a60 con 0x560cf1d9a980 2024-09-12T01:53:04.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.786+0000 7fce1d8c6740 10 client.25159 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:04.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.786+0000 7fce1d8c6740 10 client.25159 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:53:04.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.786+0000 7fce1d8c6740 20 client.25159 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:04.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.786+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560cf1db4b10 0x560cf1db6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.786+0000 7fce1d8c6740 4 client.25159 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.786+0000 7fce1d8c6740 1 -- 172.21.15.70:0/2134344407 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cf1d0cb90 con 0x560cf1db4b10 2024-09-12T01:53:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.787+0000 7fce19289640 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560cf1db4b10 0x560cf1db6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.787+0000 7fcdfcff9640 10 client.25159 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.787+0000 7fce19289640 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560cf1db4b10 0x560cf1db6f60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d484307293040313 server_cookie=da32657ddc8440ba in_seq=0 out_seq=0 2024-09-12T01:53:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.788+0000 7fcdfcff9640 1 -- 172.21.15.70:0/2134344407 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560cf1d0cb90 con 0x560cf1db4b10 2024-09-12T01:53:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.788+0000 7fcdfcff9640 10 client.25159 handle_command_reply: tid=0 2024-09-12T01:53:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.788+0000 7fce1d8c6740 1 client.25159 shutdown 2024-09-12T01:53:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.788+0000 7fce1d8c6740 1 -- 172.21.15.70:0/2134344407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a980 msgr2=0x560cf1da2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.788+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a980 0x560cf1da2610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fce04008000 tx=0x7fce04009260 comp rx=0 tx=0).stop 2024-09-12T01:53:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.788+0000 7fce1d8c6740 1 -- 172.21.15.70:0/2134344407 shutdown_connections 2024-09-12T01:53:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.788+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560cf1db4b10 0x560cf1db6f60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.788+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1da5240 0x560cf1da2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.788+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a980 0x560cf1da2610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.788+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/2134344407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 0x560cf1da20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.788+0000 7fce1d8c6740 1 -- 172.21.15.70:0/2134344407 >> 172.21.15.70:0/2134344407 conn(0x560cf1d965f0 msgr2=0x560cf1d95750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.788+0000 7fcdfcff9640 0 client.25159 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:04.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.789+0000 7fce1d8c6740 1 -- 172.21.15.70:0/2134344407 shutdown_connections 2024-09-12T01:53:04.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.789+0000 7fce1d8c6740 1 -- 172.21.15.70:0/2134344407 wait complete. 2024-09-12T01:53:04.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.789+0000 7fce1d8c6740 20 client.25159 trim_cache size 0 max 16384 2024-09-12T01:53:04.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce1d8c6740 1 Processor -- start 2024-09-12T01:53:04.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce1d8c6740 1 -- start start 2024-09-12T01:53:04.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce1d8c6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 0x560cf1d9d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce1d8c6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a980 0x560cf1d9c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce1d8c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1da5240 0x560cf1dbc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce1d8c6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fce141afde0 con 0x560cf1d9a060 2024-09-12T01:53:04.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce1d8c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fce141b1920 con 0x560cf1da5240 2024-09-12T01:53:04.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce1d8c6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fce141b04b0 con 0x560cf1d9a980 2024-09-12T01:53:04.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce19289640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 0x560cf1d9d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce19289640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 0x560cf1d9d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44294/0 (socket says 172.21.15.70:44294) 2024-09-12T01:53:04.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce19289640 1 -- 172.21.15.70:0/3849944691 learned_addr learned my addr 172.21.15.70:0/3849944691 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:04.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce19a8a640 1 --2- 172.21.15.70:0/3849944691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1da5240 0x560cf1dbc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce18a88640 1 --2- 172.21.15.70:0/3849944691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a980 0x560cf1d9c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce19289640 1 -- 172.21.15.70:0/3849944691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a980 msgr2=0x560cf1d9c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce19289640 1 --2- 172.21.15.70:0/3849944691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a980 0x560cf1d9c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce19289640 1 -- 172.21.15.70:0/3849944691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1da5240 msgr2=0x560cf1dbc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce19289640 1 --2- 172.21.15.70:0/3849944691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1da5240 0x560cf1dbc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.806+0000 7fce19289640 1 -- 172.21.15.70:0/3849944691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cf1da4010 con 0x560cf1d9a060 2024-09-12T01:53:04.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.807+0000 7fce19289640 1 --2- 172.21.15.70:0/3849944691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 0x560cf1d9d380 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fce10004630 tx=0x7fce10011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe0ec6067fc834d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.807+0000 7fcdfeffd640 1 -- 172.21.15.70:0/3849944691 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10030070 con 0x560cf1d9a060 2024-09-12T01:53:04.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.807+0000 7fcdfeffd640 1 -- 172.21.15.70:0/3849944691 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce100035f0 con 0x560cf1d9a060 2024-09-12T01:53:04.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.807+0000 7fcdfeffd640 1 -- 172.21.15.70:0/3849944691 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce100048a0 con 0x560cf1d9a060 2024-09-12T01:53:04.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.808+0000 7fce1d8c6740 1 -- 172.21.15.70:0/3849944691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 msgr2=0x560cf1d9d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.808+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/3849944691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 0x560cf1d9d380 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fce10004630 tx=0x7fce10011810 comp rx=0 tx=0).stop 2024-09-12T01:53:04.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.808+0000 7fce1d8c6740 1 -- 172.21.15.70:0/3849944691 shutdown_connections 2024-09-12T01:53:04.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.808+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/3849944691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1da5240 0x560cf1dbc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.808+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/3849944691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a980 0x560cf1d9c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.808+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/3849944691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1d9a060 0x560cf1d9d380 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.808+0000 7fce1d8c6740 1 -- 172.21.15.70:0/3849944691 >> 172.21.15.70:0/3849944691 conn(0x560cf1d965f0 msgr2=0x560cf1d9bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.808+0000 7fce1d8c6740 1 -- 172.21.15.70:0/3849944691 shutdown_connections 2024-09-12T01:53:04.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.808+0000 7fce1d8c6740 1 -- 172.21.15.70:0/3849944691 wait complete. 2024-09-12T01:53:04.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.808+0000 7fce1d8c6740 1 -- start start 2024-09-12T01:53:04.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.808+0000 7fce1d8c6740 1 Processor -- start 2024-09-12T01:53:04.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce1d8c6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 0x560cf1dad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce1d8c6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1d9a980 0x560cf1da9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce1d8c6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1da5240 0x560cf1daa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce1d8c6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fce141b1250 con 0x560cf1da5240 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce1d8c6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fce141b0b80 con 0x560cf1d9a980 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce1d8c6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fce141adda0 con 0x560cf1d9a060 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce19289640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 0x560cf1dad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce19a8a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1da5240 0x560cf1daa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce19289640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 0x560cf1dad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:33078/0 (socket says 172.21.15.70:33078) 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce19289640 1 -- 172.21.15.70:0/830808567 learned_addr learned my addr 172.21.15.70:0/830808567 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce18a88640 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1d9a980 0x560cf1da9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce1d8c6740 10 client.0 _ll_register_callbacks cb 0x7fce04009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce19289640 1 -- 172.21.15.70:0/830808567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1d9a980 msgr2=0x560cf1da9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce19289640 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1d9a980 0x560cf1da9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce19289640 1 -- 172.21.15.70:0/830808567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1da5240 msgr2=0x560cf1daa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce19289640 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1da5240 0x560cf1daa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce19289640 1 -- 172.21.15.70:0/830808567 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cf1daa9d0 con 0x560cf1d9a060 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce18a88640 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1d9a980 0x560cf1da9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.809+0000 7fce19a8a640 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1da5240 0x560cf1daa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.810+0000 7fce19289640 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 0x560cf1dad920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce10004600 tx=0x7fce100039d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28486e58b56b313 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.810+0000 7fcdfcff9640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.810+0000 7fcdfcff9640 1 -- 172.21.15.70:0/830808567 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10030040 con 0x560cf1d9a060 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.810+0000 7fcdfcff9640 1 -- 172.21.15.70:0/830808567 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fce10003d40 con 0x560cf1d9a060 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.810+0000 7fce1d8c6740 1 -- 172.21.15.70:0/830808567 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce100035f0 con 0x560cf1d9a060 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.810+0000 7fcdfcff9640 1 -- 172.21.15.70:0/830808567 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fce10005040 con 0x560cf1d9a060 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.810+0000 7fce1d8c6740 10 client.25165 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.810+0000 7fce1d8c6740 1 -- 172.21.15.70:0/830808567 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560cf1e28fd0 con 0x560cf1d9a060 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.811+0000 7fcdfcff9640 1 -- 172.21.15.70:0/830808567 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce10039070 con 0x560cf1d9a060 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.811+0000 7fcdfcff9640 1 -- 172.21.15.70:0/830808567 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fce10004c40 con 0x560cf1d9a060 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.811+0000 7fce1d8c6740 10 client.25165 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:04.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.811+0000 7fce1d8c6740 10 client.25165 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:53:04.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.811+0000 7fce1d8c6740 20 client.25165 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:04.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.811+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560cf1e293f0 0x560cf1e2b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:04.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.811+0000 7fce1d8c6740 4 client.25165 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c24bc2c2", "release": true, "await": true}] 2024-09-12T01:53:04.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.811+0000 7fce1d8c6740 1 -- 172.21.15.70:0/830808567 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c24bc2c2", "release": true, "await": true}) -- 0x7fce100035f0 con 0x560cf1e293f0 2024-09-12T01:53:04.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.811+0000 7fce18a88640 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560cf1e293f0 0x560cf1e2b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:04.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.812+0000 7fcdfcff9640 10 client.25165 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:04.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.812+0000 7fce18a88640 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560cf1e293f0 0x560cf1e2b7e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf90d8b7fec79ee0 server_cookie=27ab79083684577 in_seq=0 out_seq=0 2024-09-12T01:53:04.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fcdfcff9640 1 -- 172.21.15.70:0/830808567 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fce100035f0 con 0x560cf1e293f0 2024-09-12T01:53:04.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fcdfcff9640 10 client.25165 handle_command_reply: tid=0 2024-09-12T01:53:04.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fce1d8c6740 1 client.25165 shutdown 2024-09-12T01:53:04.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fce1d8c6740 1 -- 172.21.15.70:0/830808567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 msgr2=0x560cf1dad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 0x560cf1dad920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce10004600 tx=0x7fce100039d0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fce1d8c6740 1 -- 172.21.15.70:0/830808567 shutdown_connections 2024-09-12T01:53:04.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560cf1e293f0 0x560cf1e2b7e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.818 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:53:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-09-12T01:53:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24452, 2024-09-12T01:53:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 4, 2024-09-12T01:53:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-12T01:53:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: "c24bc2c2": { 2024-09-12T01:53:04.818 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 4, 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 144.5, 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-12T01:53:04.819 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-12T01:53:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:53:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:53:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:53:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:53:04.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:53:04.820 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:53:04.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cf1da5240 0x560cf1daa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560cf1d9a980 0x560cf1da9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fce1d8c6740 1 --2- 172.21.15.70:0/830808567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560cf1d9a060 0x560cf1dad920 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fcdfcff9640 0 client.25165 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fce1d8c6740 1 -- 172.21.15.70:0/830808567 >> 172.21.15.70:0/830808567 conn(0x560cf1d965f0 msgr2=0x560cf1d9c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fce1d8c6740 1 -- 172.21.15.70:0/830808567 shutdown_connections 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fce1d8c6740 1 -- 172.21.15.70:0/830808567 wait complete. 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.814+0000 7fce1d8c6740 20 client.25165 trim_cache size 0 max 16384 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.815+0000 7fce1b4ed640 1 -- 172.21.15.70:0/3798742999 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fce000a2c80 msgr2=0x7fce000a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.815+0000 7fce1b4ed640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fce000a2c80 0x7fce000a5140 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fce04006010 tx=0x7fce04000bc0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.815+0000 7fce1b4ed640 1 -- 172.21.15.70:0/3798742999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1419a720 msgr2=0x7fce1419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.815+0000 7fce1b4ed640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1419a720 0x7fce1419aba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00eaa0 tx=0x7fce0c00ef60 comp rx=0 tx=0).stop 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.815+0000 7fce1b4ed640 1 -- 172.21.15.70:0/3798742999 shutdown_connections 2024-09-12T01:53:04.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.815+0000 7fce1b4ed640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fce000a2c80 0x7fce000a5140 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.815+0000 7fce1b4ed640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce1419a720 0x7fce1419aba0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.815+0000 7fce1b4ed640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce14109120 0x7fce141a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.815+0000 7fce1b4ed640 1 --2- 172.21.15.70:0/3798742999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce14103ff0 0x7fce141a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:04.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.815+0000 7fce1b4ed640 1 -- 172.21.15.70:0/3798742999 >> 172.21.15.70:0/3798742999 conn(0x7fce140ffab0 msgr2=0x7fce14100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:04.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.815+0000 7fce1b4ed640 1 -- 172.21.15.70:0/3798742999 shutdown_connections 2024-09-12T01:53:04.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:04.815+0000 7fce1b4ed640 1 -- 172.21.15.70:0/3798742999 wait complete. 2024-09-12T01:53:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:04 smithi191 ceph-mon[35770]: pgmap v364: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T01:53:05.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:04 smithi152 ceph-mon[35055]: pgmap v364: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T01:53:05.186 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:53:05.186 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:53:05.670 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c24bc2c2', total seconds elapsed: 29.5 2024-09-12T01:53:05.739 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.225+0000 7ff3f1dbf640 1 -- 172.21.15.70:0/914239797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3ec102570 msgr2=0x7ff3ec1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.225+0000 7ff3f1dbf640 1 --2- 172.21.15.70:0/914239797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3ec102570 0x7ff3ec1029b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009900 tx=0x7ff3e002a480 comp rx=0 tx=0).stop 2024-09-12T01:53:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.225+0000 7ff3f1dbf640 1 -- 172.21.15.70:0/914239797 shutdown_connections 2024-09-12T01:53:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.225+0000 7ff3f1dbf640 1 --2- 172.21.15.70:0/914239797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3ec102ef0 0x7ff3ec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.225+0000 7ff3f1dbf640 1 --2- 172.21.15.70:0/914239797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3ec102570 0x7ff3ec1029b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.225+0000 7ff3f1dbf640 1 --2- 172.21.15.70:0/914239797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3ec100e20 0x7ff3ec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.225+0000 7ff3f1dbf640 1 -- 172.21.15.70:0/914239797 >> 172.21.15.70:0/914239797 conn(0x7ff3ec0fc7d0 msgr2=0x7ff3ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.225+0000 7ff3f1dbf640 1 -- 172.21.15.70:0/914239797 shutdown_connections 2024-09-12T01:53:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.225+0000 7ff3f1dbf640 1 -- 172.21.15.70:0/914239797 wait complete. 2024-09-12T01:53:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.226+0000 7ff3f1dbf640 1 Processor -- start 2024-09-12T01:53:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.227+0000 7ff3f1dbf640 1 -- start start 2024-09-12T01:53:06.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.228+0000 7ff3f1dbf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3ec100e20 0x7ff3ec198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.228+0000 7ff3f1dbf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3ec102570 0x7ff3ec198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.228+0000 7ff3eb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3ec100e20 0x7ff3ec198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.228+0000 7ff3f1dbf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3ec102ef0 0x7ff3ec19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.228+0000 7ff3f1dbf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec1110c0 con 0x7ff3ec100e20 2024-09-12T01:53:06.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.228+0000 7ff3f1dbf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec110f40 con 0x7ff3ec102ef0 2024-09-12T01:53:06.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.228+0000 7ff3f1dbf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec111240 con 0x7ff3ec102570 2024-09-12T01:53:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.228+0000 7ff3eb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3ec100e20 0x7ff3ec198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44320/0 (socket says 172.21.15.70:44320) 2024-09-12T01:53:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.228+0000 7ff3eb7fe640 1 -- 172.21.15.70:0/4270150620 learned_addr learned my addr 172.21.15.70:0/4270150620 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.228+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3ec102570 0x7ff3ec198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.228+0000 7ff3ebfff640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3ec102ef0 0x7ff3ec19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.229+0000 7ff3eaffd640 1 -- 172.21.15.70:0/4270150620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3ec102ef0 msgr2=0x7ff3ec19cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.229+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3ec102ef0 0x7ff3ec19cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.229+0000 7ff3eaffd640 1 -- 172.21.15.70:0/4270150620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3ec100e20 msgr2=0x7ff3ec198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.229+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3ec100e20 0x7ff3ec198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.229+0000 7ff3eaffd640 1 -- 172.21.15.70:0/4270150620 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ec19d5d0 con 0x7ff3ec102570 2024-09-12T01:53:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.229+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3ec102570 0x7ff3ec198b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff3e002a9a0 tx=0x7ff3e00045c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:06.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.229+0000 7ff3e8ff9640 1 -- 172.21.15.70:0/4270150620 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e003f070 con 0x7ff3ec102570 2024-09-12T01:53:06.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.229+0000 7ff3f1dbf640 1 -- 172.21.15.70:0/4270150620 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3ec19d860 con 0x7ff3ec102570 2024-09-12T01:53:06.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.230+0000 7ff3f1dbf640 1 -- 172.21.15.70:0/4270150620 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3ec1a51a0 con 0x7ff3ec102570 2024-09-12T01:53:06.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.230+0000 7ff3e8ff9640 1 -- 172.21.15.70:0/4270150620 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff3e0005410 con 0x7ff3ec102570 2024-09-12T01:53:06.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.230+0000 7ff3e8ff9640 1 -- 172.21.15.70:0/4270150620 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0035030 con 0x7ff3ec102570 2024-09-12T01:53:06.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.233+0000 7ff3f4198740 1 Processor -- start 2024-09-12T01:53:06.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.233+0000 7ff3f4198740 1 -- start start 2024-09-12T01:53:06.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3f4198740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 0x5620ab87a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3f4198740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 0x5620ab884e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3f4198740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 0x5620ab887770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3f4198740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5620ab7db280 con 0x5620ab879fc0 2024-09-12T01:53:06.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3f4198740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5620ab782b10 con 0x5620ab885380 2024-09-12T01:53:06.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3f4198740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5620ab7d7240 con 0x5620ab87a8e0 2024-09-12T01:53:06.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3eb7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 0x5620ab884e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3ebfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 0x5620ab87a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3ebfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 0x5620ab87a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44324/0 (socket says 172.21.15.70:44324) 2024-09-12T01:53:06.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3ebfff640 1 -- 172.21.15.70:0/3864670635 learned_addr learned my addr 172.21.15.70:0/3864670635 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:06.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3ebfff640 1 -- 172.21.15.70:0/3864670635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 msgr2=0x5620ab884e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:06.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3ebfff640 1 --2- 172.21.15.70:0/3864670635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 0x5620ab884e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3ebfff640 1 -- 172.21.15.70:0/3864670635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 msgr2=0x5620ab887770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:53:06.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3ebfff640 1 --2- 172.21.15.70:0/3864670635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 0x5620ab887770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.234+0000 7ff3ebfff640 1 -- 172.21.15.70:0/3864670635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620ab78f1f0 con 0x5620ab879fc0 2024-09-12T01:53:06.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.235+0000 7ff3ebfff640 1 --2- 172.21.15.70:0/3864670635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 0x5620ab87a3a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009f80 tx=0x7ff3e40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4a58e5f8fe32d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:06.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.235+0000 7ff3f1dbf640 1 -- 172.21.15.70:0/3864670635 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4004d20 con 0x5620ab879fc0 2024-09-12T01:53:06.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.235+0000 7ff3f1dbf640 1 -- 172.21.15.70:0/3864670635 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff3e4004050 con 0x5620ab879fc0 2024-09-12T01:53:06.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.235+0000 7ff3f1dbf640 1 -- 172.21.15.70:0/3864670635 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4005310 con 0x5620ab879fc0 2024-09-12T01:53:06.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.236+0000 7ff3e8ff9640 1 -- 172.21.15.70:0/4270150620 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff3e0042070 con 0x7ff3ec102570 2024-09-12T01:53:06.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.236+0000 7ff3f4198740 1 -- 172.21.15.70:0/3864670635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 msgr2=0x5620ab87a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:06.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.236+0000 7ff3f4198740 1 --2- 172.21.15.70:0/3864670635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 0x5620ab87a3a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009f80 tx=0x7ff3e40118d0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.237+0000 7ff3f4198740 1 -- 172.21.15.70:0/3864670635 shutdown_connections 2024-09-12T01:53:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.237+0000 7ff3f4198740 1 --2- 172.21.15.70:0/3864670635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 0x5620ab887770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.237+0000 7ff3f4198740 1 --2- 172.21.15.70:0/3864670635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 0x5620ab884e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.237+0000 7ff3f4198740 1 --2- 172.21.15.70:0/3864670635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 0x5620ab87a3a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.237+0000 7ff3f4198740 1 -- 172.21.15.70:0/3864670635 >> 172.21.15.70:0/3864670635 conn(0x5620ab876730 msgr2=0x5620ab876b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.237+0000 7ff3e8ff9640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff3d40a2b80 0x7ff3d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.237+0000 7ff3e8ff9640 1 -- 172.21.15.70:0/4270150620 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff3e00ef7e0 con 0x7ff3ec102570 2024-09-12T01:53:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.237+0000 7ff3f4198740 1 -- 172.21.15.70:0/3864670635 shutdown_connections 2024-09-12T01:53:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.237+0000 7ff3ebfff640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff3d40a2b80 0x7ff3d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.237+0000 7ff3f4198740 1 -- 172.21.15.70:0/3864670635 wait complete. 2024-09-12T01:53:06.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.238+0000 7ff3f4198740 1 -- start start 2024-09-12T01:53:06.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.238+0000 7ff3ebfff640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff3d40a2b80 0x7ff3d40a5040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4005fd0 tx=0x7ff3e4005bd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:06.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.238+0000 7ff3f4198740 1 Processor -- start 2024-09-12T01:53:06.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.238+0000 7ff3f4198740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 0x5620ab884c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.238+0000 7ff3f4198740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 0x5620ab87df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3f4198740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 0x5620ab87e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3f4198740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5620ab887d70 con 0x5620ab879fc0 2024-09-12T01:53:06.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3f4198740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5620ab795f10 con 0x5620ab885380 2024-09-12T01:53:06.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3f4198740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5620ab887ef0 con 0x5620ab87a8e0 2024-09-12T01:53:06.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3f4198740 10 client.0 _ll_register_callbacks cb 0x5620ab75ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:06.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3eb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 0x5620ab884c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3eb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 0x5620ab884c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44338/0 (socket says 172.21.15.70:44338) 2024-09-12T01:53:06.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3eb7fe640 1 -- 172.21.15.70:0/102266185 learned_addr learned my addr 172.21.15.70:0/102266185 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:06.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 0x5620ab87df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3ebfff640 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 0x5620ab87e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3eb7fe640 1 -- 172.21.15.70:0/102266185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 msgr2=0x5620ab87df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:06.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3eb7fe640 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 0x5620ab87df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3eb7fe640 1 -- 172.21.15.70:0/102266185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 msgr2=0x5620ab87e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:06.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3eb7fe640 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 0x5620ab87e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.239+0000 7ff3eb7fe640 1 -- 172.21.15.70:0/102266185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620ab54c6a0 con 0x5620ab879fc0 2024-09-12T01:53:06.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.240+0000 7ff3eb7fe640 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 0x5620ab884c20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00be00 tx=0x7ff3dc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac046037f695ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:06.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.240+0000 7ff3caffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:06.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.240+0000 7ff3caffd640 1 -- 172.21.15.70:0/102266185 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc011440 con 0x5620ab879fc0 2024-09-12T01:53:06.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.240+0000 7ff3f4198740 1 -- 172.21.15.70:0/102266185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e4004050 con 0x5620ab879fc0 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.240+0000 7ff3caffd640 1 -- 172.21.15.70:0/102266185 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff3dc0115e0 con 0x5620ab879fc0 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.240+0000 7ff3caffd640 1 -- 172.21.15.70:0/102266185 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff3dc005020 con 0x5620ab879fc0 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.240+0000 7ff3f4198740 10 client.15879 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.240+0000 7ff3f4198740 1 -- 172.21.15.70:0/102266185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620ab898010 con 0x5620ab879fc0 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.241+0000 7ff3caffd640 1 -- 172.21.15.70:0/102266185 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff3e4004050 con 0x5620ab879fc0 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.242+0000 7ff3caffd640 1 -- 172.21.15.70:0/102266185 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff3dc0047a0 con 0x5620ab879fc0 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.242+0000 7ff3f4198740 10 client.15879 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.242+0000 7ff3f4198740 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.242+0000 7ff3f4198740 20 client.15879 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.242+0000 7ff3f4198740 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5620ab899850 0x5620ab89bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.242+0000 7ff3f4198740 4 client.15879 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.242+0000 7ff3f4198740 1 -- 172.21.15.70:0/102266185 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620ab7e87f0 con 0x5620ab899850 2024-09-12T01:53:06.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.242+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5620ab899850 0x5620ab89bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.243+0000 7ff3caffd640 10 client.15879 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:06.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.243+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5620ab899850 0x5620ab89bcc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f09312934d08a20b server_cookie=e7e19e59fb439401 in_seq=0 out_seq=0 2024-09-12T01:53:06.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.243+0000 7ff3caffd640 1 -- 172.21.15.70:0/102266185 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620ab7e87f0 con 0x5620ab899850 2024-09-12T01:53:06.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.243+0000 7ff3caffd640 10 client.15879 handle_command_reply: tid=0 2024-09-12T01:53:06.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.243+0000 7ff3f4198740 1 client.15879 shutdown 2024-09-12T01:53:06.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.244+0000 7ff3f4198740 1 -- 172.21.15.70:0/102266185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 msgr2=0x5620ab884c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:06.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.244+0000 7ff3f4198740 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 0x5620ab884c20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00be00 tx=0x7ff3dc0039c0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.244+0000 7ff3f4198740 1 -- 172.21.15.70:0/102266185 shutdown_connections 2024-09-12T01:53:06.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.244+0000 7ff3f4198740 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5620ab899850 0x5620ab89bcc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.244+0000 7ff3f4198740 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 0x5620ab87e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.244+0000 7ff3f4198740 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 0x5620ab87df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.244+0000 7ff3f4198740 1 --2- 172.21.15.70:0/102266185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab879fc0 0x5620ab884c20 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.244+0000 7ff3f4198740 1 -- 172.21.15.70:0/102266185 >> 172.21.15.70:0/102266185 conn(0x5620ab876730 msgr2=0x5620ab87c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:06.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.244+0000 7ff3caffd640 0 client.15879 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:06.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.244+0000 7ff3f4198740 1 -- 172.21.15.70:0/102266185 shutdown_connections 2024-09-12T01:53:06.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.244+0000 7ff3f4198740 1 -- 172.21.15.70:0/102266185 wait complete. 2024-09-12T01:53:06.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.244+0000 7ff3f4198740 20 client.15879 trim_cache size 0 max 16384 2024-09-12T01:53:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.261+0000 7ff3f4198740 1 Processor -- start 2024-09-12T01:53:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.261+0000 7ff3f4198740 1 -- start start 2024-09-12T01:53:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3f4198740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 0x5620ab871300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3f4198740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab885380 0x5620ab8a1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3f4198740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab882650 0x5620ab8a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3f4198740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec1ab310 con 0x5620ab885380 2024-09-12T01:53:06.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3f4198740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec1ace50 con 0x5620ab882650 2024-09-12T01:53:06.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3f4198740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec1ab9e0 con 0x5620ab87a8e0 2024-09-12T01:53:06.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3eaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab885380 0x5620ab8a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3eaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab885380 0x5620ab8a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44340/0 (socket says 172.21.15.70:44340) 2024-09-12T01:53:06.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3eaffd640 1 -- 172.21.15.70:0/285507830 learned_addr learned my addr 172.21.15.70:0/285507830 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:06.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3ebfff640 1 --2- 172.21.15.70:0/285507830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab882650 0x5620ab8a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3eaffd640 1 -- 172.21.15.70:0/285507830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 msgr2=0x5620ab871300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:53:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/285507830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 0x5620ab871300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3eaffd640 1 -- 172.21.15.70:0/285507830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab882650 msgr2=0x5620ab8a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/285507830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab882650 0x5620ab8a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3eaffd640 1 -- 172.21.15.70:0/285507830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620ab872120 con 0x5620ab885380 2024-09-12T01:53:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/285507830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab885380 0x5620ab8a1560 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00bbd00 tx=0x7ff3e0003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ffdfb0596e4d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3d17fa640 1 -- 172.21.15.70:0/285507830 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00dc0c0 con 0x5620ab885380 2024-09-12T01:53:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.262+0000 7ff3d17fa640 1 -- 172.21.15.70:0/285507830 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff3e00c03b0 con 0x5620ab885380 2024-09-12T01:53:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.263+0000 7ff3d17fa640 1 -- 172.21.15.70:0/285507830 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0003c80 con 0x5620ab885380 2024-09-12T01:53:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.263+0000 7ff3f4198740 1 -- 172.21.15.70:0/285507830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab885380 msgr2=0x5620ab8a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.263+0000 7ff3f4198740 1 --2- 172.21.15.70:0/285507830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab885380 0x5620ab8a1560 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00bbd00 tx=0x7ff3e0003bf0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.263+0000 7ff3f4198740 1 -- 172.21.15.70:0/285507830 shutdown_connections 2024-09-12T01:53:06.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.263+0000 7ff3f4198740 1 --2- 172.21.15.70:0/285507830 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab882650 0x5620ab8a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.263+0000 7ff3f4198740 1 --2- 172.21.15.70:0/285507830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab885380 0x5620ab8a1560 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.263+0000 7ff3f4198740 1 --2- 172.21.15.70:0/285507830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab87a8e0 0x5620ab871300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.263+0000 7ff3f4198740 1 -- 172.21.15.70:0/285507830 >> 172.21.15.70:0/285507830 conn(0x5620ab876730 msgr2=0x5620ab870bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:06.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.263+0000 7ff3f4198740 1 -- 172.21.15.70:0/285507830 shutdown_connections 2024-09-12T01:53:06.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.263+0000 7ff3f4198740 1 -- 172.21.15.70:0/285507830 wait complete. 2024-09-12T01:53:06.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.264+0000 7ff3f4198740 1 -- start start 2024-09-12T01:53:06.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.264+0000 7ff3f4198740 1 Processor -- start 2024-09-12T01:53:06.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.264+0000 7ff3f4198740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab87a8e0 0x5620ab895d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.264+0000 7ff3f4198740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab882650 0x5620ab896280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.264+0000 7ff3f4198740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 0x5620ab8929a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.264+0000 7ff3f4198740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec1ac780 con 0x5620ab87a8e0 2024-09-12T01:53:06.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.264+0000 7ff3f4198740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec1ac0b0 con 0x5620ab885380 2024-09-12T01:53:06.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.264+0000 7ff3f4198740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec1a93a0 con 0x5620ab882650 2024-09-12T01:53:06.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3f4198740 10 client.0 _ll_register_callbacks cb 0x7ff3dc004110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:06.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3eb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab87a8e0 0x5620ab895d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3eb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab87a8e0 0x5620ab895d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44356/0 (socket says 172.21.15.70:44356) 2024-09-12T01:53:06.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3eb7fe640 1 -- 172.21.15.70:0/2883475348 learned_addr learned my addr 172.21.15.70:0/2883475348 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:06.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab882650 0x5620ab896280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3ebfff640 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 0x5620ab8929a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3eb7fe640 1 -- 172.21.15.70:0/2883475348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab882650 msgr2=0x5620ab896280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:06.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3eb7fe640 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab882650 0x5620ab896280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3eb7fe640 1 -- 172.21.15.70:0/2883475348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 msgr2=0x5620ab8929a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:06.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3eb7fe640 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 0x5620ab8929a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3eb7fe640 1 -- 172.21.15.70:0/2883475348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620ab8931a0 con 0x5620ab87a8e0 2024-09-12T01:53:06.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab882650 0x5620ab896280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:06.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3eb7fe640 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab87a8e0 0x5620ab895d40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00bdd0 tx=0x7ff3dc00ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f056735db609fa30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:06.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3caffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:06.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3caffd640 1 -- 172.21.15.70:0/2883475348 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0043b0 con 0x5620ab87a8e0 2024-09-12T01:53:06.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3caffd640 1 -- 172.21.15.70:0/2883475348 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff3dc0053d0 con 0x5620ab87a8e0 2024-09-12T01:53:06.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.265+0000 7ff3f4198740 1 -- 172.21.15.70:0/2883475348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e00c03b0 con 0x5620ab87a8e0 2024-09-12T01:53:06.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.266+0000 7ff3caffd640 1 -- 172.21.15.70:0/2883475348 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff3dc0055d0 con 0x5620ab87a8e0 2024-09-12T01:53:06.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.266+0000 7ff3f4198740 10 client.15885 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:06.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.266+0000 7ff3f4198740 1 -- 172.21.15.70:0/2883475348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620ab916030 con 0x5620ab87a8e0 2024-09-12T01:53:06.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.266+0000 7ff3caffd640 1 -- 172.21.15.70:0/2883475348 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff3e00c03b0 con 0x5620ab87a8e0 2024-09-12T01:53:06.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.266+0000 7ff3caffd640 1 -- 172.21.15.70:0/2883475348 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff3dc036050 con 0x5620ab87a8e0 2024-09-12T01:53:06.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.266+0000 7ff3f4198740 10 client.15885 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:06.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.266+0000 7ff3f4198740 10 client.15885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:06.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.266+0000 7ff3f4198740 20 client.15885 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:06.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.266+0000 7ff3f4198740 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5620ab916750 0x5620ab918b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:06.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.266+0000 7ff3f4198740 4 client.15885 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:53:06.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.266+0000 7ff3f4198740 1 -- 172.21.15.70:0/2883475348 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5620ab7e2d00 con 0x5620ab916750 2024-09-12T01:53:06.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.266+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5620ab916750 0x5620ab918b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:06.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.267+0000 7ff3caffd640 10 client.15885 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:06.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.267+0000 7ff3eaffd640 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5620ab916750 0x5620ab918b40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=278ed5930694a15e server_cookie=9a21dd686218e35a in_seq=0 out_seq=0 2024-09-12T01:53:06.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3caffd640 1 -- 172.21.15.70:0/2883475348 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5620ab7e2d00 con 0x5620ab916750 2024-09-12T01:53:06.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3caffd640 10 client.15885 handle_command_reply: tid=0 2024-09-12T01:53:06.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3f4198740 1 client.15885 shutdown 2024-09-12T01:53:06.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3f4198740 1 -- 172.21.15.70:0/2883475348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab87a8e0 msgr2=0x5620ab895d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:06.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3f4198740 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab87a8e0 0x5620ab895d40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00bdd0 tx=0x7ff3dc00ba90 comp rx=0 tx=0).stop 2024-09-12T01:53:06.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3f4198740 1 -- 172.21.15.70:0/2883475348 shutdown_connections 2024-09-12T01:53:06.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3f4198740 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5620ab916750 0x5620ab918b40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3caffd640 0 client.15885 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:06.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3f4198740 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5620ab885380 0x5620ab8929a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3f4198740 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5620ab882650 0x5620ab896280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3f4198740 1 --2- 172.21.15.70:0/2883475348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620ab87a8e0 0x5620ab895d40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3f4198740 1 -- 172.21.15.70:0/2883475348 >> 172.21.15.70:0/2883475348 conn(0x5620ab876730 msgr2=0x5620ab881640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:06.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3f4198740 1 -- 172.21.15.70:0/2883475348 shutdown_connections 2024-09-12T01:53:06.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3f4198740 1 -- 172.21.15.70:0/2883475348 wait complete. 2024-09-12T01:53:06.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.268+0000 7ff3f4198740 20 client.15885 trim_cache size 0 max 16384 2024-09-12T01:53:06.280 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:53:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-12T01:53:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "9cb3b499-81c8-46af-9938-46a0ecd9b59b", 2024-09-12T01:53:06.280 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-12T01:53:06.280 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:53:06.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.269+0000 7ff3d27fc640 1 -- 172.21.15.70:0/4270150620 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff3d40a2b80 msgr2=0x7ff3d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:06.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.269+0000 7ff3d27fc640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff3d40a2b80 0x7ff3d40a5040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4005fd0 tx=0x7ff3e4005bd0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.269+0000 7ff3d27fc640 1 -- 172.21.15.70:0/4270150620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3ec102570 msgr2=0x7ff3ec198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:06.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.269+0000 7ff3d27fc640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3ec102570 0x7ff3ec198b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff3e002a9a0 tx=0x7ff3e00045c0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.269+0000 7ff3d27fc640 1 -- 172.21.15.70:0/4270150620 shutdown_connections 2024-09-12T01:53:06.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.269+0000 7ff3d27fc640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff3d40a2b80 0x7ff3d40a5040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.269+0000 7ff3d27fc640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3ec102ef0 0x7ff3ec19cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.269+0000 7ff3d27fc640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3ec102570 0x7ff3ec198b60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.269+0000 7ff3d27fc640 1 --2- 172.21.15.70:0/4270150620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3ec100e20 0x7ff3ec198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:06.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.270+0000 7ff3d27fc640 1 -- 172.21.15.70:0/4270150620 >> 172.21.15.70:0/4270150620 conn(0x7ff3ec0fc7d0 msgr2=0x7ff3ec06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:06.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.270+0000 7ff3d27fc640 1 -- 172.21.15.70:0/4270150620 shutdown_connections 2024-09-12T01:53:06.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:06.270+0000 7ff3d27fc640 1 -- 172.21.15.70:0/4270150620 wait complete. 2024-09-12T01:53:06.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:06 smithi191 ceph-mon[35770]: pgmap v365: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-12T01:53:07.009 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:06 smithi070 ceph-mon[31177]: pgmap v365: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-12T01:53:07.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:06 smithi152 ceph-mon[35055]: pgmap v365: 97 pgs: 97 active+clean; 668 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-12T01:53:07.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:53:07.329 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:07.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:07 smithi070 ceph-mon[31177]: scrub queued for path: / 2024-09-12T01:53:07.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:07 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:53:07.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:07 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:53:07.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:07 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:53:07.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.797+0000 7f5b71b19640 1 -- 172.21.15.70:0/3700988038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b6c106a90 msgr2=0x7f5b6c106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:07.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.797+0000 7f5b71b19640 1 --2- 172.21.15.70:0/3700988038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b6c106a90 0x7f5b6c106e70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009930 tx=0x7f5b5c02a420 comp rx=0 tx=0).stop 2024-09-12T01:53:07.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.797+0000 7f5b71b19640 1 -- 172.21.15.70:0/3700988038 shutdown_connections 2024-09-12T01:53:07.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.797+0000 7f5b71b19640 1 --2- 172.21.15.70:0/3700988038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b6c101430 0x7f5b6c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.797+0000 7f5b71b19640 1 --2- 172.21.15.70:0/3700988038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b6c100a90 0x7f5b6c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.797+0000 7f5b71b19640 1 --2- 172.21.15.70:0/3700988038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b6c106a90 0x7f5b6c106e70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.797+0000 7f5b71b19640 1 -- 172.21.15.70:0/3700988038 >> 172.21.15.70:0/3700988038 conn(0x7f5b6c0fc7d0 msgr2=0x7f5b6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:07.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.798+0000 7f5b71b19640 1 -- 172.21.15.70:0/3700988038 shutdown_connections 2024-09-12T01:53:07.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.798+0000 7f5b71b19640 1 -- 172.21.15.70:0/3700988038 wait complete. 2024-09-12T01:53:07.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.798+0000 7f5b71b19640 1 Processor -- start 2024-09-12T01:53:07.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.798+0000 7f5b71b19640 1 -- start start 2024-09-12T01:53:07.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b71b19640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b6c100a90 0x7f5b6c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b71b19640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b6c101430 0x7f5b6c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b71b19640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b6c106a90 0x7f5b6c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b71b19640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1120b0 con 0x7f5b6c100a90 2024-09-12T01:53:07.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b71b19640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c111f30 con 0x7f5b6c101430 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b6b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b6c100a90 0x7f5b6c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b6b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b6c100a90 0x7f5b6c198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44372/0 (socket says 172.21.15.70:44372) 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b6b7fe640 1 -- 172.21.15.70:0/3395805880 learned_addr learned my addr 172.21.15.70:0/3395805880 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b71b19640 1 -- 172.21.15.70:0/3395805880 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c112230 con 0x7f5b6c106a90 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b6affd640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b6c101430 0x7f5b6c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b6c106a90 0x7f5b6c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b6b7fe640 1 -- 172.21.15.70:0/3395805880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b6c106a90 msgr2=0x7f5b6c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b6b7fe640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b6c106a90 0x7f5b6c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b6b7fe640 1 -- 172.21.15.70:0/3395805880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b6c101430 msgr2=0x7f5b6c198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b6b7fe640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b6c101430 0x7f5b6c198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.799+0000 7f5b6b7fe640 1 -- 172.21.15.70:0/3395805880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6c19d500 con 0x7f5b6c100a90 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.800+0000 7f5b6affd640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b6c101430 0x7f5b6c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.800+0000 7f5b6b7fe640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b6c100a90 0x7f5b6c198550 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009230 tx=0x7f5b5c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:07.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.800+0000 7f5b68ff9640 1 -- 172.21.15.70:0/3395805880 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c03f030 con 0x7f5b6c100a90 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.800+0000 7f5b68ff9640 1 -- 172.21.15.70:0/3395805880 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5b5c003af0 con 0x7f5b6c100a90 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.800+0000 7f5b71b19640 1 -- 172.21.15.70:0/3395805880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6c19d790 con 0x7f5b6c100a90 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.800+0000 7f5b68ff9640 1 -- 172.21.15.70:0/3395805880 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c035070 con 0x7f5b6c100a90 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.801+0000 7f5b71b19640 1 -- 172.21.15.70:0/3395805880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b6c19dc20 con 0x7f5b6c100a90 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.803+0000 7f5b73ef2740 1 Processor -- start 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.803+0000 7f5b73ef2740 1 -- start start 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b73ef2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 0x55c8c917c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b73ef2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c917ccc0 0x55c8c918b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b73ef2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c918ba90 0x55c8c918de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b73ef2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c8c90e22e0 con 0x55c8c917c3a0 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b73ef2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c8c9089ce0 con 0x55c8c918ba90 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b73ef2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c8c90de2a0 con 0x55c8c917ccc0 2024-09-12T01:53:07.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 0x55c8c917c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 0x55c8c917c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44378/0 (socket says 172.21.15.70:44378) 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b6bfff640 1 -- 172.21.15.70:0/4038132586 learned_addr learned my addr 172.21.15.70:0/4038132586 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b6bfff640 1 -- 172.21.15.70:0/4038132586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c917ccc0 msgr2=0x55c8c918b550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/4038132586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c917ccc0 0x55c8c918b550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b6bfff640 1 -- 172.21.15.70:0/4038132586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c918ba90 msgr2=0x55c8c918de80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/4038132586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c918ba90 0x55c8c918de80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b6bfff640 1 -- 172.21.15.70:0/4038132586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8c906e440 con 0x55c8c917c3a0 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.804+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/4038132586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 0x55c8c917c780 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009f70 tx=0x7f5b64010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d71ec4b6edaa8d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.805+0000 7f5b51ffb640 1 -- 172.21.15.70:0/4038132586 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64016070 con 0x55c8c917c3a0 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.805+0000 7f5b51ffb640 1 -- 172.21.15.70:0/4038132586 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5b64004d20 con 0x55c8c917c3a0 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.805+0000 7f5b68ff9640 1 -- 172.21.15.70:0/3395805880 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5b5c042030 con 0x7f5b6c100a90 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.805+0000 7f5b51ffb640 1 -- 172.21.15.70:0/4038132586 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64012a10 con 0x55c8c917c3a0 2024-09-12T01:53:07.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.806+0000 7f5b68ff9640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5b540a2b80 0x7f5b540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.806+0000 7f5b73ef2740 1 -- 172.21.15.70:0/4038132586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 msgr2=0x55c8c917c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.806+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/4038132586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 0x55c8c917c780 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009f70 tx=0x7f5b64010800 comp rx=0 tx=0).stop 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.806+0000 7f5b73ef2740 1 -- 172.21.15.70:0/4038132586 shutdown_connections 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.806+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/4038132586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c918ba90 0x55c8c918de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.806+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/4038132586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c917ccc0 0x55c8c918b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.806+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/4038132586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 0x55c8c917c780 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.806+0000 7f5b73ef2740 1 -- 172.21.15.70:0/4038132586 >> 172.21.15.70:0/4038132586 conn(0x55c8c9178a30 msgr2=0x55c8c9178e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.806+0000 7f5b68ff9640 1 -- 172.21.15.70:0/3395805880 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5b5c0ba400 con 0x7f5b6c100a90 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.806+0000 7f5b6b7fe640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5b540a2b80 0x7f5b540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.807+0000 7f5b73ef2740 1 -- 172.21.15.70:0/4038132586 shutdown_connections 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.807+0000 7f5b73ef2740 1 -- 172.21.15.70:0/4038132586 wait complete. 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.807+0000 7f5b6b7fe640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5b540a2b80 0x7f5b540a5040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55c8c917eff0 tx=0x7f5b5c005b50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:07.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.807+0000 7f5b73ef2740 1 -- start start 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.807+0000 7f5b73ef2740 1 Processor -- start 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b73ef2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c917c3a0 0x55c8c918b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b73ef2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c918ba90 0x55c8c9184360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b73ef2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c91848a0 0x55c8c9184d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b73ef2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c8c918e6c0 con 0x55c8c91848a0 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b73ef2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55c8c909d050 con 0x55c8c918ba90 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b73ef2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c8c918e840 con 0x55c8c917c3a0 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b73ef2740 10 client.0 _ll_register_callbacks cb 0x55c8c90dd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c91848a0 0x55c8c9184d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c91848a0 0x55c8c9184d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44382/0 (socket says 172.21.15.70:44382) 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b6bfff640 1 -- 172.21.15.70:0/175544699 learned_addr learned my addr 172.21.15.70:0/175544699 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b6affd640 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c918ba90 0x55c8c9184360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c917c3a0 0x55c8c918b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b6bfff640 1 -- 172.21.15.70:0/175544699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c917c3a0 msgr2=0x55c8c918b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c917c3a0 0x55c8c918b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b6bfff640 1 -- 172.21.15.70:0/175544699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c918ba90 msgr2=0x55c8c9184360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c918ba90 0x55c8c9184360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b6bfff640 1 -- 172.21.15.70:0/175544699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8c8e533c0 con 0x55c8c91848a0 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.808+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c91848a0 0x55c8c9184d20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5b64004c00 tx=0x7f5b64012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee05d10247a636dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.809+0000 7f5b4affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.809+0000 7f5b4affd640 1 -- 172.21.15.70:0/175544699 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64016030 con 0x55c8c91848a0 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.809+0000 7f5b4affd640 1 -- 172.21.15.70:0/175544699 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5b64003970 con 0x55c8c91848a0 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.809+0000 7f5b73ef2740 1 -- 172.21.15.70:0/175544699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b64004d20 con 0x55c8c91848a0 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.809+0000 7f5b4affd640 1 -- 172.21.15.70:0/175544699 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b64004ed0 con 0x55c8c91848a0 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.809+0000 7f5b73ef2740 10 client.15897 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.809+0000 7f5b73ef2740 1 -- 172.21.15.70:0/175544699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8c919ea20 con 0x55c8c91848a0 2024-09-12T01:53:07.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.809+0000 7f5b4affd640 1 -- 172.21.15.70:0/175544699 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5b64004d20 con 0x55c8c91848a0 2024-09-12T01:53:07.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.809+0000 7f5b4affd640 1 -- 172.21.15.70:0/175544699 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b6400f040 con 0x55c8c91848a0 2024-09-12T01:53:07.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.809+0000 7f5b73ef2740 10 client.15897 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:07.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.809+0000 7f5b73ef2740 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:07.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.809+0000 7f5b73ef2740 20 client.15897 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:07.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.810+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c8c919fd70 0x55c8c91a2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.810+0000 7f5b73ef2740 4 client.15897 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:07.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.810+0000 7f5b73ef2740 1 -- 172.21.15.70:0/175544699 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8c90ef850 con 0x55c8c919fd70 2024-09-12T01:53:07.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.810+0000 7f5b6affd640 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c8c919fd70 0x55c8c91a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.810+0000 7f5b6affd640 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c8c919fd70 0x55c8c91a2160 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f48294a97fd58270 server_cookie=e423d324476a308e in_seq=0 out_seq=0 2024-09-12T01:53:07.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.810+0000 7f5b4affd640 10 client.15897 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:07.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b4affd640 1 -- 172.21.15.70:0/175544699 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8c90ef850 con 0x55c8c919fd70 2024-09-12T01:53:07.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b4affd640 10 client.15897 handle_command_reply: tid=0 2024-09-12T01:53:07.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b73ef2740 1 client.15897 shutdown 2024-09-12T01:53:07.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b73ef2740 1 -- 172.21.15.70:0/175544699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c91848a0 msgr2=0x55c8c9184d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:07.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c91848a0 0x55c8c9184d20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5b64004c00 tx=0x7f5b64012690 comp rx=0 tx=0).stop 2024-09-12T01:53:07.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b73ef2740 1 -- 172.21.15.70:0/175544699 shutdown_connections 2024-09-12T01:53:07.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c8c919fd70 0x55c8c91a2160 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c91848a0 0x55c8c9184d20 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c918ba90 0x55c8c9184360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/175544699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c917c3a0 0x55c8c918b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b73ef2740 1 -- 172.21.15.70:0/175544699 >> 172.21.15.70:0/175544699 conn(0x55c8c9178a30 msgr2=0x55c8c917e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:07.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b4affd640 0 client.15897 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:07.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b73ef2740 1 -- 172.21.15.70:0/175544699 shutdown_connections 2024-09-12T01:53:07.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.811+0000 7f5b73ef2740 1 -- 172.21.15.70:0/175544699 wait complete. 2024-09-12T01:53:07.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.812+0000 7f5b73ef2740 20 client.15897 trim_cache size 0 max 16384 2024-09-12T01:53:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.829+0000 7f5b73ef2740 1 Processor -- start 2024-09-12T01:53:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.829+0000 7f5b73ef2740 1 -- start start 2024-09-12T01:53:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.829+0000 7f5b73ef2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c917c3a0 0x55c8c9188be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.829+0000 7f5b73ef2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c91848a0 0x55c8c9182c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.829+0000 7f5b73ef2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c918ba90 0x55c8c917e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.829+0000 7f5b73ef2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1ab540 con 0x55c8c918ba90 2024-09-12T01:53:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.829+0000 7f5b73ef2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1ad080 con 0x55c8c917c3a0 2024-09-12T01:53:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.829+0000 7f5b73ef2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1abc10 con 0x55c8c91848a0 2024-09-12T01:53:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.829+0000 7f5b6affd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c91848a0 0x55c8c9182c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.830+0000 7f5b6affd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c91848a0 0x55c8c9182c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:33166/0 (socket says 172.21.15.70:33166) 2024-09-12T01:53:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.830+0000 7f5b6affd640 1 -- 172.21.15.70:0/283419225 learned_addr learned my addr 172.21.15.70:0/283419225 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.830+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/283419225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c918ba90 0x55c8c917e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.830+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/283419225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c917c3a0 0x55c8c9188be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.830+0000 7f5b6affd640 1 -- 172.21.15.70:0/283419225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c917c3a0 msgr2=0x55c8c9188be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.830+0000 7f5b6affd640 1 --2- 172.21.15.70:0/283419225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c917c3a0 0x55c8c9188be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.830+0000 7f5b6affd640 1 -- 172.21.15.70:0/283419225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c918ba90 msgr2=0x55c8c917e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.830+0000 7f5b6affd640 1 --2- 172.21.15.70:0/283419225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c918ba90 0x55c8c917e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.830+0000 7f5b6affd640 1 -- 172.21.15.70:0/283419225 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8c918b440 con 0x55c8c91848a0 2024-09-12T01:53:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.830+0000 7f5b6affd640 1 --2- 172.21.15.70:0/283419225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c91848a0 0x55c8c9182c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55c8c91859a0 tx=0x7f5b60005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2151ed3c0e14ecd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.831+0000 7f5b517fa640 1 -- 172.21.15.70:0/283419225 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6001f070 con 0x55c8c91848a0 2024-09-12T01:53:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.831+0000 7f5b517fa640 1 -- 172.21.15.70:0/283419225 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5b60005520 con 0x55c8c91848a0 2024-09-12T01:53:07.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.831+0000 7f5b517fa640 1 -- 172.21.15.70:0/283419225 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b600137a0 con 0x55c8c91848a0 2024-09-12T01:53:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.831+0000 7f5b73ef2740 1 -- 172.21.15.70:0/283419225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c91848a0 msgr2=0x55c8c9182c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.831+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/283419225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c91848a0 0x55c8c9182c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55c8c91859a0 tx=0x7f5b60005f90 comp rx=0 tx=0).stop 2024-09-12T01:53:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.832+0000 7f5b73ef2740 1 -- 172.21.15.70:0/283419225 shutdown_connections 2024-09-12T01:53:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.832+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/283419225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c918ba90 0x55c8c917e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.832+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/283419225 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c91848a0 0x55c8c9182c30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.832+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/283419225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c917c3a0 0x55c8c9188be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.832+0000 7f5b73ef2740 1 -- 172.21.15.70:0/283419225 >> 172.21.15.70:0/283419225 conn(0x55c8c9178a30 msgr2=0x55c8c917df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.832+0000 7f5b73ef2740 1 -- 172.21.15.70:0/283419225 shutdown_connections 2024-09-12T01:53:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.832+0000 7f5b73ef2740 1 -- 172.21.15.70:0/283419225 wait complete. 2024-09-12T01:53:07.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.832+0000 7f5b73ef2740 1 -- start start 2024-09-12T01:53:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.832+0000 7f5b73ef2740 1 Processor -- start 2024-09-12T01:53:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b73ef2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 0x55c8c919c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 0x55c8c919c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 0x55c8c919c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44390/0 (socket says 172.21.15.70:44390) 2024-09-12T01:53:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b6bfff640 1 -- 172.21.15.70:0/2815739699 learned_addr learned my addr 172.21.15.70:0/2815739699 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c91848a0 0x55c8c919ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c918ba90 0x55c8c9197e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b73ef2740 1 -- 172.21.15.70:0/2815739699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1ac9b0 con 0x55c8c917c3a0 2024-09-12T01:53:07.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b73ef2740 1 -- 172.21.15.70:0/2815739699 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1ac2e0 con 0x55c8c91848a0 2024-09-12T01:53:07.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b73ef2740 1 -- 172.21.15.70:0/2815739699 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1a9500 con 0x55c8c918ba90 2024-09-12T01:53:07.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b6affd640 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c91848a0 0x55c8c919ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b6bfff640 1 -- 172.21.15.70:0/2815739699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c918ba90 msgr2=0x55c8c9197e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:53:07.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c918ba90 0x55c8c9197e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b6bfff640 1 -- 172.21.15.70:0/2815739699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c91848a0 msgr2=0x55c8c919ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:07.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c91848a0 0x55c8c919ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.833+0000 7f5b6bfff640 1 -- 172.21.15.70:0/2815739699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8c9198690 con 0x55c8c917c3a0 2024-09-12T01:53:07.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.834+0000 7f5b73ef2740 10 client.0 _ll_register_callbacks cb 0x7f5b64009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:07.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.834+0000 7f5b6bfff640 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 0x55c8c919c8e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5b64006010 tx=0x7f5b64004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64643ae9cf203337 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:07.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.834+0000 7f5b73ef2740 1 -- 172.21.15.70:0/2815739699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b60005520 con 0x55c8c917c3a0 2024-09-12T01:53:07.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.834+0000 7f5b4affd640 10 client.15903 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:07.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.834+0000 7f5b4affd640 1 -- 172.21.15.70:0/2815739699 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64016040 con 0x55c8c917c3a0 2024-09-12T01:53:07.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.834+0000 7f5b4affd640 1 -- 172.21.15.70:0/2815739699 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5b64003970 con 0x55c8c917c3a0 2024-09-12T01:53:07.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.834+0000 7f5b4affd640 1 -- 172.21.15.70:0/2815739699 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b64003bd0 con 0x55c8c917c3a0 2024-09-12T01:53:07.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.834+0000 7f5b73ef2740 10 client.15903 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:07.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.834+0000 7f5b73ef2740 1 -- 172.21.15.70:0/2815739699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c8c920a0c0 con 0x55c8c917c3a0 2024-09-12T01:53:07.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.835+0000 7f5b4affd640 1 -- 172.21.15.70:0/2815739699 <== mon.0 v2:172.21.15.70:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b6403b030 con 0x55c8c917c3a0 2024-09-12T01:53:07.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.835+0000 7f5b73ef2740 10 client.15903 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:07.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.835+0000 7f5b73ef2740 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:07.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.835+0000 7f5b73ef2740 20 client.15903 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:07.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.835+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c8c920a7d0 0x55c8c920cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.835+0000 7f5b73ef2740 4 client.15903 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:53:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.835+0000 7f5b73ef2740 1 -- 172.21.15.70:0/2815739699 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c8c90e9d60 con 0x55c8c920a7d0 2024-09-12T01:53:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.835+0000 7f5b6affd640 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c8c920a7d0 0x55c8c920cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.835+0000 7f5b4affd640 10 client.15903 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.835+0000 7f5b6affd640 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c8c920a7d0 0x55c8c920cc90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=599f56bff174b607 server_cookie=a34a9dd3e2578e52 in_seq=0 out_seq=0 2024-09-12T01:53:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b4affd640 1 -- 172.21.15.70:0/2815739699 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c8c90e9d60 con 0x55c8c920a7d0 2024-09-12T01:53:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b4affd640 10 client.15903 handle_command_reply: tid=0 2024-09-12T01:53:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b73ef2740 1 client.15903 shutdown 2024-09-12T01:53:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b73ef2740 1 -- 172.21.15.70:0/2815739699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 msgr2=0x55c8c919c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 0x55c8c919c8e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5b64006010 tx=0x7f5b64004e60 comp rx=0 tx=0).stop 2024-09-12T01:53:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b73ef2740 1 -- 172.21.15.70:0/2815739699 shutdown_connections 2024-09-12T01:53:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55c8c920a7d0 0x55c8c920cc90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c8c918ba90 0x55c8c9197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b4affd640 0 client.15903 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55c8c91848a0 0x55c8c919ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b73ef2740 1 --2- 172.21.15.70:0/2815739699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c8c917c3a0 0x55c8c919c8e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b73ef2740 1 -- 172.21.15.70:0/2815739699 >> 172.21.15.70:0/2815739699 conn(0x55c8c9178a30 msgr2=0x55c8c917e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b73ef2740 1 -- 172.21.15.70:0/2815739699 shutdown_connections 2024-09-12T01:53:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b73ef2740 1 -- 172.21.15.70:0/2815739699 wait complete. 2024-09-12T01:53:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.836+0000 7f5b73ef2740 20 client.15903 trim_cache size 0 max 16384 2024-09-12T01:53:07.860 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:53:07.860 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-12T01:53:07.861 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-12T01:53:07.861 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:53:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.837+0000 7f5b71b19640 1 -- 172.21.15.70:0/3395805880 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5b540a2b80 msgr2=0x7f5b540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.837+0000 7f5b71b19640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5b540a2b80 0x7f5b540a5040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55c8c917eff0 tx=0x7f5b5c005b50 comp rx=0 tx=0).stop 2024-09-12T01:53:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.837+0000 7f5b71b19640 1 -- 172.21.15.70:0/3395805880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b6c100a90 msgr2=0x7f5b6c198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.837+0000 7f5b71b19640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b6c100a90 0x7f5b6c198550 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009230 tx=0x7f5b5c004270 comp rx=0 tx=0).stop 2024-09-12T01:53:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.837+0000 7f5b71b19640 1 -- 172.21.15.70:0/3395805880 shutdown_connections 2024-09-12T01:53:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.837+0000 7f5b71b19640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5b540a2b80 0x7f5b540a5040 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.837+0000 7f5b71b19640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5b6c106a90 0x7f5b6c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.837+0000 7f5b71b19640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b6c101430 0x7f5b6c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.837+0000 7f5b71b19640 1 --2- 172.21.15.70:0/3395805880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b6c100a90 0x7f5b6c198550 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.837+0000 7f5b71b19640 1 -- 172.21.15.70:0/3395805880 >> 172.21.15.70:0/3395805880 conn(0x7f5b6c0fc7d0 msgr2=0x7f5b6c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.837+0000 7f5b71b19640 1 -- 172.21.15.70:0/3395805880 shutdown_connections 2024-09-12T01:53:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:07.837+0000 7f5b71b19640 1 -- 172.21.15.70:0/3395805880 wait complete. 2024-09-12T01:53:07.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:07 smithi191 ceph-mon[35770]: scrub queued for path: / 2024-09-12T01:53:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:07 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:53:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:07 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:53:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:07 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:53:08.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:07 smithi152 ceph-mon[35055]: scrub queued for path: / 2024-09-12T01:53:08.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:07 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:53:08.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:07 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:53:08.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:07 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:53:08.547 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:53:08.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:53:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:08 smithi070 ceph-mon[31177]: pgmap v366: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T01:53:08.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:08 smithi070 ceph-mon[31177]: scrub summary: idle 2024-09-12T01:53:08.804 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:08 smithi191 ceph-mon[35770]: pgmap v366: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T01:53:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:08 smithi191 ceph-mon[35770]: scrub summary: idle 2024-09-12T01:53:09.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:08 smithi152 ceph-mon[35055]: pgmap v366: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-12T01:53:09.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:08 smithi152 ceph-mon[35055]: scrub summary: idle 2024-09-12T01:53:09.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.256+0000 7f50266b4640 1 -- 172.21.15.70:0/4234999338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50201082e0 msgr2=0x7f502010ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:09.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.256+0000 7f50266b4640 1 --2- 172.21.15.70:0/4234999338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50201082e0 0x7f502010ec50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5018009cd0 tx=0x7f501802a8e0 comp rx=0 tx=0).stop 2024-09-12T01:53:09.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.256+0000 7f50266b4640 1 -- 172.21.15.70:0/4234999338 shutdown_connections 2024-09-12T01:53:09.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.256+0000 7f50266b4640 1 --2- 172.21.15.70:0/4234999338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50201082e0 0x7f502010ec50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.256+0000 7f50266b4640 1 --2- 172.21.15.70:0/4234999338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5020103760 0x7f5020107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.256+0000 7f50266b4640 1 --2- 172.21.15.70:0/4234999338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5020102db0 0x7f5020103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.256+0000 7f50266b4640 1 -- 172.21.15.70:0/4234999338 >> 172.21.15.70:0/4234999338 conn(0x7f50200fc7d0 msgr2=0x7f50200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.257+0000 7f50266b4640 1 -- 172.21.15.70:0/4234999338 shutdown_connections 2024-09-12T01:53:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.257+0000 7f50266b4640 1 -- 172.21.15.70:0/4234999338 wait complete. 2024-09-12T01:53:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.258+0000 7f50266b4640 1 Processor -- start 2024-09-12T01:53:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.258+0000 7f50266b4640 1 -- start start 2024-09-12T01:53:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.258+0000 7f50266b4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020102db0 0x7f5020100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.258+0000 7f50266b4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5020103760 0x7f5020100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.258+0000 7f50266b4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50201082e0 0x7f5020101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f50266b4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5020112250 con 0x7f5020102db0 2024-09-12T01:53:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f50266b4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f50201120d0 con 0x7f5020103760 2024-09-12T01:53:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f50266b4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f50201123d0 con 0x7f50201082e0 2024-09-12T01:53:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f501ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020102db0 0x7f5020100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f501f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5020103760 0x7f5020100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f501ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020102db0 0x7f5020100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44416/0 (socket says 172.21.15.70:44416) 2024-09-12T01:53:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f501ffff640 1 -- 172.21.15.70:0/2567439687 learned_addr learned my addr 172.21.15.70:0/2567439687 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f5024c51640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50201082e0 0x7f5020101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f501f7fe640 1 -- 172.21.15.70:0/2567439687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50201082e0 msgr2=0x7f5020101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f501f7fe640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50201082e0 0x7f5020101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f501f7fe640 1 -- 172.21.15.70:0/2567439687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020102db0 msgr2=0x7f5020100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f501f7fe640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020102db0 0x7f5020100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:09.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f501f7fe640 1 -- 172.21.15.70:0/2567439687 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50201a6ae0 con 0x7f5020103760 2024-09-12T01:53:09.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f501ffff640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020102db0 0x7f5020100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:09.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.259+0000 7f501f7fe640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5020103760 0x7f5020100f50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f50200697d0 tx=0x7f501400cdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:09.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.260+0000 7f501d7fa640 1 -- 172.21.15.70:0/2567439687 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014007bb0 con 0x7f5020103760 2024-09-12T01:53:09.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.260+0000 7f50266b4640 1 -- 172.21.15.70:0/2567439687 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50201a6dd0 con 0x7f5020103760 2024-09-12T01:53:09.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.260+0000 7f501d7fa640 1 -- 172.21.15.70:0/2567439687 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5014007d50 con 0x7f5020103760 2024-09-12T01:53:09.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.260+0000 7f501d7fa640 1 -- 172.21.15.70:0/2567439687 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014018850 con 0x7f5020103760 2024-09-12T01:53:09.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.260+0000 7f50266b4640 1 -- 172.21.15.70:0/2567439687 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50201a7280 con 0x7f5020103760 2024-09-12T01:53:09.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.261+0000 7f50266b4640 1 -- 172.21.15.70:0/2567439687 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5020103190 con 0x7f5020103760 2024-09-12T01:53:09.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.263+0000 7f501d7fa640 1 -- 172.21.15.70:0/2567439687 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5014018af0 con 0x7f5020103760 2024-09-12T01:53:09.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.264+0000 7f501d7fa640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f50080a2b80 0x7f50080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:09.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.264+0000 7f501d7fa640 1 -- 172.21.15.70:0/2567439687 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f50140cf1b0 con 0x7f5020103760 2024-09-12T01:53:09.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.264+0000 7f501ffff640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f50080a2b80 0x7f50080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:09.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.265+0000 7f501ffff640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f50080a2b80 0x7f50080a5040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5010009e10 tx=0x7f50100091c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:09.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.266+0000 7f501d7fa640 1 -- 172.21.15.70:0/2567439687 <== mon.2 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5014014030 con 0x7f5020103760 2024-09-12T01:53:09.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.519+0000 7f50266b4640 1 -- 172.21.15.70:0/2567439687 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50201a7510 con 0x7f5020103760 2024-09-12T01:53:09.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.520+0000 7f501d7fa640 1 -- 172.21.15.70:0/2567439687 <== mon.2 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f501409c110 con 0x7f5020103760 2024-09-12T01:53:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:53:09.521 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-12T01:51:51:564560+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:51:51.387340+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24427,24433,24437,24445,24452]},"id":1}]} 2024-09-12T01:53:09.521 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-12T01:53:09.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.523+0000 7f50266b4640 1 -- 172.21.15.70:0/2567439687 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f50080a2b80 msgr2=0x7f50080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:09.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.523+0000 7f50266b4640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f50080a2b80 0x7f50080a5040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5010009e10 tx=0x7f50100091c0 comp rx=0 tx=0).stop 2024-09-12T01:53:09.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.523+0000 7f50266b4640 1 -- 172.21.15.70:0/2567439687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5020103760 msgr2=0x7f5020100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:09.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.523+0000 7f50266b4640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5020103760 0x7f5020100f50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f50200697d0 tx=0x7f501400cdd0 comp rx=0 tx=0).stop 2024-09-12T01:53:09.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.523+0000 7f50266b4640 1 -- 172.21.15.70:0/2567439687 shutdown_connections 2024-09-12T01:53:09.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.523+0000 7f50266b4640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f50080a2b80 0x7f50080a5040 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:09.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.523+0000 7f50266b4640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50201082e0 0x7f5020101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:09.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.523+0000 7f50266b4640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5020103760 0x7f5020100f50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:09.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.523+0000 7f50266b4640 1 --2- 172.21.15.70:0/2567439687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020102db0 0x7f5020100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:09.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.523+0000 7f50266b4640 1 -- 172.21.15.70:0/2567439687 >> 172.21.15.70:0/2567439687 conn(0x7f50200fc7d0 msgr2=0x7f50200fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:09.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.523+0000 7f50266b4640 1 -- 172.21.15.70:0/2567439687 shutdown_connections 2024-09-12T01:53:09.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:09.523+0000 7f50266b4640 1 -- 172.21.15.70:0/2567439687 wait complete. 2024-09-12T01:53:09.824 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:09 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2567439687' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:53:09.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:09 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2567439687' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:53:10.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:09 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2567439687' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:53:10.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:53:10.835 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:10.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:10 smithi191 ceph-mon[35770]: pgmap v367: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:53:10.957 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:10 smithi070 ceph-mon[31177]: pgmap v367: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:53:11.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:10 smithi152 ceph-mon[35055]: pgmap v367: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-12T01:53:11.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.537+0000 7efdda6c0640 1 -- 172.21.15.70:0/154473938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd41082e0 msgr2=0x7efdd410ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.537+0000 7efdda6c0640 1 --2- 172.21.15.70:0/154473938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd41082e0 0x7efdd410ec50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009cd0 tx=0x7efdcc02a8e0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.538+0000 7efdda6c0640 1 -- 172.21.15.70:0/154473938 shutdown_connections 2024-09-12T01:53:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.538+0000 7efdda6c0640 1 --2- 172.21.15.70:0/154473938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd41082e0 0x7efdd410ec50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.538+0000 7efdda6c0640 1 --2- 172.21.15.70:0/154473938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd4103760 0x7efdd4107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.538+0000 7efdda6c0640 1 --2- 172.21.15.70:0/154473938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd4102db0 0x7efdd4103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.538+0000 7efdda6c0640 1 -- 172.21.15.70:0/154473938 >> 172.21.15.70:0/154473938 conn(0x7efdd40fc7d0 msgr2=0x7efdd40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.538+0000 7efdda6c0640 1 -- 172.21.15.70:0/154473938 shutdown_connections 2024-09-12T01:53:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.538+0000 7efdda6c0640 1 -- 172.21.15.70:0/154473938 wait complete. 2024-09-12T01:53:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.538+0000 7efdda6c0640 1 Processor -- start 2024-09-12T01:53:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.538+0000 7efdda6c0640 1 -- start start 2024-09-12T01:53:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdda6c0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd4102db0 0x7efdd4100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdda6c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd4103760 0x7efdd4100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdda6c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd41082e0 0x7efdd4101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdda6c0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41121d0 con 0x7efdd41082e0 2024-09-12T01:53:11.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdda6c0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efdd4112050 con 0x7efdd4103760 2024-09-12T01:53:11.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdda6c0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efdd4112350 con 0x7efdd4102db0 2024-09-12T01:53:11.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdd8c5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd41082e0 0x7efdd4101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd4102db0 0x7efdd4100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdd8c5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd41082e0 0x7efdd4101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52404/0 (socket says 172.21.15.70:52404) 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdd8c5d640 1 -- 172.21.15.70:0/342724771 learned_addr learned my addr 172.21.15.70:0/342724771 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdd37fe640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd4103760 0x7efdd4100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdd3fff640 1 -- 172.21.15.70:0/342724771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd4103760 msgr2=0x7efdd4100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdd3fff640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd4103760 0x7efdd4100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdd3fff640 1 -- 172.21.15.70:0/342724771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd41082e0 msgr2=0x7efdd4101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdd3fff640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd41082e0 0x7efdd4101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdd3fff640 1 -- 172.21.15.70:0/342724771 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd41a6b10 con 0x7efdd4102db0 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.539+0000 7efdd8c5d640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd41082e0 0x7efdd4101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.540+0000 7efdd3fff640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd4102db0 0x7efdd4100a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efdc400e9f0 tx=0x7efdc400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.540+0000 7efdd17fa640 1 -- 172.21.15.70:0/342724771 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc400ccc0 con 0x7efdd4102db0 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.540+0000 7efdda6c0640 1 -- 172.21.15.70:0/342724771 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd41a6e00 con 0x7efdd4102db0 2024-09-12T01:53:11.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.540+0000 7efdd17fa640 1 -- 172.21.15.70:0/342724771 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efdc4010930 con 0x7efdd4102db0 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.540+0000 7efdd17fa640 1 -- 172.21.15.70:0/342724771 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc40189f0 con 0x7efdd4102db0 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.540+0000 7efdda6c0640 1 -- 172.21.15.70:0/342724771 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd41a72b0 con 0x7efdd4102db0 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.542+0000 7efdd17fa640 1 -- 172.21.15.70:0/342724771 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efdc4010ae0 con 0x7efdd4102db0 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.543+0000 7efddca99740 1 Processor -- start 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.543+0000 7efddca99740 1 -- start start 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.543+0000 7efddca99740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3f7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.543+0000 7efddca99740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf3f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.543+0000 7efdd17fa640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7efdc00a2b80 0x7efdc00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.543+0000 7efddca99740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf404760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.543+0000 7efddca99740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ffdf35d2f0 con 0x55ffdf402370 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.543+0000 7efddca99740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ffdf304cf0 con 0x55ffdf3f8b40 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.543+0000 7efddca99740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ffdf3592b0 con 0x55ffdf3f75d0 2024-09-12T01:53:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd8c5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf404760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd37fe640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7efdc00a2b80 0x7efdc00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd8c5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf404760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52406/0 (socket says 172.21.15.70:52406) 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd8c5d640 1 -- 172.21.15.70:0/4076628058 learned_addr learned my addr 172.21.15.70:0/4076628058 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd8c5d640 1 --2- 172.21.15.70:0/4076628058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd8c5d640 1 -- 172.21.15.70:0/4076628058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 msgr2=0x55ffdf3f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd3fff640 1 --2- 172.21.15.70:0/4076628058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf3f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd8c5d640 1 --2- 172.21.15.70:0/4076628058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf3f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd8c5d640 1 -- 172.21.15.70:0/4076628058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 msgr2=0x55ffdf3f7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd8c5d640 1 --2- 172.21.15.70:0/4076628058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3f7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd8c5d640 1 -- 172.21.15.70:0/4076628058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffdf2e93a0 con 0x55ffdf402370 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd3fff640 1 --2- 172.21.15.70:0/4076628058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf3f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd37fe640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7efdc00a2b80 0x7efdc00a5040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efdd41024a0 tx=0x7efdbc00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd17fa640 1 -- 172.21.15.70:0/342724771 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7efdc40cf300 con 0x7efdd4102db0 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdd8c5d640 1 --2- 172.21.15.70:0/4076628058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf404760 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009df0 tx=0x7efdcc009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55184e8c093abd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.544+0000 7efdca7fc640 1 -- 172.21.15.70:0/4076628058 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc003c90 con 0x55ffdf402370 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.545+0000 7efdca7fc640 1 -- 172.21.15.70:0/4076628058 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efdcc036070 con 0x55ffdf402370 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.545+0000 7efdca7fc640 1 -- 172.21.15.70:0/4076628058 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc030b00 con 0x55ffdf402370 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.546+0000 7efddca99740 1 -- 172.21.15.70:0/4076628058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 msgr2=0x55ffdf404760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.546+0000 7efddca99740 1 --2- 172.21.15.70:0/4076628058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf404760 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009df0 tx=0x7efdcc009360 comp rx=0 tx=0).stop 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.546+0000 7efddca99740 1 -- 172.21.15.70:0/4076628058 shutdown_connections 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.546+0000 7efddca99740 1 --2- 172.21.15.70:0/4076628058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf404760 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.546+0000 7efddca99740 1 --2- 172.21.15.70:0/4076628058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf3f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.546+0000 7efddca99740 1 --2- 172.21.15.70:0/4076628058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.546+0000 7efddca99740 1 -- 172.21.15.70:0/4076628058 >> 172.21.15.70:0/4076628058 conn(0x55ffdf3c0310 msgr2=0x55ffdf3f3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.546+0000 7efddca99740 1 -- 172.21.15.70:0/4076628058 shutdown_connections 2024-09-12T01:53:11.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.546+0000 7efddca99740 1 -- 172.21.15.70:0/4076628058 wait complete. 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.546+0000 7efddca99740 1 -- start start 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.546+0000 7efddca99740 1 Processor -- start 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efddca99740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf401d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efddca99740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3feff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efddca99740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf3ff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efddca99740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ffdf405010 con 0x55ffdf402370 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efddca99740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55ffdf318060 con 0x55ffdf3f8b40 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efddca99740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55ffdf405190 con 0x55ffdf3f75d0 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf401d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf401d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:35266/0 (socket says 172.21.15.70:35266) 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efdd3fff640 1 -- 172.21.15.70:0/2554560707 learned_addr learned my addr 172.21.15.70:0/2554560707 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efdd37fe640 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3feff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efddca99740 10 client.0 _ll_register_callbacks cb 0x55ffdf06b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efdd8c5d640 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf3ff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efdd3fff640 1 -- 172.21.15.70:0/2554560707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 msgr2=0x55ffdf3feff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efdd3fff640 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3feff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efdd3fff640 1 -- 172.21.15.70:0/2554560707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 msgr2=0x55ffdf3ff5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efdd3fff640 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf3ff5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efdd3fff640 1 -- 172.21.15.70:0/2554560707 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffdf0ce3c0 con 0x55ffdf3f75d0 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.547+0000 7efdd8c5d640 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf3ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.548+0000 7efdb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.548+0000 7efdd3fff640 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf401d40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efdc4000c00 tx=0x7efdc409b5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee0e7cd43a14579a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.548+0000 7efdb37fe640 1 -- 172.21.15.70:0/2554560707 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc4018b90 con 0x55ffdf3f75d0 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.548+0000 7efddca99740 1 -- 172.21.15.70:0/2554560707 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdcc036070 con 0x55ffdf3f75d0 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.549+0000 7efdb37fe640 1 -- 172.21.15.70:0/2554560707 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7efdc4018d30 con 0x55ffdf3f75d0 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.549+0000 7efdb37fe640 1 -- 172.21.15.70:0/2554560707 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efdc409b020 con 0x55ffdf3f75d0 2024-09-12T01:53:11.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.549+0000 7efddca99740 10 client.25201 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.549+0000 7efddca99740 1 -- 172.21.15.70:0/2554560707 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ffdf410a50 con 0x55ffdf3f75d0 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.549+0000 7efdb37fe640 1 -- 172.21.15.70:0/2554560707 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efdcc036070 con 0x55ffdf3f75d0 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.549+0000 7efdb37fe640 1 -- 172.21.15.70:0/2554560707 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efdc409aa90 con 0x55ffdf3f75d0 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.549+0000 7efddca99740 10 client.25201 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.549+0000 7efddca99740 10 client.25201 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.549+0000 7efddca99740 20 client.25201 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.549+0000 7efddca99740 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55ffdf411e60 0x55ffdf4142b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.549+0000 7efddca99740 4 client.25201 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.549+0000 7efddca99740 1 -- 172.21.15.70:0/2554560707 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffdf36a860 con 0x55ffdf411e60 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.550+0000 7efdd37fe640 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55ffdf411e60 0x55ffdf4142b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.550+0000 7efdd37fe640 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55ffdf411e60 0x55ffdf4142b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4d3930e4168e23b7 server_cookie=ad5fdc30ab65368c in_seq=0 out_seq=0 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.550+0000 7efdb37fe640 10 client.25201 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efdb37fe640 1 -- 172.21.15.70:0/2554560707 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ffdf36a860 con 0x55ffdf411e60 2024-09-12T01:53:11.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efdb37fe640 10 client.25201 handle_command_reply: tid=0 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efddca99740 1 client.25201 shutdown 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efddca99740 1 -- 172.21.15.70:0/2554560707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 msgr2=0x55ffdf401d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efddca99740 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf401d40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efdc4000c00 tx=0x7efdc409b5f0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efddca99740 1 -- 172.21.15.70:0/2554560707 shutdown_connections 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efddca99740 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55ffdf411e60 0x55ffdf4142b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efddca99740 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf3ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efddca99740 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3feff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efdb37fe640 0 client.25201 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efddca99740 1 --2- 172.21.15.70:0/2554560707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf401d40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efddca99740 1 -- 172.21.15.70:0/2554560707 >> 172.21.15.70:0/2554560707 conn(0x55ffdf3c0310 msgr2=0x55ffdf3f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efddca99740 1 -- 172.21.15.70:0/2554560707 shutdown_connections 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efddca99740 1 -- 172.21.15.70:0/2554560707 wait complete. 2024-09-12T01:53:11.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.551+0000 7efddca99740 20 client.25201 trim_cache size 0 max 16384 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.564+0000 7efddca99740 1 Processor -- start 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.564+0000 7efddca99740 1 -- start start 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.564+0000 7efddca99740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf3fe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.564+0000 7efddca99740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf400f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.564+0000 7efddca99740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf4014a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.564+0000 7efddca99740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41afa00 con 0x55ffdf402370 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.564+0000 7efddca99740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41b1540 con 0x55ffdf3f8b40 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.564+0000 7efddca99740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41b00d0 con 0x55ffdf3f75d0 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.564+0000 7efdd8c5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf4014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdd8c5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf4014a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52432/0 (socket says 172.21.15.70:52432) 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdd8c5d640 1 -- 172.21.15.70:0/1697091086 learned_addr learned my addr 172.21.15.70:0/1697091086 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdd37fe640 1 --2- 172.21.15.70:0/1697091086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf400f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdd3fff640 1 --2- 172.21.15.70:0/1697091086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf3fe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdd8c5d640 1 -- 172.21.15.70:0/1697091086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 msgr2=0x55ffdf3fe8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdd8c5d640 1 --2- 172.21.15.70:0/1697091086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf3fe8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdd8c5d640 1 -- 172.21.15.70:0/1697091086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 msgr2=0x55ffdf400f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdd8c5d640 1 --2- 172.21.15.70:0/1697091086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf400f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdd8c5d640 1 -- 172.21.15.70:0/1697091086 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffdf3f4dd0 con 0x55ffdf402370 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdd3fff640 1 --2- 172.21.15.70:0/1697091086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf3fe8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdd37fe640 1 --2- 172.21.15.70:0/1697091086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf400f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdd8c5d640 1 --2- 172.21.15.70:0/1697091086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf4014a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0306b0 tx=0x7efdcc030640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7e5e00d0a367d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdc9ffb640 1 -- 172.21.15.70:0/1697091086 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc04f070 con 0x55ffdf402370 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdc9ffb640 1 -- 172.21.15.70:0/1697091086 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efdcc036030 con 0x55ffdf402370 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.565+0000 7efdc9ffb640 1 -- 172.21.15.70:0/1697091086 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc030a40 con 0x55ffdf402370 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.566+0000 7efddca99740 1 -- 172.21.15.70:0/1697091086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 msgr2=0x55ffdf4014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:11.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.566+0000 7efddca99740 1 --2- 172.21.15.70:0/1697091086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf4014a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0306b0 tx=0x7efdcc030640 comp rx=0 tx=0).stop 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.566+0000 7efddca99740 1 -- 172.21.15.70:0/1697091086 shutdown_connections 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.566+0000 7efddca99740 1 --2- 172.21.15.70:0/1697091086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf402370 0x55ffdf4014a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.566+0000 7efddca99740 1 --2- 172.21.15.70:0/1697091086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f8b40 0x55ffdf400f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.566+0000 7efddca99740 1 --2- 172.21.15.70:0/1697091086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf3f75d0 0x55ffdf3fe8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.566+0000 7efddca99740 1 -- 172.21.15.70:0/1697091086 >> 172.21.15.70:0/1697091086 conn(0x55ffdf3c0310 msgr2=0x55ffdf400850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.566+0000 7efddca99740 1 -- 172.21.15.70:0/1697091086 shutdown_connections 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.566+0000 7efddca99740 1 -- 172.21.15.70:0/1697091086 wait complete. 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.566+0000 7efddca99740 1 -- start start 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efddca99740 1 Processor -- start 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efddca99740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f75d0 0x55ffdf40aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efddca99740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3fbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efddca99740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf402370 0x55ffdf3fc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efddca99740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41b0e70 con 0x55ffdf3f8b40 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efddca99740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41b07a0 con 0x55ffdf3f75d0 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efddca99740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41ad9c0 con 0x55ffdf402370 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efddca99740 10 client.0 _ll_register_callbacks cb 0x7efdc400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efdd37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3fbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efdd37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3fbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52440/0 (socket says 172.21.15.70:52440) 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efdd37fe640 1 -- 172.21.15.70:0/2852791728 learned_addr learned my addr 172.21.15.70:0/2852791728 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efdd8c5d640 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf402370 0x55ffdf3fc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efdd3fff640 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f75d0 0x55ffdf40aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efdd37fe640 1 -- 172.21.15.70:0/2852791728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf402370 msgr2=0x55ffdf3fc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efdd37fe640 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf402370 0x55ffdf3fc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efdd37fe640 1 -- 172.21.15.70:0/2852791728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f75d0 msgr2=0x55ffdf40aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efdd37fe640 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f75d0 0x55ffdf40aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.567+0000 7efdd37fe640 1 -- 172.21.15.70:0/2852791728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffdf3f4960 con 0x55ffdf3f8b40 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efdd37fe640 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3fbb70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efdbc011010 tx=0x7efdbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0706cfea84912f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efdb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efdb37fe640 1 -- 172.21.15.70:0/2852791728 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc01e9b0 con 0x55ffdf3f8b40 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efdb37fe640 1 -- 172.21.15.70:0/2852791728 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7efdbc01eb50 con 0x55ffdf3f8b40 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efddca99740 1 -- 172.21.15.70:0/2852791728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdcc036030 con 0x55ffdf3f8b40 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efdb37fe640 1 -- 172.21.15.70:0/2852791728 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efdbc01ed50 con 0x55ffdf3f8b40 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efddca99740 10 client.15924 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efddca99740 1 -- 172.21.15.70:0/2852791728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ffdf47c810 con 0x55ffdf3f8b40 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efdb37fe640 1 -- 172.21.15.70:0/2852791728 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efdbc02b070 con 0x55ffdf3f8b40 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efdb37fe640 1 -- 172.21.15.70:0/2852791728 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efdbc004ca0 con 0x55ffdf3f8b40 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efddca99740 10 client.15924 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efddca99740 10 client.15924 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efddca99740 20 client.15924 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:11.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efddca99740 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55ffdf411e60 0x55ffdf47f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efddca99740 4 client.15924 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.568+0000 7efddca99740 1 -- 172.21.15.70:0/2852791728 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7efdcc036030 con 0x55ffdf411e60 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efdd3fff640 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55ffdf411e60 0x55ffdf47f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efdb37fe640 10 client.15924 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efdd3fff640 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55ffdf411e60 0x55ffdf47f000 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f812f4cee8c4816f server_cookie=babd1ccec06b0d93 in_seq=0 out_seq=0 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efdb37fe640 1 -- 172.21.15.70:0/2852791728 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7efdcc036030 con 0x55ffdf411e60 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efdb37fe640 10 client.15924 handle_command_reply: tid=0 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efddca99740 1 client.15924 shutdown 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efddca99740 1 -- 172.21.15.70:0/2852791728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf3f8b40 msgr2=0x55ffdf3fbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efddca99740 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3fbb70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efdbc011010 tx=0x7efdbc004730 comp rx=0 tx=0).stop 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efddca99740 1 -- 172.21.15.70:0/2852791728 shutdown_connections 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efddca99740 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55ffdf411e60 0x55ffdf47f000 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efddca99740 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ffdf402370 0x55ffdf3fc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efddca99740 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdf3f8b40 0x55ffdf3fbb70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efddca99740 1 --2- 172.21.15.70:0/2852791728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ffdf3f75d0 0x55ffdf40aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.569+0000 7efddca99740 1 -- 172.21.15.70:0/2852791728 >> 172.21.15.70:0/2852791728 conn(0x55ffdf3c0310 msgr2=0x55ffdf401070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:11.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdb37fe640 0 client.15924 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:53:11.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efddca99740 1 -- 172.21.15.70:0/2852791728 shutdown_connections 2024-09-12T01:53:11.607 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:53:11.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efddca99740 1 -- 172.21.15.70:0/2852791728 wait complete. 2024-09-12T01:53:11.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efddca99740 20 client.15924 trim_cache size 0 max 16384 2024-09-12T01:53:11.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdda6c0640 1 -- 172.21.15.70:0/342724771 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7efdc00a2b80 msgr2=0x7efdc00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:11.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdda6c0640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7efdc00a2b80 0x7efdc00a5040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efdd41024a0 tx=0x7efdbc00b390 comp rx=0 tx=0).stop 2024-09-12T01:53:11.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdda6c0640 1 -- 172.21.15.70:0/342724771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd4102db0 msgr2=0x7efdd4100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:11.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdda6c0640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd4102db0 0x7efdd4100a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efdc400e9f0 tx=0x7efdc400eeb0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdda6c0640 1 -- 172.21.15.70:0/342724771 shutdown_connections 2024-09-12T01:53:11.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdda6c0640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7efdc00a2b80 0x7efdc00a5040 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdda6c0640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdd41082e0 0x7efdd4101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdda6c0640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd4103760 0x7efdd4100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdda6c0640 1 --2- 172.21.15.70:0/342724771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efdd4102db0 0x7efdd4100a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:11.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdda6c0640 1 -- 172.21.15.70:0/342724771 >> 172.21.15.70:0/342724771 conn(0x7efdd40fc7d0 msgr2=0x7efdd40fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:11.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdda6c0640 1 -- 172.21.15.70:0/342724771 shutdown_connections 2024-09-12T01:53:11.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:11.570+0000 7efdda6c0640 1 -- 172.21.15.70:0/342724771 wait complete. 2024-09-12T01:53:11.812 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:11 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:11.812 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:11 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:11.812 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:11 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:11.812 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:11 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:53:11.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:11 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:11.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:11 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:11.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:11 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:11.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:11 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:53:12.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:11 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:12.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:11 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:12.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:11 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:12.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:11 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:53:12.315 INFO:tasks.workunit.client.0.smithi070.stderr:Updating files: 93% (12088/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T01:53:12.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:53:12.694 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:12.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:12 smithi070 ceph-mon[31177]: pgmap v368: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T01:53:12.919 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T01:53:12.919 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:53:12.920 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:53:12.920 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:53:12.920 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:53:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:53:12.920 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:53:12.920 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:53:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:53:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-09-12T01:53:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:53:12.920 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-09-12T01:53:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:53:12.920 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-09-12T01:53:12.921 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:53:12.921 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:53:12.921 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-12T01:53:12.921 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T01:53:12.925 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:53:12.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:12 smithi191 ceph-mon[35770]: pgmap v368: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T01:53:12.991 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:53:12.993 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:53:12.993 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:53:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:12 smithi152 ceph-mon[35055]: pgmap v368: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T01:53:13.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.259+0000 7fbbbc303640 1 -- 172.21.15.70:0/528179379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbb4102570 msgr2=0x7fbbb41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:13.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.259+0000 7fbbbc303640 1 --2- 172.21.15.70:0/528179379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbb4102570 0x7fbbb41029b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009900 tx=0x7fbbb002a480 comp rx=0 tx=0).stop 2024-09-12T01:53:13.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.259+0000 7fbbbc303640 1 -- 172.21.15.70:0/528179379 shutdown_connections 2024-09-12T01:53:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.259+0000 7fbbbc303640 1 --2- 172.21.15.70:0/528179379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbb4102ef0 0x7fbbb410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.259+0000 7fbbbc303640 1 --2- 172.21.15.70:0/528179379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbb4102570 0x7fbbb41029b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.259+0000 7fbbbc303640 1 --2- 172.21.15.70:0/528179379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbb4100e20 0x7fbbb4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.259+0000 7fbbbc303640 1 -- 172.21.15.70:0/528179379 >> 172.21.15.70:0/528179379 conn(0x7fbbb40fc7d0 msgr2=0x7fbbb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.259+0000 7fbbbc303640 1 -- 172.21.15.70:0/528179379 shutdown_connections 2024-09-12T01:53:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.259+0000 7fbbbc303640 1 -- 172.21.15.70:0/528179379 wait complete. 2024-09-12T01:53:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbbc303640 1 Processor -- start 2024-09-12T01:53:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbbc303640 1 -- start start 2024-09-12T01:53:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbbc303640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbb4100e20 0x7fbbb41986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbbc303640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbb4102570 0x7fbbb4198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbbc303640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbb4102ef0 0x7fbbb419cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbbc303640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb4111160 con 0x7fbbb4100e20 2024-09-12T01:53:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbbc303640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb4110fe0 con 0x7fbbb4102570 2024-09-12T01:53:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbbc303640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41112e0 con 0x7fbbb4102ef0 2024-09-12T01:53:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbba09f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbb4100e20 0x7fbbb41986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbba09f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbb4100e20 0x7fbbb41986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52452/0 (socket says 172.21.15.70:52452) 2024-09-12T01:53:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbba09f640 1 -- 172.21.15.70:0/2197301788 learned_addr learned my addr 172.21.15.70:0/2197301788 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbb989e640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbb4102570 0x7fbbb4198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbba09f640 1 -- 172.21.15.70:0/2197301788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbb4102ef0 msgr2=0x7fbbb419cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbba09f640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbb4102ef0 0x7fbbb419cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbba09f640 1 -- 172.21.15.70:0/2197301788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbb4102570 msgr2=0x7fbbb4198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbba09f640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbb4102570 0x7fbbb4198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbba09f640 1 -- 172.21.15.70:0/2197301788 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb419d6a0 con 0x7fbbb4100e20 2024-09-12T01:53:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.260+0000 7fbbb989e640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbb4102570 0x7fbbb4198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.261+0000 7fbbba09f640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbb4100e20 0x7fbbb41986f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbba800b4a0 tx=0x7fbba800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.261+0000 7fbba77fe640 1 -- 172.21.15.70:0/2197301788 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba8014070 con 0x7fbbb4100e20 2024-09-12T01:53:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.261+0000 7fbba77fe640 1 -- 172.21.15.70:0/2197301788 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbba8010b10 con 0x7fbbb4100e20 2024-09-12T01:53:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.261+0000 7fbba77fe640 1 -- 172.21.15.70:0/2197301788 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba8017d60 con 0x7fbbb4100e20 2024-09-12T01:53:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.261+0000 7fbbbc303640 1 -- 172.21.15.70:0/2197301788 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb419d990 con 0x7fbbb4100e20 2024-09-12T01:53:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.261+0000 7fbbbc303640 1 -- 172.21.15.70:0/2197301788 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb41a5270 con 0x7fbbb4100e20 2024-09-12T01:53:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.264+0000 7fbba77fe640 1 -- 172.21.15.70:0/2197301788 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbba8017070 con 0x7fbbb4100e20 2024-09-12T01:53:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.264+0000 7fbbbe6dc740 1 Processor -- start 2024-09-12T01:53:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.264+0000 7fbbbe6dc740 1 -- start start 2024-09-12T01:53:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.264+0000 7fbbbe6dc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37b98b40 0x560b37b97090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.264+0000 7fbbbe6dc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 0x560b37b97a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.264+0000 7fbbbe6dc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37ba6780 0x560b37ba8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.264+0000 7fbbbe6dc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560b37afd2f0 con 0x560b37b975d0 2024-09-12T01:53:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.264+0000 7fbbbe6dc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560b37aa4cf0 con 0x560b37b98b40 2024-09-12T01:53:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.264+0000 7fbbbe6dc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560b37af92b0 con 0x560b37ba6780 2024-09-12T01:53:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.264+0000 7fbbba09f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 0x560b37b97a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.264+0000 7fbbba09f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 0x560b37b97a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52456/0 (socket says 172.21.15.70:52456) 2024-09-12T01:53:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbbba09f640 1 -- 172.21.15.70:0/2728495599 learned_addr learned my addr 172.21.15.70:0/2728495599 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbba77fe640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbba00a2b80 0x7fbba00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbbb989e640 1 --2- 172.21.15.70:0/2728495599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37ba6780 0x560b37ba8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbbba8a0640 1 --2- 172.21.15.70:0/2728495599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37b98b40 0x560b37b97090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbbba8a0640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbba00a2b80 0x7fbba00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbbba09f640 1 -- 172.21.15.70:0/2728495599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37ba6780 msgr2=0x560b37ba8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbbba09f640 1 --2- 172.21.15.70:0/2728495599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37ba6780 0x560b37ba8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbbba09f640 1 -- 172.21.15.70:0/2728495599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37b98b40 msgr2=0x560b37b97090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbbba09f640 1 --2- 172.21.15.70:0/2728495599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37b98b40 0x560b37b97090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbbba09f640 1 -- 172.21.15.70:0/2728495599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b37a893a0 con 0x560b37b975d0 2024-09-12T01:53:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbbb989e640 1 --2- 172.21.15.70:0/2728495599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37ba6780 0x560b37ba8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbba77fe640 1 -- 172.21.15.70:0/2197301788 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbba80ce500 con 0x7fbbb4100e20 2024-09-12T01:53:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbbba8a0640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbba00a2b80 0x7fbba00a5040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbbac008fd0 tx=0x7fbbac006ce0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbbba09f640 1 --2- 172.21.15.70:0/2728495599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 0x560b37b97a10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbba80971c0 tx=0x7fbba8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68cf121c42596ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbba4dea640 1 -- 172.21.15.70:0/2728495599 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba801e070 con 0x560b37b975d0 2024-09-12T01:53:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbba4dea640 1 -- 172.21.15.70:0/2728495599 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbba809b460 con 0x560b37b975d0 2024-09-12T01:53:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.265+0000 7fbba4dea640 1 -- 172.21.15.70:0/2728495599 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba809f110 con 0x560b37b975d0 2024-09-12T01:53:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.266+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/2728495599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 msgr2=0x560b37b97a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.266+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/2728495599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 0x560b37b97a10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbba80971c0 tx=0x7fbba8020000 comp rx=0 tx=0).stop 2024-09-12T01:53:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.266+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/2728495599 shutdown_connections 2024-09-12T01:53:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.266+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/2728495599 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37ba6780 0x560b37ba8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.266+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/2728495599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 0x560b37b97a10 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.266+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/2728495599 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37b98b40 0x560b37b97090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.266+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/2728495599 >> 172.21.15.70:0/2728495599 conn(0x560b37b60310 msgr2=0x560b37b93c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.266+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/2728495599 shutdown_connections 2024-09-12T01:53:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.266+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/2728495599 wait complete. 2024-09-12T01:53:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbbe6dc740 1 -- start start 2024-09-12T01:53:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbbe6dc740 1 Processor -- start 2024-09-12T01:53:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbbe6dc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37b975d0 0x560b37ba6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbbe6dc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b98b40 0x560b37ba3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbbe6dc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37ba6780 0x560b37ba39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbbe6dc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560b37ba9420 con 0x560b37ba6780 2024-09-12T01:53:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbbe6dc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560b37ab8060 con 0x560b37b975d0 2024-09-12T01:53:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbbe6dc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560b37ba95a0 con 0x560b37b98b40 2024-09-12T01:53:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbbe6dc740 10 client.0 _ll_register_callbacks cb 0x560b3780b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbba8a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37ba6780 0x560b37ba39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbba8a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37ba6780 0x560b37ba39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52470/0 (socket says 172.21.15.70:52470) 2024-09-12T01:53:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbba8a0640 1 -- 172.21.15.70:0/3390840845 learned_addr learned my addr 172.21.15.70:0/3390840845 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbba09f640 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37b975d0 0x560b37ba6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbb989e640 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b98b40 0x560b37ba3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbba8a0640 1 -- 172.21.15.70:0/3390840845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b98b40 msgr2=0x560b37ba3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbba8a0640 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b98b40 0x560b37ba3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbba8a0640 1 -- 172.21.15.70:0/3390840845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37b975d0 msgr2=0x560b37ba6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbba8a0640 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37b975d0 0x560b37ba6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.267+0000 7fbbba8a0640 1 -- 172.21.15.70:0/3390840845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3786e3c0 con 0x560b37ba6780 2024-09-12T01:53:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbbba8a0640 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37ba6780 0x560b37ba39e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbbac014f40 tx=0x7fbbac004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6455b1c4dabe9f76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbb9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbb9dffb640 1 -- 172.21.15.70:0/3390840845 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac028060 con 0x560b37ba6780 2024-09-12T01:53:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbb9dffb640 1 -- 172.21.15.70:0/3390840845 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbbac019630 con 0x560b37ba6780 2024-09-12T01:53:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/3390840845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbba809b460 con 0x560b37ba6780 2024-09-12T01:53:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbb9dffb640 1 -- 172.21.15.70:0/3390840845 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbbac00de80 con 0x560b37ba6780 2024-09-12T01:53:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbbbe6dc740 10 client.15936 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/3390840845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560b37bb4ea0 con 0x560b37ba6780 2024-09-12T01:53:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbb9dffb640 1 -- 172.21.15.70:0/3390840845 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbba809b460 con 0x560b37ba6780 2024-09-12T01:53:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbb9dffb640 1 -- 172.21.15.70:0/3390840845 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbbac022030 con 0x560b37ba6780 2024-09-12T01:53:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbbbe6dc740 10 client.15936 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbbbe6dc740 10 client.15936 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T01:53:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbbbe6dc740 20 client.15936 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x560b37bb6360 0x560b37bb8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbbbe6dc740 4 client.15936 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.268+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/3390840845 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b37b0a860 con 0x560b37bb6360 2024-09-12T01:53:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.269+0000 7fbbba09f640 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x560b37bb6360 0x560b37bb8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.269+0000 7fbb9dffb640 10 client.15936 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:53:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.269+0000 7fbbba09f640 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x560b37bb6360 0x560b37bb8770 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=40dcc9e23b224a75 server_cookie=ab0b11381b2840 in_seq=0 out_seq=0 2024-09-12T01:53:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbb9dffb640 1 -- 172.21.15.70:0/3390840845 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560b37b0a860 con 0x560b37bb6360 2024-09-12T01:53:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbb9dffb640 10 client.15936 handle_command_reply: tid=0 2024-09-12T01:53:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbbbe6dc740 1 client.15936 shutdown 2024-09-12T01:53:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/3390840845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37ba6780 msgr2=0x560b37ba39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37ba6780 0x560b37ba39e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbbac014f40 tx=0x7fbbac004b50 comp rx=0 tx=0).stop 2024-09-12T01:53:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/3390840845 shutdown_connections 2024-09-12T01:53:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x560b37bb6360 0x560b37bb8770 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37ba6780 0x560b37ba39e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbb9dffb640 0 client.15936 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:53:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b98b40 0x560b37ba3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/3390840845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37b975d0 0x560b37ba6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/3390840845 >> 172.21.15.70:0/3390840845 conn(0x560b37b60310 msgr2=0x560b37b99960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/3390840845 shutdown_connections 2024-09-12T01:53:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/3390840845 wait complete. 2024-09-12T01:53:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.270+0000 7fbbbe6dc740 20 client.15936 trim_cache size 0 max 16384 2024-09-12T01:53:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbbe6dc740 1 Processor -- start 2024-09-12T01:53:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbbe6dc740 1 -- start start 2024-09-12T01:53:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbbe6dc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b975d0 0x560b37b93e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbbe6dc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b98b40 0x560b37bb26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbbe6dc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37ba6780 0x560b37bbe040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbbe6dc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41ab5b0 con 0x560b37b98b40 2024-09-12T01:53:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbbe6dc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41ad0f0 con 0x560b37ba6780 2024-09-12T01:53:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbbe6dc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41abc80 con 0x560b37b975d0 2024-09-12T01:53:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbb989e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b98b40 0x560b37bb26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbba09f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b975d0 0x560b37b93e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbb989e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b98b40 0x560b37bb26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52474/0 (socket says 172.21.15.70:52474) 2024-09-12T01:53:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbb989e640 1 -- 172.21.15.70:0/233256601 learned_addr learned my addr 172.21.15.70:0/233256601 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.283+0000 7fbbba8a0640 1 --2- 172.21.15.70:0/233256601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37ba6780 0x560b37bbe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.284+0000 7fbbba09f640 1 -- 172.21.15.70:0/233256601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37ba6780 msgr2=0x560b37bbe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.284+0000 7fbbba09f640 1 --2- 172.21.15.70:0/233256601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37ba6780 0x560b37bbe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.284+0000 7fbbba09f640 1 -- 172.21.15.70:0/233256601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b98b40 msgr2=0x560b37bb26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.284+0000 7fbbba09f640 1 --2- 172.21.15.70:0/233256601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b98b40 0x560b37bb26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.284+0000 7fbbba09f640 1 -- 172.21.15.70:0/233256601 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b37b9a120 con 0x560b37b975d0 2024-09-12T01:53:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.284+0000 7fbbba8a0640 1 --2- 172.21.15.70:0/233256601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37ba6780 0x560b37bbe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.284+0000 7fbbb989e640 1 --2- 172.21.15.70:0/233256601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b98b40 0x560b37bb26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.284+0000 7fbbba09f640 1 --2- 172.21.15.70:0/233256601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b975d0 0x560b37b93e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbba809acf0 tx=0x7fbba8017f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9f5a77bd5b957b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.284+0000 7fbb9ffff640 1 -- 172.21.15.70:0/233256601 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba801e040 con 0x560b37b975d0 2024-09-12T01:53:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.284+0000 7fbb9ffff640 1 -- 172.21.15.70:0/233256601 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbba80a39d0 con 0x560b37b975d0 2024-09-12T01:53:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.284+0000 7fbb9ffff640 1 -- 172.21.15.70:0/233256601 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba8010cc0 con 0x560b37b975d0 2024-09-12T01:53:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/233256601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b975d0 msgr2=0x560b37b93e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/233256601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b975d0 0x560b37b93e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbba809acf0 tx=0x7fbba8017f60 comp rx=0 tx=0).stop 2024-09-12T01:53:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/233256601 shutdown_connections 2024-09-12T01:53:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/233256601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37ba6780 0x560b37bbe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/233256601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b98b40 0x560b37bb26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/233256601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b975d0 0x560b37b93e10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/233256601 >> 172.21.15.70:0/233256601 conn(0x560b37b60310 msgr2=0x560b37b93700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/233256601 shutdown_connections 2024-09-12T01:53:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/233256601 wait complete. 2024-09-12T01:53:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 -- start start 2024-09-12T01:53:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 Processor -- start 2024-09-12T01:53:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 0x560b37bae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b98b40 0x560b37baed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37ba6780 0x560b37bab800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41aca20 con 0x560b37b975d0 2024-09-12T01:53:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41ac350 con 0x560b37ba6780 2024-09-12T01:53:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb41a9570 con 0x560b37b98b40 2024-09-12T01:53:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbbe6dc740 10 client.0 _ll_register_callbacks cb 0x7fbbac014bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbba09f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 0x560b37bae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbba09f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 0x560b37bae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52488/0 (socket says 172.21.15.70:52488) 2024-09-12T01:53:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbba09f640 1 -- 172.21.15.70:0/1902471546 learned_addr learned my addr 172.21.15.70:0/1902471546 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.285+0000 7fbbb989e640 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b98b40 0x560b37baed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbba09f640 1 -- 172.21.15.70:0/1902471546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b98b40 msgr2=0x560b37baed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbba09f640 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b98b40 0x560b37baed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbba8a0640 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37ba6780 0x560b37bab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbba09f640 1 -- 172.21.15.70:0/1902471546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37ba6780 msgr2=0x560b37bab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbba09f640 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37ba6780 0x560b37bab800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbba09f640 1 -- 172.21.15.70:0/1902471546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b37baf400 con 0x560b37b975d0 2024-09-12T01:53:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbb989e640 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b98b40 0x560b37baed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbba8a0640 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37ba6780 0x560b37bab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbba09f640 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 0x560b37bae830 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbba809af20 tx=0x7fbba80047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68b89828bb63f3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbb9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbb9dffb640 1 -- 172.21.15.70:0/1902471546 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba80b8060 con 0x560b37b975d0 2024-09-12T01:53:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbb9dffb640 1 -- 172.21.15.70:0/1902471546 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbba80173f0 con 0x560b37b975d0 2024-09-12T01:53:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/1902471546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbba80a39d0 con 0x560b37b975d0 2024-09-12T01:53:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbb9dffb640 1 -- 172.21.15.70:0/1902471546 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbba801e040 con 0x560b37b975d0 2024-09-12T01:53:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbbe6dc740 10 client.15942 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/1902471546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560b37c215b0 con 0x560b37b975d0 2024-09-12T01:53:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbb9dffb640 1 -- 172.21.15.70:0/1902471546 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbba80a39d0 con 0x560b37b975d0 2024-09-12T01:53:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbb9dffb640 1 -- 172.21.15.70:0/1902471546 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbba8063030 con 0x560b37b975d0 2024-09-12T01:53:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbbe6dc740 10 client.15942 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbbe6dc740 10 client.15942 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T01:53:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbbe6dc740 20 client.15942 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x560b37c21830 0x560b37c23c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbbe6dc740 4 client.15942 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:53:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.286+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/1902471546 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560b37b04d70 con 0x560b37c21830 2024-09-12T01:53:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbbb989e640 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x560b37c21830 0x560b37c23c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbb9dffb640 10 client.15942 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:53:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbbb989e640 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x560b37c21830 0x560b37c23c20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=93645aaf756c67f6 server_cookie=e079c1acb150f9c1 in_seq=0 out_seq=0 2024-09-12T01:53:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbb9dffb640 1 -- 172.21.15.70:0/1902471546 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560b37b04d70 con 0x560b37c21830 2024-09-12T01:53:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbb9dffb640 10 client.15942 handle_command_reply: tid=0 2024-09-12T01:53:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbbbe6dc740 1 client.15942 shutdown 2024-09-12T01:53:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/1902471546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 msgr2=0x560b37bae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 0x560b37bae830 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbba809af20 tx=0x7fbba80047d0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/1902471546 shutdown_connections 2024-09-12T01:53:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x560b37c21830 0x560b37c23c20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560b37ba6780 0x560b37bab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b37b98b40 0x560b37baed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbb9dffb640 0 client.15942 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:53:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbbbe6dc740 1 --2- 172.21.15.70:0/1902471546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560b37b975d0 0x560b37bae830 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.287+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/1902471546 >> 172.21.15.70:0/1902471546 conn(0x560b37b60310 msgr2=0x560b37ba4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/1902471546 shutdown_connections 2024-09-12T01:53:13.345 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:53:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbe6dc740 1 -- 172.21.15.70:0/1902471546 wait complete. 2024-09-12T01:53:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbe6dc740 20 client.15942 trim_cache size 0 max 16384 2024-09-12T01:53:13.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbc303640 1 -- 172.21.15.70:0/2197301788 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbba00a2b80 msgr2=0x7fbba00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:13.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbc303640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbba00a2b80 0x7fbba00a5040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbbac008fd0 tx=0x7fbbac006ce0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbc303640 1 -- 172.21.15.70:0/2197301788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbb4100e20 msgr2=0x7fbbb41986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:13.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbc303640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbb4100e20 0x7fbbb41986f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbba800b4a0 tx=0x7fbba800b960 comp rx=0 tx=0).stop 2024-09-12T01:53:13.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbc303640 1 -- 172.21.15.70:0/2197301788 shutdown_connections 2024-09-12T01:53:13.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbc303640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbba00a2b80 0x7fbba00a5040 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbc303640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbb4102ef0 0x7fbbb419cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbc303640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbb4102570 0x7fbbb4198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbc303640 1 --2- 172.21.15.70:0/2197301788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbb4100e20 0x7fbbb41986f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:13.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbc303640 1 -- 172.21.15.70:0/2197301788 >> 172.21.15.70:0/2197301788 conn(0x7fbbb40fc7d0 msgr2=0x7fbbb406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:13.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbc303640 1 -- 172.21.15.70:0/2197301788 shutdown_connections 2024-09-12T01:53:13.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:13.288+0000 7fbbbc303640 1 -- 172.21.15.70:0/2197301788 wait complete. 2024-09-12T01:53:14.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:53:14.475 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:53:14.497 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:14.558 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:53:14.600 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:53:14.602 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:53:14.602 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:53:14.640 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:53:14.643 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:53:14.643 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:53:14.659 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-12T01:53:14.660 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-12T01:53:14.660 DEBUG:teuthology.orchestra.run.smithi070:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-12T01:53:14.721 INFO:tasks.workunit.client.0.smithi070.stderr:+ KERNEL=linux-4.0.5 2024-09-12T01:53:14.721 INFO:tasks.workunit.client.0.smithi070.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-09-12T01:53:14.870 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:14 smithi070 ceph-mon[31177]: pgmap v369: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:53:14.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:14 smithi191 ceph-mon[35770]: pgmap v369: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:53:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.952+0000 7fae7ae72640 1 -- 172.21.15.70:0/889482696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae74100e30 msgr2=0x7fae74104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.952+0000 7fae7ae72640 1 --2- 172.21.15.70:0/889482696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae74100e30 0x7fae74104e80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fae64009900 tx=0x7fae6402a410 comp rx=0 tx=0).stop 2024-09-12T01:53:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.952+0000 7fae7ae72640 1 -- 172.21.15.70:0/889482696 shutdown_connections 2024-09-12T01:53:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.952+0000 7fae7ae72640 1 --2- 172.21.15.70:0/889482696 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae741055b0 0x7fae7410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.952+0000 7fae7ae72640 1 --2- 172.21.15.70:0/889482696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae74100e30 0x7fae74104e80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.952+0000 7fae7ae72640 1 --2- 172.21.15.70:0/889482696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae74100480 0x7fae74100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.952+0000 7fae7ae72640 1 -- 172.21.15.70:0/889482696 >> 172.21.15.70:0/889482696 conn(0x7fae74077210 msgr2=0x7fae740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.952+0000 7fae7ae72640 1 -- 172.21.15.70:0/889482696 shutdown_connections 2024-09-12T01:53:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.952+0000 7fae7ae72640 1 -- 172.21.15.70:0/889482696 wait complete. 2024-09-12T01:53:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.952+0000 7fae7ae72640 1 Processor -- start 2024-09-12T01:53:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae7ae72640 1 -- start start 2024-09-12T01:53:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae7ae72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae74100480 0x7fae7410e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae7ae72640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae74100e30 0x7fae7410ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae7ae72640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae741055b0 0x7fae7410f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae7ae72640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fae741120f0 con 0x7fae74100480 2024-09-12T01:53:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae7ae72640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fae74111f70 con 0x7fae74100e30 2024-09-12T01:53:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae7ae72640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fae74112270 con 0x7fae741055b0 2024-09-12T01:53:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae78c0e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae74100480 0x7fae7410e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae78c0e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae74100480 0x7fae7410e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52500/0 (socket says 172.21.15.70:52500) 2024-09-12T01:53:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae78c0e640 1 -- 172.21.15.70:0/2834592909 learned_addr learned my addr 172.21.15.70:0/2834592909 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae6bfff640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae74100e30 0x7fae7410ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae7940f640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae741055b0 0x7fae7410f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae78c0e640 1 -- 172.21.15.70:0/2834592909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae741055b0 msgr2=0x7fae7410f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae78c0e640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae741055b0 0x7fae7410f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae78c0e640 1 -- 172.21.15.70:0/2834592909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae74100e30 msgr2=0x7fae7410ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae78c0e640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae74100e30 0x7fae7410ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae78c0e640 1 -- 172.21.15.70:0/2834592909 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae741a6af0 con 0x7fae74100480 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae7940f640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae741055b0 0x7fae7410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.953+0000 7fae6bfff640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae74100e30 0x7fae7410ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.954+0000 7fae78c0e640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae74100480 0x7fae7410e850 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fae7000b4a0 tx=0x7fae7000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.954+0000 7fae69ffb640 1 -- 172.21.15.70:0/2834592909 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae70014070 con 0x7fae74100480 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.954+0000 7fae7ae72640 1 -- 172.21.15.70:0/2834592909 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae741a6de0 con 0x7fae74100480 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.954+0000 7fae69ffb640 1 -- 172.21.15.70:0/2834592909 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae70010b10 con 0x7fae74100480 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.954+0000 7fae69ffb640 1 -- 172.21.15.70:0/2834592909 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae70017d60 con 0x7fae74100480 2024-09-12T01:53:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.954+0000 7fae7ae72640 1 -- 172.21.15.70:0/2834592909 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae741a7290 con 0x7fae74100480 2024-09-12T01:53:14.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.956+0000 7fae69ffb640 1 -- 172.21.15.70:0/2834592909 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fae70017070 con 0x7fae74100480 2024-09-12T01:53:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7d24b740 1 Processor -- start 2024-09-12T01:53:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7d24b740 1 -- start start 2024-09-12T01:53:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7d24b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f01059b40 0x564f01058090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7d24b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f010585d0 0x564f01058a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae69ffb640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fae5c0a2b80 0x7fae5c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7d24b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f01065760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7d24b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564f00fbe2f0 con 0x564f01063370 2024-09-12T01:53:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7d24b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564f00f65cf0 con 0x564f010585d0 2024-09-12T01:53:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7d24b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564f00fba2b0 con 0x564f01059b40 2024-09-12T01:53:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7940f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f01065760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae78c0e640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fae5c0a2b80 0x7fae5c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7940f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f01065760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52504/0 (socket says 172.21.15.70:52504) 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7940f640 1 -- 172.21.15.70:0/1350031466 learned_addr learned my addr 172.21.15.70:0/1350031466 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae6bfff640 1 --2- 172.21.15.70:0/1350031466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f010585d0 0x564f01058a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae69ffb640 1 -- 172.21.15.70:0/2834592909 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fae700ce460 con 0x7fae74100480 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7940f640 1 --2- 172.21.15.70:0/1350031466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f01059b40 0x564f01058090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7940f640 1 -- 172.21.15.70:0/1350031466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f01059b40 msgr2=0x564f01058090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7940f640 1 --2- 172.21.15.70:0/1350031466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f01059b40 0x564f01058090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7940f640 1 -- 172.21.15.70:0/1350031466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f010585d0 msgr2=0x564f01058a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7940f640 1 --2- 172.21.15.70:0/1350031466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f010585d0 0x564f01058a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.957+0000 7fae7940f640 1 -- 172.21.15.70:0/1350031466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f00f4a3a0 con 0x564f01063370 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.958+0000 7fae78c0e640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fae5c0a2b80 0x7fae5c0a5040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fae700a3400 tx=0x7fae70096840 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.958+0000 7fae7940f640 1 --2- 172.21.15.70:0/1350031466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f01065760 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fae6c012810 tx=0x7fae6c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f6a041b74e2d6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.958+0000 7fae5affd640 1 -- 172.21.15.70:0/1350031466 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c004d20 con 0x564f01063370 2024-09-12T01:53:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.958+0000 7fae5affd640 1 -- 172.21.15.70:0/1350031466 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae6c012e50 con 0x564f01063370 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.958+0000 7fae5affd640 1 -- 172.21.15.70:0/1350031466 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0057a0 con 0x564f01063370 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 -- 172.21.15.70:0/1350031466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 msgr2=0x564f01065760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 --2- 172.21.15.70:0/1350031466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f01065760 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fae6c012810 tx=0x7fae6c0099b0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 -- 172.21.15.70:0/1350031466 shutdown_connections 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 --2- 172.21.15.70:0/1350031466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f01065760 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 --2- 172.21.15.70:0/1350031466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f010585d0 0x564f01058a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 --2- 172.21.15.70:0/1350031466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f01059b40 0x564f01058090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 -- 172.21.15.70:0/1350031466 >> 172.21.15.70:0/1350031466 conn(0x564f01021310 msgr2=0x564f01054c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 -- 172.21.15.70:0/1350031466 shutdown_connections 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 -- 172.21.15.70:0/1350031466 wait complete. 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 -- start start 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 Processor -- start 2024-09-12T01:53:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f010585d0 0x564f01062d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f01059b40 0x564f0105fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f010605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564f01066070 con 0x564f01063370 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x564f00f79060 con 0x564f010585d0 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.959+0000 7fae7d24b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x564f010661f0 con 0x564f01059b40 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae7d24b740 10 client.0 _ll_register_callbacks cb 0x564f00ccc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae7940f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f010605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae7940f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f010585d0 0x564f01062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae7940f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f010585d0 0x564f01062d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41072/0 (socket says 172.21.15.70:41072) 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae7940f640 1 -- 172.21.15.70:0/2806183703 learned_addr learned my addr 172.21.15.70:0/2806183703 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae6bfff640 1 --2- 172.21.15.70:0/2806183703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f01059b40 0x564f0105fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae7940f640 1 -- 172.21.15.70:0/2806183703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f01059b40 msgr2=0x564f0105fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:14.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae7940f640 1 --2- 172.21.15.70:0/2806183703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f01059b40 0x564f0105fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae7940f640 1 -- 172.21.15.70:0/2806183703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f010585d0 msgr2=0x564f01062d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae7940f640 1 --2- 172.21.15.70:0/2806183703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f010585d0 0x564f01062d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae7940f640 1 -- 172.21.15.70:0/2806183703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f00d2f3c0 con 0x564f01063370 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae7940f640 1 --2- 172.21.15.70:0/2806183703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f010605e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fae6c01b000 tx=0x7fae6c0054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0485d951cd1a1cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae53fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae53fff640 1 -- 172.21.15.70:0/2806183703 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c029040 con 0x564f01063370 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae53fff640 1 -- 172.21.15.70:0/2806183703 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fae6c004c40 con 0x564f01063370 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.960+0000 7fae7d24b740 1 -- 172.21.15.70:0/2806183703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae6c012e50 con 0x564f01063370 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.961+0000 7fae53fff640 1 -- 172.21.15.70:0/2806183703 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fae6c005860 con 0x564f01063370 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.961+0000 7fae7d24b740 10 client.15954 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.961+0000 7fae7d24b740 1 -- 172.21.15.70:0/2806183703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f01071ac0 con 0x564f01063370 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.961+0000 7fae53fff640 1 -- 172.21.15.70:0/2806183703 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae6c012e50 con 0x564f01063370 2024-09-12T01:53:14.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.961+0000 7fae53fff640 1 -- 172.21.15.70:0/2806183703 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fae6c00c070 con 0x564f01063370 2024-09-12T01:53:14.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.961+0000 7fae7d24b740 10 client.15954 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:14.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.961+0000 7fae7d24b740 10 client.15954 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:53:14.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.961+0000 7fae7d24b740 20 client.15954 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:14.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.961+0000 7fae7d24b740 1 --2- 172.21.15.70:0/2806183703 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x564f01072e10 0x564f01075200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.961+0000 7fae7d24b740 4 client.15954 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:14.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.961+0000 7fae7d24b740 1 -- 172.21.15.70:0/2806183703 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f00fcb860 con 0x564f01072e10 2024-09-12T01:53:14.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.961+0000 7fae6bfff640 1 --2- 172.21.15.70:0/2806183703 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x564f01072e10 0x564f01075200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.962+0000 7fae6bfff640 1 --2- 172.21.15.70:0/2806183703 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x564f01072e10 0x564f01075200 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35d6f2b50e5581d8 server_cookie=1b311537fa0c27bb in_seq=0 out_seq=0 2024-09-12T01:53:14.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.962+0000 7fae53fff640 10 client.15954 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:53:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.962+0000 7fae53fff640 1 -- 172.21.15.70:0/2806183703 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f00fcb860 con 0x564f01072e10 2024-09-12T01:53:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.962+0000 7fae53fff640 10 client.15954 handle_command_reply: tid=0 2024-09-12T01:53:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.962+0000 7fae7d24b740 1 client.15954 shutdown 2024-09-12T01:53:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.963+0000 7fae7d24b740 1 -- 172.21.15.70:0/2806183703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 msgr2=0x564f010605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:14.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.963+0000 7fae7d24b740 1 --2- 172.21.15.70:0/2806183703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f010605e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fae6c01b000 tx=0x7fae6c0054a0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.963+0000 7fae7d24b740 1 -- 172.21.15.70:0/2806183703 shutdown_connections 2024-09-12T01:53:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.963+0000 7fae7d24b740 1 --2- 172.21.15.70:0/2806183703 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x564f01072e10 0x564f01075200 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.963+0000 7fae7d24b740 1 --2- 172.21.15.70:0/2806183703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f010605e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.963+0000 7fae7d24b740 1 --2- 172.21.15.70:0/2806183703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f01059b40 0x564f0105fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.963+0000 7fae53fff640 0 client.15954 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:53:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.963+0000 7fae7d24b740 1 --2- 172.21.15.70:0/2806183703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f010585d0 0x564f01062d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.963+0000 7fae7d24b740 1 -- 172.21.15.70:0/2806183703 >> 172.21.15.70:0/2806183703 conn(0x564f01021310 msgr2=0x564f0105a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.963+0000 7fae7d24b740 1 -- 172.21.15.70:0/2806183703 shutdown_connections 2024-09-12T01:53:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.963+0000 7fae7d24b740 1 -- 172.21.15.70:0/2806183703 wait complete. 2024-09-12T01:53:14.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.963+0000 7fae7d24b740 20 client.15954 trim_cache size 0 max 16384 2024-09-12T01:53:14.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.976+0000 7fae7d24b740 1 Processor -- start 2024-09-12T01:53:14.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.976+0000 7fae7d24b740 1 -- start start 2024-09-12T01:53:14.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.976+0000 7fae7d24b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f010585d0 0x564f0106f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.976+0000 7fae7d24b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f01059b40 0x564f0105f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.976+0000 7fae7d24b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f0107a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.976+0000 7fae7d24b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fae741afa20 con 0x564f01063370 2024-09-12T01:53:14.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.976+0000 7fae7d24b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fae741b1560 con 0x564f01059b40 2024-09-12T01:53:14.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.976+0000 7fae7d24b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fae741b00f0 con 0x564f010585d0 2024-09-12T01:53:14.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae7940f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f0107a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae7940f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f0107a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52510/0 (socket says 172.21.15.70:52510) 2024-09-12T01:53:14.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae7940f640 1 -- 172.21.15.70:0/4292656300 learned_addr learned my addr 172.21.15.70:0/4292656300 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:14.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae6bfff640 1 --2- 172.21.15.70:0/4292656300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f01059b40 0x564f0105f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae7940f640 1 -- 172.21.15.70:0/4292656300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f010585d0 msgr2=0x564f0106f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:14.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae7940f640 1 --2- 172.21.15.70:0/4292656300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f010585d0 0x564f0106f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae7940f640 1 -- 172.21.15.70:0/4292656300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f01059b40 msgr2=0x564f0105f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:14.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae7940f640 1 --2- 172.21.15.70:0/4292656300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f01059b40 0x564f0105f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae7940f640 1 -- 172.21.15.70:0/4292656300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f01059300 con 0x564f01063370 2024-09-12T01:53:14.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae7940f640 1 --2- 172.21.15.70:0/4292656300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f0107a860 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fae6c006010 tx=0x7fae6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf464d3843eb425 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:14.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae5a7fc640 1 -- 172.21.15.70:0/4292656300 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c009dc0 con 0x564f01063370 2024-09-12T01:53:14.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae5a7fc640 1 -- 172.21.15.70:0/4292656300 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae6c012e50 con 0x564f01063370 2024-09-12T01:53:14.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.977+0000 7fae5a7fc640 1 -- 172.21.15.70:0/4292656300 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c004f00 con 0x564f01063370 2024-09-12T01:53:14.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.978+0000 7fae7d24b740 1 -- 172.21.15.70:0/4292656300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 msgr2=0x564f0107a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:14.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.978+0000 7fae7d24b740 1 --2- 172.21.15.70:0/4292656300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f0107a860 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fae6c006010 tx=0x7fae6c0057f0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.978+0000 7fae7d24b740 1 -- 172.21.15.70:0/4292656300 shutdown_connections 2024-09-12T01:53:14.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.978+0000 7fae7d24b740 1 --2- 172.21.15.70:0/4292656300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01063370 0x564f0107a860 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.978+0000 7fae7d24b740 1 --2- 172.21.15.70:0/4292656300 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f01059b40 0x564f0105f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.978+0000 7fae7d24b740 1 --2- 172.21.15.70:0/4292656300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f010585d0 0x564f0106f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.978+0000 7fae7d24b740 1 -- 172.21.15.70:0/4292656300 >> 172.21.15.70:0/4292656300 conn(0x564f01021310 msgr2=0x564f01062070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:14.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.978+0000 7fae7d24b740 1 -- 172.21.15.70:0/4292656300 shutdown_connections 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.978+0000 7fae7d24b740 1 -- 172.21.15.70:0/4292656300 wait complete. 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.978+0000 7fae7d24b740 1 -- start start 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.978+0000 7fae7d24b740 1 Processor -- start 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae7d24b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f010585d0 0x564f0106b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae7d24b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01059b40 0x564f0105ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae7d24b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f01063370 0x564f0105cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae7d24b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fae741b0e90 con 0x564f01059b40 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae7d24b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fae741b07c0 con 0x564f01063370 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae7d24b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fae741ad9e0 con 0x564f010585d0 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae7d24b740 10 client.0 _ll_register_callbacks cb 0x7fae64009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01059b40 0x564f0105ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01059b40 0x564f0105ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52516/0 (socket says 172.21.15.70:52516) 2024-09-12T01:53:14.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae6bfff640 1 -- 172.21.15.70:0/3316475088 learned_addr learned my addr 172.21.15.70:0/3316475088 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae7940f640 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f01063370 0x564f0105cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae7940f640 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f010585d0 0x564f0106b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae6bfff640 1 -- 172.21.15.70:0/3316475088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f010585d0 msgr2=0x564f0106b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae6bfff640 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f010585d0 0x564f0106b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae6bfff640 1 -- 172.21.15.70:0/3316475088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f01063370 msgr2=0x564f0105cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae6bfff640 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f01063370 0x564f0105cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae6bfff640 1 -- 172.21.15.70:0/3316475088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f0105d540 con 0x564f01059b40 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae7940f640 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f01063370 0x564f0105cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae6bfff640 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01059b40 0x564f0105ca90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fae64005ec0 tx=0x7fae64005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feaa8159dd7e4960 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae53fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae53fff640 1 -- 172.21.15.70:0/3316475088 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64035040 con 0x564f01059b40 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae7d24b740 1 -- 172.21.15.70:0/3316475088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae6c012e50 con 0x564f01059b40 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.979+0000 7fae53fff640 1 -- 172.21.15.70:0/3316475088 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fae64005040 con 0x564f01059b40 2024-09-12T01:53:14.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.980+0000 7fae53fff640 1 -- 172.21.15.70:0/3316475088 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fae64005240 con 0x564f01059b40 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.980+0000 7fae7d24b740 10 client.15960 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.980+0000 7fae7d24b740 1 -- 172.21.15.70:0/3316475088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f010dd5e0 con 0x564f01059b40 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.980+0000 7fae53fff640 1 -- 172.21.15.70:0/3316475088 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae6c012e50 con 0x564f01059b40 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.980+0000 7fae53fff640 1 -- 172.21.15.70:0/3316475088 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fae640047e0 con 0x564f01059b40 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.980+0000 7fae7d24b740 10 client.15960 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.980+0000 7fae7d24b740 10 client.15960 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.980+0000 7fae7d24b740 20 client.15960 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.980+0000 7fae7d24b740 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x564f010ddd90 0x564f010e01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.980+0000 7fae7d24b740 4 client.15960 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.980+0000 7fae7d24b740 1 -- 172.21.15.70:0/3316475088 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564f00fc5d70 con 0x564f010ddd90 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.980+0000 7fae7940f640 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x564f010ddd90 0x564f010e01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae7940f640 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x564f010ddd90 0x564f010e01b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33ebb4921f89a0c2 server_cookie=36cc47b1dfbd8af6 in_seq=0 out_seq=0 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae53fff640 10 client.15960 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:53:14.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae53fff640 1 -- 172.21.15.70:0/3316475088 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564f00fc5d70 con 0x564f010ddd90 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae53fff640 10 client.15960 handle_command_reply: tid=0 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae7d24b740 1 client.15960 shutdown 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae7d24b740 1 -- 172.21.15.70:0/3316475088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01059b40 msgr2=0x564f0105ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae7d24b740 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01059b40 0x564f0105ca90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fae64005ec0 tx=0x7fae64005c00 comp rx=0 tx=0).stop 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae7d24b740 1 -- 172.21.15.70:0/3316475088 shutdown_connections 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae7d24b740 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x564f010ddd90 0x564f010e01b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae7d24b740 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x564f01063370 0x564f0105cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae7d24b740 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f01059b40 0x564f0105ca90 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae7d24b740 1 --2- 172.21.15.70:0/3316475088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x564f010585d0 0x564f0106b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae7d24b740 1 -- 172.21.15.70:0/3316475088 >> 172.21.15.70:0/3316475088 conn(0x564f01021310 msgr2=0x564f010534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.981+0000 7fae53fff640 0 client.15960 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7d24b740 1 -- 172.21.15.70:0/3316475088 shutdown_connections 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7d24b740 1 -- 172.21.15.70:0/3316475088 wait complete. 2024-09-12T01:53:14.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7d24b740 20 client.15960 trim_cache size 0 max 16384 2024-09-12T01:53:14.988 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:53:14.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7ae72640 1 -- 172.21.15.70:0/2834592909 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fae5c0a2b80 msgr2=0x7fae5c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:14.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7ae72640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fae5c0a2b80 0x7fae5c0a5040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fae700a3400 tx=0x7fae70096840 comp rx=0 tx=0).stop 2024-09-12T01:53:14.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7ae72640 1 -- 172.21.15.70:0/2834592909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae74100480 msgr2=0x7fae7410e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:14.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7ae72640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae74100480 0x7fae7410e850 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fae7000b4a0 tx=0x7fae7000b960 comp rx=0 tx=0).stop 2024-09-12T01:53:14.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7ae72640 1 -- 172.21.15.70:0/2834592909 shutdown_connections 2024-09-12T01:53:14.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7ae72640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fae5c0a2b80 0x7fae5c0a5040 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7ae72640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae741055b0 0x7fae7410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7ae72640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae74100e30 0x7fae7410ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7ae72640 1 --2- 172.21.15.70:0/2834592909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae74100480 0x7fae7410e850 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:14.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7ae72640 1 -- 172.21.15.70:0/2834592909 >> 172.21.15.70:0/2834592909 conn(0x7fae74077210 msgr2=0x7fae74103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:14.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7ae72640 1 -- 172.21.15.70:0/2834592909 shutdown_connections 2024-09-12T01:53:14.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:14.982+0000 7fae7ae72640 1 -- 172.21.15.70:0/2834592909 wait complete. 2024-09-12T01:53:15.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:14 smithi152 ceph-mon[35055]: pgmap v369: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:53:15.695 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:53:15.985 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:16.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.471+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/1377463990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04100a80 msgr2=0x7f6c04100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:16.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.471+0000 7f6c0b0c8640 1 --2- 172.21.15.70:0/1377463990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04100a80 0x7f6c04100ee0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009930 tx=0x7f6bf002a420 comp rx=0 tx=0).stop 2024-09-12T01:53:16.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.471+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/1377463990 shutdown_connections 2024-09-12T01:53:16.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.471+0000 7f6c0b0c8640 1 --2- 172.21.15.70:0/1377463990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c04101420 0x7f6c0410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.471+0000 7f6c0b0c8640 1 --2- 172.21.15.70:0/1377463990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04100a80 0x7f6c04100ee0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.471+0000 7f6c0b0c8640 1 --2- 172.21.15.70:0/1377463990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c04106a80 0x7f6c04106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.471+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/1377463990 >> 172.21.15.70:0/1377463990 conn(0x7f6c040fc7a0 msgr2=0x7f6c040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:16.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.471+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/1377463990 shutdown_connections 2024-09-12T01:53:16.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.471+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/1377463990 wait complete. 2024-09-12T01:53:16.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c0b0c8640 1 Processor -- start 2024-09-12T01:53:16.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c0b0c8640 1 -- start start 2024-09-12T01:53:16.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c0b0c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04100a80 0x7f6c04198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c0b0c8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c04101420 0x7f6c04198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c0b0c8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c04106a80 0x7f6c0419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c0b0c8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04110fe0 con 0x7f6c04100a80 2024-09-12T01:53:16.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c0b0c8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04110e60 con 0x7f6c04106a80 2024-09-12T01:53:16.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c0b0c8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04111160 con 0x7f6c04101420 2024-09-12T01:53:16.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c08e64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04100a80 0x7f6c04198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c08e64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04100a80 0x7f6c04198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52534/0 (socket says 172.21.15.70:52534) 2024-09-12T01:53:16.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c08e64640 1 -- 172.21.15.70:0/853692442 learned_addr learned my addr 172.21.15.70:0/853692442 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:16.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c08e64640 1 -- 172.21.15.70:0/853692442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c04101420 msgr2=0x7f6c04198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:16.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c08e64640 1 --2- 172.21.15.70:0/853692442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c04101420 0x7f6c04198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c08e64640 1 -- 172.21.15.70:0/853692442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c04106a80 msgr2=0x7f6c0419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:16.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c08e64640 1 --2- 172.21.15.70:0/853692442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c04106a80 0x7f6c0419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.472+0000 7f6c08e64640 1 -- 172.21.15.70:0/853692442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0419d5e0 con 0x7f6c04100a80 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.473+0000 7f6c08e64640 1 --2- 172.21.15.70:0/853692442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04100a80 0x7f6c04198630 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800b4a0 tx=0x7f6bf800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.473+0000 7f6c01ffb640 1 -- 172.21.15.70:0/853692442 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8014070 con 0x7f6c04100a80 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.473+0000 7f6c01ffb640 1 -- 172.21.15.70:0/853692442 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bf8010b10 con 0x7f6c04100a80 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.473+0000 7f6c01ffb640 1 -- 172.21.15.70:0/853692442 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8017d60 con 0x7f6c04100a80 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.473+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/853692442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c0419d8d0 con 0x7f6c04100a80 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.473+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/853692442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c041a51b0 con 0x7f6c04100a80 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.476+0000 7f6c01ffb640 1 -- 172.21.15.70:0/853692442 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6bf8017070 con 0x7f6c04100a80 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.476+0000 7f6c0d4a1740 1 Processor -- start 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.476+0000 7f6c0d4a1740 1 -- start start 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.476+0000 7f6c0d4a1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 0x559d7f071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.476+0000 7f6c0d4a1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f0715d0 0x559d7f071a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.476+0000 7f6c0d4a1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f080780 0x559d7f082b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.476+0000 7f6c0d4a1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559d7efd72f0 con 0x559d7f072b40 2024-09-12T01:53:16.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.476+0000 7f6c0d4a1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559d7ef7ecf0 con 0x559d7f080780 2024-09-12T01:53:16.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.476+0000 7f6c0d4a1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559d7efd32b0 con 0x559d7f0715d0 2024-09-12T01:53:16.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.476+0000 7f6c01ffb640 1 --2- 172.21.15.70:0/853692442 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6bf40a2b80 0x7f6bf40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c09665640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 0x559d7f071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f080780 0x559d7f082b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c09665640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 0x559d7f071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52544/0 (socket says 172.21.15.70:52544) 2024-09-12T01:53:16.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f080780 0x559d7f082b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41120/0 (socket says 172.21.15.70:41120) 2024-09-12T01:53:16.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c01ffb640 1 -- 172.21.15.70:0/853692442 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6bf80ce500 con 0x7f6c04100a80 2024-09-12T01:53:16.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c03fff640 1 -- 172.21.15.70:0/2174545266 learned_addr learned my addr 172.21.15.70:0/2174545266 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:16.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c09665640 1 --2- 172.21.15.70:0/853692442 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6bf40a2b80 0x7f6bf40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c08e64640 1 --2- 172.21.15.70:0/2174545266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f0715d0 0x559d7f071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c09665640 1 -- 172.21.15.70:0/2174545266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f0715d0 msgr2=0x559d7f071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c09665640 1 --2- 172.21.15.70:0/2174545266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f0715d0 0x559d7f071a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c09665640 1 -- 172.21.15.70:0/2174545266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f080780 msgr2=0x559d7f082b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c09665640 1 --2- 172.21.15.70:0/2174545266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f080780 0x559d7f082b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c09665640 1 -- 172.21.15.70:0/2174545266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7ef633a0 con 0x559d7f072b40 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c03fff640 1 --2- 172.21.15.70:0/2174545266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f080780 0x559d7f082b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c09665640 1 --2- 172.21.15.70:0/2174545266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 0x559d7f071090 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc013b90 tx=0x7f6bfc011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373c422ecd49ea8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6c09665640 1 --2- 172.21.15.70:0/853692442 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6bf40a2b80 0x7f6bf40a5040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc011c50 tx=0x7f6bfc01a000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6beeffd640 1 -- 172.21.15.70:0/2174545266 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc022070 con 0x559d7f072b40 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6beeffd640 1 -- 172.21.15.70:0/2174545266 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bfc009970 con 0x559d7f072b40 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.477+0000 7f6beeffd640 1 -- 172.21.15.70:0/2174545266 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00ed80 con 0x559d7f072b40 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.478+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/2174545266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 msgr2=0x559d7f071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.478+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/2174545266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 0x559d7f071090 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc013b90 tx=0x7f6bfc011750 comp rx=0 tx=0).stop 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.478+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/2174545266 shutdown_connections 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.478+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/2174545266 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f080780 0x559d7f082b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.478+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/2174545266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f0715d0 0x559d7f071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.478+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/2174545266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 0x559d7f071090 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.478+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/2174545266 >> 172.21.15.70:0/2174545266 conn(0x559d7f03a310 msgr2=0x559d7f06dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.478+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/2174545266 shutdown_connections 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.478+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/2174545266 wait complete. 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c0d4a1740 1 -- start start 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c0d4a1740 1 Processor -- start 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c0d4a1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f0715d0 0x559d7f0801b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c0d4a1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f072b40 0x559d7f07d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c0d4a1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f080780 0x559d7f07dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c0d4a1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559d7f083420 con 0x559d7f0715d0 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c0d4a1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559d7ef92060 con 0x559d7f072b40 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c0d4a1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559d7f0835a0 con 0x559d7f080780 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c0d4a1740 10 client.0 _ll_register_callbacks cb 0x559d7ece58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c08e64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f0715d0 0x559d7f0801b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c08e64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f0715d0 0x559d7f0801b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52560/0 (socket says 172.21.15.70:52560) 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c08e64640 1 -- 172.21.15.70:0/3790608699 learned_addr learned my addr 172.21.15.70:0/3790608699 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c03fff640 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f072b40 0x559d7f07d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.479+0000 7f6c09665640 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f080780 0x559d7f07dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6c08e64640 1 -- 172.21.15.70:0/3790608699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f080780 msgr2=0x559d7f07dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6c08e64640 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f080780 0x559d7f07dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6c08e64640 1 -- 172.21.15.70:0/3790608699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f072b40 msgr2=0x559d7f07d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6c08e64640 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f072b40 0x559d7f07d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6c08e64640 1 -- 172.21.15.70:0/3790608699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d7ed483c0 con 0x559d7f0715d0 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6c08e64640 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f0715d0 0x559d7f0801b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6bf809aca0 tx=0x7f6bf80047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fdc866a2ec2034 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6be3fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6be3fff640 1 -- 172.21.15.70:0/3790608699 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf801e040 con 0x559d7f0715d0 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6be3fff640 1 -- 172.21.15.70:0/3790608699 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6bf8010cc0 con 0x559d7f0715d0 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/3790608699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559d7efe4860 con 0x559d7f0715d0 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6be3fff640 1 -- 172.21.15.70:0/3790608699 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6bf80973d0 con 0x559d7f0715d0 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6c0d4a1740 10 client.15972 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/3790608699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d7f08ef60 con 0x559d7f0715d0 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6be3fff640 1 -- 172.21.15.70:0/3790608699 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x559d7efe4860 con 0x559d7f0715d0 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6be3fff640 1 -- 172.21.15.70:0/3790608699 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6bf8085040 con 0x559d7f0715d0 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6c0d4a1740 10 client.15972 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.480+0000 7f6c0d4a1740 10 client.15972 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:53:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.481+0000 7f6c0d4a1740 20 client.15972 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.481+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x559d7f090370 0x559d7f092760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.481+0000 7f6c0d4a1740 4 client.15972 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.481+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/3790608699 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d7efded70 con 0x559d7f090370 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.481+0000 7f6c03fff640 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x559d7f090370 0x559d7f092760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.481+0000 7f6c03fff640 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x559d7f090370 0x559d7f092760 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=381fa6306b319863 server_cookie=1e246424d5c44244 in_seq=0 out_seq=0 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.481+0000 7f6be3fff640 10 client.15972 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6be3fff640 1 -- 172.21.15.70:0/3790608699 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d7efded70 con 0x559d7f090370 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6be3fff640 10 client.15972 handle_command_reply: tid=0 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6c0d4a1740 1 client.15972 shutdown 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/3790608699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f0715d0 msgr2=0x559d7f0801b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f0715d0 0x559d7f0801b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6bf809aca0 tx=0x7f6bf80047d0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/3790608699 shutdown_connections 2024-09-12T01:53:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x559d7f090370 0x559d7f092760 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f080780 0x559d7f07dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f072b40 0x559d7f07d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6be3fff640 0 client.15972 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:53:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/3790608699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f0715d0 0x559d7f0801b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/3790608699 >> 172.21.15.70:0/3790608699 conn(0x559d7f03a310 msgr2=0x559d7f073960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/3790608699 shutdown_connections 2024-09-12T01:53:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/3790608699 wait complete. 2024-09-12T01:53:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.482+0000 7f6c0d4a1740 20 client.15972 trim_cache size 0 max 16384 2024-09-12T01:53:16.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c0d4a1740 1 Processor -- start 2024-09-12T01:53:16.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c0d4a1740 1 -- start start 2024-09-12T01:53:16.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c0d4a1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f0715d0 0x559d7f06de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c0d4a1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f072b40 0x559d7f097f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c0d4a1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f080780 0x559d7f0984d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c0d4a1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6c041ab510 con 0x559d7f080780 2024-09-12T01:53:16.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c0d4a1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6c041ad050 con 0x559d7f0715d0 2024-09-12T01:53:16.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c0d4a1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6c041abbe0 con 0x559d7f072b40 2024-09-12T01:53:16.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c09665640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f080780 0x559d7f0984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c09665640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f080780 0x559d7f0984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52566/0 (socket says 172.21.15.70:52566) 2024-09-12T01:53:16.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c09665640 1 -- 172.21.15.70:0/24765180 learned_addr learned my addr 172.21.15.70:0/24765180 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c03fff640 1 --2- 172.21.15.70:0/24765180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f072b40 0x559d7f097f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c08e64640 1 --2- 172.21.15.70:0/24765180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f0715d0 0x559d7f06de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c09665640 1 -- 172.21.15.70:0/24765180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f072b40 msgr2=0x559d7f097f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c09665640 1 --2- 172.21.15.70:0/24765180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f072b40 0x559d7f097f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c09665640 1 -- 172.21.15.70:0/24765180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f0715d0 msgr2=0x559d7f06de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c09665640 1 --2- 172.21.15.70:0/24765180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f0715d0 0x559d7f06de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c09665640 1 -- 172.21.15.70:0/24765180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7f06e950 con 0x559d7f080780 2024-09-12T01:53:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.496+0000 7f6c08e64640 1 --2- 172.21.15.70:0/24765180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f0715d0 0x559d7f06de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.497+0000 7f6c09665640 1 --2- 172.21.15.70:0/24765180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f080780 0x559d7f0984d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc013b90 tx=0x7f6bfc011fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a8b930278c7e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.497+0000 7f6bee7fc640 1 -- 172.21.15.70:0/24765180 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc02c070 con 0x559d7f080780 2024-09-12T01:53:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.497+0000 7f6bee7fc640 1 -- 172.21.15.70:0/24765180 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bfc013cf0 con 0x559d7f080780 2024-09-12T01:53:16.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.497+0000 7f6bee7fc640 1 -- 172.21.15.70:0/24765180 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc022040 con 0x559d7f080780 2024-09-12T01:53:16.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.497+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/24765180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f080780 msgr2=0x559d7f0984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:16.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.497+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/24765180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f080780 0x559d7f0984d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc013b90 tx=0x7f6bfc011fa0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.498+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/24765180 shutdown_connections 2024-09-12T01:53:16.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.498+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/24765180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f080780 0x559d7f0984d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.498+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/24765180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f072b40 0x559d7f097f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.498+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/24765180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f0715d0 0x559d7f06de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.498+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/24765180 >> 172.21.15.70:0/24765180 conn(0x559d7f03a310 msgr2=0x559d7f06d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.498+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/24765180 shutdown_connections 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.498+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/24765180 wait complete. 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.498+0000 7f6c0d4a1740 1 -- start start 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.498+0000 7f6c0d4a1740 1 Processor -- start 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.498+0000 7f6c0d4a1740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f0715d0 0x559d7f07a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.498+0000 7f6c0d4a1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 0x559d7f07aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.498+0000 7f6c0d4a1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f080780 0x559d7f07af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c0d4a1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6c041ac980 con 0x559d7f072b40 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c0d4a1740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6c041ac2b0 con 0x559d7f0715d0 2024-09-12T01:53:16.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c0d4a1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6c041a94d0 con 0x559d7f080780 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c0d4a1740 10 client.0 _ll_register_callbacks cb 0x7f6bf809b530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 0x559d7f07aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c08e64640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f0715d0 0x559d7f07a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 0x559d7f07aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52570/0 (socket says 172.21.15.70:52570) 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c03fff640 1 -- 172.21.15.70:0/27208823 learned_addr learned my addr 172.21.15.70:0/27208823 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c09665640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f080780 0x559d7f07af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c03fff640 1 -- 172.21.15.70:0/27208823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f080780 msgr2=0x559d7f07af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c03fff640 1 --2- 172.21.15.70:0/27208823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f080780 0x559d7f07af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c03fff640 1 -- 172.21.15.70:0/27208823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f0715d0 msgr2=0x559d7f07a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c03fff640 1 --2- 172.21.15.70:0/27208823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f0715d0 0x559d7f07a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c03fff640 1 -- 172.21.15.70:0/27208823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d7f0f9fb0 con 0x559d7f072b40 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c03fff640 1 --2- 172.21.15.70:0/27208823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 0x559d7f07aa40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x559d7f072070 tx=0x7f6bf002ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9fd3439950a6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6be3fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6be3fff640 1 -- 172.21.15.70:0/27208823 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0035040 con 0x559d7f072b40 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6be3fff640 1 -- 172.21.15.70:0/27208823 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6bf0004450 con 0x559d7f072b40 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.499+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/27208823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bfc013cf0 con 0x559d7f072b40 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.500+0000 7f6be3fff640 1 -- 172.21.15.70:0/27208823 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6bf00035f0 con 0x559d7f072b40 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.500+0000 7f6c0d4a1740 10 client.15978 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.500+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/27208823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d7f0fb290 con 0x559d7f072b40 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.500+0000 7f6be3fff640 1 -- 172.21.15.70:0/27208823 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bfc013cf0 con 0x559d7f072b40 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.500+0000 7f6be3fff640 1 -- 172.21.15.70:0/27208823 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6bf00437e0 con 0x559d7f072b40 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.500+0000 7f6c0d4a1740 10 client.15978 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.500+0000 7f6c0d4a1740 10 client.15978 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.500+0000 7f6c0d4a1740 20 client.15978 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.500+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/27208823 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x559d7f0fba70 0x559d7f0fde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.500+0000 7f6c0d4a1740 4 client.15978 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:53:16.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.500+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/27208823 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d7ef5b170 con 0x559d7f0fba70 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.500+0000 7f6c08e64640 1 --2- 172.21.15.70:0/27208823 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x559d7f0fba70 0x559d7f0fde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c08e64640 1 --2- 172.21.15.70:0/27208823 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x559d7f0fba70 0x559d7f0fde90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9447ddc3a375488 server_cookie=fdb721990d251942 in_seq=0 out_seq=0 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6be3fff640 10 client.15978 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6be3fff640 1 -- 172.21.15.70:0/27208823 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d7ef5b170 con 0x559d7f0fba70 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6be3fff640 10 client.15978 handle_command_reply: tid=0 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c0d4a1740 1 client.15978 shutdown 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/27208823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 msgr2=0x559d7f07aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/27208823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 0x559d7f07aa40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x559d7f072070 tx=0x7f6bf002ab90 comp rx=0 tx=0).stop 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/27208823 shutdown_connections 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/27208823 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x559d7f0fba70 0x559d7f0fde90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/27208823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559d7f080780 0x559d7f07af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6be3fff640 0 client.15978 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/27208823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d7f072b40 0x559d7f07aa40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c0d4a1740 1 --2- 172.21.15.70:0/27208823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d7f0715d0 0x559d7f07a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/27208823 >> 172.21.15.70:0/27208823 conn(0x559d7f03a310 msgr2=0x559d7f06c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:16.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/27208823 shutdown_connections 2024-09-12T01:53:16.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c0d4a1740 1 -- 172.21.15.70:0/27208823 wait complete. 2024-09-12T01:53:16.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.501+0000 7f6c0d4a1740 20 client.15978 trim_cache size 0 max 16384 2024-09-12T01:53:16.508 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:53:16.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.502+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/853692442 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6bf40a2b80 msgr2=0x7f6bf40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:16.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.502+0000 7f6c0b0c8640 1 --2- 172.21.15.70:0/853692442 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6bf40a2b80 0x7f6bf40a5040 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc011c50 tx=0x7f6bfc01a000 comp rx=0 tx=0).stop 2024-09-12T01:53:16.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.502+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/853692442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04100a80 msgr2=0x7f6c04198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:16.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.502+0000 7f6c0b0c8640 1 --2- 172.21.15.70:0/853692442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04100a80 0x7f6c04198630 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800b4a0 tx=0x7f6bf800b960 comp rx=0 tx=0).stop 2024-09-12T01:53:16.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.502+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/853692442 shutdown_connections 2024-09-12T01:53:16.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.502+0000 7f6c0b0c8640 1 --2- 172.21.15.70:0/853692442 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6bf40a2b80 0x7f6bf40a5040 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.502+0000 7f6c0b0c8640 1 --2- 172.21.15.70:0/853692442 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c04106a80 0x7f6c0419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.502+0000 7f6c0b0c8640 1 --2- 172.21.15.70:0/853692442 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c04101420 0x7f6c04198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.502+0000 7f6c0b0c8640 1 --2- 172.21.15.70:0/853692442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c04100a80 0x7f6c04198630 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:16.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.502+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/853692442 >> 172.21.15.70:0/853692442 conn(0x7f6c040fc7a0 msgr2=0x7f6c0406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:16.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.502+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/853692442 shutdown_connections 2024-09-12T01:53:16.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:16.502+0000 7f6c0b0c8640 1 -- 172.21.15.70:0/853692442 wait complete. 2024-09-12T01:53:16.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:16 smithi070 ceph-mon[31177]: pgmap v370: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:53:16.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:16 smithi191 ceph-mon[35770]: pgmap v370: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:53:17.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:16 smithi152 ceph-mon[35055]: pgmap v370: 97 pgs: 97 active+clean; 669 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-12T01:53:17.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:53:17.442 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.484+0000 7fdba46f1640 1 -- 172.21.15.70:0/3146619143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb9c104ef0 msgr2=0x7fdb9c1072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.484+0000 7fdba46f1640 1 --2- 172.21.15.70:0/3146619143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb9c104ef0 0x7fdb9c1072e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009900 tx=0x7fdb9802a410 comp rx=0 tx=0).stop 2024-09-12T01:53:17.487 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 -- 172.21.15.70:0/3146619143 shutdown_connections 2024-09-12T01:53:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 --2- 172.21.15.70:0/3146619143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb9c107820 0x7fdb9c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 --2- 172.21.15.70:0/3146619143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb9c104ef0 0x7fdb9c1072e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 --2- 172.21.15.70:0/3146619143 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb9c1025c0 0x7fdb9c1049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 -- 172.21.15.70:0/3146619143 >> 172.21.15.70:0/3146619143 conn(0x7fdb9c0fc1e0 msgr2=0x7fdb9c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 -- 172.21.15.70:0/3146619143 shutdown_connections 2024-09-12T01:53:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 -- 172.21.15.70:0/3146619143 wait complete. 2024-09-12T01:53:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 Processor -- start 2024-09-12T01:53:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 -- start start 2024-09-12T01:53:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb9c1025c0 0x7fdb9c197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb9c104ef0 0x7fdb9c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb9c107820 0x7fdb9c19f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.488 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c10d910 con 0x7fdb9c104ef0 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c10d790 con 0x7fdb9c107820 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba46f1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c10da90 con 0x7fdb9c1025c0 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba1c8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb9c104ef0 0x7fdb9c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba1c8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb9c104ef0 0x7fdb9c198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52598/0 (socket says 172.21.15.70:52598) 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.485+0000 7fdba1c8c640 1 -- 172.21.15.70:0/224966887 learned_addr learned my addr 172.21.15.70:0/224966887 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdba248d640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb9c1025c0 0x7fdb9c197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdba2c8e640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb9c107820 0x7fdb9c19f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdba1c8c640 1 -- 172.21.15.70:0/224966887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb9c1025c0 msgr2=0x7fdb9c197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb9c1025c0 0x7fdb9c197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdba1c8c640 1 -- 172.21.15.70:0/224966887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb9c107820 msgr2=0x7fdb9c19f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb9c107820 0x7fdb9c19f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdba1c8c640 1 -- 172.21.15.70:0/224966887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9c19fa70 con 0x7fdb9c104ef0 2024-09-12T01:53:17.489 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb9c104ef0 0x7fdb9c198390 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdb98005ab0 tx=0x7fdb980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdb8f7fe640 1 -- 172.21.15.70:0/224966887 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9803f030 con 0x7fdb9c104ef0 2024-09-12T01:53:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdb8f7fe640 1 -- 172.21.15.70:0/224966887 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdb98003d00 con 0x7fdb9c104ef0 2024-09-12T01:53:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdba46f1640 1 -- 172.21.15.70:0/224966887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9c19fd00 con 0x7fdb9c104ef0 2024-09-12T01:53:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdb8f7fe640 1 -- 172.21.15.70:0/224966887 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb98035070 con 0x7fdb9c104ef0 2024-09-12T01:53:17.490 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.486+0000 7fdba46f1640 1 -- 172.21.15.70:0/224966887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb9c1a01a0 con 0x7fdb9c104ef0 2024-09-12T01:53:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdb8f7fe640 1 -- 172.21.15.70:0/224966887 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdb98042030 con 0x7fdb9c104ef0 2024-09-12T01:53:17.496 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdba748c740 1 Processor -- start 2024-09-12T01:53:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdba748c740 1 -- start start 2024-09-12T01:53:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdba748c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24a9a0 0x56369b24ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdba748c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b24b2e0 0x56369b24fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdba748c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b250370 0x56369b252830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdba748c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56369b1ae2f0 con 0x56369b250370 2024-09-12T01:53:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdba748c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56369b156270 con 0x56369b24a9a0 2024-09-12T01:53:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdba748c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56369b1aa2b0 con 0x56369b24b2e0 2024-09-12T01:53:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdb8f7fe640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdb880a2c30 0x7fdb880a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdba1c8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b250370 0x56369b252830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdba1c8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b250370 0x56369b252830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52608/0 (socket says 172.21.15.70:52608) 2024-09-12T01:53:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.489+0000 7fdba1c8c640 1 -- 172.21.15.70:0/3487163490 learned_addr learned my addr 172.21.15.70:0/3487163490 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:17.497 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdba2c8e640 1 --2- 172.21.15.70:0/3487163490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24a9a0 0x56369b24ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdba2c8e640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdb880a2c30 0x7fdb880a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdba248d640 1 --2- 172.21.15.70:0/3487163490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b24b2e0 0x56369b24fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdb8f7fe640 1 -- 172.21.15.70:0/224966887 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fdb980ef600 con 0x7fdb9c104ef0 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdba1c8c640 1 -- 172.21.15.70:0/3487163490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b24b2e0 msgr2=0x56369b24fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/3487163490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b24b2e0 0x56369b24fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdba1c8c640 1 -- 172.21.15.70:0/3487163490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24a9a0 msgr2=0x56369b24ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/3487163490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24a9a0 0x56369b24ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdba1c8c640 1 -- 172.21.15.70:0/3487163490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56369b155340 con 0x56369b250370 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdba248d640 1 --2- 172.21.15.70:0/3487163490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b24b2e0 0x56369b24fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/3487163490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b250370 0x56369b252830 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fdb98004560 tx=0x7fdb98047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635c80ac0e96e3e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdba2c8e640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdb880a2c30 0x7fdb880a50f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c06a980 tx=0x7fdb94009970 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdb8cff9640 1 -- 172.21.15.70:0/3487163490 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb98049070 con 0x56369b250370 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdb8cff9640 1 -- 172.21.15.70:0/3487163490 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdb980bc560 con 0x56369b250370 2024-09-12T01:53:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.490+0000 7fdb8cff9640 1 -- 172.21.15.70:0/3487163490 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9803b460 con 0x56369b250370 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.491+0000 7fdba748c740 1 -- 172.21.15.70:0/3487163490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b250370 msgr2=0x56369b252830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.491+0000 7fdba748c740 1 --2- 172.21.15.70:0/3487163490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b250370 0x56369b252830 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fdb98004560 tx=0x7fdb98047000 comp rx=0 tx=0).stop 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.491+0000 7fdba748c740 1 -- 172.21.15.70:0/3487163490 shutdown_connections 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.491+0000 7fdba748c740 1 --2- 172.21.15.70:0/3487163490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b250370 0x56369b252830 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.491+0000 7fdba748c740 1 --2- 172.21.15.70:0/3487163490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b24b2e0 0x56369b24fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.491+0000 7fdba748c740 1 --2- 172.21.15.70:0/3487163490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24a9a0 0x56369b24ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.491+0000 7fdba748c740 1 -- 172.21.15.70:0/3487163490 >> 172.21.15.70:0/3487163490 conn(0x56369b246010 msgr2=0x56369b246410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.491+0000 7fdba748c740 1 -- 172.21.15.70:0/3487163490 shutdown_connections 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.491+0000 7fdba748c740 1 -- 172.21.15.70:0/3487163490 wait complete. 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.491+0000 7fdba748c740 1 -- start start 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.491+0000 7fdba748c740 1 Processor -- start 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba748c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24a9a0 0x56369b254890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba748c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 0x56369b254dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba748c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b250370 0x56369b25be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba748c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56369b1ae2f0 con 0x56369b24b2e0 2024-09-12T01:53:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba748c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56369b137290 con 0x56369b24a9a0 2024-09-12T01:53:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba748c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56369b253100 con 0x56369b250370 2024-09-12T01:53:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba748c740 10 client.0 _ll_register_callbacks cb 0x56369b168140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba1c8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 0x56369b254dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba1c8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 0x56369b254dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52614/0 (socket says 172.21.15.70:52614) 2024-09-12T01:53:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba1c8c640 1 -- 172.21.15.70:0/2105328606 learned_addr learned my addr 172.21.15.70:0/2105328606 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba248d640 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24a9a0 0x56369b254890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba2c8e640 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b250370 0x56369b25be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba1c8c640 1 -- 172.21.15.70:0/2105328606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b250370 msgr2=0x56369b25be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b250370 0x56369b25be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba1c8c640 1 -- 172.21.15.70:0/2105328606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24a9a0 msgr2=0x56369b254890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24a9a0 0x56369b254890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba1c8c640 1 -- 172.21.15.70:0/2105328606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56369aec1210 con 0x56369b24b2e0 2024-09-12T01:53:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 0x56369b254dd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdb980314d0 tx=0x7fdb98043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b1afa4323e4af5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdb85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdb85ffb640 1 -- 172.21.15.70:0/2105328606 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb98049040 con 0x56369b24b2e0 2024-09-12T01:53:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdb85ffb640 1 -- 172.21.15.70:0/2105328606 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fdb980b84d0 con 0x56369b24b2e0 2024-09-12T01:53:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.492+0000 7fdba748c740 1 -- 172.21.15.70:0/2105328606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb980bc560 con 0x56369b24b2e0 2024-09-12T01:53:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.493+0000 7fdb85ffb640 1 -- 172.21.15.70:0/2105328606 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdb980bc0c0 con 0x56369b24b2e0 2024-09-12T01:53:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.493+0000 7fdba748c740 10 client.15990 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.493+0000 7fdba748c740 1 -- 172.21.15.70:0/2105328606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56369af8d620 con 0x56369b24b2e0 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.493+0000 7fdb85ffb640 1 -- 172.21.15.70:0/2105328606 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdb980bc560 con 0x56369b24b2e0 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.493+0000 7fdb85ffb640 1 -- 172.21.15.70:0/2105328606 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdb980c4740 con 0x56369b24b2e0 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.493+0000 7fdba748c740 10 client.15990 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.493+0000 7fdba748c740 10 client.15990 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.493+0000 7fdba748c740 20 client.15990 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.493+0000 7fdba748c740 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x56369b260390 0x56369b262780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.493+0000 7fdba748c740 4 client.15990 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.493+0000 7fdba748c740 1 -- 172.21.15.70:0/2105328606 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56369b1bba20 con 0x56369b260390 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.493+0000 7fdba248d640 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x56369b260390 0x56369b262780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdb85ffb640 10 client.15990 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdba248d640 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x56369b260390 0x56369b262780 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=239827f3266d8d0d server_cookie=acbb5d374edf16ea in_seq=0 out_seq=0 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdb85ffb640 1 -- 172.21.15.70:0/2105328606 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56369b1bba20 con 0x56369b260390 2024-09-12T01:53:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdb85ffb640 10 client.15990 handle_command_reply: tid=0 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdba748c740 1 client.15990 shutdown 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdba748c740 1 -- 172.21.15.70:0/2105328606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 msgr2=0x56369b254dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdba748c740 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 0x56369b254dd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdb980314d0 tx=0x7fdb98043000 comp rx=0 tx=0).stop 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdba748c740 1 -- 172.21.15.70:0/2105328606 shutdown_connections 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdba748c740 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x56369b260390 0x56369b262780 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdba748c740 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b250370 0x56369b25be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdba748c740 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 0x56369b254dd0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdb85ffb640 0 client.15990 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdba748c740 1 --2- 172.21.15.70:0/2105328606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24a9a0 0x56369b254890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.494+0000 7fdba748c740 1 -- 172.21.15.70:0/2105328606 >> 172.21.15.70:0/2105328606 conn(0x56369b246010 msgr2=0x56369b247820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.495+0000 7fdba748c740 1 -- 172.21.15.70:0/2105328606 shutdown_connections 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.495+0000 7fdba748c740 1 -- 172.21.15.70:0/2105328606 wait complete. 2024-09-12T01:53:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.495+0000 7fdba748c740 20 client.15990 trim_cache size 0 max 16384 2024-09-12T01:53:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba748c740 1 Processor -- start 2024-09-12T01:53:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba748c740 1 -- start start 2024-09-12T01:53:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba748c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24a9a0 0x56369b2450b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba748c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24b2e0 0x56369b25bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba748c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b250370 0x56369b267030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba748c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c1a9040 con 0x56369b24a9a0 2024-09-12T01:53:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba748c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c1aab80 con 0x56369b24b2e0 2024-09-12T01:53:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba748c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c1a9710 con 0x56369b250370 2024-09-12T01:53:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba248d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24a9a0 0x56369b2450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba248d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24a9a0 0x56369b2450b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52628/0 (socket says 172.21.15.70:52628) 2024-09-12T01:53:17.514 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba248d640 1 -- 172.21.15.70:0/2425407185 learned_addr learned my addr 172.21.15.70:0/2425407185 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/2425407185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24b2e0 0x56369b25bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba248d640 1 -- 172.21.15.70:0/2425407185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b250370 msgr2=0x56369b267030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba248d640 1 --2- 172.21.15.70:0/2425407185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b250370 0x56369b267030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba248d640 1 -- 172.21.15.70:0/2425407185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24b2e0 msgr2=0x56369b25bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba248d640 1 --2- 172.21.15.70:0/2425407185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24b2e0 0x56369b25bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba248d640 1 -- 172.21.15.70:0/2425407185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56369b245e30 con 0x56369b24a9a0 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/2425407185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24b2e0 0x56369b25bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.509+0000 7fdba248d640 1 --2- 172.21.15.70:0/2425407185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24a9a0 0x56369b2450b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x56369b24bd10 tx=0x7fdb900138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88682f51be56b985 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdb87fff640 1 -- 172.21.15.70:0/2425407185 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90005020 con 0x56369b24a9a0 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdb87fff640 1 -- 172.21.15.70:0/2425407185 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdb900047a0 con 0x56369b24a9a0 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdb87fff640 1 -- 172.21.15.70:0/2425407185 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9001d700 con 0x56369b24a9a0 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdba748c740 1 -- 172.21.15.70:0/2425407185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24a9a0 msgr2=0x56369b2450b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.515 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdba748c740 1 --2- 172.21.15.70:0/2425407185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24a9a0 0x56369b2450b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x56369b24bd10 tx=0x7fdb900138f0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdba748c740 1 -- 172.21.15.70:0/2425407185 shutdown_connections 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdba748c740 1 --2- 172.21.15.70:0/2425407185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b250370 0x56369b267030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdba748c740 1 --2- 172.21.15.70:0/2425407185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b24b2e0 0x56369b25bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdba748c740 1 --2- 172.21.15.70:0/2425407185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24a9a0 0x56369b2450b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdba748c740 1 -- 172.21.15.70:0/2425407185 >> 172.21.15.70:0/2425407185 conn(0x56369b246010 msgr2=0x56369b2449a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdba748c740 1 -- 172.21.15.70:0/2425407185 shutdown_connections 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdba748c740 1 -- 172.21.15.70:0/2425407185 wait complete. 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.510+0000 7fdba748c740 1 -- start start 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba748c740 1 Processor -- start 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba748c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b24a9a0 0x56369b2596d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba748c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 0x56369b259c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba748c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b250370 0x56369b25ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba748c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c1aa4b0 con 0x56369b24b2e0 2024-09-12T01:53:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba748c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c1a9de0 con 0x56369b250370 2024-09-12T01:53:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba748c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c1a7000 con 0x56369b24a9a0 2024-09-12T01:53:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba748c740 10 client.0 _ll_register_callbacks cb 0x7fdb94012730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba1c8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 0x56369b259c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba1c8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 0x56369b259c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52642/0 (socket says 172.21.15.70:52642) 2024-09-12T01:53:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba1c8c640 1 -- 172.21.15.70:0/449377274 learned_addr learned my addr 172.21.15.70:0/449377274 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba2c8e640 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b250370 0x56369b25ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba248d640 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b24a9a0 0x56369b2596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba1c8c640 1 -- 172.21.15.70:0/449377274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b24a9a0 msgr2=0x56369b2596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b24a9a0 0x56369b2596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba1c8c640 1 -- 172.21.15.70:0/449377274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b250370 msgr2=0x56369b25ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b250370 0x56369b25ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba1c8c640 1 -- 172.21.15.70:0/449377274 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56369b25b230 con 0x56369b24b2e0 2024-09-12T01:53:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba2c8e640 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b250370 0x56369b25ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdba1c8c640 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 0x56369b259c10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdb980b82c0 tx=0x7fdb98003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3101c2bb9128f244 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdb85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.511+0000 7fdb85ffb640 1 -- 172.21.15.70:0/449377274 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb98049070 con 0x56369b24b2e0 2024-09-12T01:53:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdb85ffb640 1 -- 172.21.15.70:0/449377274 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fdb980bb4a0 con 0x56369b24b2e0 2024-09-12T01:53:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdba748c740 1 -- 172.21.15.70:0/449377274 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb900047a0 con 0x56369b24b2e0 2024-09-12T01:53:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdb85ffb640 1 -- 172.21.15.70:0/449377274 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdb980bc560 con 0x56369b24b2e0 2024-09-12T01:53:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdba748c740 10 client.15996 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdba748c740 1 -- 172.21.15.70:0/449377274 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56369b25b230 con 0x56369b24b2e0 2024-09-12T01:53:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdb85ffb640 1 -- 172.21.15.70:0/449377274 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdb900047a0 con 0x56369b24b2e0 2024-09-12T01:53:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdb85ffb640 1 -- 172.21.15.70:0/449377274 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdb980b84d0 con 0x56369b24b2e0 2024-09-12T01:53:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdba748c740 10 client.15996 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdba748c740 10 client.15996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdba748c740 20 client.15996 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdba748c740 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x56369b260390 0x56369b2cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdba748c740 4 client.15996 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:53:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdba748c740 1 -- 172.21.15.70:0/449377274 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56369b1b5d70 con 0x56369b260390 2024-09-12T01:53:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.512+0000 7fdba248d640 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x56369b260390 0x56369b2cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.513+0000 7fdba248d640 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x56369b260390 0x56369b2cd800 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=533ce438b8647f75 server_cookie=4582e47a92c208cf in_seq=0 out_seq=0 2024-09-12T01:53:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.513+0000 7fdb85ffb640 10 client.15996 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:17.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdb85ffb640 1 -- 172.21.15.70:0/449377274 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56369b1b5d70 con 0x56369b260390 2024-09-12T01:53:17.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdb85ffb640 10 client.15996 handle_command_reply: tid=0 2024-09-12T01:53:17.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdba748c740 1 client.15996 shutdown 2024-09-12T01:53:17.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdba748c740 1 -- 172.21.15.70:0/449377274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 msgr2=0x56369b259c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdba748c740 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 0x56369b259c10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdb980b82c0 tx=0x7fdb98003eb0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdba748c740 1 -- 172.21.15.70:0/449377274 shutdown_connections 2024-09-12T01:53:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdba748c740 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x56369b260390 0x56369b2cd800 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdba748c740 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56369b250370 0x56369b25ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdb85ffb640 0 client.15996 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdba748c740 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56369b24b2e0 0x56369b259c10 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdba748c740 1 --2- 172.21.15.70:0/449377274 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56369b24a9a0 0x56369b2596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdba748c740 1 -- 172.21.15.70:0/449377274 >> 172.21.15.70:0/449377274 conn(0x56369b246010 msgr2=0x56369b2449a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdba748c740 1 -- 172.21.15.70:0/449377274 shutdown_connections 2024-09-12T01:53:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdba748c740 1 -- 172.21.15.70:0/449377274 wait complete. 2024-09-12T01:53:17.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.522+0000 7fdba748c740 20 client.15996 trim_cache size 0 max 16384 2024-09-12T01:53:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:53:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:53:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:53:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:53:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.523+0000 7fdba46f1640 1 -- 172.21.15.70:0/224966887 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdb880a2c30 msgr2=0x7fdb880a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.523+0000 7fdba46f1640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdb880a2c30 0x7fdb880a50f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c06a980 tx=0x7fdb94009970 comp rx=0 tx=0).stop 2024-09-12T01:53:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.523+0000 7fdba46f1640 1 -- 172.21.15.70:0/224966887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb9c104ef0 msgr2=0x7fdb9c198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.523+0000 7fdba46f1640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb9c104ef0 0x7fdb9c198390 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdb98005ab0 tx=0x7fdb980042f0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.523+0000 7fdba46f1640 1 -- 172.21.15.70:0/224966887 shutdown_connections 2024-09-12T01:53:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.523+0000 7fdba46f1640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdb880a2c30 0x7fdb880a50f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.523+0000 7fdba46f1640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb9c107820 0x7fdb9c19f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.523+0000 7fdba46f1640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb9c104ef0 0x7fdb9c198390 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.523+0000 7fdba46f1640 1 --2- 172.21.15.70:0/224966887 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb9c1025c0 0x7fdb9c197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.523+0000 7fdba46f1640 1 -- 172.21.15.70:0/224966887 >> 172.21.15.70:0/224966887 conn(0x7fdb9c0fc1e0 msgr2=0x7fdb9c102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.523+0000 7fdba46f1640 1 -- 172.21.15.70:0/224966887 shutdown_connections 2024-09-12T01:53:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:17.523+0000 7fdba46f1640 1 -- 172.21.15.70:0/224966887 wait complete. 2024-09-12T01:53:17.588 INFO:tasks.workunit.client.0.smithi070.stderr:+ mkdir untar_tar 2024-09-12T01:53:17.591 INFO:tasks.workunit.client.0.smithi070.stderr:+ cd untar_tar 2024-09-12T01:53:17.591 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-09-12T01:53:17.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ 2024-09-12T01:53:17.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-12T01:53:17.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-12T01:53:17.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-12T01:53:17.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-12T01:53:17.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-12T01:53:17.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-12T01:53:17.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-12T01:53:17.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-12T01:53:17.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-12T01:53:17.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-12T01:53:17.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-12T01:53:17.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-12T01:53:17.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-12T01:53:17.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-12T01:53:17.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-12T01:53:17.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-12T01:53:17.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-12T01:53:17.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-12T01:53:17.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-12T01:53:17.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-12T01:53:17.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-12T01:53:17.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-12T01:53:17.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-12T01:53:17.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-12T01:53:17.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-12T01:53:17.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-12T01:53:17.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-12T01:53:17.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-12T01:53:17.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-12T01:53:17.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-12T01:53:17.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-12T01:53:17.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-12T01:53:17.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-12T01:53:17.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-12T01:53:17.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-12T01:53:17.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-12T01:53:17.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-12T01:53:17.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-12T01:53:17.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-12T01:53:17.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-12T01:53:17.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-12T01:53:17.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-12T01:53:17.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-12T01:53:17.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-12T01:53:17.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-12T01:53:17.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-12T01:53:17.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-12T01:53:17.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-12T01:53:17.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-12T01:53:17.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-12T01:53:17.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-12T01:53:17.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-12T01:53:17.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-12T01:53:17.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-12T01:53:17.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-12T01:53:17.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-12T01:53:17.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-12T01:53:17.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-12T01:53:17.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-12T01:53:17.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-12T01:53:17.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-12T01:53:17.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-12T01:53:17.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-12T01:53:17.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-12T01:53:17.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-12T01:53:17.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-12T01:53:17.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-12T01:53:17.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-12T01:53:17.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-12T01:53:17.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-12T01:53:17.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-12T01:53:17.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-12T01:53:17.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-12T01:53:17.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-12T01:53:17.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-12T01:53:17.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-12T01:53:17.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-12T01:53:17.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-12T01:53:17.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-12T01:53:17.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-12T01:53:17.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-12T01:53:17.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-12T01:53:17.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-12T01:53:17.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-12T01:53:17.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-12T01:53:17.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-12T01:53:17.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-12T01:53:17.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-12T01:53:17.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-12T01:53:17.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-12T01:53:17.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-12T01:53:17.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-12T01:53:17.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-12T01:53:17.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-12T01:53:17.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-12T01:53:17.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-12T01:53:17.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-12T01:53:17.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-12T01:53:17.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-12T01:53:17.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-12T01:53:17.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-12T01:53:17.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-12T01:53:17.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-12T01:53:17.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-12T01:53:17.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-12T01:53:17.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-12T01:53:17.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-12T01:53:17.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-12T01:53:17.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-12T01:53:17.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-12T01:53:17.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-12T01:53:17.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-12T01:53:17.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-12T01:53:17.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-12T01:53:17.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-12T01:53:17.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-12T01:53:17.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-12T01:53:17.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-12T01:53:17.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-12T01:53:17.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-12T01:53:17.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-12T01:53:17.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-12T01:53:17.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-12T01:53:17.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-12T01:53:17.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-12T01:53:17.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-12T01:53:17.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-12T01:53:17.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-12T01:53:17.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-12T01:53:17.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-12T01:53:17.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-12T01:53:17.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-12T01:53:17.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-12T01:53:17.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-12T01:53:17.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-12T01:53:17.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-12T01:53:17.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-12T01:53:17.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-12T01:53:17.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-12T01:53:17.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-12T01:53:17.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-12T01:53:17.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-12T01:53:17.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-12T01:53:17.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-12T01:53:17.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-12T01:53:17.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-12T01:53:17.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-12T01:53:17.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-12T01:53:17.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-12T01:53:17.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-12T01:53:17.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-12T01:53:17.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-12T01:53:17.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-12T01:53:17.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-12T01:53:17.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-12T01:53:17.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-12T01:53:17.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-12T01:53:17.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-12T01:53:17.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-12T01:53:17.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-12T01:53:17.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-12T01:53:17.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-12T01:53:17.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-12T01:53:17.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-12T01:53:17.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-12T01:53:17.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-12T01:53:17.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-12T01:53:17.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-12T01:53:17.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-12T01:53:17.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-12T01:53:17.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-12T01:53:17.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-12T01:53:17.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-12T01:53:17.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-12T01:53:17.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-12T01:53:17.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-12T01:53:17.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-12T01:53:17.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-12T01:53:17.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-12T01:53:17.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-12T01:53:17.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-12T01:53:17.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-12T01:53:17.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-12T01:53:17.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-12T01:53:17.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-12T01:53:17.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-12T01:53:17.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-12T01:53:17.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-12T01:53:17.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-12T01:53:17.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-12T01:53:17.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-12T01:53:17.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-12T01:53:17.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-12T01:53:17.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-12T01:53:17.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-12T01:53:17.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-12T01:53:17.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-12T01:53:17.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-12T01:53:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.915+0000 7f5d36e2b640 1 -- 172.21.15.70:0/2917476878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d301027a0 msgr2=0x7f5d301067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.915+0000 7f5d36e2b640 1 --2- 172.21.15.70:0/2917476878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d301027a0 0x7f5d301067f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009900 tx=0x7f5d1c02a410 comp rx=0 tx=0).stop 2024-09-12T01:53:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.915+0000 7f5d36e2b640 1 -- 172.21.15.70:0/2917476878 shutdown_connections 2024-09-12T01:53:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.915+0000 7f5d36e2b640 1 --2- 172.21.15.70:0/2917476878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d30106f20 0x7f5d3010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.915+0000 7f5d36e2b640 1 --2- 172.21.15.70:0/2917476878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d301027a0 0x7f5d301067f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.915+0000 7f5d36e2b640 1 --2- 172.21.15.70:0/2917476878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d30101df0 0x7f5d301021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.915+0000 7f5d36e2b640 1 -- 172.21.15.70:0/2917476878 >> 172.21.15.70:0/2917476878 conn(0x7f5d300fd8f0 msgr2=0x7f5d300ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.915+0000 7f5d36e2b640 1 -- 172.21.15.70:0/2917476878 shutdown_connections 2024-09-12T01:53:17.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.915+0000 7f5d36e2b640 1 -- 172.21.15.70:0/2917476878 wait complete. 2024-09-12T01:53:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.915+0000 7f5d36e2b640 1 Processor -- start 2024-09-12T01:53:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.915+0000 7f5d36e2b640 1 -- start start 2024-09-12T01:53:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d36e2b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d30101df0 0x7f5d30198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d36e2b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d301027a0 0x7f5d30198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d36e2b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d30106f20 0x7f5d3019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d36e2b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301120a0 con 0x7f5d30106f20 2024-09-12T01:53:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d36e2b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30111f20 con 0x7f5d301027a0 2024-09-12T01:53:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d36e2b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30112220 con 0x7f5d30101df0 2024-09-12T01:53:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d353c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d30106f20 0x7f5d3019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d2ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d301027a0 0x7f5d30198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d353c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d30106f20 0x7f5d3019cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52652/0 (socket says 172.21.15.70:52652) 2024-09-12T01:53:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d353c8640 1 -- 172.21.15.70:0/1759379963 learned_addr learned my addr 172.21.15.70:0/1759379963 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d34bc7640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d30101df0 0x7f5d30198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d353c8640 1 -- 172.21.15.70:0/1759379963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d30101df0 msgr2=0x7f5d30198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d353c8640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d30101df0 0x7f5d30198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d353c8640 1 -- 172.21.15.70:0/1759379963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d301027a0 msgr2=0x7f5d30198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d353c8640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d301027a0 0x7f5d30198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d353c8640 1 -- 172.21.15.70:0/1759379963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3019d4d0 con 0x7f5d30106f20 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d353c8640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d30106f20 0x7f5d3019cdf0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800cce0 tx=0x7f5d2800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d2dffb640 1 -- 172.21.15.70:0/1759379963 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800f450 con 0x7f5d30106f20 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d2dffb640 1 -- 172.21.15.70:0/1759379963 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d2800faf0 con 0x7f5d30106f20 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.916+0000 7f5d36e2b640 1 -- 172.21.15.70:0/1759379963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3019d7c0 con 0x7f5d30106f20 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.917+0000 7f5d2dffb640 1 -- 172.21.15.70:0/1759379963 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28018cc0 con 0x7f5d30106f20 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.917+0000 7f5d36e2b640 1 -- 172.21.15.70:0/1759379963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d301a50a0 con 0x7f5d30106f20 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.919+0000 7f5d2dffb640 1 -- 172.21.15.70:0/1759379963 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5d2800f5f0 con 0x7f5d30106f20 2024-09-12T01:53:17.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.919+0000 7f5d39204740 1 Processor -- start 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.919+0000 7f5d39204740 1 -- start start 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.919+0000 7f5d2dffb640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5d200a2b80 0x7f5d200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.919+0000 7f5d2ffff640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5d200a2b80 0x7f5d200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.919+0000 7f5d2dffb640 1 -- 172.21.15.70:0/1759379963 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5d280cf460 con 0x7f5d30106f20 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.919+0000 7f5d39204740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d7b40 0x5636c74d6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.919+0000 7f5d39204740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d65d0 0x5636c74d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.919+0000 7f5d39204740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74e3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.919+0000 7f5d39204740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5636c743c2f0 con 0x5636c74e1370 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.919+0000 7f5d39204740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5636c73e3cf0 con 0x5636c74d7b40 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.919+0000 7f5d39204740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5636c74382b0 con 0x5636c74d65d0 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d353c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d353c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74e3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52666/0 (socket says 172.21.15.70:52666) 2024-09-12T01:53:17.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d353c8640 1 -- 172.21.15.70:0/2002223021 learned_addr learned my addr 172.21.15.70:0/2002223021 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d34bc7640 1 --2- 172.21.15.70:0/2002223021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d7b40 0x5636c74d6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d353c8640 1 -- 172.21.15.70:0/2002223021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d65d0 msgr2=0x5636c74d6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d353c8640 1 --2- 172.21.15.70:0/2002223021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d65d0 0x5636c74d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d353c8640 1 -- 172.21.15.70:0/2002223021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d7b40 msgr2=0x5636c74d6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d353c8640 1 --2- 172.21.15.70:0/2002223021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d7b40 0x5636c74d6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d353c8640 1 -- 172.21.15.70:0/2002223021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636c73c83a0 con 0x5636c74e1370 2024-09-12T01:53:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d2ffff640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5d200a2b80 0x7f5d200a5040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009230 tx=0x7f5d1c0314e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d353c8640 1 --2- 172.21.15.70:0/2002223021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74e3760 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5d280a43c0 tx=0x7f5d28005b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405a864aece439a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d1affd640 1 -- 172.21.15.70:0/2002223021 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28018e60 con 0x5636c74e1370 2024-09-12T01:53:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d1affd640 1 -- 172.21.15.70:0/2002223021 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d280a0030 con 0x5636c74e1370 2024-09-12T01:53:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.920+0000 7f5d1affd640 1 -- 172.21.15.70:0/2002223021 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d280a4460 con 0x5636c74e1370 2024-09-12T01:53:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.921+0000 7f5d39204740 1 -- 172.21.15.70:0/2002223021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 msgr2=0x5636c74e3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.921+0000 7f5d39204740 1 --2- 172.21.15.70:0/2002223021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74e3760 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5d280a43c0 tx=0x7f5d28005b60 comp rx=0 tx=0).stop 2024-09-12T01:53:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.921+0000 7f5d39204740 1 -- 172.21.15.70:0/2002223021 shutdown_connections 2024-09-12T01:53:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.921+0000 7f5d39204740 1 --2- 172.21.15.70:0/2002223021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74e3760 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.921+0000 7f5d39204740 1 --2- 172.21.15.70:0/2002223021 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d65d0 0x5636c74d6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.921+0000 7f5d39204740 1 --2- 172.21.15.70:0/2002223021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d7b40 0x5636c74d6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.921+0000 7f5d39204740 1 -- 172.21.15.70:0/2002223021 >> 172.21.15.70:0/2002223021 conn(0x5636c749f310 msgr2=0x5636c74d2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.921+0000 7f5d39204740 1 -- 172.21.15.70:0/2002223021 shutdown_connections 2024-09-12T01:53:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.921+0000 7f5d39204740 1 -- 172.21.15.70:0/2002223021 wait complete. 2024-09-12T01:53:17.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.921+0000 7f5d39204740 1 -- start start 2024-09-12T01:53:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.921+0000 7f5d39204740 1 Processor -- start 2024-09-12T01:53:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d39204740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d65d0 0x5636c74e0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d39204740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74d7b40 0x5636c74de040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d39204740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74e1370 0x5636c74de650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d39204740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5636c74e4070 con 0x5636c74d7b40 2024-09-12T01:53:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d39204740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5636c73f7060 con 0x5636c74e1370 2024-09-12T01:53:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d39204740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5636c74e41f0 con 0x5636c74d65d0 2024-09-12T01:53:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d39204740 10 client.0 _ll_register_callbacks cb 0x5636c714a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74d7b40 0x5636c74de040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74d7b40 0x5636c74de040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52676/0 (socket says 172.21.15.70:52676) 2024-09-12T01:53:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d2ffff640 1 -- 172.21.15.70:0/666886593 learned_addr learned my addr 172.21.15.70:0/666886593 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d34bc7640 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d65d0 0x5636c74e0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d353c8640 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74e1370 0x5636c74de650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d2ffff640 1 -- 172.21.15.70:0/666886593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d65d0 msgr2=0x5636c74e0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d2ffff640 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d65d0 0x5636c74e0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d2ffff640 1 -- 172.21.15.70:0/666886593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74e1370 msgr2=0x5636c74de650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d2ffff640 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74e1370 0x5636c74de650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d2ffff640 1 -- 172.21.15.70:0/666886593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636c71ad3c0 con 0x5636c74d7b40 2024-09-12T01:53:17.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d2ffff640 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74d7b40 0x5636c74de040 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009900 tx=0x7f5d1c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3850da93a739a7d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:17.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:17.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.922+0000 7f5d0ffff640 1 -- 172.21.15.70:0/666886593 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c035040 con 0x5636c74d7b40 2024-09-12T01:53:17.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d0ffff640 1 -- 172.21.15.70:0/666886593 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5d1c0037f0 con 0x5636c74d7b40 2024-09-12T01:53:17.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d39204740 1 -- 172.21.15.70:0/666886593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d280a0030 con 0x5636c74d7b40 2024-09-12T01:53:17.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d0ffff640 1 -- 172.21.15.70:0/666886593 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d1c057050 con 0x5636c74d7b40 2024-09-12T01:53:17.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d39204740 10 client.16008 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:17.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d39204740 1 -- 172.21.15.70:0/666886593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5636c74efb40 con 0x5636c74d7b40 2024-09-12T01:53:17.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d0ffff640 1 -- 172.21.15.70:0/666886593 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d280a0030 con 0x5636c74d7b40 2024-09-12T01:53:17.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d0ffff640 1 -- 172.21.15.70:0/666886593 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5d1c048430 con 0x5636c74d7b40 2024-09-12T01:53:17.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d39204740 10 client.16008 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:17.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d39204740 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:17.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d39204740 20 client.16008 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:17.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d39204740 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5636c74f1050 0x5636c74f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d39204740 4 client.16008 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:17.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d39204740 1 -- 172.21.15.70:0/666886593 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636c7449860 con 0x5636c74f1050 2024-09-12T01:53:17.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.923+0000 7f5d34bc7640 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5636c74f1050 0x5636c74f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.924+0000 7f5d0ffff640 10 client.16008 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:17.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.924+0000 7f5d34bc7640 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5636c74f1050 0x5636c74f34b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c9c19d9065ad8e8 server_cookie=d6fcbddffa3befc3 in_seq=0 out_seq=0 2024-09-12T01:53:17.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.924+0000 7f5d0ffff640 1 -- 172.21.15.70:0/666886593 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636c7449860 con 0x5636c74f1050 2024-09-12T01:53:17.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.924+0000 7f5d0ffff640 10 client.16008 handle_command_reply: tid=0 2024-09-12T01:53:17.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.924+0000 7f5d39204740 1 client.16008 shutdown 2024-09-12T01:53:17.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.924+0000 7f5d39204740 1 -- 172.21.15.70:0/666886593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74d7b40 msgr2=0x5636c74de040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.924+0000 7f5d39204740 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74d7b40 0x5636c74de040 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009900 tx=0x7f5d1c02a410 comp rx=0 tx=0).stop 2024-09-12T01:53:17.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.924+0000 7f5d39204740 1 -- 172.21.15.70:0/666886593 shutdown_connections 2024-09-12T01:53:17.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.924+0000 7f5d39204740 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5636c74f1050 0x5636c74f34b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.925+0000 7f5d39204740 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74e1370 0x5636c74de650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.925+0000 7f5d39204740 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74d7b40 0x5636c74de040 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.925+0000 7f5d0ffff640 0 client.16008 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.925+0000 7f5d39204740 1 --2- 172.21.15.70:0/666886593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d65d0 0x5636c74e0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.925+0000 7f5d39204740 1 -- 172.21.15.70:0/666886593 >> 172.21.15.70:0/666886593 conn(0x5636c749f310 msgr2=0x5636c74d8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.925+0000 7f5d39204740 1 -- 172.21.15.70:0/666886593 shutdown_connections 2024-09-12T01:53:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.925+0000 7f5d39204740 1 -- 172.21.15.70:0/666886593 wait complete. 2024-09-12T01:53:17.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.925+0000 7f5d39204740 20 client.16008 trim_cache size 0 max 16384 2024-09-12T01:53:17.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.937+0000 7f5d39204740 1 Processor -- start 2024-09-12T01:53:17.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.937+0000 7f5d39204740 1 -- start start 2024-09-12T01:53:17.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d39204740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d65d0 0x5636c74ed310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d39204740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d7b40 0x5636c74dd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d39204740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74f8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d39204740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301ad570 con 0x5636c74e1370 2024-09-12T01:53:17.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d39204740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301af0b0 con 0x5636c74d65d0 2024-09-12T01:53:17.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d39204740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301adc40 con 0x5636c74d7b40 2024-09-12T01:53:17.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d34bc7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d65d0 0x5636c74ed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d34bc7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d65d0 0x5636c74ed310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:41268/0 (socket says 172.21.15.70:41268) 2024-09-12T01:53:17.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d34bc7640 1 -- 172.21.15.70:0/988062270 learned_addr learned my addr 172.21.15.70:0/988062270 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:17.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d34bc7640 1 -- 172.21.15.70:0/988062270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d7b40 msgr2=0x5636c74dd020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:53:17.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d353c8640 1 --2- 172.21.15.70:0/988062270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74f8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d34bc7640 1 --2- 172.21.15.70:0/988062270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d7b40 0x5636c74dd020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d34bc7640 1 -- 172.21.15.70:0/988062270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 msgr2=0x5636c74f8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d34bc7640 1 --2- 172.21.15.70:0/988062270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74f8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d34bc7640 1 -- 172.21.15.70:0/988062270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636c74dc590 con 0x5636c74d65d0 2024-09-12T01:53:17.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d353c8640 1 --2- 172.21.15.70:0/988062270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74f8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:17.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.938+0000 7f5d34bc7640 1 --2- 172.21.15.70:0/988062270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d65d0 0x5636c74ed310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5d240045f0 tx=0x7f5d2400b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27e0f101a25a1b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:17.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.939+0000 7f5d1a7fc640 1 -- 172.21.15.70:0/988062270 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24026440 con 0x5636c74d65d0 2024-09-12T01:53:17.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.939+0000 7f5d1a7fc640 1 -- 172.21.15.70:0/988062270 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d24026ae0 con 0x5636c74d65d0 2024-09-12T01:53:17.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.939+0000 7f5d1a7fc640 1 -- 172.21.15.70:0/988062270 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24011be0 con 0x5636c74d65d0 2024-09-12T01:53:17.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.939+0000 7f5d39204740 1 -- 172.21.15.70:0/988062270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d65d0 msgr2=0x5636c74ed310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.939+0000 7f5d39204740 1 --2- 172.21.15.70:0/988062270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d65d0 0x5636c74ed310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5d240045f0 tx=0x7f5d2400b390 comp rx=0 tx=0).stop 2024-09-12T01:53:17.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.939+0000 7f5d39204740 1 -- 172.21.15.70:0/988062270 shutdown_connections 2024-09-12T01:53:17.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.939+0000 7f5d39204740 1 --2- 172.21.15.70:0/988062270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74f8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.939+0000 7f5d39204740 1 --2- 172.21.15.70:0/988062270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d7b40 0x5636c74dd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.939+0000 7f5d39204740 1 --2- 172.21.15.70:0/988062270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d65d0 0x5636c74ed310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.939+0000 7f5d39204740 1 -- 172.21.15.70:0/988062270 >> 172.21.15.70:0/988062270 conn(0x5636c749f310 msgr2=0x5636c74dc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:17.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.940+0000 7f5d39204740 1 -- 172.21.15.70:0/988062270 shutdown_connections 2024-09-12T01:53:17.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.940+0000 7f5d39204740 1 -- 172.21.15.70:0/988062270 wait complete. 2024-09-12T01:53:17.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.940+0000 7f5d39204740 1 -- start start 2024-09-12T01:53:17.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.940+0000 7f5d39204740 1 Processor -- start 2024-09-12T01:53:17.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.940+0000 7f5d39204740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d65d0 0x5636c74e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.940+0000 7f5d39204740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d7b40 0x5636c74dae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.940+0000 7f5d39204740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74db340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.940+0000 7f5d39204740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301ae9e0 con 0x5636c74e1370 2024-09-12T01:53:17.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.940+0000 7f5d39204740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301ae310 con 0x5636c74d65d0 2024-09-12T01:53:17.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.940+0000 7f5d39204740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301ab530 con 0x5636c74d7b40 2024-09-12T01:53:17.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.940+0000 7f5d39204740 10 client.0 _ll_register_callbacks cb 0x7f5d1c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:17.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.940+0000 7f5d353c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74db340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d353c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74db340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52688/0 (socket says 172.21.15.70:52688) 2024-09-12T01:53:17.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d353c8640 1 -- 172.21.15.70:0/726867352 learned_addr learned my addr 172.21.15.70:0/726867352 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:17.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d2ffff640 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d7b40 0x5636c74dae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d34bc7640 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d65d0 0x5636c74e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d353c8640 1 -- 172.21.15.70:0/726867352 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d7b40 msgr2=0x5636c74dae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d353c8640 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d7b40 0x5636c74dae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d353c8640 1 -- 172.21.15.70:0/726867352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d65d0 msgr2=0x5636c74e9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d353c8640 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d65d0 0x5636c74e9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d353c8640 1 -- 172.21.15.70:0/726867352 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636c74dbb70 con 0x5636c74e1370 2024-09-12T01:53:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d353c8640 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74db340 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5d2801f000 tx=0x7f5d28097f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef8505ea4e950e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d0ffff640 1 -- 172.21.15.70:0/726867352 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2807e070 con 0x5636c74e1370 2024-09-12T01:53:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d0ffff640 1 -- 172.21.15.70:0/726867352 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5d2800fca0 con 0x5636c74e1370 2024-09-12T01:53:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d39204740 1 -- 172.21.15.70:0/726867352 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d24026ae0 con 0x5636c74e1370 2024-09-12T01:53:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d0ffff640 1 -- 172.21.15.70:0/726867352 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d28018e60 con 0x5636c74e1370 2024-09-12T01:53:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d39204740 10 client.16011 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d39204740 1 -- 172.21.15.70:0/726867352 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5636c755bd20 con 0x5636c74e1370 2024-09-12T01:53:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.941+0000 7f5d0ffff640 1 -- 172.21.15.70:0/726867352 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d24026ae0 con 0x5636c74e1370 2024-09-12T01:53:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d0ffff640 1 -- 172.21.15.70:0/726867352 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5d2809b0d0 con 0x5636c74e1370 2024-09-12T01:53:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d39204740 10 client.16011 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d39204740 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d39204740 20 client.16011 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d39204740 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5636c7564950 0x5636c7566d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d39204740 4 client.16011 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:53:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d39204740 1 -- 172.21.15.70:0/726867352 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5636c7443d70 con 0x5636c7564950 2024-09-12T01:53:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d34bc7640 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5636c7564950 0x5636c7566d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d34bc7640 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5636c7564950 0x5636c7566d40 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c685674ca66f5dbc server_cookie=4cf7e12f17e37a22 in_seq=0 out_seq=0 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d0ffff640 10 client.16011 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d0ffff640 1 -- 172.21.15.70:0/726867352 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5636c7443d70 con 0x5636c7564950 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d0ffff640 10 client.16011 handle_command_reply: tid=0 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.942+0000 7f5d39204740 1 client.16011 shutdown 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d39204740 1 -- 172.21.15.70:0/726867352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 msgr2=0x5636c74db340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d39204740 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74db340 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5d2801f000 tx=0x7f5d28097f20 comp rx=0 tx=0).stop 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d39204740 1 -- 172.21.15.70:0/726867352 shutdown_connections 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d39204740 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5636c7564950 0x5636c7566d40 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d39204740 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5636c74e1370 0x5636c74db340 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d39204740 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5636c74d7b40 0x5636c74dae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d39204740 1 --2- 172.21.15.70:0/726867352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5636c74d65d0 0x5636c74e9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d39204740 1 -- 172.21.15.70:0/726867352 >> 172.21.15.70:0/726867352 conn(0x5636c749f310 msgr2=0x5636c74dd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d0ffff640 0 client.16011 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:17.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d39204740 1 -- 172.21.15.70:0/726867352 shutdown_connections 2024-09-12T01:53:17.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d39204740 1 -- 172.21.15.70:0/726867352 wait complete. 2024-09-12T01:53:17.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d39204740 20 client.16011 trim_cache size 0 max 16384 2024-09-12T01:53:17.975 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:53:17.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d36e2b640 1 -- 172.21.15.70:0/1759379963 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5d200a2b80 msgr2=0x7f5d200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d36e2b640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5d200a2b80 0x7f5d200a5040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009230 tx=0x7f5d1c0314e0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d36e2b640 1 -- 172.21.15.70:0/1759379963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d30106f20 msgr2=0x7f5d3019cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:17.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d36e2b640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d30106f20 0x7f5d3019cdf0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800cce0 tx=0x7f5d2800a620 comp rx=0 tx=0).stop 2024-09-12T01:53:17.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d36e2b640 1 -- 172.21.15.70:0/1759379963 shutdown_connections 2024-09-12T01:53:17.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d36e2b640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f5d200a2b80 0x7f5d200a5040 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d36e2b640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d30106f20 0x7f5d3019cdf0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d36e2b640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d301027a0 0x7f5d30198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.943+0000 7f5d36e2b640 1 --2- 172.21.15.70:0/1759379963 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d30101df0 0x7f5d30198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:17.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.944+0000 7f5d36e2b640 1 -- 172.21.15.70:0/1759379963 >> 172.21.15.70:0/1759379963 conn(0x7f5d300fd8f0 msgr2=0x7f5d300feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:17.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.944+0000 7f5d36e2b640 1 -- 172.21.15.70:0/1759379963 shutdown_connections 2024-09-12T01:53:17.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:17.944+0000 7f5d36e2b640 1 -- 172.21.15.70:0/1759379963 wait complete. 2024-09-12T01:53:18.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:18 smithi191 ceph-mon[35770]: pgmap v371: 97 pgs: 97 active+clean; 690 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-12T01:53:19.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:18 smithi152 ceph-mon[35055]: pgmap v371: 97 pgs: 97 active+clean; 690 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-12T01:53:19.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:18 smithi070 ceph-mon[31177]: pgmap v371: 97 pgs: 97 active+clean; 690 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.3 KiB/s wr, 12 op/s 2024-09-12T01:53:19.739 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:53:19.740 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:53:20.001 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.460+0000 7f9e1debf640 1 -- 172.21.15.70:0/2685237703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102570 msgr2=0x7f9e181029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.460+0000 7f9e1debf640 1 --2- 172.21.15.70:0/2685237703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102570 0x7f9e181029b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009900 tx=0x7f9e0c02a480 comp rx=0 tx=0).stop 2024-09-12T01:53:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.460+0000 7f9e1debf640 1 -- 172.21.15.70:0/2685237703 shutdown_connections 2024-09-12T01:53:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.460+0000 7f9e1debf640 1 --2- 172.21.15.70:0/2685237703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e18102ef0 0x7f9e1810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.460+0000 7f9e1debf640 1 --2- 172.21.15.70:0/2685237703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102570 0x7f9e181029b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.460+0000 7f9e1debf640 1 --2- 172.21.15.70:0/2685237703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e18100e20 0x7f9e18101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.460+0000 7f9e1debf640 1 -- 172.21.15.70:0/2685237703 >> 172.21.15.70:0/2685237703 conn(0x7f9e180fc7d0 msgr2=0x7f9e180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.460+0000 7f9e1debf640 1 -- 172.21.15.70:0/2685237703 shutdown_connections 2024-09-12T01:53:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.460+0000 7f9e1debf640 1 -- 172.21.15.70:0/2685237703 wait complete. 2024-09-12T01:53:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e1debf640 1 Processor -- start 2024-09-12T01:53:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e1debf640 1 -- start start 2024-09-12T01:53:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e1debf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e18100e20 0x7f9e1810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e1debf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e18102570 0x7f9e1810ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e1debf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102ef0 0x7f9e1810ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e1debf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e181121c0 con 0x7f9e18102ef0 2024-09-12T01:53:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e1debf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9e18112040 con 0x7f9e18100e20 2024-09-12T01:53:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e1debf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9e18112340 con 0x7f9e18102570 2024-09-12T01:53:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e17fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102ef0 0x7f9e1810ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e17fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102ef0 0x7f9e1810ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33064/0 (socket says 172.21.15.70:33064) 2024-09-12T01:53:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e17fff640 1 -- 172.21.15.70:0/199583451 learned_addr learned my addr 172.21.15.70:0/199583451 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e18102570 0x7f9e1810ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.461+0000 7f9e177fe640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e18100e20 0x7f9e1810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.462+0000 7f9e17fff640 1 -- 172.21.15.70:0/199583451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e18102570 msgr2=0x7f9e1810ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.462+0000 7f9e17fff640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e18102570 0x7f9e1810ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.462+0000 7f9e17fff640 1 -- 172.21.15.70:0/199583451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e18100e20 msgr2=0x7f9e1810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.462+0000 7f9e17fff640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e18100e20 0x7f9e1810e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.462+0000 7f9e17fff640 1 -- 172.21.15.70:0/199583451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e181a6a40 con 0x7f9e18102ef0 2024-09-12T01:53:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.462+0000 7f9e17fff640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102ef0 0x7f9e1810ef50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000eaa0 tx=0x7f9e1000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.462+0000 7f9e14ff9640 1 -- 172.21.15.70:0/199583451 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1000cdb0 con 0x7f9e18102ef0 2024-09-12T01:53:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.462+0000 7f9e1debf640 1 -- 172.21.15.70:0/199583451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e181a6d30 con 0x7f9e18102ef0 2024-09-12T01:53:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.462+0000 7f9e14ff9640 1 -- 172.21.15.70:0/199583451 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e10004b20 con 0x7f9e18102ef0 2024-09-12T01:53:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.462+0000 7f9e14ff9640 1 -- 172.21.15.70:0/199583451 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e10011760 con 0x7f9e18102ef0 2024-09-12T01:53:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.462+0000 7f9e1debf640 1 -- 172.21.15.70:0/199583451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e181a7290 con 0x7f9e18102ef0 2024-09-12T01:53:20.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.464+0000 7f9e14ff9640 1 -- 172.21.15.70:0/199583451 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9e10011900 con 0x7f9e18102ef0 2024-09-12T01:53:20.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.464+0000 7f9e20298740 1 Processor -- start 2024-09-12T01:53:20.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.464+0000 7f9e20298740 1 -- start start 2024-09-12T01:53:20.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e20298740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022571b60 0x55e022571f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e20298740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e022572480 0x55e02257c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e20298740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 0x55e02257f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e20298740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e0224d7280 con 0x55e02257cd40 2024-09-12T01:53:20.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e20298740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e02247eb10 con 0x55e022571b60 2024-09-12T01:53:20.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e20298740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e0224d3240 con 0x55e022572480 2024-09-12T01:53:20.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e16ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 0x55e02257f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e16ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 0x55e02257f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33070/0 (socket says 172.21.15.70:33070) 2024-09-12T01:53:20.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e16ffd640 1 -- 172.21.15.70:0/2706064854 learned_addr learned my addr 172.21.15.70:0/2706064854 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:20.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/2706064854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022571b60 0x55e022571f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e14ff9640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9e000a2c00 0x7f9e000a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e177fe640 1 --2- 172.21.15.70:0/2706064854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e022572480 0x55e02257c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e14ff9640 1 -- 172.21.15.70:0/199583451 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9e100cf0c0 con 0x7f9e18102ef0 2024-09-12T01:53:20.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e17fff640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9e000a2c00 0x7f9e000a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e16ffd640 1 -- 172.21.15.70:0/2706064854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e022572480 msgr2=0x55e02257c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:20.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.465+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/2706064854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e022572480 0x55e02257c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.466+0000 7f9e16ffd640 1 -- 172.21.15.70:0/2706064854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022571b60 msgr2=0x55e022571f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:20.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.466+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/2706064854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022571b60 0x55e022571f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.466+0000 7f9e16ffd640 1 -- 172.21.15.70:0/2706064854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e02248b1f0 con 0x55e02257cd40 2024-09-12T01:53:20.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.466+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/2706064854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 0x55e02257f130 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c000c00 tx=0x7f9e0c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d83d52ebe48349 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:20.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.466+0000 7f9dfdffb640 1 -- 172.21.15.70:0/2706064854 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c035070 con 0x55e02257cd40 2024-09-12T01:53:20.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.466+0000 7f9e17fff640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9e000a2c00 0x7f9e000a50c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9e10097e30 tx=0x7f9e10000f40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:20.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.466+0000 7f9dfdffb640 1 -- 172.21.15.70:0/2706064854 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e0c005020 con 0x55e02257cd40 2024-09-12T01:53:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.466+0000 7f9dfdffb640 1 -- 172.21.15.70:0/2706064854 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c004a00 con 0x55e02257cd40 2024-09-12T01:53:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.467+0000 7f9e20298740 1 -- 172.21.15.70:0/2706064854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 msgr2=0x55e02257f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.467+0000 7f9e20298740 1 --2- 172.21.15.70:0/2706064854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 0x55e02257f130 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c000c00 tx=0x7f9e0c005d50 comp rx=0 tx=0).stop 2024-09-12T01:53:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.467+0000 7f9e20298740 1 -- 172.21.15.70:0/2706064854 shutdown_connections 2024-09-12T01:53:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.467+0000 7f9e20298740 1 --2- 172.21.15.70:0/2706064854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 0x55e02257f130 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.467+0000 7f9e20298740 1 --2- 172.21.15.70:0/2706064854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e022572480 0x55e02257c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.467+0000 7f9e20298740 1 --2- 172.21.15.70:0/2706064854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022571b60 0x55e022571f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.467+0000 7f9e20298740 1 -- 172.21.15.70:0/2706064854 >> 172.21.15.70:0/2706064854 conn(0x55e02256e0f0 msgr2=0x55e02256e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.467+0000 7f9e20298740 1 -- 172.21.15.70:0/2706064854 shutdown_connections 2024-09-12T01:53:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.467+0000 7f9e20298740 1 -- 172.21.15.70:0/2706064854 wait complete. 2024-09-12T01:53:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.467+0000 7f9e20298740 1 -- start start 2024-09-12T01:53:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.467+0000 7f9e20298740 1 Processor -- start 2024-09-12T01:53:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e20298740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e022571b60 0x55e022579c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e20298740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 0x55e02257a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e20298740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 0x55e02257a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e20298740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e02257f910 con 0x55e02257cd40 2024-09-12T01:53:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e20298740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e022491f10 con 0x55e022572480 2024-09-12T01:53:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e20298740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e02257fa90 con 0x55e022571b60 2024-09-12T01:53:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e20298740 10 client.0 _ll_register_callbacks cb 0x55e02245aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 0x55e02257a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e16ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 0x55e02257a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 0x55e02257a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:52698/0 (socket says 172.21.15.70:52698) 2024-09-12T01:53:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e177fe640 1 -- 172.21.15.70:0/702531276 learned_addr learned my addr 172.21.15.70:0/702531276 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e022571b60 0x55e022579c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e177fe640 1 -- 172.21.15.70:0/702531276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e022571b60 msgr2=0x55e022579c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e177fe640 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e022571b60 0x55e022579c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e177fe640 1 -- 172.21.15.70:0/702531276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 msgr2=0x55e02257a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e177fe640 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 0x55e02257a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e177fe640 1 -- 172.21.15.70:0/702531276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0222486a0 con 0x55e022572480 2024-09-12T01:53:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 0x55e02257a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9e177fe640 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 0x55e02257a150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9e08012740 tx=0x7f9e08012c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1067bd1453be77e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.468+0000 7f9df6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-12T01:53:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9df6ffd640 1 -- 172.21.15.70:0/702531276 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0800f920 con 0x55e022572480 2024-09-12T01:53:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9e20298740 1 -- 172.21.15.70:0/702531276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e0c005020 con 0x55e022572480 2024-09-12T01:53:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9df6ffd640 1 -- 172.21.15.70:0/702531276 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9e0800fac0 con 0x55e022572480 2024-09-12T01:53:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9df6ffd640 1 -- 172.21.15.70:0/702531276 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9e0800fcc0 con 0x55e022572480 2024-09-12T01:53:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9e20298740 10 client.25394 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9e20298740 1 -- 172.21.15.70:0/702531276 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e02258b5a0 con 0x55e022572480 2024-09-12T01:53:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9df6ffd640 1 -- 172.21.15.70:0/702531276 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e0c005020 con 0x55e022572480 2024-09-12T01:53:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9df6ffd640 1 -- 172.21.15.70:0/702531276 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9e0801c420 con 0x55e022572480 2024-09-12T01:53:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9e20298740 10 client.25394 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9e20298740 10 client.25394 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9e20298740 20 client.25394 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9e20298740 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e02258ca70 0x55e02258ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9e20298740 4 client.25394 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9e20298740 1 -- 172.21.15.70:0/702531276 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0224e47f0 con 0x55e02258ca70 2024-09-12T01:53:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.469+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e02258ca70 0x55e02258ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.470+0000 7f9df6ffd640 10 client.25394 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.470+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e02258ca70 0x55e02258ee90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e83af0374a024ef server_cookie=ffa32572615642f4 in_seq=0 out_seq=0 2024-09-12T01:53:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9df6ffd640 1 -- 172.21.15.70:0/702531276 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e0224e47f0 con 0x55e02258ca70 2024-09-12T01:53:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9df6ffd640 10 client.25394 handle_command_reply: tid=0 2024-09-12T01:53:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9e20298740 1 client.25394 shutdown 2024-09-12T01:53:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9e20298740 1 -- 172.21.15.70:0/702531276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 msgr2=0x55e02257a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9e20298740 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 0x55e02257a150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9e08012740 tx=0x7f9e08012c00 comp rx=0 tx=0).stop 2024-09-12T01:53:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9e20298740 1 -- 172.21.15.70:0/702531276 shutdown_connections 2024-09-12T01:53:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9e20298740 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e02258ca70 0x55e02258ee90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9e20298740 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e02257cd40 0x55e02257a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9e20298740 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 0x55e02257a150 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9df6ffd640 0 client.25394 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9e20298740 1 --2- 172.21.15.70:0/702531276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e022571b60 0x55e022579c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9e20298740 1 -- 172.21.15.70:0/702531276 >> 172.21.15.70:0/702531276 conn(0x55e02256e0f0 msgr2=0x55e022573dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9e20298740 1 -- 172.21.15.70:0/702531276 shutdown_connections 2024-09-12T01:53:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9e20298740 1 -- 172.21.15.70:0/702531276 wait complete. 2024-09-12T01:53:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.471+0000 7f9e20298740 20 client.25394 trim_cache size 0 max 16384 2024-09-12T01:53:20.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.489+0000 7f9e20298740 1 Processor -- start 2024-09-12T01:53:20.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.489+0000 7f9e20298740 1 -- start start 2024-09-12T01:53:20.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.489+0000 7f9e20298740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022571b60 0x55e02257a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.489+0000 7f9e20298740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022572480 0x55e02256d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.489+0000 7f9e20298740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e02257cd40 0x55e022594760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.489+0000 7f9e20298740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e181af8a0 con 0x55e022572480 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.489+0000 7f9e20298740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9e181b13e0 con 0x55e022571b60 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.489+0000 7f9e20298740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9e181aff70 con 0x55e02257cd40 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.489+0000 7f9e177fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022572480 0x55e02256d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.489+0000 7f9e177fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022572480 0x55e02256d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33086/0 (socket says 172.21.15.70:33086) 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.489+0000 7f9e177fe640 1 -- 172.21.15.70:0/1857209497 learned_addr learned my addr 172.21.15.70:0/1857209497 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.489+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/1857209497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022571b60 0x55e02257a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.490+0000 7f9e177fe640 1 -- 172.21.15.70:0/1857209497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e02257cd40 msgr2=0x55e022594760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.490+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/1857209497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e02257cd40 0x55e022594760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.490+0000 7f9e177fe640 1 --2- 172.21.15.70:0/1857209497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e02257cd40 0x55e022594760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.490+0000 7f9e177fe640 1 -- 172.21.15.70:0/1857209497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022571b60 msgr2=0x55e02257a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.490+0000 7f9e177fe640 1 --2- 172.21.15.70:0/1857209497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022571b60 0x55e02257a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.490+0000 7f9e177fe640 1 -- 172.21.15.70:0/1857209497 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e02256f280 con 0x55e022572480 2024-09-12T01:53:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.490+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/1857209497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e02257cd40 0x55e022594760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:20.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.490+0000 7f9e177fe640 1 --2- 172.21.15.70:0/1857209497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022572480 0x55e02256d160 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9e0801ca00 tx=0x7f9e080096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26252caa8c9ad336 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:20.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.490+0000 7f9dfd7fa640 1 -- 172.21.15.70:0/1857209497 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0800f920 con 0x55e022572480 2024-09-12T01:53:20.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.490+0000 7f9dfd7fa640 1 -- 172.21.15.70:0/1857209497 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e0801ce50 con 0x55e022572480 2024-09-12T01:53:20.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.490+0000 7f9dfd7fa640 1 -- 172.21.15.70:0/1857209497 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0801cbb0 con 0x55e022572480 2024-09-12T01:53:20.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.491+0000 7f9e20298740 1 -- 172.21.15.70:0/1857209497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022572480 msgr2=0x55e02256d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:20.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.491+0000 7f9e20298740 1 --2- 172.21.15.70:0/1857209497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022572480 0x55e02256d160 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9e0801ca00 tx=0x7f9e080096f0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.491+0000 7f9e20298740 1 -- 172.21.15.70:0/1857209497 shutdown_connections 2024-09-12T01:53:20.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.491+0000 7f9e20298740 1 --2- 172.21.15.70:0/1857209497 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e02257cd40 0x55e022594760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.491+0000 7f9e20298740 1 --2- 172.21.15.70:0/1857209497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022572480 0x55e02256d160 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.491+0000 7f9e20298740 1 --2- 172.21.15.70:0/1857209497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022571b60 0x55e02257a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.491+0000 7f9e20298740 1 -- 172.21.15.70:0/1857209497 >> 172.21.15.70:0/1857209497 conn(0x55e02256e0f0 msgr2=0x55e02256ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:20.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.491+0000 7f9e20298740 1 -- 172.21.15.70:0/1857209497 shutdown_connections 2024-09-12T01:53:20.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.491+0000 7f9e20298740 1 -- 172.21.15.70:0/1857209497 wait complete. 2024-09-12T01:53:20.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.491+0000 7f9e20298740 1 -- start start 2024-09-12T01:53:20.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.491+0000 7f9e20298740 1 Processor -- start 2024-09-12T01:53:20.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e20298740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022571b60 0x55e022585630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e20298740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 0x55e022580960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e20298740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e02257cd40 0x55e0225810f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e20298740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e181b0d10 con 0x55e022571b60 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e20298740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9e181b0640 con 0x55e022572480 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e20298740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9e181ad860 con 0x55e02257cd40 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e20298740 10 client.0 _ll_register_callbacks cb 0x7f9e08009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e16ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022571b60 0x55e022585630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e16ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022571b60 0x55e022585630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33096/0 (socket says 172.21.15.70:33096) 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 0x55e022580960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e16ffd640 1 -- 172.21.15.70:0/2212511100 learned_addr learned my addr 172.21.15.70:0/2212511100 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e02257cd40 0x55e0225810f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e177fe640 1 -- 172.21.15.70:0/2212511100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e02257cd40 msgr2=0x55e0225810f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e177fe640 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e02257cd40 0x55e0225810f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e177fe640 1 -- 172.21.15.70:0/2212511100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022571b60 msgr2=0x55e022585630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e177fe640 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022571b60 0x55e022585630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e177fe640 1 -- 172.21.15.70:0/2212511100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0225f6730 con 0x55e022572480 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e02257cd40 0x55e0225810f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9e177fe640 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 0x55e022580960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55e02258b570 tx=0x7f9e08009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b741dae3ac2f8e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.492+0000 7f9df6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9df6ffd640 1 -- 172.21.15.70:0/2212511100 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0801cc40 con 0x55e022572480 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9df6ffd640 1 -- 172.21.15.70:0/2212511100 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9e08018040 con 0x55e022572480 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9e20298740 1 -- 172.21.15.70:0/2212511100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e0801ce50 con 0x55e022572480 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9df6ffd640 1 -- 172.21.15.70:0/2212511100 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9e080050b0 con 0x55e022572480 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9e20298740 10 client.25400 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9e20298740 1 -- 172.21.15.70:0/2212511100 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0225f78c0 con 0x55e022572480 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9df6ffd640 1 -- 172.21.15.70:0/2212511100 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e0801ce50 con 0x55e022572480 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9df6ffd640 1 -- 172.21.15.70:0/2212511100 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9e08003b50 con 0x55e022572480 2024-09-12T01:53:20.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9e20298740 10 client.25400 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:20.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9e20298740 10 client.25400 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:20.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9e20298740 20 client.25400 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:20.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9e20298740 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e0225f7f20 0x55e0225fa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:20.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9e20298740 4 client.25400 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:53:20.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9e20298740 1 -- 172.21.15.70:0/2212511100 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e0224ded00 con 0x55e0225f7f20 2024-09-12T01:53:20.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.493+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e0225f7f20 0x55e0225fa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:20.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.494+0000 7f9df6ffd640 10 client.25400 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:20.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.494+0000 7f9e16ffd640 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e0225f7f20 0x55e0225fa340 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cf708d228ed583f server_cookie=586893451198423a in_seq=0 out_seq=0 2024-09-12T01:53:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9df6ffd640 1 -- 172.21.15.70:0/2212511100 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e0224ded00 con 0x55e0225f7f20 2024-09-12T01:53:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9df6ffd640 10 client.25400 handle_command_reply: tid=0 2024-09-12T01:53:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9e20298740 1 client.25400 shutdown 2024-09-12T01:53:20.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9e20298740 1 -- 172.21.15.70:0/2212511100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 msgr2=0x55e022580960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9e20298740 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 0x55e022580960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55e02258b570 tx=0x7f9e08009f50 comp rx=0 tx=0).stop 2024-09-12T01:53:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9e20298740 1 -- 172.21.15.70:0/2212511100 shutdown_connections 2024-09-12T01:53:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9e20298740 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e0225f7f20 0x55e0225fa340 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9e20298740 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e02257cd40 0x55e0225810f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9e20298740 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e022572480 0x55e022580960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9e20298740 1 --2- 172.21.15.70:0/2212511100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e022571b60 0x55e022585630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9e20298740 1 -- 172.21.15.70:0/2212511100 >> 172.21.15.70:0/2212511100 conn(0x55e02256e0f0 msgr2=0x55e022573dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9df6ffd640 0 client.25400 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9e20298740 1 -- 172.21.15.70:0/2212511100 shutdown_connections 2024-09-12T01:53:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9e20298740 1 -- 172.21.15.70:0/2212511100 wait complete. 2024-09-12T01:53:20.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.586+0000 7f9e20298740 20 client.25400 trim_cache size 0 max 16384 2024-09-12T01:53:20.588 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:53:20.588 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-12T01:53:20.588 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "b63e0b12-70aa-4eb3-a5ef-7e16d9cec8de", 2024-09-12T01:53:20.588 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-12T01:53:20.588 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:53:20.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.587+0000 7f9e1debf640 1 -- 172.21.15.70:0/199583451 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9e000a2c00 msgr2=0x7f9e000a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:20.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.587+0000 7f9e1debf640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9e000a2c00 0x7f9e000a50c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9e10097e30 tx=0x7f9e10000f40 comp rx=0 tx=0).stop 2024-09-12T01:53:20.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.587+0000 7f9e1debf640 1 -- 172.21.15.70:0/199583451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102ef0 msgr2=0x7f9e1810ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:20.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.587+0000 7f9e1debf640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102ef0 0x7f9e1810ef50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000eaa0 tx=0x7f9e1000ef60 comp rx=0 tx=0).stop 2024-09-12T01:53:20.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.587+0000 7f9e1debf640 1 -- 172.21.15.70:0/199583451 shutdown_connections 2024-09-12T01:53:20.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.587+0000 7f9e1debf640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9e000a2c00 0x7f9e000a50c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.587+0000 7f9e1debf640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e18102ef0 0x7f9e1810ef50 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.587+0000 7f9e1debf640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e18102570 0x7f9e1810ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.587+0000 7f9e1debf640 1 --2- 172.21.15.70:0/199583451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e18100e20 0x7f9e1810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:20.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.587+0000 7f9e1debf640 1 -- 172.21.15.70:0/199583451 >> 172.21.15.70:0/199583451 conn(0x7f9e180fc7d0 msgr2=0x7f9e180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:20.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.587+0000 7f9e1debf640 1 -- 172.21.15.70:0/199583451 shutdown_connections 2024-09-12T01:53:20.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:20.587+0000 7f9e1debf640 1 -- 172.21.15.70:0/199583451 wait complete. 2024-09-12T01:53:20.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-12T01:53:20.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-12T01:53:20.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-12T01:53:20.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-12T01:53:20.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-12T01:53:20.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-12T01:53:20.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-12T01:53:20.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-12T01:53:20.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-12T01:53:20.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-12T01:53:20.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-12T01:53:20.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-12T01:53:20.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-12T01:53:20.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-12T01:53:20.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-12T01:53:20.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-12T01:53:20.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-12T01:53:20.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-12T01:53:20.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-12T01:53:20.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-12T01:53:20.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-12T01:53:20.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-12T01:53:20.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-12T01:53:20.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-12T01:53:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-12T01:53:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-12T01:53:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-12T01:53:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-12T01:53:20.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-12T01:53:20.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-12T01:53:20.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-12T01:53:20.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-12T01:53:20.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-12T01:53:20.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-12T01:53:20.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-12T01:53:20.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-12T01:53:20.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-12T01:53:20.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-12T01:53:20.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-12T01:53:20.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-12T01:53:20.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-12T01:53:20.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-12T01:53:20.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-12T01:53:20.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-12T01:53:20.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-12T01:53:20.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-12T01:53:20.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-12T01:53:20.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-12T01:53:20.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-12T01:53:20.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-12T01:53:20.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-12T01:53:20.657 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-12T01:53:20.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-12T01:53:20.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-12T01:53:20.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-12T01:53:20.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-12T01:53:20.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-12T01:53:20.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-12T01:53:20.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-12T01:53:20.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-12T01:53:20.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-12T01:53:20.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-12T01:53:20.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-12T01:53:20.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/Changes 2024-09-12T01:53:20.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-12T01:53:20.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-12T01:53:20.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-12T01:53:20.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-12T01:53:20.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-12T01:53:20.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-12T01:53:20.677 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-12T01:53:20.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-12T01:53:20.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-12T01:53:20.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-12T01:53:20.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-12T01:53:20.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-12T01:53:20.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-12T01:53:20.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-12T01:53:20.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-12T01:53:20.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-12T01:53:20.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-12T01:53:20.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-12T01:53:20.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-12T01:53:20.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-12T01:53:20.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-12T01:53:20.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-12T01:53:20.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-12T01:53:20.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-12T01:53:20.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-12T01:53:20.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-12T01:53:20.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-12T01:53:20.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-12T01:53:20.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-12T01:53:20.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-12T01:53:20.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-12T01:53:20.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-12T01:53:20.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-12T01:53:20.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-12T01:53:20.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-12T01:53:20.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-12T01:53:20.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-12T01:53:20.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-12T01:53:20.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-12T01:53:20.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-12T01:53:20.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-12T01:53:20.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-12T01:53:20.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-12T01:53:20.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-12T01:53:20.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-12T01:53:20.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-12T01:53:20.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-12T01:53:20.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-12T01:53:20.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-12T01:53:20.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-12T01:53:20.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-12T01:53:20.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-12T01:53:20.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-12T01:53:20.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-12T01:53:20.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-12T01:53:20.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-12T01:53:20.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-12T01:53:20.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-12T01:53:20.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-12T01:53:20.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-12T01:53:20.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-12T01:53:20.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-12T01:53:20.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-12T01:53:20.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-12T01:53:20.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-12T01:53:20.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-12T01:53:20.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-12T01:53:20.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-12T01:53:20.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-12T01:53:20.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-12T01:53:20.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-12T01:53:20.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-12T01:53:20.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-12T01:53:20.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-12T01:53:20.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-12T01:53:20.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-12T01:53:20.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-12T01:53:20.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-12T01:53:20.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-12T01:53:20.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-12T01:53:20.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-12T01:53:20.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-12T01:53:20.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-12T01:53:20.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-12T01:53:20.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-12T01:53:20.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-12T01:53:20.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-12T01:53:20.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-12T01:53:20.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-12T01:53:20.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-12T01:53:20.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-12T01:53:20.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-12T01:53:20.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-12T01:53:20.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-12T01:53:20.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-12T01:53:20.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-12T01:53:20.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-12T01:53:20.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-12T01:53:20.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-12T01:53:20.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-12T01:53:20.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-12T01:53:20.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-12T01:53:20.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-12T01:53:20.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-12T01:53:20.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:20 smithi070 ceph-mon[31177]: pgmap v372: 97 pgs: 97 active+clean; 690 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-12T01:53:20.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-12T01:53:20.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-12T01:53:20.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-12T01:53:20.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-12T01:53:20.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-12T01:53:20.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-12T01:53:20.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-12T01:53:20.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-12T01:53:20.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-12T01:53:20.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-12T01:53:20.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-12T01:53:20.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-12T01:53:20.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-12T01:53:20.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-12T01:53:20.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-12T01:53:20.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-12T01:53:20.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-12T01:53:20.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-12T01:53:20.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-12T01:53:20.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-12T01:53:20.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-12T01:53:20.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-12T01:53:20.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-12T01:53:20.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-12T01:53:20.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-12T01:53:20.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-12T01:53:20.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-12T01:53:20.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-12T01:53:20.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-12T01:53:20.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-12T01:53:20.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-12T01:53:20.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-12T01:53:20.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-12T01:53:20.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-12T01:53:20.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-12T01:53:20.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-12T01:53:20.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-12T01:53:20.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-12T01:53:20.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-12T01:53:20.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-12T01:53:20.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-12T01:53:20.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-12T01:53:20.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-12T01:53:20.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-12T01:53:20.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-12T01:53:20.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-12T01:53:20.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-12T01:53:20.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-12T01:53:20.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-12T01:53:20.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-12T01:53:20.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-12T01:53:20.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-12T01:53:20.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-12T01:53:20.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-12T01:53:20.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-12T01:53:20.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-12T01:53:20.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-12T01:53:20.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-12T01:53:20.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-12T01:53:20.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-12T01:53:20.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-12T01:53:20.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-12T01:53:20.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-12T01:53:20.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-12T01:53:20.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-12T01:53:20.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-12T01:53:20.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-12T01:53:20.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-12T01:53:20.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-12T01:53:20.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-12T01:53:20.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-12T01:53:20.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-12T01:53:20.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-12T01:53:20.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-12T01:53:20.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-12T01:53:20.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-12T01:53:20.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-12T01:53:20.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-12T01:53:20.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-12T01:53:20.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-12T01:53:20.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-12T01:53:20.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-12T01:53:20.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-12T01:53:20.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-12T01:53:20.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-12T01:53:20.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-12T01:53:20.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-12T01:53:20.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-12T01:53:20.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-12T01:53:20.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-12T01:53:20.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-12T01:53:20.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-12T01:53:20.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-12T01:53:20.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-12T01:53:20.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-12T01:53:20.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-12T01:53:20.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-12T01:53:20.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-12T01:53:20.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-12T01:53:20.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-12T01:53:20.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-12T01:53:20.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:20 smithi191 ceph-mon[35770]: pgmap v372: 97 pgs: 97 active+clean; 690 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-12T01:53:21.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:20 smithi152 ceph-mon[35055]: pgmap v372: 97 pgs: 97 active+clean; 690 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-12T01:53:21.432 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:53:21.682 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:21 smithi070 ceph-mon[31177]: scrub queued for path: / 2024-09-12T01:53:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:21 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:53:21.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:21 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:53:21.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:21 smithi191 ceph-mon[35770]: scrub queued for path: / 2024-09-12T01:53:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:21 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:53:21.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:21 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:53:22.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:21 smithi152 ceph-mon[35055]: scrub queued for path: / 2024-09-12T01:53:22.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:21 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:53:22.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:21 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:53:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.137+0000 7f3b050ae640 1 -- 172.21.15.70:0/942409283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b00100e20 msgr2=0x7f3b00101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.137+0000 7f3b050ae640 1 --2- 172.21.15.70:0/942409283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b00100e20 0x7f3b00101200 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009900 tx=0x7f3af002a480 comp rx=0 tx=0).stop 2024-09-12T01:53:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.137+0000 7f3b050ae640 1 -- 172.21.15.70:0/942409283 shutdown_connections 2024-09-12T01:53:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.137+0000 7f3b050ae640 1 --2- 172.21.15.70:0/942409283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b00102ef0 0x7f3b0010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.137+0000 7f3b050ae640 1 --2- 172.21.15.70:0/942409283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b00102570 0x7f3b001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.137+0000 7f3b050ae640 1 --2- 172.21.15.70:0/942409283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b00100e20 0x7f3b00101200 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.137+0000 7f3b050ae640 1 -- 172.21.15.70:0/942409283 >> 172.21.15.70:0/942409283 conn(0x7f3b000fc7d0 msgr2=0x7f3b000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.137+0000 7f3b050ae640 1 -- 172.21.15.70:0/942409283 shutdown_connections 2024-09-12T01:53:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.137+0000 7f3b050ae640 1 -- 172.21.15.70:0/942409283 wait complete. 2024-09-12T01:53:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.137+0000 7f3b050ae640 1 Processor -- start 2024-09-12T01:53:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3b050ae640 1 -- start start 2024-09-12T01:53:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3b050ae640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b00100e20 0x7f3b0010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3b050ae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b00102570 0x7f3b0010ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3b050ae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b00102ef0 0x7f3b0010ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3b050ae640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001121e0 con 0x7f3b00102ef0 2024-09-12T01:53:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3b050ae640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b00112060 con 0x7f3b00102570 2024-09-12T01:53:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3b050ae640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3b00112360 con 0x7f3b00100e20 2024-09-12T01:53:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3aff59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b00102ef0 0x7f3b0010ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3aff59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b00102ef0 0x7f3b0010ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33116/0 (socket says 172.21.15.70:33116) 2024-09-12T01:53:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3aff59e640 1 -- 172.21.15.70:0/1356281950 learned_addr learned my addr 172.21.15.70:0/1356281950 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3afe59c640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b00102570 0x7f3b0010ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3afed9d640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b00100e20 0x7f3b0010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3aff59e640 1 -- 172.21.15.70:0/1356281950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b00100e20 msgr2=0x7f3b0010e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3aff59e640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b00100e20 0x7f3b0010e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3aff59e640 1 -- 172.21.15.70:0/1356281950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b00102570 msgr2=0x7f3b0010ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3aff59e640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b00102570 0x7f3b0010ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3aff59e640 1 -- 172.21.15.70:0/1356281950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b001ab010 con 0x7f3b00102ef0 2024-09-12T01:53:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3afed9d640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b00100e20 0x7f3b0010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3afe59c640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b00102570 0x7f3b0010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3aff59e640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b00102ef0 0x7f3b0010ef50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009fd0 tx=0x7f3af800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3af7fff640 1 -- 172.21.15.70:0/1356281950 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8017070 con 0x7f3b00102ef0 2024-09-12T01:53:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.138+0000 7f3b050ae640 1 -- 172.21.15.70:0/1356281950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b001ab240 con 0x7f3b00102ef0 2024-09-12T01:53:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.139+0000 7f3af7fff640 1 -- 172.21.15.70:0/1356281950 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3af8004020 con 0x7f3b00102ef0 2024-09-12T01:53:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.139+0000 7f3af7fff640 1 -- 172.21.15.70:0/1356281950 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af80106a0 con 0x7f3b00102ef0 2024-09-12T01:53:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.139+0000 7f3b050ae640 1 -- 172.21.15.70:0/1356281950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b001ab780 con 0x7f3b00102ef0 2024-09-12T01:53:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.141+0000 7f3af7fff640 1 -- 172.21.15.70:0/1356281950 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3af80041d0 con 0x7f3b00102ef0 2024-09-12T01:53:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.141+0000 7f3b07487740 1 Processor -- start 2024-09-12T01:53:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.141+0000 7f3b07487740 1 -- start start 2024-09-12T01:53:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.141+0000 7f3b07487740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e774a0 0x559ef8e77880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3b07487740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e82140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3b07487740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e82680 0x559ef8e84a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3b07487740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559ef8ddd2e0 con 0x559ef8e77dc0 2024-09-12T01:53:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3b07487740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559ef8d84ce0 con 0x559ef8e82680 2024-09-12T01:53:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3b07487740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559ef8dd92a0 con 0x559ef8e774a0 2024-09-12T01:53:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3af7fff640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3aec0a2b80 0x7f3aec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3afed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e82140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3afed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e82140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33132/0 (socket says 172.21.15.70:33132) 2024-09-12T01:53:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3afed9d640 1 -- 172.21.15.70:0/3185238585 learned_addr learned my addr 172.21.15.70:0/3185238585 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3aff59e640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3aec0a2b80 0x7f3aec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3afe59c640 1 --2- 172.21.15.70:0/3185238585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e774a0 0x559ef8e77880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3afe59c640 1 --2- 172.21.15.70:0/3185238585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e82680 0x559ef8e84a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3af7fff640 1 -- 172.21.15.70:0/1356281950 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3af80cee60 con 0x7f3b00102ef0 2024-09-12T01:53:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3afed9d640 1 -- 172.21.15.70:0/3185238585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e774a0 msgr2=0x559ef8e77880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3afed9d640 1 --2- 172.21.15.70:0/3185238585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e774a0 0x559ef8e77880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3afed9d640 1 -- 172.21.15.70:0/3185238585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e82680 msgr2=0x559ef8e84a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3afed9d640 1 --2- 172.21.15.70:0/3185238585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e82680 0x559ef8e84a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3afed9d640 1 -- 172.21.15.70:0/3185238585 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef8d69440 con 0x559ef8e77dc0 2024-09-12T01:53:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3aff59e640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3aec0a2b80 0x7f3aec0a5040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3af8097ae0 tx=0x7f3af806e740 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3afed9d640 1 --2- 172.21.15.70:0/3185238585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e82140 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3af0033000 tx=0x7f3af0032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225c60d1b43fd79a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.142+0000 7f3af57fa640 1 -- 172.21.15.70:0/3185238585 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af003f070 con 0x559ef8e77dc0 2024-09-12T01:53:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.143+0000 7f3af57fa640 1 -- 172.21.15.70:0/3185238585 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3af00317e0 con 0x559ef8e77dc0 2024-09-12T01:53:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.143+0000 7f3af57fa640 1 -- 172.21.15.70:0/3185238585 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0035070 con 0x559ef8e77dc0 2024-09-12T01:53:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.143+0000 7f3b07487740 1 -- 172.21.15.70:0/3185238585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 msgr2=0x559ef8e82140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.143+0000 7f3b07487740 1 --2- 172.21.15.70:0/3185238585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e82140 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3af0033000 tx=0x7f3af0032d50 comp rx=0 tx=0).stop 2024-09-12T01:53:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.143+0000 7f3b07487740 1 -- 172.21.15.70:0/3185238585 shutdown_connections 2024-09-12T01:53:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.143+0000 7f3b07487740 1 --2- 172.21.15.70:0/3185238585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e82680 0x559ef8e84a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.143+0000 7f3b07487740 1 --2- 172.21.15.70:0/3185238585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e82140 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.143+0000 7f3b07487740 1 --2- 172.21.15.70:0/3185238585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e774a0 0x559ef8e77880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.143+0000 7f3b07487740 1 -- 172.21.15.70:0/3185238585 >> 172.21.15.70:0/3185238585 conn(0x559ef8e73a30 msgr2=0x559ef8e73e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.143+0000 7f3b07487740 1 -- 172.21.15.70:0/3185238585 shutdown_connections 2024-09-12T01:53:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.143+0000 7f3b07487740 1 -- 172.21.15.70:0/3185238585 wait complete. 2024-09-12T01:53:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.144+0000 7f3b07487740 1 -- start start 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.144+0000 7f3b07487740 1 Processor -- start 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.144+0000 7f3b07487740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e774a0 0x559ef8e81f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.144+0000 7f3b07487740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e77dc0 0x559ef8e7f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.144+0000 7f3b07487740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e82680 0x559ef8e7f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.144+0000 7f3b07487740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559ef8e85250 con 0x559ef8e774a0 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.144+0000 7f3b07487740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559ef8d98050 con 0x559ef8e82680 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.144+0000 7f3b07487740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x559ef8e853d0 con 0x559ef8e77dc0 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.144+0000 7f3b07487740 10 client.0 _ll_register_callbacks cb 0x559ef8dd8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.144+0000 7f3afe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e774a0 0x559ef8e81f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.144+0000 7f3afe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e774a0 0x559ef8e81f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33142/0 (socket says 172.21.15.70:33142) 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.144+0000 7f3afe59c640 1 -- 172.21.15.70:0/4193814160 learned_addr learned my addr 172.21.15.70:0/4193814160 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3afe59c640 1 -- 172.21.15.70:0/4193814160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e77dc0 msgr2=0x559ef8e7f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3afed9d640 1 --2- 172.21.15.70:0/4193814160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e77dc0 0x559ef8e7f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3afe59c640 1 --2- 172.21.15.70:0/4193814160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e77dc0 0x559ef8e7f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3afe59c640 1 -- 172.21.15.70:0/4193814160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e82680 msgr2=0x559ef8e7f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3afe59c640 1 --2- 172.21.15.70:0/4193814160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e82680 0x559ef8e7f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3afe59c640 1 -- 172.21.15.70:0/4193814160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ef8b4e3c0 con 0x559ef8e774a0 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3afe59c640 1 --2- 172.21.15.70:0/4193814160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e774a0 0x559ef8e81f00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800af50 tx=0x7f3ae8014a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ec94c6f48736b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3ae67fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3ae67fc640 1 -- 172.21.15.70:0/4193814160 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8013670 con 0x559ef8e774a0 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3ae67fc640 1 -- 172.21.15.70:0/4193814160 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3ae8013810 con 0x559ef8e774a0 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3b07487740 1 -- 172.21.15.70:0/4193814160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3af00317e0 con 0x559ef8e774a0 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3ae67fc640 1 -- 172.21.15.70:0/4193814160 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ae8013a10 con 0x559ef8e774a0 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3b07487740 10 client.16041 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3b07487740 1 -- 172.21.15.70:0/4193814160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559ef8e90c40 con 0x559ef8e774a0 2024-09-12T01:53:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3ae67fc640 1 -- 172.21.15.70:0/4193814160 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3af00317e0 con 0x559ef8e774a0 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.145+0000 7f3ae67fc640 1 -- 172.21.15.70:0/4193814160 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3ae8015040 con 0x559ef8e774a0 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.146+0000 7f3b07487740 10 client.16041 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.146+0000 7f3b07487740 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.146+0000 7f3b07487740 20 client.16041 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.146+0000 7f3b07487740 1 --2- 172.21.15.70:0/4193814160 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x559ef8e92100 0x559ef8e945c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.146+0000 7f3b07487740 4 client.16041 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.146+0000 7f3b07487740 1 -- 172.21.15.70:0/4193814160 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ef8dea850 con 0x559ef8e92100 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.146+0000 7f3afed9d640 1 --2- 172.21.15.70:0/4193814160 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x559ef8e92100 0x559ef8e945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.146+0000 7f3ae67fc640 10 client.16041 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.146+0000 7f3afed9d640 1 --2- 172.21.15.70:0/4193814160 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x559ef8e92100 0x559ef8e945c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1cb978013630e90 server_cookie=1e26d68897027f2f in_seq=0 out_seq=0 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3ae67fc640 1 -- 172.21.15.70:0/4193814160 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ef8dea850 con 0x559ef8e92100 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3ae67fc640 10 client.16041 handle_command_reply: tid=0 2024-09-12T01:53:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3b07487740 1 client.16041 shutdown 2024-09-12T01:53:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3b07487740 1 -- 172.21.15.70:0/4193814160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e774a0 msgr2=0x559ef8e81f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3b07487740 1 --2- 172.21.15.70:0/4193814160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e774a0 0x559ef8e81f00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800af50 tx=0x7f3ae8014a60 comp rx=0 tx=0).stop 2024-09-12T01:53:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3b07487740 1 -- 172.21.15.70:0/4193814160 shutdown_connections 2024-09-12T01:53:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3b07487740 1 --2- 172.21.15.70:0/4193814160 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x559ef8e92100 0x559ef8e945c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3b07487740 1 --2- 172.21.15.70:0/4193814160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e82680 0x559ef8e7f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3ae67fc640 0 client.16041 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3b07487740 1 --2- 172.21.15.70:0/4193814160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e77dc0 0x559ef8e7f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3b07487740 1 --2- 172.21.15.70:0/4193814160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e774a0 0x559ef8e81f00 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3b07487740 1 -- 172.21.15.70:0/4193814160 >> 172.21.15.70:0/4193814160 conn(0x559ef8e73a30 msgr2=0x559ef8e79710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3b07487740 1 -- 172.21.15.70:0/4193814160 shutdown_connections 2024-09-12T01:53:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3b07487740 1 -- 172.21.15.70:0/4193814160 wait complete. 2024-09-12T01:53:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.147+0000 7f3b07487740 20 client.16041 trim_cache size 0 max 16384 2024-09-12T01:53:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.164+0000 7f3b07487740 1 Processor -- start 2024-09-12T01:53:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.164+0000 7f3b07487740 1 -- start start 2024-09-12T01:53:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3b07487740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e774a0 0x559ef8e99e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3b07487740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e9a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3b07487740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e82680 0x559ef8e7c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3b07487740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001b3c90 con 0x559ef8e77dc0 2024-09-12T01:53:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3b07487740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001b57d0 con 0x559ef8e774a0 2024-09-12T01:53:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3b07487740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001b4360 con 0x559ef8e82680 2024-09-12T01:53:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3afed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e9a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3afed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e9a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33154/0 (socket says 172.21.15.70:33154) 2024-09-12T01:53:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3afed9d640 1 -- 172.21.15.70:0/3324412175 learned_addr learned my addr 172.21.15.70:0/3324412175 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3afe59c640 1 --2- 172.21.15.70:0/3324412175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e774a0 0x559ef8e99e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3afe59c640 1 --2- 172.21.15.70:0/3324412175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e82680 0x559ef8e7c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3afed9d640 1 -- 172.21.15.70:0/3324412175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e82680 msgr2=0x559ef8e7c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3afed9d640 1 --2- 172.21.15.70:0/3324412175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e82680 0x559ef8e7c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3afed9d640 1 -- 172.21.15.70:0/3324412175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e774a0 msgr2=0x559ef8e99e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3afed9d640 1 --2- 172.21.15.70:0/3324412175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e774a0 0x559ef8e99e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3afed9d640 1 -- 172.21.15.70:0/3324412175 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef8e7ff70 con 0x559ef8e77dc0 2024-09-12T01:53:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3afe59c640 1 --2- 172.21.15.70:0/3324412175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e774a0 0x559ef8e99e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.165+0000 7f3afed9d640 1 --2- 172.21.15.70:0/3324412175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e9a3d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3af0005450 tx=0x7f3af0005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1ad5b3671d4ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.166+0000 7f3af4ff9640 1 -- 172.21.15.70:0/3324412175 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af003f070 con 0x559ef8e77dc0 2024-09-12T01:53:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.166+0000 7f3af4ff9640 1 -- 172.21.15.70:0/3324412175 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3af00319f0 con 0x559ef8e77dc0 2024-09-12T01:53:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.166+0000 7f3af4ff9640 1 -- 172.21.15.70:0/3324412175 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0035040 con 0x559ef8e77dc0 2024-09-12T01:53:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.166+0000 7f3b07487740 1 -- 172.21.15.70:0/3324412175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 msgr2=0x559ef8e9a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.166+0000 7f3b07487740 1 --2- 172.21.15.70:0/3324412175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e9a3d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3af0005450 tx=0x7f3af0005520 comp rx=0 tx=0).stop 2024-09-12T01:53:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 -- 172.21.15.70:0/3324412175 shutdown_connections 2024-09-12T01:53:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 --2- 172.21.15.70:0/3324412175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e82680 0x559ef8e7c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 --2- 172.21.15.70:0/3324412175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e9a3d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 --2- 172.21.15.70:0/3324412175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e774a0 0x559ef8e99e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 -- 172.21.15.70:0/3324412175 >> 172.21.15.70:0/3324412175 conn(0x559ef8e73a30 msgr2=0x559ef8e72b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 -- 172.21.15.70:0/3324412175 shutdown_connections 2024-09-12T01:53:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 -- 172.21.15.70:0/3324412175 wait complete. 2024-09-12T01:53:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 -- start start 2024-09-12T01:53:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 Processor -- start 2024-09-12T01:53:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e774a0 0x559ef8e883a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e888e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e82680 0x559ef8e88e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001b5100 con 0x559ef8e77dc0 2024-09-12T01:53:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001b4a30 con 0x559ef8e774a0 2024-09-12T01:53:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001b1c50 con 0x559ef8e82680 2024-09-12T01:53:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3b07487740 10 client.0 _ll_register_callbacks cb 0x7f3ae800ab80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.167+0000 7f3afed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e888e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3afed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e888e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33164/0 (socket says 172.21.15.70:33164) 2024-09-12T01:53:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3afed9d640 1 -- 172.21.15.70:0/4071262074 learned_addr learned my addr 172.21.15.70:0/4071262074 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3afe59c640 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e774a0 0x559ef8e883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3afe59c640 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e82680 0x559ef8e88e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3afed9d640 1 -- 172.21.15.70:0/4071262074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e82680 msgr2=0x559ef8e88e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3afed9d640 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e82680 0x559ef8e88e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3afed9d640 1 -- 172.21.15.70:0/4071262074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e774a0 msgr2=0x559ef8e883a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3afed9d640 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e774a0 0x559ef8e883a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3afed9d640 1 -- 172.21.15.70:0/4071262074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ef8efbe70 con 0x559ef8e77dc0 2024-09-12T01:53:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3afed9d640 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e888e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3af0006010 tx=0x7f3af0005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865c9fc83c8e2c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3ae67fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3ae67fc640 1 -- 172.21.15.70:0/4071262074 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0055060 con 0x559ef8e77dc0 2024-09-12T01:53:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3ae67fc640 1 -- 172.21.15.70:0/4071262074 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3af00317f0 con 0x559ef8e77dc0 2024-09-12T01:53:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3b07487740 1 -- 172.21.15.70:0/4071262074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3af00319f0 con 0x559ef8e77dc0 2024-09-12T01:53:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3ae67fc640 1 -- 172.21.15.70:0/4071262074 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3af003f050 con 0x559ef8e77dc0 2024-09-12T01:53:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3b07487740 10 client.16047 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.168+0000 7f3b07487740 1 -- 172.21.15.70:0/4071262074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559ef8efd050 con 0x559ef8e77dc0 2024-09-12T01:53:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.169+0000 7f3ae67fc640 1 -- 172.21.15.70:0/4071262074 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3af00319f0 con 0x559ef8e77dc0 2024-09-12T01:53:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.169+0000 7f3ae67fc640 1 -- 172.21.15.70:0/4071262074 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3af0050c40 con 0x559ef8e77dc0 2024-09-12T01:53:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.169+0000 7f3b07487740 10 client.16047 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.169+0000 7f3b07487740 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.169+0000 7f3b07487740 20 client.16047 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.169+0000 7f3b07487740 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x559ef8efd320 0x559ef8eff710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.169+0000 7f3b07487740 4 client.16047 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:53:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.169+0000 7f3b07487740 1 -- 172.21.15.70:0/4071262074 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559ef8de4d60 con 0x559ef8efd320 2024-09-12T01:53:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.169+0000 7f3afe59c640 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x559ef8efd320 0x559ef8eff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3ae67fc640 10 client.16047 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3afe59c640 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x559ef8efd320 0x559ef8eff710 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86c5132b4dc8e136 server_cookie=aa2321ada866405c in_seq=0 out_seq=0 2024-09-12T01:53:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3ae67fc640 1 -- 172.21.15.70:0/4071262074 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559ef8de4d60 con 0x559ef8efd320 2024-09-12T01:53:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3ae67fc640 10 client.16047 handle_command_reply: tid=0 2024-09-12T01:53:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3b07487740 1 client.16047 shutdown 2024-09-12T01:53:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3b07487740 1 -- 172.21.15.70:0/4071262074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 msgr2=0x559ef8e888e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3b07487740 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e888e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3af0006010 tx=0x7f3af0005480 comp rx=0 tx=0).stop 2024-09-12T01:53:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3b07487740 1 -- 172.21.15.70:0/4071262074 shutdown_connections 2024-09-12T01:53:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3b07487740 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x559ef8efd320 0x559ef8eff710 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3b07487740 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559ef8e82680 0x559ef8e88e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3b07487740 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ef8e77dc0 0x559ef8e888e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3b07487740 1 --2- 172.21.15.70:0/4071262074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559ef8e774a0 0x559ef8e883a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3b07487740 1 -- 172.21.15.70:0/4071262074 >> 172.21.15.70:0/4071262074 conn(0x559ef8e73a30 msgr2=0x559ef8e80a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3ae67fc640 0 client.16047 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3b07487740 1 -- 172.21.15.70:0/4071262074 shutdown_connections 2024-09-12T01:53:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3b07487740 1 -- 172.21.15.70:0/4071262074 wait complete. 2024-09-12T01:53:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.170+0000 7f3b07487740 20 client.16047 trim_cache size 0 max 16384 2024-09-12T01:53:22.177 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:53:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:53:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-12T01:53:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "b63e0b12-70aa-4eb3-a5ef-7e16d9cec8de": { 2024-09-12T01:53:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T01:53:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "b63e0b12-70aa-4eb3-a5ef-7e16d9cec8de", 2024-09-12T01:53:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-12T01:53:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:53:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:53:22.178 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:53:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.171+0000 7f3b050ae640 1 -- 172.21.15.70:0/1356281950 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3aec0a2b80 msgr2=0x7f3aec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.171+0000 7f3b050ae640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3aec0a2b80 0x7f3aec0a5040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3af8097ae0 tx=0x7f3af806e740 comp rx=0 tx=0).stop 2024-09-12T01:53:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.171+0000 7f3b050ae640 1 -- 172.21.15.70:0/1356281950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b00102ef0 msgr2=0x7f3b0010ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.171+0000 7f3b050ae640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b00102ef0 0x7f3b0010ef50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009fd0 tx=0x7f3af800b260 comp rx=0 tx=0).stop 2024-09-12T01:53:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.171+0000 7f3b050ae640 1 -- 172.21.15.70:0/1356281950 shutdown_connections 2024-09-12T01:53:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.171+0000 7f3b050ae640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3aec0a2b80 0x7f3aec0a5040 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.171+0000 7f3b050ae640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b00102ef0 0x7f3b0010ef50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.171+0000 7f3b050ae640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b00102570 0x7f3b0010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.171+0000 7f3b050ae640 1 --2- 172.21.15.70:0/1356281950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b00100e20 0x7f3b0010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:22.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.171+0000 7f3b050ae640 1 -- 172.21.15.70:0/1356281950 >> 172.21.15.70:0/1356281950 conn(0x7f3b000fc7d0 msgr2=0x7f3b000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:22.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.171+0000 7f3b050ae640 1 -- 172.21.15.70:0/1356281950 shutdown_connections 2024-09-12T01:53:22.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:22.171+0000 7f3b050ae640 1 -- 172.21.15.70:0/1356281950 wait complete. 2024-09-12T01:53:22.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-12T01:53:22.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-12T01:53:22.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-12T01:53:22.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-12T01:53:22.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-12T01:53:22.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-12T01:53:22.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-12T01:53:22.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-12T01:53:22.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-12T01:53:22.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-12T01:53:22.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-12T01:53:22.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-12T01:53:22.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-12T01:53:22.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-12T01:53:22.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-12T01:53:22.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-12T01:53:22.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:22 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:53:22.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:22 smithi070 ceph-mon[31177]: pgmap v373: 97 pgs: 97 active+clean; 16 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 MiB/s wr, 18 op/s 2024-09-12T01:53:22.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-12T01:53:22.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-12T01:53:22.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-12T01:53:22.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-12T01:53:22.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-12T01:53:22.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-12T01:53:22.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-12T01:53:22.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-12T01:53:22.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-12T01:53:22.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-12T01:53:22.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-12T01:53:22.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-12T01:53:22.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-12T01:53:22.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-12T01:53:22.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-12T01:53:22.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-12T01:53:22.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-12T01:53:22.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-12T01:53:22.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-12T01:53:22.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-12T01:53:22.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-12T01:53:22.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-12T01:53:22.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-12T01:53:22.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-12T01:53:22.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-12T01:53:22.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-12T01:53:22.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-12T01:53:22.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-12T01:53:22.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-12T01:53:22.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-12T01:53:22.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-12T01:53:22.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-12T01:53:22.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-12T01:53:22.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-12T01:53:22.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-12T01:53:22.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/Makefile 2024-09-12T01:53:22.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-12T01:53:22.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-12T01:53:22.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-12T01:53:22.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-12T01:53:22.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-12T01:53:22.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-12T01:53:22.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-12T01:53:22.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-12T01:53:22.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-12T01:53:22.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-12T01:53:22.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-12T01:53:22.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-12T01:53:22.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-12T01:53:22.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-12T01:53:22.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-12T01:53:22.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-12T01:53:22.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-12T01:53:22.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-12T01:53:22.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-12T01:53:22.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-12T01:53:22.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-12T01:53:22.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-12T01:53:22.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-12T01:53:22.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-12T01:53:22.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-12T01:53:22.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-12T01:53:22.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-12T01:53:22.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-12T01:53:22.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-12T01:53:22.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-12T01:53:22.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-12T01:53:22.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-12T01:53:22.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-12T01:53:22.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-12T01:53:22.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-12T01:53:22.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-12T01:53:22.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-12T01:53:22.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-12T01:53:22.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-12T01:53:22.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-12T01:53:22.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-12T01:53:22.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-12T01:53:22.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-12T01:53:22.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-12T01:53:22.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-12T01:53:22.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-12T01:53:22.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-12T01:53:22.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-12T01:53:22.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-12T01:53:22.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-12T01:53:22.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-12T01:53:22.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-12T01:53:22.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-12T01:53:22.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-12T01:53:22.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-12T01:53:22.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-12T01:53:22.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-12T01:53:22.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-12T01:53:22.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-12T01:53:22.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-12T01:53:22.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-12T01:53:22.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-12T01:53:22.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-12T01:53:22.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-12T01:53:22.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-12T01:53:22.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/ 2024-09-12T01:53:22.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-12T01:53:22.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-12T01:53:22.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-12T01:53:22.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-12T01:53:22.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-12T01:53:22.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-12T01:53:22.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-12T01:53:22.862 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-12T01:53:22.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-12T01:53:22.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-12T01:53:22.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-12T01:53:22.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-12T01:53:22.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-12T01:53:22.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-12T01:53:22.867 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-12T01:53:22.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/README 2024-09-12T01:53:22.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-12T01:53:22.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-12T01:53:22.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-12T01:53:22.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-12T01:53:22.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-12T01:53:22.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-12T01:53:22.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-12T01:53:22.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-12T01:53:22.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-12T01:53:22.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-12T01:53:22.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-12T01:53:22.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-12T01:53:22.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-12T01:53:22.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-12T01:53:22.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-12T01:53:22.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-12T01:53:22.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-12T01:53:22.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-12T01:53:22.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-12T01:53:22.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-12T01:53:22.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-12T01:53:22.884 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-12T01:53:22.884 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-12T01:53:22.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-12T01:53:22.886 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-12T01:53:22.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-12T01:53:22.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-12T01:53:22.888 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-12T01:53:22.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-12T01:53:22.890 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-12T01:53:22.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-12T01:53:22.892 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-12T01:53:22.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-12T01:53:22.894 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-12T01:53:22.894 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-12T01:53:22.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-12T01:53:22.896 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-12T01:53:22.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-12T01:53:22.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-12T01:53:22.898 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-12T01:53:22.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-12T01:53:22.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-12T01:53:22.900 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-12T01:53:22.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-12T01:53:22.902 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-12T01:53:22.902 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-12T01:53:22.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-12T01:53:22.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-12T01:53:22.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-12T01:53:22.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-12T01:53:22.907 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-12T01:53:22.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-12T01:53:22.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-12T01:53:22.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-12T01:53:22.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-12T01:53:22.910 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-12T01:53:22.910 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-12T01:53:22.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-12T01:53:22.912 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-12T01:53:22.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-12T01:53:22.914 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-12T01:53:22.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-12T01:53:22.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-12T01:53:22.917 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-12T01:53:22.918 INFO:tasks.cephfs.filesystem:scrub status for tag:b63e0b12-70aa-4eb3-a5ef-7e16d9cec8de - {'path': '/', 'tag': 'b63e0b12-70aa-4eb3-a5ef-7e16d9cec8de', 'options': 'recursive,force'} 2024-09-12T01:53:22.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-12T01:53:22.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-12T01:53:22.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-12T01:53:22.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-12T01:53:22.923 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-12T01:53:22.924 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-12T01:53:22.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-12T01:53:22.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-12T01:53:22.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-12T01:53:22.927 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-12T01:53:22.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-12T01:53:22.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-12T01:53:22.930 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-12T01:53:22.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-12T01:53:22.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-12T01:53:22.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-12T01:53:22.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-12T01:53:22.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-12T01:53:22.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-12T01:53:22.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-12T01:53:22.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-12T01:53:22.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:22 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:53:22.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:22 smithi191 ceph-mon[35770]: pgmap v373: 97 pgs: 97 active+clean; 16 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 MiB/s wr, 18 op/s 2024-09-12T01:53:22.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-12T01:53:22.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-12T01:53:22.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-12T01:53:22.940 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-12T01:53:22.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-12T01:53:22.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-12T01:53:22.943 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-12T01:53:22.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-12T01:53:22.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-12T01:53:22.945 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-12T01:53:22.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-12T01:53:22.947 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-12T01:53:22.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-12T01:53:22.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-12T01:53:22.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/ 2024-09-12T01:53:22.951 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-12T01:53:22.952 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-12T01:53:22.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-12T01:53:22.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-12T01:53:22.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-12T01:53:22.955 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-12T01:53:22.956 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-12T01:53:22.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-12T01:53:22.958 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-12T01:53:22.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-12T01:53:22.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-12T01:53:22.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-12T01:53:22.961 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-12T01:53:22.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-12T01:53:22.963 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-12T01:53:22.964 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-12T01:53:22.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-12T01:53:22.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-12T01:53:22.966 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-12T01:53:22.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-12T01:53:22.968 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-12T01:53:22.969 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-12T01:53:22.970 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-12T01:53:22.970 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-12T01:53:22.972 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-12T01:53:22.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-12T01:53:22.974 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-12T01:53:22.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-12T01:53:22.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-12T01:53:22.976 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-12T01:53:22.977 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-12T01:53:22.978 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-12T01:53:22.978 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-12T01:53:22.979 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-12T01:53:22.980 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-12T01:53:22.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-12T01:53:22.982 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-12T01:53:22.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-12T01:53:22.984 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-12T01:53:22.984 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-12T01:53:22.985 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-12T01:53:22.986 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-12T01:53:22.987 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-12T01:53:22.988 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-12T01:53:22.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-12T01:53:22.990 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-12T01:53:22.990 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-12T01:53:22.991 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-12T01:53:22.992 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-12T01:53:22.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-12T01:53:22.994 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-12T01:53:22.995 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-12T01:53:22.996 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-12T01:53:22.997 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-12T01:53:22.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-12T01:53:22.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-12T01:53:23.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-12T01:53:23.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-12T01:53:23.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-12T01:53:23.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-12T01:53:23.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-12T01:53:23.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-12T01:53:23.005 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-12T01:53:23.006 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-12T01:53:23.007 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-12T01:53:23.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/ 2024-09-12T01:53:23.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-12T01:53:23.010 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-12T01:53:23.010 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-12T01:53:23.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-12T01:53:23.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:22 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:53:23.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:22 smithi152 ceph-mon[35055]: pgmap v373: 97 pgs: 97 active+clean; 16 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.3 MiB/s wr, 18 op/s 2024-09-12T01:53:23.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-12T01:53:23.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/console/ 2024-09-12T01:53:23.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-12T01:53:23.015 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-12T01:53:23.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-12T01:53:23.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-12T01:53:23.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-12T01:53:23.018 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-12T01:53:23.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-12T01:53:23.020 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-12T01:53:23.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-12T01:53:23.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-12T01:53:23.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-12T01:53:23.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-12T01:53:23.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-12T01:53:23.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-12T01:53:23.026 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-12T01:53:23.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-12T01:53:23.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-12T01:53:23.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-12T01:53:23.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-12T01:53:23.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-12T01:53:23.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-12T01:53:23.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-12T01:53:23.033 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cris/ 2024-09-12T01:53:23.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cris/README 2024-09-12T01:53:23.035 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-12T01:53:23.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-12T01:53:23.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-12T01:53:23.037 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-12T01:53:23.038 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-12T01:53:23.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-12T01:53:23.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-12T01:53:23.041 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-12T01:53:23.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-12T01:53:23.043 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-12T01:53:23.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-12T01:53:23.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-12T01:53:23.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-12T01:53:23.047 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-12T01:53:23.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-12T01:53:23.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-12T01:53:23.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-12T01:53:23.050 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-12T01:53:23.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-12T01:53:23.052 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-12T01:53:23.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-12T01:53:23.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-12T01:53:23.054 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-12T01:53:23.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-12T01:53:23.056 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-12T01:53:23.057 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-12T01:53:23.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-12T01:53:23.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-12T01:53:23.059 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-12T01:53:23.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-12T01:53:23.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-12T01:53:23.062 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-12T01:53:23.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-12T01:53:23.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-12T01:53:23.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-12T01:53:23.065 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-12T01:53:23.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-12T01:53:23.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-12T01:53:23.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-12T01:53:23.069 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-12T01:53:23.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-12T01:53:23.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-12T01:53:23.071 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-12T01:53:23.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-12T01:53:23.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-12T01:53:23.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-12T01:53:23.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-12T01:53:23.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-12T01:53:23.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-12T01:53:23.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-12T01:53:23.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-12T01:53:23.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-12T01:53:23.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-12T01:53:23.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-12T01:53:23.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-12T01:53:23.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-12T01:53:23.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-12T01:53:23.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-12T01:53:23.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-12T01:53:23.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-12T01:53:23.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-12T01:53:23.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-12T01:53:23.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-12T01:53:23.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-12T01:53:23.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-12T01:53:23.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-12T01:53:23.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-12T01:53:23.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-12T01:53:23.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-12T01:53:23.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-12T01:53:23.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-12T01:53:23.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-12T01:53:23.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-12T01:53:23.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-12T01:53:23.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-12T01:53:23.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-12T01:53:23.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-12T01:53:23.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-12T01:53:23.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-12T01:53:23.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-12T01:53:23.104 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-12T01:53:23.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-12T01:53:23.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-12T01:53:23.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-12T01:53:23.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-12T01:53:23.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-12T01:53:23.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-12T01:53:23.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-12T01:53:23.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-12T01:53:23.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-12T01:53:23.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-12T01:53:23.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-12T01:53:23.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-12T01:53:23.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-12T01:53:23.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-12T01:53:23.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-12T01:53:23.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-12T01:53:23.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-12T01:53:23.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-12T01:53:23.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-12T01:53:23.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-12T01:53:23.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-12T01:53:23.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-12T01:53:23.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-12T01:53:23.126 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-12T01:53:23.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-12T01:53:23.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-12T01:53:23.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-12T01:53:23.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-12T01:53:23.131 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-12T01:53:23.131 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-12T01:53:23.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-12T01:53:23.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-12T01:53:23.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-12T01:53:23.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-12T01:53:23.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-12T01:53:23.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-12T01:53:23.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-12T01:53:23.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-12T01:53:23.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-12T01:53:23.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-12T01:53:23.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-12T01:53:23.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-12T01:53:23.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-12T01:53:23.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-12T01:53:23.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-12T01:53:23.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-12T01:53:23.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-12T01:53:23.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-12T01:53:23.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-12T01:53:23.149 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-12T01:53:23.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-12T01:53:23.151 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-12T01:53:23.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-12T01:53:23.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-12T01:53:23.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-12T01:53:23.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-12T01:53:23.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-12T01:53:23.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-12T01:53:23.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-12T01:53:23.158 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-12T01:53:23.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-12T01:53:23.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-12T01:53:23.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-12T01:53:23.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-12T01:53:23.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-12T01:53:23.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-12T01:53:23.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-12T01:53:23.165 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-12T01:53:23.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-12T01:53:23.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-12T01:53:23.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-12T01:53:23.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-12T01:53:23.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-12T01:53:23.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-12T01:53:23.172 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-12T01:53:23.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-12T01:53:23.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-12T01:53:23.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-12T01:53:23.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-12T01:53:23.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-12T01:53:23.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-12T01:53:23.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-12T01:53:23.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-12T01:53:23.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-12T01:53:23.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-12T01:53:23.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-12T01:53:23.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-12T01:53:23.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-12T01:53:23.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-12T01:53:23.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-12T01:53:23.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-12T01:53:23.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-12T01:53:23.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-12T01:53:23.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-12T01:53:23.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-12T01:53:23.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-12T01:53:23.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-12T01:53:23.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-12T01:53:23.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-12T01:53:23.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-12T01:53:23.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-12T01:53:23.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-12T01:53:23.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-12T01:53:23.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-12T01:53:23.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-12T01:53:23.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-12T01:53:23.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-12T01:53:23.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-12T01:53:23.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-12T01:53:23.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-12T01:53:23.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-12T01:53:23.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-12T01:53:23.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-12T01:53:23.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-12T01:53:23.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-12T01:53:23.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-12T01:53:23.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-12T01:53:23.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-12T01:53:23.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-12T01:53:23.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-12T01:53:23.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-12T01:53:23.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-12T01:53:23.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-12T01:53:23.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-12T01:53:23.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-12T01:53:23.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-12T01:53:23.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-12T01:53:23.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-12T01:53:23.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-12T01:53:23.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-12T01:53:23.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-12T01:53:23.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-12T01:53:23.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-12T01:53:23.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-12T01:53:23.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-12T01:53:23.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-12T01:53:23.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-12T01:53:23.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-12T01:53:23.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-12T01:53:23.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-12T01:53:23.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-12T01:53:23.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-12T01:53:23.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-12T01:53:23.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-12T01:53:23.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-12T01:53:23.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-12T01:53:23.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-12T01:53:23.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-12T01:53:23.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-12T01:53:23.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-12T01:53:23.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-12T01:53:23.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-12T01:53:23.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-12T01:53:23.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-12T01:53:23.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-12T01:53:23.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-12T01:53:23.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-12T01:53:23.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-12T01:53:23.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-12T01:53:23.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-12T01:53:23.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-12T01:53:23.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-12T01:53:23.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-12T01:53:23.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-12T01:53:23.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-12T01:53:23.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-12T01:53:23.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-12T01:53:23.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-12T01:53:23.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-12T01:53:23.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-12T01:53:23.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-12T01:53:23.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-12T01:53:23.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-12T01:53:23.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-12T01:53:23.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-12T01:53:23.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-12T01:53:23.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-12T01:53:23.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-12T01:53:23.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-12T01:53:23.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-12T01:53:23.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-12T01:53:23.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-12T01:53:23.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-12T01:53:23.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-12T01:53:23.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-12T01:53:23.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-12T01:53:23.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-12T01:53:23.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-12T01:53:23.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-12T01:53:23.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-12T01:53:23.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-12T01:53:23.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-12T01:53:23.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-12T01:53:23.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-12T01:53:23.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-12T01:53:23.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-12T01:53:23.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-12T01:53:23.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-12T01:53:23.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-12T01:53:23.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-12T01:53:23.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-12T01:53:23.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-12T01:53:23.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-12T01:53:23.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-12T01:53:23.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-12T01:53:23.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-12T01:53:23.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-12T01:53:23.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-12T01:53:23.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-12T01:53:23.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-12T01:53:23.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-12T01:53:23.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-12T01:53:23.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-12T01:53:23.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-12T01:53:23.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-12T01:53:23.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-12T01:53:23.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-12T01:53:23.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-12T01:53:23.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-12T01:53:23.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-12T01:53:23.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-12T01:53:23.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-12T01:53:23.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-12T01:53:23.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-12T01:53:23.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-12T01:53:23.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-12T01:53:23.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-12T01:53:23.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-12T01:53:23.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-12T01:53:23.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-12T01:53:23.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-12T01:53:23.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-12T01:53:23.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-12T01:53:23.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-12T01:53:23.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-12T01:53:23.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-12T01:53:23.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-12T01:53:23.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-12T01:53:23.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-12T01:53:23.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-12T01:53:23.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-12T01:53:23.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-12T01:53:23.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-12T01:53:23.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-12T01:53:23.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-12T01:53:23.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-12T01:53:23.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-12T01:53:23.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-12T01:53:23.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-12T01:53:23.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-12T01:53:23.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-12T01:53:23.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-12T01:53:23.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-12T01:53:23.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-12T01:53:23.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-12T01:53:23.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-12T01:53:23.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-12T01:53:23.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-12T01:53:23.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-12T01:53:23.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-12T01:53:23.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-12T01:53:23.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-12T01:53:23.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-12T01:53:23.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-12T01:53:23.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-12T01:53:23.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-12T01:53:23.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-12T01:53:23.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-12T01:53:23.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-12T01:53:23.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-12T01:53:23.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-12T01:53:23.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-12T01:53:23.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-12T01:53:23.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-12T01:53:23.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-12T01:53:23.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-12T01:53:23.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-12T01:53:23.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-12T01:53:23.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-12T01:53:23.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-12T01:53:23.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-12T01:53:23.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-12T01:53:23.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-12T01:53:23.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-12T01:53:23.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-12T01:53:23.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-12T01:53:23.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-12T01:53:23.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-12T01:53:23.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-12T01:53:23.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-12T01:53:23.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-12T01:53:23.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-12T01:53:23.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-12T01:53:23.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-12T01:53:23.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-12T01:53:23.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-12T01:53:23.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-12T01:53:23.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-12T01:53:23.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-12T01:53:23.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-12T01:53:23.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-12T01:53:23.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-12T01:53:23.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-12T01:53:23.578 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-12T01:53:23.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-12T01:53:23.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-12T01:53:23.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-12T01:53:23.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-12T01:53:23.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-12T01:53:23.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-12T01:53:23.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-12T01:53:23.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-12T01:53:23.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-12T01:53:23.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-12T01:53:23.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-12T01:53:23.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-12T01:53:23.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-12T01:53:23.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-12T01:53:23.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-12T01:53:23.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-12T01:53:23.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-12T01:53:23.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-12T01:53:23.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-12T01:53:23.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-12T01:53:23.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-12T01:53:23.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-12T01:53:23.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-12T01:53:23.600 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-12T01:53:23.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-12T01:53:23.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-12T01:53:23.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-12T01:53:23.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-12T01:53:23.605 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-12T01:53:23.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-12T01:53:23.607 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-12T01:53:23.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-12T01:53:23.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-12T01:53:23.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-12T01:53:23.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-12T01:53:23.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-12T01:53:23.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-12T01:53:23.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-12T01:53:23.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-12T01:53:23.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-12T01:53:23.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-12T01:53:23.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-12T01:53:23.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-12T01:53:23.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-12T01:53:23.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-12T01:53:23.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-12T01:53:23.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-12T01:53:23.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-12T01:53:23.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-12T01:53:23.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-12T01:53:23.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-12T01:53:23.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-12T01:53:23.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-12T01:53:23.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-12T01:53:23.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-12T01:53:23.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-12T01:53:23.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-12T01:53:23.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-12T01:53:23.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-12T01:53:23.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-12T01:53:23.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-12T01:53:23.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-12T01:53:23.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-12T01:53:23.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-12T01:53:23.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-12T01:53:23.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-12T01:53:23.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-12T01:53:23.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-12T01:53:23.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-12T01:53:23.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-12T01:53:23.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-12T01:53:23.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-12T01:53:23.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-12T01:53:23.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-12T01:53:23.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-12T01:53:23.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-12T01:53:23.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-12T01:53:23.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-12T01:53:23.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-12T01:53:23.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-12T01:53:23.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-12T01:53:23.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-12T01:53:23.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-12T01:53:23.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-12T01:53:23.657 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-12T01:53:23.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-12T01:53:23.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-12T01:53:23.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-12T01:53:23.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-12T01:53:23.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-12T01:53:23.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-12T01:53:23.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-12T01:53:23.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-12T01:53:23.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-12T01:53:23.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-12T01:53:23.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-12T01:53:23.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-12T01:53:23.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-12T01:53:23.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-12T01:53:23.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-12T01:53:23.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-12T01:53:23.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-12T01:53:23.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-12T01:53:23.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-12T01:53:23.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-12T01:53:23.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-12T01:53:23.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-12T01:53:23.677 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-12T01:53:23.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-12T01:53:23.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-12T01:53:23.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-12T01:53:23.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-12T01:53:23.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-12T01:53:23.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-12T01:53:23.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-12T01:53:23.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-12T01:53:23.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-12T01:53:23.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-12T01:53:23.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-12T01:53:23.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-12T01:53:23.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-12T01:53:23.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-12T01:53:23.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-12T01:53:23.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-12T01:53:23.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-12T01:53:23.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-12T01:53:23.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-12T01:53:23.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-12T01:53:23.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-12T01:53:23.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-12T01:53:23.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-12T01:53:23.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-12T01:53:23.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-12T01:53:23.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-12T01:53:23.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-12T01:53:23.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-12T01:53:23.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-12T01:53:23.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-12T01:53:23.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-12T01:53:23.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-12T01:53:23.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-12T01:53:23.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-12T01:53:23.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-12T01:53:23.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-12T01:53:23.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-12T01:53:23.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-12T01:53:23.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-12T01:53:23.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-12T01:53:23.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-12T01:53:23.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-12T01:53:23.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-12T01:53:23.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-12T01:53:23.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-12T01:53:23.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-12T01:53:23.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-12T01:53:23.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-12T01:53:23.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-12T01:53:23.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-12T01:53:23.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-12T01:53:23.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-12T01:53:23.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-12T01:53:23.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-12T01:53:23.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-12T01:53:23.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-12T01:53:23.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-12T01:53:23.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-12T01:53:23.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-12T01:53:23.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-12T01:53:23.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-12T01:53:23.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-12T01:53:23.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-12T01:53:23.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-12T01:53:23.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-12T01:53:23.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-12T01:53:23.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-12T01:53:23.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-12T01:53:23.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-12T01:53:23.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-12T01:53:23.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-12T01:53:23.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-12T01:53:23.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-12T01:53:23.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-12T01:53:23.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-12T01:53:23.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-12T01:53:23.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-12T01:53:23.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-12T01:53:23.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-12T01:53:23.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-12T01:53:23.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-12T01:53:23.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-12T01:53:23.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-12T01:53:23.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-12T01:53:23.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-12T01:53:23.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-12T01:53:23.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-12T01:53:23.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-12T01:53:23.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-12T01:53:23.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-12T01:53:23.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-12T01:53:23.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-12T01:53:23.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-12T01:53:23.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-12T01:53:23.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-12T01:53:23.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-12T01:53:23.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-12T01:53:23.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-12T01:53:23.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-12T01:53:23.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-12T01:53:23.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-12T01:53:23.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-12T01:53:23.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-12T01:53:23.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-12T01:53:23.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-12T01:53:23.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-12T01:53:23.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-12T01:53:23.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-12T01:53:23.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-12T01:53:23.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-12T01:53:23.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-12T01:53:23.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-12T01:53:23.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-12T01:53:23.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-12T01:53:23.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-12T01:53:23.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-12T01:53:23.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-12T01:53:23.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-12T01:53:23.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-12T01:53:23.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-12T01:53:23.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-12T01:53:23.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-12T01:53:23.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-12T01:53:23.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-12T01:53:23.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-12T01:53:23.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-12T01:53:23.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-12T01:53:23.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-12T01:53:23.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-12T01:53:23.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-12T01:53:23.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-12T01:53:23.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-12T01:53:23.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-12T01:53:23.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-12T01:53:23.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-12T01:53:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-12T01:53:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-12T01:53:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-12T01:53:23.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-12T01:53:23.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-12T01:53:23.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-12T01:53:23.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-12T01:53:23.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-12T01:53:23.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-12T01:53:23.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-12T01:53:23.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-12T01:53:23.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-12T01:53:23.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-12T01:53:23.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-12T01:53:23.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-12T01:53:23.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-12T01:53:23.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-12T01:53:23.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-12T01:53:23.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-12T01:53:23.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-12T01:53:23.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-12T01:53:23.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-12T01:53:23.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-12T01:53:23.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-12T01:53:23.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-12T01:53:23.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-12T01:53:23.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-12T01:53:23.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-12T01:53:23.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-12T01:53:23.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-12T01:53:23.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-12T01:53:23.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-12T01:53:23.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-12T01:53:23.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-12T01:53:23.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-12T01:53:23.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-12T01:53:23.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-12T01:53:23.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-12T01:53:23.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-12T01:53:23.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-12T01:53:23.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-12T01:53:23.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-12T01:53:23.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-12T01:53:23.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-12T01:53:23.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-12T01:53:23.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-12T01:53:23.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-12T01:53:23.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-12T01:53:23.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-12T01:53:23.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-12T01:53:23.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-12T01:53:23.862 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-12T01:53:23.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-12T01:53:23.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-12T01:53:23.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-12T01:53:23.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-12T01:53:23.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-12T01:53:23.867 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-12T01:53:23.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-12T01:53:23.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-12T01:53:23.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-12T01:53:23.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-12T01:53:23.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-12T01:53:23.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-12T01:53:23.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-12T01:53:23.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-12T01:53:23.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-12T01:53:23.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-12T01:53:23.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-12T01:53:23.878 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-12T01:53:23.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-12T01:53:23.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-12T01:53:23.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-12T01:53:23.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-12T01:53:23.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-12T01:53:23.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-12T01:53:23.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:23 smithi191 ceph-mon[35770]: scrub summary: idle 2024-09-12T01:53:24.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:23 smithi152 ceph-mon[35055]: scrub summary: idle 2024-09-12T01:53:24.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:23 smithi070 ceph-mon[31177]: scrub summary: idle 2024-09-12T01:53:24.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-12T01:53:24.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-12T01:53:24.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-12T01:53:24.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-12T01:53:24.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-12T01:53:24.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-12T01:53:24.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-12T01:53:24.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-12T01:53:24.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-12T01:53:24.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-12T01:53:24.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-12T01:53:24.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-12T01:53:24.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-12T01:53:24.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-12T01:53:24.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-12T01:53:24.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-12T01:53:24.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-12T01:53:24.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-12T01:53:24.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-12T01:53:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-12T01:53:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-12T01:53:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-12T01:53:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-12T01:53:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-12T01:53:24.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-12T01:53:24.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-12T01:53:24.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-12T01:53:24.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-12T01:53:24.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-12T01:53:24.104 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-12T01:53:24.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-12T01:53:24.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-12T01:53:24.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-12T01:53:24.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-12T01:53:24.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-12T01:53:24.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-12T01:53:24.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-12T01:53:24.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-12T01:53:24.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-12T01:53:24.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-12T01:53:24.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-12T01:53:24.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-12T01:53:24.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-12T01:53:24.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-12T01:53:24.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-12T01:53:24.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-12T01:53:24.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-12T01:53:24.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-12T01:53:24.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-12T01:53:24.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-12T01:53:24.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-12T01:53:24.126 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-12T01:53:24.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-12T01:53:24.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-12T01:53:24.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-12T01:53:24.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-12T01:53:24.131 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-12T01:53:24.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-12T01:53:24.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-12T01:53:24.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-12T01:53:24.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-12T01:53:24.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-12T01:53:24.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-12T01:53:24.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-12T01:53:24.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-12T01:53:24.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-12T01:53:24.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-12T01:53:24.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-12T01:53:24.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-12T01:53:24.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-12T01:53:24.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-12T01:53:24.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-12T01:53:24.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-12T01:53:24.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-12T01:53:24.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-12T01:53:24.149 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-12T01:53:24.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-12T01:53:24.151 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-12T01:53:24.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-12T01:53:24.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-12T01:53:24.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-12T01:53:24.154 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-12T01:53:24.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-12T01:53:24.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-12T01:53:24.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-12T01:53:24.158 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-12T01:53:24.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-12T01:53:24.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-12T01:53:24.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-12T01:53:24.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-12T01:53:24.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-12T01:53:24.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-12T01:53:24.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-12T01:53:24.165 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-12T01:53:24.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-12T01:53:24.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-12T01:53:24.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-12T01:53:24.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-12T01:53:24.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-12T01:53:24.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-12T01:53:24.172 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-12T01:53:24.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-12T01:53:24.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-12T01:53:24.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-12T01:53:24.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-12T01:53:24.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-12T01:53:24.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-12T01:53:24.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-12T01:53:24.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-12T01:53:24.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-12T01:53:24.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-12T01:53:24.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-12T01:53:24.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-12T01:53:24.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-12T01:53:24.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-12T01:53:24.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-12T01:53:24.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-12T01:53:24.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-12T01:53:24.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-12T01:53:24.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-12T01:53:24.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-12T01:53:24.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-12T01:53:24.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-12T01:53:24.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-12T01:53:24.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-12T01:53:24.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-12T01:53:24.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-12T01:53:24.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-12T01:53:24.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-12T01:53:24.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-12T01:53:24.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-12T01:53:24.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-12T01:53:24.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-12T01:53:24.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-12T01:53:24.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-12T01:53:24.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-12T01:53:24.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-12T01:53:24.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-12T01:53:24.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-12T01:53:24.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-12T01:53:24.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-12T01:53:24.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-12T01:53:24.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-12T01:53:24.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-12T01:53:24.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-12T01:53:24.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-12T01:53:24.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-12T01:53:24.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-12T01:53:24.215 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-12T01:53:24.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-12T01:53:24.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-12T01:53:24.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-12T01:53:24.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-12T01:53:24.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-12T01:53:24.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-12T01:53:24.222 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-12T01:53:24.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-12T01:53:24.224 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-12T01:53:24.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-12T01:53:24.226 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-12T01:53:24.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-12T01:53:24.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-12T01:53:24.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-12T01:53:24.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-12T01:53:24.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-12T01:53:24.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-12T01:53:24.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-12T01:53:24.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-12T01:53:24.235 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-12T01:53:24.236 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-12T01:53:24.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-12T01:53:24.238 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-12T01:53:24.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-12T01:53:24.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-12T01:53:24.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-12T01:53:24.242 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-12T01:53:24.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-12T01:53:24.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-12T01:53:24.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-12T01:53:24.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-12T01:53:24.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-12T01:53:24.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-12T01:53:24.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-12T01:53:24.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-12T01:53:24.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-12T01:53:24.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-12T01:53:24.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-12T01:53:24.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-12T01:53:24.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-12T01:53:24.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-12T01:53:24.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-12T01:53:24.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-12T01:53:24.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-12T01:53:24.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-12T01:53:24.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-12T01:53:24.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-12T01:53:24.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-12T01:53:24.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-12T01:53:24.265 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-12T01:53:24.265 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-12T01:53:24.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-12T01:53:24.267 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-12T01:53:24.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-12T01:53:24.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-12T01:53:24.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-12T01:53:24.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-12T01:53:24.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-12T01:53:24.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-12T01:53:24.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-12T01:53:24.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-12T01:53:24.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-12T01:53:24.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-12T01:53:24.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-12T01:53:24.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-12T01:53:24.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-12T01:53:24.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-12T01:53:24.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-12T01:53:24.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-12T01:53:24.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-12T01:53:24.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-12T01:53:24.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-12T01:53:24.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-12T01:53:24.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-12T01:53:24.291 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-12T01:53:24.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-12T01:53:24.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-12T01:53:24.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-12T01:53:24.295 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-12T01:53:24.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-12T01:53:24.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-12T01:53:24.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-12T01:53:24.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-12T01:53:24.301 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-12T01:53:24.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-12T01:53:24.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-12T01:53:24.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-12T01:53:24.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-12T01:53:24.306 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-12T01:53:24.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-12T01:53:24.309 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-12T01:53:24.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-12T01:53:24.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-12T01:53:24.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-12T01:53:24.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-12T01:53:24.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-12T01:53:24.316 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-12T01:53:24.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-12T01:53:24.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-12T01:53:24.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-12T01:53:24.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-12T01:53:24.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-12T01:53:24.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-12T01:53:24.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-12T01:53:24.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-12T01:53:24.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-12T01:53:24.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-12T01:53:24.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-12T01:53:24.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-12T01:53:24.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-12T01:53:24.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-12T01:53:24.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-12T01:53:24.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-12T01:53:24.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-12T01:53:24.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-12T01:53:24.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-12T01:53:24.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-12T01:53:24.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-12T01:53:24.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-12T01:53:24.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-12T01:53:24.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-12T01:53:24.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-12T01:53:24.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-12T01:53:24.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-12T01:53:24.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-12T01:53:24.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-12T01:53:24.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-12T01:53:24.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-12T01:53:24.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-12T01:53:24.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-12T01:53:24.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-12T01:53:24.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-12T01:53:24.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-12T01:53:24.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-12T01:53:24.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-12T01:53:24.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-12T01:53:24.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-12T01:53:24.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-12T01:53:24.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-12T01:53:24.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-12T01:53:24.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-12T01:53:24.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-12T01:53:24.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-12T01:53:24.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-12T01:53:24.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-12T01:53:24.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-12T01:53:24.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-12T01:53:24.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-12T01:53:24.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-12T01:53:24.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-12T01:53:24.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-12T01:53:24.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-12T01:53:24.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-12T01:53:24.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-12T01:53:24.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-12T01:53:24.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-12T01:53:24.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-12T01:53:24.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-12T01:53:24.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-12T01:53:24.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-12T01:53:24.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-12T01:53:24.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-12T01:53:24.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-12T01:53:24.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-12T01:53:24.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-12T01:53:24.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-12T01:53:24.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-12T01:53:24.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-12T01:53:24.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-12T01:53:24.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-12T01:53:24.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-12T01:53:24.406 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-12T01:53:24.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-12T01:53:24.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-12T01:53:24.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-12T01:53:24.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-12T01:53:24.411 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-12T01:53:24.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-12T01:53:24.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-12T01:53:24.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-12T01:53:24.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-12T01:53:24.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-12T01:53:24.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-12T01:53:24.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-12T01:53:24.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-12T01:53:24.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-12T01:53:24.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-12T01:53:24.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-12T01:53:24.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-12T01:53:24.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-12T01:53:24.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-12T01:53:24.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-12T01:53:24.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-12T01:53:24.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-12T01:53:24.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-12T01:53:24.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-12T01:53:24.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-12T01:53:24.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-12T01:53:24.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-12T01:53:24.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-12T01:53:24.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-12T01:53:24.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-12T01:53:24.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-12T01:53:24.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-12T01:53:24.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-12T01:53:24.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-12T01:53:24.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-12T01:53:24.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-12T01:53:24.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-12T01:53:24.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-12T01:53:24.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-12T01:53:24.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-12T01:53:24.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-12T01:53:24.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-12T01:53:24.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-12T01:53:24.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-12T01:53:24.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-12T01:53:24.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-12T01:53:24.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-12T01:53:24.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-12T01:53:24.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-12T01:53:24.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-12T01:53:24.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-12T01:53:24.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-12T01:53:24.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-12T01:53:24.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-12T01:53:24.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-12T01:53:24.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-12T01:53:24.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-12T01:53:24.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-12T01:53:24.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-12T01:53:24.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-12T01:53:24.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-12T01:53:24.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-12T01:53:24.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-12T01:53:24.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-12T01:53:24.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-12T01:53:24.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-12T01:53:24.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-12T01:53:24.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-12T01:53:24.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-12T01:53:24.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-12T01:53:24.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-12T01:53:24.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-12T01:53:24.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-12T01:53:24.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-12T01:53:24.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-12T01:53:24.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-12T01:53:24.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-12T01:53:24.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-12T01:53:24.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-12T01:53:24.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-12T01:53:24.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-12T01:53:24.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-12T01:53:24.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-12T01:53:24.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-12T01:53:24.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-12T01:53:24.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-12T01:53:24.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-12T01:53:24.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-12T01:53:24.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-12T01:53:24.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-12T01:53:24.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-12T01:53:24.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-12T01:53:24.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-12T01:53:24.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-12T01:53:24.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-12T01:53:24.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-12T01:53:24.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-12T01:53:24.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-12T01:53:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-12T01:53:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-12T01:53:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-12T01:53:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-12T01:53:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-12T01:53:24.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-12T01:53:24.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-12T01:53:24.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-12T01:53:24.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-12T01:53:24.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-12T01:53:24.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-12T01:53:24.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-12T01:53:24.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-12T01:53:24.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-12T01:53:24.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-12T01:53:24.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-12T01:53:24.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-12T01:53:24.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-12T01:53:24.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-12T01:53:24.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-12T01:53:24.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-12T01:53:24.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-12T01:53:24.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-12T01:53:24.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-12T01:53:24.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-12T01:53:24.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-12T01:53:24.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-12T01:53:24.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-12T01:53:24.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-12T01:53:24.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-12T01:53:24.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-12T01:53:24.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-12T01:53:24.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-12T01:53:24.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-12T01:53:24.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-12T01:53:24.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-12T01:53:24.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-12T01:53:24.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-12T01:53:24.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-12T01:53:24.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-12T01:53:24.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-12T01:53:24.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-12T01:53:24.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-12T01:53:24.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-12T01:53:24.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-12T01:53:24.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-12T01:53:24.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-12T01:53:24.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-12T01:53:24.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-12T01:53:24.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-12T01:53:24.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-12T01:53:24.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-12T01:53:24.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-12T01:53:24.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-12T01:53:24.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-12T01:53:24.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-12T01:53:24.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-12T01:53:24.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-12T01:53:24.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-12T01:53:24.578 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-12T01:53:24.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-12T01:53:24.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-12T01:53:24.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-12T01:53:24.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-12T01:53:24.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-12T01:53:24.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-12T01:53:24.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-12T01:53:24.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-12T01:53:24.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-12T01:53:24.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-12T01:53:24.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-12T01:53:24.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-12T01:53:24.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-12T01:53:24.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-12T01:53:24.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-12T01:53:24.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-12T01:53:24.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-12T01:53:24.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-12T01:53:24.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-12T01:53:24.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-12T01:53:24.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-12T01:53:24.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-12T01:53:24.600 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-12T01:53:24.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-12T01:53:24.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-12T01:53:24.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-12T01:53:24.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-12T01:53:24.605 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-12T01:53:24.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-12T01:53:24.607 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-12T01:53:24.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-12T01:53:24.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-12T01:53:24.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-12T01:53:24.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-12T01:53:24.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-12T01:53:24.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-12T01:53:24.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-12T01:53:24.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-12T01:53:24.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-12T01:53:24.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-12T01:53:24.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-12T01:53:24.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-12T01:53:24.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-12T01:53:24.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-12T01:53:24.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-12T01:53:24.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-12T01:53:24.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-12T01:53:24.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-12T01:53:24.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-12T01:53:24.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-12T01:53:24.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-12T01:53:24.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-12T01:53:24.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-12T01:53:24.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-12T01:53:24.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-12T01:53:24.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-12T01:53:24.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-12T01:53:24.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-12T01:53:24.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-12T01:53:24.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-12T01:53:24.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-12T01:53:24.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-12T01:53:24.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-12T01:53:24.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-12T01:53:24.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-12T01:53:24.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-12T01:53:24.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-12T01:53:24.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-12T01:53:24.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-12T01:53:24.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-12T01:53:24.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-12T01:53:24.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-12T01:53:24.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-12T01:53:24.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-12T01:53:24.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-12T01:53:24.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-12T01:53:24.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-12T01:53:24.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-12T01:53:24.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-12T01:53:24.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-12T01:53:24.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-12T01:53:24.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-12T01:53:24.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-12T01:53:24.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-12T01:53:24.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-12T01:53:24.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-12T01:53:24.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-12T01:53:24.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-12T01:53:24.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-12T01:53:24.657 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-12T01:53:24.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-12T01:53:24.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-12T01:53:24.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-12T01:53:24.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-12T01:53:24.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-12T01:53:24.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-12T01:53:24.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-12T01:53:24.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-12T01:53:24.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-12T01:53:24.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-12T01:53:24.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-12T01:53:24.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-12T01:53:24.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-12T01:53:24.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-12T01:53:24.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-12T01:53:24.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-12T01:53:24.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-12T01:53:24.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-12T01:53:24.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-12T01:53:24.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-12T01:53:24.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-12T01:53:24.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-12T01:53:24.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-12T01:53:24.677 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-12T01:53:24.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-12T01:53:24.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-12T01:53:24.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-12T01:53:24.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-12T01:53:24.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-12T01:53:24.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-12T01:53:24.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-12T01:53:24.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-12T01:53:24.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-12T01:53:24.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-12T01:53:24.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-12T01:53:24.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-12T01:53:24.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-12T01:53:24.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-12T01:53:24.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-12T01:53:24.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-12T01:53:24.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-12T01:53:24.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-12T01:53:24.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-12T01:53:24.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-12T01:53:24.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-12T01:53:24.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-12T01:53:24.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-12T01:53:24.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-12T01:53:24.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-12T01:53:24.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-12T01:53:24.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-12T01:53:24.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-12T01:53:24.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-12T01:53:24.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-12T01:53:24.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-12T01:53:24.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-12T01:53:24.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-12T01:53:24.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-12T01:53:24.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-12T01:53:24.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-12T01:53:24.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-12T01:53:24.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-12T01:53:24.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-12T01:53:24.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-12T01:53:24.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-12T01:53:24.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-12T01:53:24.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-12T01:53:24.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-12T01:53:24.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-12T01:53:24.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-12T01:53:24.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-12T01:53:24.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-12T01:53:24.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-12T01:53:24.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-12T01:53:24.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-12T01:53:24.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-12T01:53:24.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-12T01:53:24.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-12T01:53:24.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-12T01:53:24.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-12T01:53:24.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-12T01:53:24.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-12T01:53:24.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-12T01:53:24.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-12T01:53:24.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-12T01:53:24.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-12T01:53:24.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-12T01:53:24.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-12T01:53:24.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-12T01:53:24.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-12T01:53:24.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-12T01:53:24.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-12T01:53:24.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-12T01:53:24.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-12T01:53:24.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-12T01:53:24.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-12T01:53:24.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-12T01:53:24.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-12T01:53:24.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-12T01:53:24.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-12T01:53:24.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-12T01:53:24.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-12T01:53:24.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-12T01:53:24.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-12T01:53:24.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-12T01:53:24.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-12T01:53:24.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-12T01:53:24.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-12T01:53:24.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-12T01:53:24.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-12T01:53:24.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-12T01:53:24.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-12T01:53:24.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-12T01:53:24.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-12T01:53:24.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-12T01:53:24.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-12T01:53:24.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-12T01:53:24.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-12T01:53:24.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-12T01:53:24.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-12T01:53:24.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-12T01:53:24.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-12T01:53:24.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-12T01:53:24.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-12T01:53:24.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-12T01:53:24.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-12T01:53:24.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-12T01:53:24.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-12T01:53:24.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-12T01:53:24.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-12T01:53:24.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-12T01:53:24.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-12T01:53:24.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-12T01:53:24.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-12T01:53:24.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-12T01:53:24.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-12T01:53:24.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-12T01:53:24.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-12T01:53:24.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-12T01:53:24.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-12T01:53:24.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-12T01:53:24.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-12T01:53:24.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-12T01:53:24.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-12T01:53:24.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-12T01:53:24.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-12T01:53:24.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-12T01:53:24.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-12T01:53:24.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-12T01:53:24.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-12T01:53:24.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-12T01:53:24.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-12T01:53:24.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-12T01:53:24.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-12T01:53:24.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-12T01:53:24.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-12T01:53:24.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-12T01:53:24.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-12T01:53:24.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-12T01:53:24.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-12T01:53:24.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-12T01:53:24.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-12T01:53:24.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-12T01:53:24.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-12T01:53:24.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-12T01:53:24.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-12T01:53:24.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-12T01:53:24.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-12T01:53:24.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-12T01:53:24.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-12T01:53:24.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-12T01:53:24.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-12T01:53:24.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-12T01:53:24.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-12T01:53:24.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-12T01:53:24.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-12T01:53:24.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-12T01:53:24.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-12T01:53:24.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-12T01:53:24.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-12T01:53:24.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-12T01:53:24.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-12T01:53:24.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-12T01:53:24.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-12T01:53:24.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-12T01:53:24.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-12T01:53:24.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-12T01:53:24.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-12T01:53:24.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-12T01:53:24.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-12T01:53:24.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-12T01:53:24.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-12T01:53:24.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-12T01:53:24.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-12T01:53:24.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-12T01:53:24.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-12T01:53:24.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-12T01:53:24.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-12T01:53:24.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-12T01:53:24.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-12T01:53:24.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-12T01:53:24.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-12T01:53:24.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-12T01:53:24.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-12T01:53:24.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-12T01:53:24.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-12T01:53:24.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-12T01:53:24.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-12T01:53:24.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-12T01:53:24.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-12T01:53:24.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-12T01:53:24.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-12T01:53:24.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-12T01:53:24.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-12T01:53:24.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-12T01:53:24.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-12T01:53:24.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-12T01:53:24.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-12T01:53:24.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-12T01:53:24.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-12T01:53:24.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-12T01:53:24.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-12T01:53:24.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-12T01:53:24.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-12T01:53:24.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-12T01:53:24.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-12T01:53:24.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-12T01:53:24.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-12T01:53:24.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-12T01:53:24.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-12T01:53:24.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-12T01:53:24.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-12T01:53:24.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-12T01:53:24.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-12T01:53:24.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-12T01:53:24.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-12T01:53:24.862 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-12T01:53:24.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-12T01:53:24.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-12T01:53:24.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-12T01:53:24.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-12T01:53:24.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-12T01:53:24.867 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-12T01:53:24.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-12T01:53:24.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-12T01:53:24.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-12T01:53:24.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-12T01:53:24.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-12T01:53:24.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-12T01:53:24.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-12T01:53:24.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-12T01:53:24.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-12T01:53:24.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-12T01:53:24.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-12T01:53:24.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-12T01:53:24.878 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-12T01:53:24.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-12T01:53:24.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-12T01:53:24.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-12T01:53:24.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-12T01:53:24.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-12T01:53:24.884 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-12T01:53:24.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-12T01:53:24.886 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-12T01:53:24.886 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-12T01:53:24.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-12T01:53:24.888 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-12T01:53:24.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-12T01:53:24.890 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-12T01:53:24.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-12T01:53:24.892 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-12T01:53:24.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-12T01:53:24.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-12T01:53:24.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-12T01:53:24.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-12T01:53:24.898 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-12T01:53:24.898 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-12T01:53:24.898 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-12T01:53:24.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-12T01:53:24.900 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-12T01:53:24.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-12T01:53:24.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-12T01:53:24.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-12T01:53:24.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-12T01:53:24.904 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-12T01:53:24.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-12T01:53:24.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-12T01:53:24.907 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-12T01:53:24.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-12T01:53:24.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-12T01:53:24.910 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-12T01:53:24.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-12T01:53:24.912 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-12T01:53:24.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-12T01:53:24.914 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-12T01:53:24.914 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-12T01:53:24.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-12T01:53:24.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-12T01:53:24.917 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-12T01:53:24.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-12T01:53:24.919 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-12T01:53:24.919 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-12T01:53:24.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-12T01:53:24.921 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-12T01:53:24.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-12T01:53:24.923 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-12T01:53:24.924 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-12T01:53:24.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-12T01:53:24.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-12T01:53:24.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-12T01:53:24.927 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-12T01:53:24.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-12T01:53:24.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-12T01:53:24.930 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-12T01:53:24.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-12T01:53:24.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-12T01:53:24.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-12T01:53:24.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-12T01:53:24.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-12T01:53:24.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-12T01:53:24.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-12T01:53:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:24 smithi191 ceph-mon[35770]: pgmap v374: 97 pgs: 97 active+clean; 40 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.3 MiB/s wr, 25 op/s 2024-09-12T01:53:24.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-12T01:53:24.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-12T01:53:24.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-12T01:53:24.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-12T01:53:24.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-12T01:53:24.943 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-12T01:53:24.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-12T01:53:24.945 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-12T01:53:24.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-12T01:53:24.947 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-12T01:53:24.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-12T01:53:24.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-12T01:53:24.949 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-12T01:53:24.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-12T01:53:24.951 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-12T01:53:24.952 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-12T01:53:24.953 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-12T01:53:24.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-12T01:53:24.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-12T01:53:24.955 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-12T01:53:24.956 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-12T01:53:24.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-12T01:53:24.958 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-12T01:53:24.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-12T01:53:24.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-12T01:53:24.961 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-12T01:53:24.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-12T01:53:24.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-12T01:53:24.964 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-12T01:53:24.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-12T01:53:24.966 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-12T01:53:24.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-12T01:53:24.968 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-12T01:53:24.969 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-12T01:53:24.970 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-12T01:53:24.970 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-12T01:53:24.971 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-12T01:53:24.972 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-12T01:53:24.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-12T01:53:24.974 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-12T01:53:24.976 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-12T01:53:24.976 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-12T01:53:24.977 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-12T01:53:24.978 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-12T01:53:24.979 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-12T01:53:24.980 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-12T01:53:24.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-12T01:53:24.982 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-12T01:53:24.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-12T01:53:24.984 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-12T01:53:24.984 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-12T01:53:24.985 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-12T01:53:24.986 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-12T01:53:24.987 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-12T01:53:24.988 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-12T01:53:24.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-12T01:53:24.990 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-12T01:53:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-12T01:53:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-12T01:53:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-12T01:53:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-12T01:53:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-12T01:53:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-12T01:53:24.996 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-12T01:53:24.997 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-12T01:53:25.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-12T01:53:25.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-12T01:53:25.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-12T01:53:25.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-12T01:53:25.002 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-12T01:53:25.002 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-12T01:53:25.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-12T01:53:25.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-12T01:53:25.005 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-12T01:53:25.006 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-12T01:53:25.007 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-12T01:53:25.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-12T01:53:25.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-12T01:53:25.010 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-12T01:53:25.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-12T01:53:25.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:24 smithi152 ceph-mon[35055]: pgmap v374: 97 pgs: 97 active+clean; 40 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.3 MiB/s wr, 25 op/s 2024-09-12T01:53:25.012 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-12T01:53:25.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-12T01:53:25.015 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-12T01:53:25.015 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-12T01:53:25.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-12T01:53:25.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-12T01:53:25.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-12T01:53:25.018 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-12T01:53:25.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:24 smithi070 ceph-mon[31177]: pgmap v374: 97 pgs: 97 active+clean; 40 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.3 MiB/s wr, 25 op/s 2024-09-12T01:53:25.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-12T01:53:25.020 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-12T01:53:25.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-12T01:53:25.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-12T01:53:25.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-12T01:53:25.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-12T01:53:25.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-12T01:53:25.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-12T01:53:25.026 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-12T01:53:25.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-12T01:53:25.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-12T01:53:25.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-12T01:53:25.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-12T01:53:25.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-12T01:53:25.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-12T01:53:25.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-12T01:53:25.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-12T01:53:25.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-12T01:53:25.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-12T01:53:25.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-12T01:53:25.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-12T01:53:25.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-12T01:53:25.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-12T01:53:25.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-12T01:53:25.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-12T01:53:25.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-12T01:53:25.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-12T01:53:25.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-12T01:53:25.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-12T01:53:25.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-12T01:53:25.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-12T01:53:25.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-12T01:53:25.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-12T01:53:25.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-12T01:53:25.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-12T01:53:25.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-12T01:53:25.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-12T01:53:25.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-12T01:53:25.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-12T01:53:25.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-12T01:53:25.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-12T01:53:25.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-12T01:53:25.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-12T01:53:25.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-12T01:53:25.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-12T01:53:25.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-12T01:53:25.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-12T01:53:25.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-12T01:53:25.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-12T01:53:25.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-12T01:53:25.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-12T01:53:25.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-12T01:53:25.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-12T01:53:25.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-12T01:53:25.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-12T01:53:25.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-12T01:53:25.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-12T01:53:25.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-12T01:53:25.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-12T01:53:25.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-12T01:53:25.406 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-12T01:53:25.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-12T01:53:25.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-12T01:53:25.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-12T01:53:25.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-12T01:53:25.411 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-12T01:53:25.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-12T01:53:25.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-12T01:53:25.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-12T01:53:25.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-12T01:53:25.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-12T01:53:25.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-12T01:53:25.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-12T01:53:25.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-12T01:53:25.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-12T01:53:25.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-12T01:53:25.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-12T01:53:25.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-12T01:53:25.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-12T01:53:25.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-12T01:53:25.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-12T01:53:25.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-12T01:53:25.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-12T01:53:25.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-12T01:53:25.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-12T01:53:25.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-12T01:53:25.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-12T01:53:25.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-12T01:53:25.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-12T01:53:25.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-12T01:53:25.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-12T01:53:25.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-12T01:53:25.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-12T01:53:25.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-12T01:53:25.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-12T01:53:25.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-12T01:53:25.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-12T01:53:25.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-12T01:53:25.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-12T01:53:25.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-12T01:53:25.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-12T01:53:25.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-12T01:53:25.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-12T01:53:25.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-12T01:53:25.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-12T01:53:25.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-12T01:53:25.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-12T01:53:25.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-12T01:53:25.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-12T01:53:25.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-12T01:53:25.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-12T01:53:25.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-12T01:53:25.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-12T01:53:25.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-12T01:53:25.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-12T01:53:25.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-12T01:53:25.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-12T01:53:25.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-12T01:53:25.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-12T01:53:25.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-12T01:53:25.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-12T01:53:25.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-12T01:53:25.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-12T01:53:25.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-12T01:53:25.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-12T01:53:25.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-12T01:53:25.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-12T01:53:25.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-12T01:53:25.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-12T01:53:25.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-12T01:53:25.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-12T01:53:25.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-12T01:53:25.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-12T01:53:25.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-12T01:53:25.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-12T01:53:25.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-12T01:53:25.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-12T01:53:25.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-12T01:53:25.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-12T01:53:25.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-12T01:53:25.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-12T01:53:25.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-12T01:53:25.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-12T01:53:25.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/ 2024-09-12T01:53:25.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-12T01:53:25.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-12T01:53:25.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-12T01:53:25.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-12T01:53:25.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-12T01:53:25.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-12T01:53:25.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-12T01:53:25.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-12T01:53:25.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-12T01:53:25.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-12T01:53:25.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-12T01:53:25.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-12T01:53:25.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-12T01:53:25.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-12T01:53:25.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-12T01:53:25.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-12T01:53:25.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-12T01:53:25.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-12T01:53:25.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-12T01:53:25.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-12T01:53:25.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-12T01:53:25.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-12T01:53:25.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-12T01:53:25.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-12T01:53:25.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-12T01:53:25.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-12T01:53:25.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-12T01:53:25.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-12T01:53:25.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-12T01:53:25.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-12T01:53:25.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-12T01:53:25.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-12T01:53:25.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-12T01:53:25.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-12T01:53:25.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-12T01:53:25.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-12T01:53:25.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-12T01:53:25.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-12T01:53:25.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-12T01:53:25.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-12T01:53:25.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-12T01:53:25.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-12T01:53:25.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-12T01:53:25.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-12T01:53:25.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-12T01:53:25.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-12T01:53:25.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-12T01:53:25.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-12T01:53:25.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-12T01:53:25.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-12T01:53:25.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-12T01:53:25.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-12T01:53:25.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-12T01:53:25.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-12T01:53:25.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-12T01:53:25.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-12T01:53:25.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-12T01:53:25.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-12T01:53:25.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-12T01:53:25.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-12T01:53:25.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-12T01:53:25.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-12T01:53:25.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-12T01:53:25.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-12T01:53:25.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-12T01:53:25.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-12T01:53:25.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-12T01:53:25.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-12T01:53:25.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-12T01:53:25.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-12T01:53:25.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-12T01:53:25.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-12T01:53:25.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-12T01:53:25.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-12T01:53:25.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-12T01:53:25.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-12T01:53:25.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-12T01:53:25.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-12T01:53:25.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-12T01:53:25.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-12T01:53:25.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-12T01:53:25.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-12T01:53:25.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-12T01:53:25.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-12T01:53:25.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-12T01:53:25.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-12T01:53:25.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-12T01:53:25.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-12T01:53:25.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-12T01:53:25.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-12T01:53:25.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-12T01:53:25.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-12T01:53:25.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-12T01:53:25.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-12T01:53:25.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-12T01:53:25.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-12T01:53:25.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-12T01:53:25.578 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-12T01:53:25.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-12T01:53:25.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-12T01:53:25.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-12T01:53:25.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-12T01:53:25.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-12T01:53:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-12T01:53:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-12T01:53:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-12T01:53:25.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-12T01:53:25.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-12T01:53:25.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-12T01:53:25.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-12T01:53:25.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-12T01:53:25.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-12T01:53:25.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-12T01:53:25.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-12T01:53:25.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-12T01:53:25.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-12T01:53:25.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-12T01:53:25.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-12T01:53:25.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-12T01:53:25.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-12T01:53:25.600 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-12T01:53:25.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-12T01:53:25.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-12T01:53:25.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-12T01:53:25.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-12T01:53:25.605 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-12T01:53:25.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-12T01:53:25.607 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-12T01:53:25.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-12T01:53:25.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-12T01:53:25.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-12T01:53:25.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-12T01:53:25.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-12T01:53:25.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-12T01:53:25.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-12T01:53:25.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-12T01:53:25.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-12T01:53:25.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-12T01:53:25.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-12T01:53:25.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-12T01:53:25.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-12T01:53:25.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-12T01:53:25.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-12T01:53:25.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-12T01:53:25.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-12T01:53:25.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-12T01:53:25.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-12T01:53:25.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-12T01:53:25.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-12T01:53:25.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-12T01:53:25.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-12T01:53:25.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-12T01:53:25.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-12T01:53:25.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-12T01:53:25.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-12T01:53:25.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-12T01:53:25.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-12T01:53:25.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-12T01:53:25.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-12T01:53:25.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-12T01:53:25.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-12T01:53:25.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-12T01:53:25.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-12T01:53:25.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-12T01:53:25.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-12T01:53:25.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-12T01:53:25.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-12T01:53:25.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/ 2024-09-12T01:53:25.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-12T01:53:25.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-12T01:53:25.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-12T01:53:25.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-12T01:53:25.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-12T01:53:25.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-12T01:53:25.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-12T01:53:25.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-12T01:53:25.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-12T01:53:25.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-12T01:53:25.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-12T01:53:25.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-12T01:53:25.657 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-12T01:53:25.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-12T01:53:25.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-12T01:53:25.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-12T01:53:25.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-12T01:53:25.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-12T01:53:25.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-12T01:53:25.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-12T01:53:25.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-12T01:53:25.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/ 2024-09-12T01:53:25.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-12T01:53:25.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-12T01:53:25.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-12T01:53:25.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-12T01:53:25.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-12T01:53:25.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-12T01:53:25.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-12T01:53:25.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-12T01:53:25.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-12T01:53:25.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-12T01:53:25.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-12T01:53:25.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-12T01:53:25.677 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-12T01:53:25.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-12T01:53:25.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-12T01:53:25.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-12T01:53:25.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-12T01:53:25.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-12T01:53:25.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-12T01:53:25.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-12T01:53:25.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-12T01:53:25.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-12T01:53:25.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-12T01:53:25.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-12T01:53:25.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-12T01:53:25.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-12T01:53:25.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-12T01:53:25.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-12T01:53:25.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-12T01:53:25.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-12T01:53:25.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-12T01:53:25.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-12T01:53:25.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-12T01:53:25.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-12T01:53:25.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-12T01:53:25.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-12T01:53:25.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-12T01:53:25.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-12T01:53:25.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-12T01:53:25.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-12T01:53:25.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-12T01:53:25.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-12T01:53:25.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-12T01:53:25.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-12T01:53:25.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-12T01:53:25.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-12T01:53:25.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-12T01:53:25.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-12T01:53:25.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-12T01:53:25.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-12T01:53:25.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-12T01:53:25.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-12T01:53:25.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-12T01:53:25.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-12T01:53:25.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-12T01:53:25.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-12T01:53:25.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-12T01:53:25.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-12T01:53:25.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-12T01:53:25.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-12T01:53:25.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-12T01:53:25.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-12T01:53:25.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-12T01:53:25.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-12T01:53:25.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-12T01:53:25.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-12T01:53:25.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-12T01:53:25.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-12T01:53:25.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-12T01:53:25.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-12T01:53:25.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-12T01:53:25.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-12T01:53:25.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-12T01:53:25.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-12T01:53:25.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-12T01:53:25.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-12T01:53:25.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-12T01:53:25.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-12T01:53:25.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-12T01:53:25.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-12T01:53:25.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-12T01:53:25.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-12T01:53:25.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-12T01:53:25.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-12T01:53:25.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-12T01:53:25.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-12T01:53:25.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-12T01:53:25.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-12T01:53:25.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-12T01:53:25.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-12T01:53:25.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-12T01:53:25.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-12T01:53:25.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-12T01:53:25.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-12T01:53:25.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-12T01:53:25.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-12T01:53:25.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-12T01:53:25.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-12T01:53:25.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-12T01:53:25.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-12T01:53:25.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-12T01:53:25.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-12T01:53:25.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-12T01:53:25.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-12T01:53:25.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-12T01:53:25.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-12T01:53:25.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-12T01:53:25.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-12T01:53:25.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-12T01:53:25.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-12T01:53:25.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-12T01:53:25.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-12T01:53:25.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-12T01:53:25.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-12T01:53:25.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-12T01:53:25.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-12T01:53:25.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-12T01:53:25.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-12T01:53:25.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-12T01:53:25.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-12T01:53:25.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-12T01:53:25.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-12T01:53:25.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-12T01:53:25.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-12T01:53:25.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-12T01:53:25.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-12T01:53:25.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-12T01:53:25.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-12T01:53:25.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-12T01:53:25.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-12T01:53:25.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-12T01:53:25.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-12T01:53:25.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-12T01:53:25.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-12T01:53:25.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-12T01:53:25.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-12T01:53:25.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-12T01:53:25.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-12T01:53:25.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-12T01:53:25.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-12T01:53:25.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-12T01:53:25.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-12T01:53:25.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-12T01:53:25.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-12T01:53:25.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-12T01:53:25.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-12T01:53:25.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-12T01:53:25.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-12T01:53:25.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-12T01:53:25.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-12T01:53:25.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-12T01:53:25.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-12T01:53:25.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-12T01:53:25.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-12T01:53:25.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-12T01:53:25.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-12T01:53:25.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-12T01:53:25.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-12T01:53:25.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-12T01:53:25.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-12T01:53:25.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-12T01:53:25.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-12T01:53:25.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-12T01:53:25.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-12T01:53:25.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-12T01:53:25.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-12T01:53:25.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-12T01:53:25.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-12T01:53:25.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-12T01:53:25.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-12T01:53:25.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-12T01:53:25.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-12T01:53:25.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-12T01:53:25.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-12T01:53:25.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-12T01:53:25.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-12T01:53:25.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-12T01:53:25.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-12T01:53:25.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-12T01:53:25.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-12T01:53:25.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-12T01:53:25.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-12T01:53:25.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-12T01:53:25.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-12T01:53:25.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-12T01:53:25.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-12T01:53:25.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-12T01:53:25.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-12T01:53:25.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-12T01:53:25.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-12T01:53:25.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-12T01:53:25.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-12T01:53:25.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-12T01:53:25.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:25 smithi191 ceph-mon[35770]: pgmap v375: 97 pgs: 97 active+clean; 82 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 6.8 MiB/s wr, 34 op/s 2024-09-12T01:53:26.007 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-12T01:53:26.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-12T01:53:26.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-12T01:53:26.010 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-12T01:53:26.010 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-12T01:53:26.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-12T01:53:26.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:25 smithi152 ceph-mon[35055]: pgmap v375: 97 pgs: 97 active+clean; 82 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 6.8 MiB/s wr, 34 op/s 2024-09-12T01:53:26.012 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ 2024-09-12T01:53:26.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-12T01:53:26.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-12T01:53:26.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-12T01:53:26.015 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-12T01:53:26.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-12T01:53:26.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-12T01:53:26.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-12T01:53:26.020 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-12T01:53:26.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:25 smithi070 ceph-mon[31177]: pgmap v375: 97 pgs: 97 active+clean; 82 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 6.8 MiB/s wr, 34 op/s 2024-09-12T01:53:26.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-12T01:53:26.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-12T01:53:26.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-12T01:53:26.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-12T01:53:26.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-12T01:53:26.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/init.txt 2024-09-12T01:53:26.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-12T01:53:26.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/ 2024-09-12T01:53:26.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-12T01:53:26.026 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-12T01:53:26.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-12T01:53:26.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-12T01:53:26.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-12T01:53:26.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-12T01:53:26.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-12T01:53:26.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-12T01:53:26.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-12T01:53:26.033 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-12T01:53:26.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-12T01:53:26.035 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-12T01:53:26.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-12T01:53:26.037 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-12T01:53:26.038 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-12T01:53:26.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-12T01:53:26.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-12T01:53:26.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-12T01:53:26.041 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-12T01:53:26.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-12T01:53:26.043 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-12T01:53:26.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-12T01:53:26.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-12T01:53:26.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-12T01:53:26.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-12T01:53:26.047 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-12T01:53:26.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-12T01:53:26.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-12T01:53:26.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-12T01:53:26.050 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-12T01:53:26.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-12T01:53:26.052 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-12T01:53:26.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-12T01:53:26.054 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-12T01:53:26.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-12T01:53:26.056 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-12T01:53:26.057 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-12T01:53:26.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-12T01:53:26.059 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-12T01:53:26.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-12T01:53:26.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-12T01:53:26.062 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-12T01:53:26.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-12T01:53:26.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-12T01:53:26.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-12T01:53:26.065 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-12T01:53:26.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-12T01:53:26.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-12T01:53:26.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-12T01:53:26.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-12T01:53:26.069 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-12T01:53:26.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-12T01:53:26.071 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-12T01:53:26.071 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-12T01:53:26.072 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-12T01:53:26.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-12T01:53:26.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-12T01:53:26.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-12T01:53:26.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-12T01:53:26.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-12T01:53:26.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-12T01:53:26.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-12T01:53:26.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-12T01:53:26.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-12T01:53:26.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-12T01:53:26.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-12T01:53:26.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-12T01:53:26.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-12T01:53:26.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-12T01:53:26.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-12T01:53:26.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-12T01:53:26.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-12T01:53:26.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-12T01:53:26.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-12T01:53:26.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-12T01:53:26.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-12T01:53:26.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/java.txt 2024-09-12T01:53:26.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-12T01:53:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-12T01:53:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-12T01:53:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-12T01:53:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-12T01:53:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-12T01:53:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-12T01:53:26.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-12T01:53:26.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-12T01:53:26.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-12T01:53:26.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-12T01:53:26.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-12T01:53:26.104 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-12T01:53:26.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-12T01:53:26.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-12T01:53:26.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-12T01:53:26.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-12T01:53:26.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-12T01:53:26.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-12T01:53:26.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-12T01:53:26.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-12T01:53:26.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-12T01:53:26.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-12T01:53:26.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-12T01:53:26.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-12T01:53:26.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-12T01:53:26.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-12T01:53:26.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-12T01:53:26.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-12T01:53:26.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-12T01:53:26.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-12T01:53:26.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-12T01:53:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-12T01:53:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-12T01:53:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-12T01:53:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-12T01:53:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-12T01:53:26.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-12T01:53:26.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-12T01:53:26.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/ 2024-09-12T01:53:26.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-12T01:53:26.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-12T01:53:26.131 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-12T01:53:26.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-12T01:53:26.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-12T01:53:26.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-12T01:53:26.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-12T01:53:26.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-12T01:53:26.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-12T01:53:26.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-12T01:53:26.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-12T01:53:26.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-12T01:53:26.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/ 2024-09-12T01:53:26.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-12T01:53:26.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-12T01:53:26.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-12T01:53:26.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-12T01:53:26.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-12T01:53:26.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-12T01:53:26.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-12T01:53:26.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-12T01:53:26.149 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-12T01:53:26.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-12T01:53:26.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-12T01:53:26.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-12T01:53:26.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-12T01:53:26.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-12T01:53:26.158 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-12T01:53:26.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-12T01:53:26.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-12T01:53:26.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-12T01:53:26.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-12T01:53:26.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-12T01:53:26.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/md.txt 2024-09-12T01:53:26.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-12T01:53:26.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-12T01:53:26.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-12T01:53:26.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-12T01:53:26.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-12T01:53:26.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/metag/ 2024-09-12T01:53:26.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-12T01:53:26.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-12T01:53:26.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/ 2024-09-12T01:53:26.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-12T01:53:26.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-12T01:53:26.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-12T01:53:26.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-12T01:53:26.263 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-12T01:53:26.263 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-12T01:53:26.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-12T01:53:26.265 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-12T01:53:26.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-12T01:53:26.267 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-12T01:53:26.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mips/ 2024-09-12T01:53:26.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-12T01:53:26.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-12T01:53:26.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-12T01:53:26.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-12T01:53:26.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-12T01:53:26.273 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-12T01:53:26.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-12T01:53:26.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-12T01:53:26.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-12T01:53:26.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-12T01:53:26.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-12T01:53:26.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-12T01:53:26.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-12T01:53:26.280 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-12T01:53:26.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-12T01:53:26.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-12T01:53:26.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-12T01:53:26.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-12T01:53:26.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-12T01:53:26.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-12T01:53:26.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-12T01:53:26.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-12T01:53:26.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-12T01:53:26.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-12T01:53:26.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-12T01:53:26.291 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-12T01:53:26.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-12T01:53:26.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-12T01:53:26.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-12T01:53:26.295 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-12T01:53:26.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-12T01:53:26.297 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-12T01:53:26.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-12T01:53:26.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-12T01:53:26.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-12T01:53:26.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-12T01:53:26.301 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-12T01:53:26.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-12T01:53:26.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-12T01:53:26.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-12T01:53:26.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-12T01:53:26.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-12T01:53:26.306 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-12T01:53:26.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-12T01:53:26.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-12T01:53:26.309 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ 2024-09-12T01:53:26.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-12T01:53:26.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-12T01:53:26.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-12T01:53:26.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-12T01:53:26.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-12T01:53:26.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-12T01:53:26.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-12T01:53:26.316 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-12T01:53:26.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-12T01:53:26.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-12T01:53:26.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-12T01:53:26.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-12T01:53:26.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-12T01:53:26.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-12T01:53:26.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-12T01:53:26.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-12T01:53:26.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-12T01:53:26.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-12T01:53:26.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-12T01:53:26.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-12T01:53:26.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-12T01:53:26.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-12T01:53:26.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-12T01:53:26.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-12T01:53:26.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-12T01:53:26.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-12T01:53:26.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-12T01:53:26.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-12T01:53:26.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-12T01:53:26.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-12T01:53:26.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-12T01:53:26.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-12T01:53:26.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-12T01:53:26.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-12T01:53:26.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-12T01:53:26.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-12T01:53:26.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-12T01:53:26.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-12T01:53:26.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-12T01:53:26.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-12T01:53:26.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-12T01:53:26.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-12T01:53:26.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-12T01:53:26.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-12T01:53:26.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-12T01:53:26.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-12T01:53:26.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-12T01:53:26.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-12T01:53:26.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-12T01:53:26.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-12T01:53:26.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-12T01:53:26.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-12T01:53:26.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-12T01:53:26.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-12T01:53:26.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-12T01:53:26.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-12T01:53:26.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-12T01:53:26.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-12T01:53:26.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-12T01:53:26.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-12T01:53:26.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-12T01:53:26.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-12T01:53:26.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-12T01:53:26.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-12T01:53:26.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-12T01:53:26.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-12T01:53:26.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-12T01:53:26.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-12T01:53:26.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-12T01:53:26.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-12T01:53:26.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-12T01:53:26.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-12T01:53:26.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-12T01:53:26.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-12T01:53:26.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-12T01:53:26.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-12T01:53:26.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-12T01:53:26.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-12T01:53:26.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-12T01:53:26.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-12T01:53:26.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-12T01:53:26.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-12T01:53:26.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-12T01:53:26.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-12T01:53:26.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-12T01:53:26.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-12T01:53:26.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-12T01:53:26.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-12T01:53:26.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-12T01:53:26.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-12T01:53:26.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-12T01:53:26.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-12T01:53:26.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-12T01:53:26.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-12T01:53:26.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-12T01:53:26.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-12T01:53:26.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-12T01:53:26.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-12T01:53:26.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-12T01:53:26.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-12T01:53:26.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-12T01:53:26.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-12T01:53:26.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-12T01:53:26.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-12T01:53:26.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-12T01:53:26.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-12T01:53:26.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-12T01:53:26.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-12T01:53:26.406 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-12T01:53:26.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-12T01:53:26.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-12T01:53:26.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-12T01:53:26.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-12T01:53:26.411 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-12T01:53:26.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-12T01:53:26.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-12T01:53:26.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-12T01:53:26.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-12T01:53:26.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-12T01:53:26.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-12T01:53:26.417 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-12T01:53:26.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-12T01:53:26.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-12T01:53:26.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-12T01:53:26.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-12T01:53:26.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-12T01:53:26.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-12T01:53:26.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-12T01:53:26.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-12T01:53:26.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-12T01:53:26.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-12T01:53:26.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-12T01:53:26.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-12T01:53:26.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-12T01:53:26.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-12T01:53:26.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-12T01:53:26.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-12T01:53:26.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-12T01:53:26.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-12T01:53:26.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-12T01:53:26.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-12T01:53:26.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-12T01:53:26.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-12T01:53:26.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-12T01:53:26.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-12T01:53:26.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-12T01:53:26.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-12T01:53:26.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-12T01:53:26.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-12T01:53:26.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-12T01:53:26.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-12T01:53:26.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-12T01:53:26.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-12T01:53:26.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-12T01:53:26.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-12T01:53:26.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-12T01:53:26.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-12T01:53:26.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-12T01:53:26.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-12T01:53:26.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-12T01:53:26.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/phy/ 2024-09-12T01:53:26.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-12T01:53:26.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-12T01:53:26.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-12T01:53:26.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/platform/ 2024-09-12T01:53:26.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-12T01:53:26.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-12T01:53:26.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/ 2024-09-12T01:53:26.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-12T01:53:26.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-12T01:53:26.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-12T01:53:26.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-12T01:53:26.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-12T01:53:26.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-12T01:53:26.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-12T01:53:26.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-12T01:53:26.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-12T01:53:26.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-12T01:53:26.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-12T01:53:26.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-12T01:53:26.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-12T01:53:26.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-12T01:53:26.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-12T01:53:26.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-12T01:53:26.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-12T01:53:26.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-12T01:53:26.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-12T01:53:26.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-12T01:53:26.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-12T01:53:26.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-12T01:53:26.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-12T01:53:26.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-12T01:53:26.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-12T01:53:26.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-12T01:53:26.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-12T01:53:26.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-12T01:53:26.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-12T01:53:26.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-12T01:53:26.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-12T01:53:26.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-12T01:53:26.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-12T01:53:26.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-12T01:53:26.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-12T01:53:26.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-12T01:53:26.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-12T01:53:26.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-12T01:53:26.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-12T01:53:26.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-12T01:53:26.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-12T01:53:26.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-12T01:53:26.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-12T01:53:26.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-12T01:53:26.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-12T01:53:26.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-12T01:53:26.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pps/ 2024-09-12T01:53:26.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-12T01:53:26.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-12T01:53:26.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-12T01:53:26.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-12T01:53:26.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-12T01:53:26.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-12T01:53:26.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-12T01:53:26.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-12T01:53:26.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-12T01:53:26.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-12T01:53:26.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-12T01:53:26.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pti/ 2024-09-12T01:53:26.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-12T01:53:26.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-12T01:53:26.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-12T01:53:26.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-12T01:53:26.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-12T01:53:26.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-12T01:53:26.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-12T01:53:26.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-12T01:53:26.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-12T01:53:26.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-12T01:53:26.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-12T01:53:26.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-12T01:53:26.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-12T01:53:26.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-12T01:53:26.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-12T01:53:26.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-12T01:53:26.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-12T01:53:26.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-12T01:53:26.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-12T01:53:26.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-12T01:53:26.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/ 2024-09-12T01:53:26.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-12T01:53:26.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-12T01:53:26.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-12T01:53:26.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-12T01:53:26.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-12T01:53:26.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-12T01:53:26.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-12T01:53:26.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-12T01:53:26.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-12T01:53:26.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-12T01:53:26.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-12T01:53:26.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-12T01:53:26.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-12T01:53:26.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-12T01:53:26.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-12T01:53:26.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-12T01:53:26.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-12T01:53:26.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-12T01:53:26.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-12T01:53:26.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-12T01:53:26.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-12T01:53:26.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-12T01:53:26.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-12T01:53:26.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-12T01:53:26.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-12T01:53:26.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-12T01:53:26.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-12T01:53:26.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-12T01:53:26.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-12T01:53:26.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-12T01:53:26.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-12T01:53:26.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-12T01:53:26.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-12T01:53:26.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-12T01:53:26.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-12T01:53:26.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-12T01:53:26.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-12T01:53:26.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-12T01:53:26.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-12T01:53:26.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-12T01:53:26.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-12T01:53:26.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-12T01:53:26.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-12T01:53:26.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-12T01:53:26.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-12T01:53:26.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-12T01:53:26.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-12T01:53:26.578 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-12T01:53:26.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-12T01:53:26.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-12T01:53:26.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-12T01:53:26.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-12T01:53:26.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-12T01:53:26.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-12T01:53:26.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-12T01:53:26.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-12T01:53:26.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-12T01:53:26.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-12T01:53:26.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-12T01:53:26.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-12T01:53:26.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-12T01:53:26.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-12T01:53:26.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-12T01:53:26.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-12T01:53:26.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-12T01:53:26.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-12T01:53:26.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-12T01:53:26.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-12T01:53:26.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-12T01:53:26.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-12T01:53:26.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-12T01:53:26.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-12T01:53:26.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-12T01:53:26.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-12T01:53:26.600 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-12T01:53:26.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-12T01:53:26.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-12T01:53:26.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-12T01:53:26.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-12T01:53:26.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-12T01:53:26.605 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-12T01:53:26.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-12T01:53:26.607 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-12T01:53:26.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-12T01:53:26.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-12T01:53:26.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/ 2024-09-12T01:53:26.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-12T01:53:26.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-12T01:53:26.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-12T01:53:26.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-12T01:53:26.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-12T01:53:26.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-12T01:53:26.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-12T01:53:26.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-12T01:53:26.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-12T01:53:26.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-12T01:53:26.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-12T01:53:26.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-12T01:53:26.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-12T01:53:26.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-12T01:53:26.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/ 2024-09-12T01:53:26.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-12T01:53:26.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-12T01:53:26.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-12T01:53:26.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-12T01:53:26.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-12T01:53:26.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-12T01:53:26.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-12T01:53:26.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-12T01:53:26.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-12T01:53:26.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sh/ 2024-09-12T01:53:26.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-12T01:53:26.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-12T01:53:26.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-12T01:53:26.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/ 2024-09-12T01:53:26.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-12T01:53:26.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-12T01:53:26.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-12T01:53:26.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-12T01:53:26.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-12T01:53:26.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-12T01:53:26.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-12T01:53:26.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-12T01:53:26.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-12T01:53:26.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-12T01:53:26.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-12T01:53:26.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-12T01:53:26.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-12T01:53:26.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-12T01:53:26.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-12T01:53:26.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-12T01:53:26.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-12T01:53:26.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-12T01:53:26.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-12T01:53:26.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-12T01:53:26.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-12T01:53:26.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-12T01:53:26.657 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-12T01:53:26.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-12T01:53:26.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-12T01:53:26.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-12T01:53:26.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-12T01:53:26.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-12T01:53:26.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-12T01:53:26.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-12T01:53:26.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-12T01:53:26.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-12T01:53:26.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-12T01:53:26.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-12T01:53:26.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-12T01:53:26.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-12T01:53:26.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-12T01:53:26.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-12T01:53:26.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-12T01:53:26.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-12T01:53:26.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-12T01:53:26.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-12T01:53:26.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-12T01:53:26.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-12T01:53:26.677 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-12T01:53:26.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-12T01:53:26.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-12T01:53:26.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-12T01:53:26.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-12T01:53:26.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-12T01:53:26.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-12T01:53:26.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-12T01:53:26.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-12T01:53:26.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-12T01:53:26.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-12T01:53:26.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-12T01:53:26.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-12T01:53:26.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-12T01:53:26.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-12T01:53:26.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-12T01:53:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-12T01:53:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-12T01:53:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-12T01:53:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/ 2024-09-12T01:53:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-12T01:53:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-12T01:53:26.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-12T01:53:26.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-12T01:53:26.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-12T01:53:26.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-12T01:53:26.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-12T01:53:26.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-12T01:53:26.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-12T01:53:26.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-12T01:53:26.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-12T01:53:26.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-12T01:53:26.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-12T01:53:26.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-12T01:53:26.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-12T01:53:26.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-12T01:53:26.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-12T01:53:26.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-12T01:53:26.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-12T01:53:26.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-12T01:53:26.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-12T01:53:26.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-12T01:53:26.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-12T01:53:26.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-12T01:53:26.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-12T01:53:26.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-12T01:53:26.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-12T01:53:26.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/ 2024-09-12T01:53:26.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-12T01:53:26.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-12T01:53:26.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-12T01:53:26.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-12T01:53:26.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-12T01:53:26.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-12T01:53:26.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-12T01:53:26.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-12T01:53:26.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-12T01:53:26.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-12T01:53:26.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-12T01:53:26.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-12T01:53:26.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/ 2024-09-12T01:53:26.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-12T01:53:26.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-12T01:53:26.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-12T01:53:26.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-12T01:53:26.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-12T01:53:26.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-12T01:53:26.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-12T01:53:26.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-12T01:53:26.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-12T01:53:26.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-12T01:53:26.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-12T01:53:26.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-12T01:53:26.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-12T01:53:26.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ 2024-09-12T01:53:26.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-12T01:53:26.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-12T01:53:26.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-12T01:53:26.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-12T01:53:26.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-12T01:53:26.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-12T01:53:26.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-12T01:53:26.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-12T01:53:26.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-12T01:53:26.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-12T01:53:26.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-12T01:53:26.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-12T01:53:26.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-12T01:53:26.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-12T01:53:26.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-12T01:53:26.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-12T01:53:26.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-12T01:53:26.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-12T01:53:26.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-12T01:53:26.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-12T01:53:26.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/ 2024-09-12T01:53:26.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-12T01:53:26.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-12T01:53:26.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-12T01:53:26.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-12T01:53:26.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-12T01:53:26.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-12T01:53:26.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-12T01:53:26.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-12T01:53:26.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-12T01:53:26.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-12T01:53:26.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-12T01:53:26.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-12T01:53:26.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-12T01:53:26.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-12T01:53:26.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-12T01:53:26.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-12T01:53:26.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-12T01:53:26.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-12T01:53:26.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-12T01:53:26.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-12T01:53:26.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-12T01:53:26.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-12T01:53:26.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-12T01:53:26.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-12T01:53:26.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-12T01:53:26.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-12T01:53:26.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-12T01:53:26.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-12T01:53:26.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-12T01:53:26.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-12T01:53:26.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-12T01:53:26.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-12T01:53:26.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-12T01:53:26.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-12T01:53:26.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-12T01:53:26.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-12T01:53:26.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-12T01:53:26.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-12T01:53:26.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-12T01:53:26.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-12T01:53:26.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-12T01:53:26.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-12T01:53:26.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-12T01:53:26.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-12T01:53:26.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-12T01:53:26.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-12T01:53:26.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-12T01:53:26.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-12T01:53:26.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-12T01:53:26.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-12T01:53:26.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-12T01:53:26.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-12T01:53:26.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-12T01:53:26.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-12T01:53:26.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-12T01:53:26.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-12T01:53:26.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-12T01:53:26.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-12T01:53:26.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-12T01:53:26.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-12T01:53:26.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-12T01:53:26.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-12T01:53:26.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-12T01:53:26.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-12T01:53:26.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-12T01:53:26.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-12T01:53:26.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-12T01:53:26.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-12T01:53:26.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-12T01:53:26.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-12T01:53:26.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-12T01:53:26.852 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-12T01:53:26.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-12T01:53:26.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-12T01:53:26.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-12T01:53:26.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-12T01:53:26.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-12T01:53:26.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-12T01:53:26.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-12T01:53:26.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-12T01:53:26.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-12T01:53:26.862 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-12T01:53:26.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-12T01:53:26.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-12T01:53:26.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-12T01:53:26.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-12T01:53:26.867 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-12T01:53:26.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-12T01:53:26.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-12T01:53:26.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-12T01:53:26.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-12T01:53:26.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-12T01:53:26.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-12T01:53:26.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-12T01:53:26.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-12T01:53:26.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-12T01:53:26.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-12T01:53:26.878 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-12T01:53:26.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-12T01:53:26.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-12T01:53:26.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-12T01:53:26.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-12T01:53:26.884 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-12T01:53:26.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-12T01:53:26.886 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-12T01:53:26.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-12T01:53:26.888 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-12T01:53:26.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-12T01:53:26.890 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-12T01:53:26.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-12T01:53:26.892 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-12T01:53:26.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-12T01:53:26.894 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-12T01:53:26.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-12T01:53:26.896 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-12T01:53:26.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-12T01:53:26.898 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-12T01:53:26.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-12T01:53:26.900 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-12T01:53:26.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-12T01:53:26.902 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-12T01:53:26.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-12T01:53:26.904 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-12T01:53:26.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-12T01:53:26.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-12T01:53:26.907 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-12T01:53:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-12T01:53:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-12T01:53:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-12T01:53:26.912 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-12T01:53:26.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-12T01:53:26.914 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-12T01:53:26.914 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-12T01:53:26.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-12T01:53:26.917 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-12T01:53:26.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-12T01:53:26.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-12T01:53:26.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-12T01:53:26.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-12T01:53:26.921 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-12T01:53:26.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-12T01:53:26.923 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-12T01:53:26.924 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-12T01:53:26.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-12T01:53:26.927 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-12T01:53:26.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-12T01:53:26.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-12T01:53:26.930 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-12T01:53:26.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-12T01:53:26.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-12T01:53:26.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/ 2024-09-12T01:53:26.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-12T01:53:26.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-12T01:53:26.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-12T01:53:26.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-12T01:53:26.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-12T01:53:26.940 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-12T01:53:26.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-12T01:53:26.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-12T01:53:26.943 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-12T01:53:26.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-12T01:53:26.945 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-12T01:53:26.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-12T01:53:26.947 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-12T01:53:26.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-12T01:53:26.949 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-12T01:53:26.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-12T01:53:26.951 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-12T01:53:26.952 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-12T01:53:26.953 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-12T01:53:26.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-12T01:53:26.955 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-12T01:53:26.956 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-12T01:53:26.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-12T01:53:26.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-12T01:53:26.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-12T01:53:26.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/ 2024-09-12T01:53:26.961 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-12T01:53:26.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-12T01:53:26.963 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-12T01:53:26.964 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-12T01:53:26.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-12T01:53:26.966 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-12T01:53:26.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-12T01:53:26.968 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-12T01:53:26.969 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-12T01:53:26.970 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-12T01:53:26.971 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-12T01:53:26.972 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-12T01:53:26.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-12T01:53:26.974 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-12T01:53:26.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-12T01:53:26.976 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-12T01:53:26.977 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-12T01:53:26.978 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-12T01:53:26.979 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-12T01:53:26.980 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-12T01:53:26.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-12T01:53:26.982 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-12T01:53:26.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-12T01:53:26.984 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-12T01:53:26.985 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-12T01:53:26.986 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-12T01:53:26.987 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-12T01:53:26.988 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-12T01:53:26.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-12T01:53:26.990 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-12T01:53:26.991 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-12T01:53:26.992 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-12T01:53:26.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-12T01:53:26.994 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-12T01:53:26.995 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/ 2024-09-12T01:53:26.996 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-12T01:53:26.997 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-12T01:53:26.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-12T01:53:26.999 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-12T01:53:27.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-12T01:53:27.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-12T01:53:27.002 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-12T01:53:27.003 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-12T01:53:27.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-12T01:53:27.005 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-12T01:53:27.006 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-12T01:53:27.007 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-12T01:53:27.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-12T01:53:27.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-12T01:53:27.010 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-12T01:53:27.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-12T01:53:27.012 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-12T01:53:27.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-12T01:53:27.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-12T01:53:27.015 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-12T01:53:27.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-12T01:53:27.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-12T01:53:27.018 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-12T01:53:27.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-12T01:53:27.020 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-12T01:53:27.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-12T01:53:27.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-12T01:53:27.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-12T01:53:27.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-12T01:53:27.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-12T01:53:27.026 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-12T01:53:27.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-12T01:53:27.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-12T01:53:27.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-12T01:53:27.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-12T01:53:27.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-12T01:53:27.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-12T01:53:27.033 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-12T01:53:27.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-12T01:53:27.035 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-12T01:53:27.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-12T01:53:27.037 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-12T01:53:27.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-12T01:53:27.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-12T01:53:27.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-12T01:53:27.041 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-12T01:53:27.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-12T01:53:27.043 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-12T01:53:27.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-12T01:53:27.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-12T01:53:27.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-12T01:53:27.047 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-12T01:53:27.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-12T01:53:27.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-12T01:53:27.050 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-12T01:53:27.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-12T01:53:27.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-12T01:53:27.054 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-12T01:53:28.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:28 smithi191 ceph-mon[35770]: pgmap v376: 97 pgs: 97 active+clean; 85 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 7.1 MiB/s wr, 39 op/s 2024-09-12T01:53:29.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:28 smithi152 ceph-mon[35055]: pgmap v376: 97 pgs: 97 active+clean; 85 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 7.1 MiB/s wr, 39 op/s 2024-09-12T01:53:29.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:28 smithi070 ceph-mon[31177]: pgmap v376: 97 pgs: 97 active+clean; 85 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 7.1 MiB/s wr, 39 op/s 2024-09-12T01:53:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.614+0000 7f45eaa35640 1 -- 172.21.15.70:0/3311081074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e4101b60 msgr2=0x7f45e4101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.614+0000 7f45eaa35640 1 --2- 172.21.15.70:0/3311081074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e4101b60 0x7f45e4101f60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009900 tx=0x7f45d402a410 comp rx=0 tx=0).stop 2024-09-12T01:53:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.614+0000 7f45eaa35640 1 -- 172.21.15.70:0/3311081074 shutdown_connections 2024-09-12T01:53:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.614+0000 7f45eaa35640 1 --2- 172.21.15.70:0/3311081074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45e4103710 0x7f45e4109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.614+0000 7f45eaa35640 1 --2- 172.21.15.70:0/3311081074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45e4102d50 0x7f45e41031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.614+0000 7f45eaa35640 1 --2- 172.21.15.70:0/3311081074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e4101b60 0x7f45e4101f60 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.614+0000 7f45eaa35640 1 -- 172.21.15.70:0/3311081074 >> 172.21.15.70:0/3311081074 conn(0x7f45e40fd2e0 msgr2=0x7f45e40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.614+0000 7f45eaa35640 1 -- 172.21.15.70:0/3311081074 shutdown_connections 2024-09-12T01:53:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.614+0000 7f45eaa35640 1 -- 172.21.15.70:0/3311081074 wait complete. 2024-09-12T01:53:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.614+0000 7f45eaa35640 1 Processor -- start 2024-09-12T01:53:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.614+0000 7f45eaa35640 1 -- start start 2024-09-12T01:53:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45eaa35640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45e4101b60 0x7f45e4075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45eaa35640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e4102d50 0x7f45e40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45eaa35640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45e4103710 0x7f45e4074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45eaa35640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45e410d900 con 0x7f45e4102d50 2024-09-12T01:53:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45eaa35640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f45e410d780 con 0x7f45e4103710 2024-09-12T01:53:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45eaa35640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f45e410da80 con 0x7f45e4101b60 2024-09-12T01:53:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e4102d50 0x7f45e40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e4102d50 0x7f45e40745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43146/0 (socket says 172.21.15.70:43146) 2024-09-12T01:53:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e37fe640 1 -- 172.21.15.70:0/2528862644 learned_addr learned my addr 172.21.15.70:0/2528862644 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e3fff640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45e4101b60 0x7f45e4075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45e4103710 0x7f45e4074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e37fe640 1 -- 172.21.15.70:0/2528862644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45e4101b60 msgr2=0x7f45e4075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e37fe640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45e4101b60 0x7f45e4075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e37fe640 1 -- 172.21.15.70:0/2528862644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45e4103710 msgr2=0x7f45e4074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e37fe640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45e4103710 0x7f45e4074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e37fe640 1 -- 172.21.15.70:0/2528862644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e40753b0 con 0x7f45e4102d50 2024-09-12T01:53:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45e4103710 0x7f45e4074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e3fff640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45e4101b60 0x7f45e4075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e37fe640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e4102d50 0x7f45e40745e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f45d800d950 tx=0x7f45d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e17fa640 1 -- 172.21.15.70:0/2528862644 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d8017070 con 0x7f45e4102d50 2024-09-12T01:53:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45e17fa640 1 -- 172.21.15.70:0/2528862644 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45d8009c30 con 0x7f45e4102d50 2024-09-12T01:53:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.615+0000 7f45eaa35640 1 -- 172.21.15.70:0/2528862644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e41a1f60 con 0x7f45e4102d50 2024-09-12T01:53:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.616+0000 7f45e17fa640 1 -- 172.21.15.70:0/2528862644 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d800f740 con 0x7f45e4102d50 2024-09-12T01:53:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.616+0000 7f45eaa35640 1 -- 172.21.15.70:0/2528862644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e41a23c0 con 0x7f45e4102d50 2024-09-12T01:53:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.618+0000 7f45ed7d0740 1 Processor -- start 2024-09-12T01:53:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.618+0000 7f45ed7d0740 1 -- start start 2024-09-12T01:53:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.618+0000 7f45ed7d0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 0x5582f75a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.618+0000 7f45ed7d0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75a72e0 0x5582f75abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.618+0000 7f45ed7d0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75ac370 0x5582f75ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.618+0000 7f45ed7d0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5582f750a2f0 con 0x5582f75a72e0 2024-09-12T01:53:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.618+0000 7f45ed7d0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5582f74b2270 con 0x5582f75a69a0 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.618+0000 7f45ed7d0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5582f75062b0 con 0x5582f75ac370 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.618+0000 7f45e3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75a72e0 0x5582f75abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.618+0000 7f45e3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75a72e0 0x5582f75abda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43154/0 (socket says 172.21.15.70:43154) 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.618+0000 7f45e3fff640 1 -- 172.21.15.70:0/23734785 learned_addr learned my addr 172.21.15.70:0/23734785 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.619+0000 7f45e17fa640 1 -- 172.21.15.70:0/2528862644 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f45d8010a80 con 0x7f45e4102d50 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.619+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/23734785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 0x5582f75a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.619+0000 7f45e3fff640 1 -- 172.21.15.70:0/23734785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75ac370 msgr2=0x5582f75ae830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.619+0000 7f45e3fff640 1 --2- 172.21.15.70:0/23734785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75ac370 0x5582f75ae830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.619+0000 7f45e3fff640 1 -- 172.21.15.70:0/23734785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 msgr2=0x5582f75a6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.619+0000 7f45e3fff640 1 --2- 172.21.15.70:0/23734785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 0x5582f75a6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.619+0000 7f45e3fff640 1 -- 172.21.15.70:0/23734785 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582f74b1340 con 0x5582f75a72e0 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.619+0000 7f45e3fff640 1 --2- 172.21.15.70:0/23734785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75a72e0 0x5582f75abda0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f45d4005ab0 tx=0x7f45d4032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336df64f22d457e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.619+0000 7f45ca7fc640 1 -- 172.21.15.70:0/23734785 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d403f070 con 0x5582f75a72e0 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.619+0000 7f45ca7fc640 1 -- 172.21.15.70:0/23734785 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45d4031940 con 0x5582f75a72e0 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.619+0000 7f45ca7fc640 1 -- 172.21.15.70:0/23734785 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d4035070 con 0x5582f75a72e0 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.619+0000 7f45e17fa640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f45cc0a2c30 0x7f45cc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f45cc0a2c30 0x7f45cc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45e17fa640 1 -- 172.21.15.70:0/2528862644 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f45d80cece0 con 0x7f45e4102d50 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45ed7d0740 1 -- 172.21.15.70:0/23734785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75a72e0 msgr2=0x5582f75abda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/23734785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75a72e0 0x5582f75abda0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f45d4005ab0 tx=0x7f45d4032d00 comp rx=0 tx=0).stop 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f45cc0a2c30 0x7f45cc0a50f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f45dc005fd0 tx=0x7f45dc008470 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45ed7d0740 1 -- 172.21.15.70:0/23734785 shutdown_connections 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/23734785 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75ac370 0x5582f75ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/23734785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75a72e0 0x5582f75abda0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/23734785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 0x5582f75a6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45ed7d0740 1 -- 172.21.15.70:0/23734785 >> 172.21.15.70:0/23734785 conn(0x5582f75a2010 msgr2=0x5582f75a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45ed7d0740 1 -- 172.21.15.70:0/23734785 shutdown_connections 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45ed7d0740 1 -- 172.21.15.70:0/23734785 wait complete. 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.620+0000 7f45ed7d0740 1 -- start start 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45ed7d0740 1 Processor -- start 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45ed7d0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 0x5582f75b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45ed7d0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a72e0 0x5582f75b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45ed7d0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45ed7d0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5582f75af2e0 con 0x5582f75ac370 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45ed7d0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5582f7493290 con 0x5582f75a69a0 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45ed7d0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5582f75af460 con 0x5582f75a72e0 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45ed7d0740 10 client.0 _ll_register_callbacks cb 0x5582f74c4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45e8fd2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45e8fd2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75b80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43158/0 (socket says 172.21.15.70:43158) 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45e8fd2640 1 -- 172.21.15.70:0/3518476669 learned_addr learned my addr 172.21.15.70:0/3518476669 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45e3fff640 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 0x5582f75b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45e37fe640 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a72e0 0x5582f75b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45e8fd2640 1 -- 172.21.15.70:0/3518476669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a72e0 msgr2=0x5582f75b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a72e0 0x5582f75b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45e8fd2640 1 -- 172.21.15.70:0/3518476669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 msgr2=0x5582f75b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 0x5582f75b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45e8fd2640 1 -- 172.21.15.70:0/3518476669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582f721d210 con 0x5582f75ac370 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45e37fe640 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a72e0 0x5582f75b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75b80e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f45dc010e30 tx=0x7f45dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c876603c8595123 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.621+0000 7f45c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45c37fe640 1 -- 172.21.15.70:0/3518476669 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc010e60 con 0x5582f75ac370 2024-09-12T01:53:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45c37fe640 1 -- 172.21.15.70:0/3518476669 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f45dc01d620 con 0x5582f75ac370 2024-09-12T01:53:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45ed7d0740 1 -- 172.21.15.70:0/3518476669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45d4031940 con 0x5582f75ac370 2024-09-12T01:53:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45c37fe640 1 -- 172.21.15.70:0/3518476669 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f45dc01d820 con 0x5582f75ac370 2024-09-12T01:53:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45ed7d0740 10 client.16059 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45ed7d0740 1 -- 172.21.15.70:0/3518476669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5582f72e9620 con 0x5582f75ac370 2024-09-12T01:53:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45c37fe640 1 -- 172.21.15.70:0/3518476669 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45d4031940 con 0x5582f75ac370 2024-09-12T01:53:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45c37fe640 1 -- 172.21.15.70:0/3518476669 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f45dc01bc70 con 0x5582f75ac370 2024-09-12T01:53:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45ed7d0740 10 client.16059 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45ed7d0740 10 client.16059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45ed7d0740 20 client.16059 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5582f75bc830 0x5582f75beca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45ed7d0740 4 client.16059 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.622+0000 7f45ed7d0740 1 -- 172.21.15.70:0/3518476669 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582f7517a20 con 0x5582f75bc830 2024-09-12T01:53:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.623+0000 7f45e3fff640 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5582f75bc830 0x5582f75beca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.623+0000 7f45c37fe640 10 client.16059 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.623+0000 7f45e3fff640 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5582f75bc830 0x5582f75beca0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3d1b98f8cb0def server_cookie=f68b3de084ed936c in_seq=0 out_seq=0 2024-09-12T01:53:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45c37fe640 1 -- 172.21.15.70:0/3518476669 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582f7517a20 con 0x5582f75bc830 2024-09-12T01:53:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45c37fe640 10 client.16059 handle_command_reply: tid=0 2024-09-12T01:53:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45ed7d0740 1 client.16059 shutdown 2024-09-12T01:53:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45ed7d0740 1 -- 172.21.15.70:0/3518476669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 msgr2=0x5582f75b80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75b80e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f45dc010e30 tx=0x7f45dc004a40 comp rx=0 tx=0).stop 2024-09-12T01:53:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45ed7d0740 1 -- 172.21.15.70:0/3518476669 shutdown_connections 2024-09-12T01:53:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5582f75bc830 0x5582f75beca0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75b80e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45c37fe640 0 client.16059 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a72e0 0x5582f75b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/3518476669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 0x5582f75b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45ed7d0740 1 -- 172.21.15.70:0/3518476669 >> 172.21.15.70:0/3518476669 conn(0x5582f75a2010 msgr2=0x5582f75a3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45ed7d0740 1 -- 172.21.15.70:0/3518476669 shutdown_connections 2024-09-12T01:53:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45ed7d0740 1 -- 172.21.15.70:0/3518476669 wait complete. 2024-09-12T01:53:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.624+0000 7f45ed7d0740 20 client.16059 trim_cache size 0 max 16384 2024-09-12T01:53:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.638+0000 7f45ed7d0740 1 Processor -- start 2024-09-12T01:53:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.638+0000 7f45ed7d0740 1 -- start start 2024-09-12T01:53:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.638+0000 7f45ed7d0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a69a0 0x5582f75a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.638+0000 7f45ed7d0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a72e0 0x5582f75b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45ed7d0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45ed7d0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41ab320 con 0x5582f75ac370 2024-09-12T01:53:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45ed7d0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41ace60 con 0x5582f75a72e0 2024-09-12T01:53:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45ed7d0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41ab9f0 con 0x5582f75a69a0 2024-09-12T01:53:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45e8fd2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45e8fd2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75c35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43168/0 (socket says 172.21.15.70:43168) 2024-09-12T01:53:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45e8fd2640 1 -- 172.21.15.70:0/2202818124 learned_addr learned my addr 172.21.15.70:0/2202818124 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45e37fe640 1 --2- 172.21.15.70:0/2202818124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a72e0 0x5582f75b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45e3fff640 1 --2- 172.21.15.70:0/2202818124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a69a0 0x5582f75a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45e8fd2640 1 -- 172.21.15.70:0/2202818124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a69a0 msgr2=0x5582f75a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/2202818124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a69a0 0x5582f75a10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45e8fd2640 1 -- 172.21.15.70:0/2202818124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a72e0 msgr2=0x5582f75b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/2202818124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a72e0 0x5582f75b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45e8fd2640 1 -- 172.21.15.70:0/2202818124 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582f75a77c0 con 0x5582f75ac370 2024-09-12T01:53:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45e37fe640 1 --2- 172.21.15.70:0/2202818124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a72e0 0x5582f75b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/2202818124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75c35a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f45dc000f80 tx=0x7f45dc005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c148796ff51c4b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45c9ffb640 1 -- 172.21.15.70:0/2202818124 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00dc10 con 0x5582f75ac370 2024-09-12T01:53:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45c9ffb640 1 -- 172.21.15.70:0/2202818124 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45dc01d420 con 0x5582f75ac370 2024-09-12T01:53:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.639+0000 7f45c9ffb640 1 -- 172.21.15.70:0/2202818124 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc03a420 con 0x5582f75ac370 2024-09-12T01:53:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.640+0000 7f45ed7d0740 1 -- 172.21.15.70:0/2202818124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 msgr2=0x5582f75c35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.640+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/2202818124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75c35a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f45dc000f80 tx=0x7f45dc005ac0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.640+0000 7f45ed7d0740 1 -- 172.21.15.70:0/2202818124 shutdown_connections 2024-09-12T01:53:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.640+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/2202818124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75c35a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.640+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/2202818124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a72e0 0x5582f75b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.640+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/2202818124 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a69a0 0x5582f75a10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.640+0000 7f45ed7d0740 1 -- 172.21.15.70:0/2202818124 >> 172.21.15.70:0/2202818124 conn(0x5582f75a2010 msgr2=0x5582f75a09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.640+0000 7f45ed7d0740 1 -- 172.21.15.70:0/2202818124 shutdown_connections 2024-09-12T01:53:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.640+0000 7f45ed7d0740 1 -- 172.21.15.70:0/2202818124 wait complete. 2024-09-12T01:53:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.640+0000 7f45ed7d0740 1 -- start start 2024-09-12T01:53:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45ed7d0740 1 Processor -- start 2024-09-12T01:53:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45ed7d0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 0x5582f75b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45ed7d0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a72e0 0x5582f75b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45ed7d0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45ed7d0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41ac790 con 0x5582f75ac370 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45ed7d0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41ac0c0 con 0x5582f75a69a0 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45ed7d0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41a92e0 con 0x5582f75a72e0 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45ed7d0740 10 client.0 _ll_register_callbacks cb 0x7f45dc00ff50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45e8fd2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45e8fd2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75b70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43176/0 (socket says 172.21.15.70:43176) 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45e8fd2640 1 -- 172.21.15.70:0/118675726 learned_addr learned my addr 172.21.15.70:0/118675726 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45e3fff640 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 0x5582f75b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45e37fe640 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a72e0 0x5582f75b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45e8fd2640 1 -- 172.21.15.70:0/118675726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a72e0 msgr2=0x5582f75b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a72e0 0x5582f75b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.646 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45e8fd2640 1 -- 172.21.15.70:0/118675726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 msgr2=0x5582f75b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 0x5582f75b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45e8fd2640 1 -- 172.21.15.70:0/118675726 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582f75b76b0 con 0x5582f75ac370 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45e37fe640 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a72e0 0x5582f75b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45e8fd2640 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75b70a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f45dc01c570 tx=0x7f45dc01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db3149fd952886d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.641+0000 7f45c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45c37fe640 1 -- 172.21.15.70:0/118675726 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc03e020 con 0x5582f75ac370 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45c37fe640 1 -- 172.21.15.70:0/118675726 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f45dc01dbd0 con 0x5582f75ac370 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45ed7d0740 1 -- 172.21.15.70:0/118675726 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45dc01d420 con 0x5582f75ac370 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45c37fe640 1 -- 172.21.15.70:0/118675726 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f45dc01de10 con 0x5582f75ac370 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45ed7d0740 10 client.16065 fetch_fsmap learned FSMap version 28 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45ed7d0740 1 -- 172.21.15.70:0/118675726 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5582f76277c0 con 0x5582f75ac370 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45c37fe640 1 -- 172.21.15.70:0/118675726 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45dc01d420 con 0x5582f75ac370 2024-09-12T01:53:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45c37fe640 1 -- 172.21.15.70:0/118675726 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f45dc03a730 con 0x5582f75ac370 2024-09-12T01:53:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45ed7d0740 10 client.16065 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T01:53:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45ed7d0740 10 client.16065 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45ed7d0740 20 client.16065 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5582f7628050 0x5582f762a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45ed7d0740 4 client.16065 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:53:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.642+0000 7f45ed7d0740 1 -- 172.21.15.70:0/118675726 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5582f7511d70 con 0x5582f7628050 2024-09-12T01:53:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.643+0000 7f45e3fff640 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5582f7628050 0x5582f762a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.643+0000 7f45e3fff640 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5582f7628050 0x5582f762a470 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4510f6dfa567589 server_cookie=8352365f0798a6b5 in_seq=0 out_seq=0 2024-09-12T01:53:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:30.643+0000 7f45c37fe640 10 client.16065 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:30.941 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:30 smithi191 ceph-mon[35770]: pgmap v377: 97 pgs: 97 active+clean; 86 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 7.2 MiB/s wr, 39 op/s 2024-09-12T01:53:31.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:30 smithi152 ceph-mon[35055]: pgmap v377: 97 pgs: 97 active+clean; 86 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 7.2 MiB/s wr, 39 op/s 2024-09-12T01:53:31.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:30 smithi070 ceph-mon[31177]: pgmap v377: 97 pgs: 97 active+clean; 86 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 7.2 MiB/s wr, 39 op/s 2024-09-12T01:53:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.296+0000 7f45c37fe640 1 -- 172.21.15.70:0/118675726 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5582f7511d70 con 0x5582f7628050 2024-09-12T01:53:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.296+0000 7f45c37fe640 10 client.16065 handle_command_reply: tid=0 2024-09-12T01:53:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.296+0000 7f45ed7d0740 1 client.16065 shutdown 2024-09-12T01:53:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.296+0000 7f45ed7d0740 1 -- 172.21.15.70:0/118675726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 msgr2=0x5582f75b70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.296+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75b70a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f45dc01c570 tx=0x7f45dc01c8a0 comp rx=0 tx=0).stop 2024-09-12T01:53:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.296+0000 7f45ed7d0740 1 -- 172.21.15.70:0/118675726 shutdown_connections 2024-09-12T01:53:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.296+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5582f7628050 0x5582f762a470 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.296+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5582f75ac370 0x5582f75b70a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.296+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5582f75a72e0 0x5582f75b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.296+0000 7f45ed7d0740 1 --2- 172.21.15.70:0/118675726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5582f75a69a0 0x5582f75b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.296+0000 7f45ed7d0740 1 -- 172.21.15.70:0/118675726 >> 172.21.15.70:0/118675726 conn(0x5582f75a2010 msgr2=0x5582f75a2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.296+0000 7f45c37fe640 0 client.16065 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.297+0000 7f45ed7d0740 1 -- 172.21.15.70:0/118675726 shutdown_connections 2024-09-12T01:53:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.297+0000 7f45ed7d0740 1 -- 172.21.15.70:0/118675726 wait complete. 2024-09-12T01:53:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.297+0000 7f45ed7d0740 20 client.16065 trim_cache size 0 max 16384 2024-09-12T01:53:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:53:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:53:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:53:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:53:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.297+0000 7f45eaa35640 1 -- 172.21.15.70:0/2528862644 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f45cc0a2c30 msgr2=0x7f45cc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.297+0000 7f45eaa35640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f45cc0a2c30 0x7f45cc0a50f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f45dc005fd0 tx=0x7f45dc008470 comp rx=0 tx=0).stop 2024-09-12T01:53:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.297+0000 7f45eaa35640 1 -- 172.21.15.70:0/2528862644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e4102d50 msgr2=0x7f45e40745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.297+0000 7f45eaa35640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e4102d50 0x7f45e40745e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f45d800d950 tx=0x7f45d800de10 comp rx=0 tx=0).stop 2024-09-12T01:53:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.297+0000 7f45eaa35640 1 -- 172.21.15.70:0/2528862644 shutdown_connections 2024-09-12T01:53:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.297+0000 7f45eaa35640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f45cc0a2c30 0x7f45cc0a50f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.297+0000 7f45eaa35640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45e4103710 0x7f45e4074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.297+0000 7f45eaa35640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e4102d50 0x7f45e40745e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.297+0000 7f45eaa35640 1 --2- 172.21.15.70:0/2528862644 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45e4101b60 0x7f45e4075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.298+0000 7f45eaa35640 1 -- 172.21.15.70:0/2528862644 >> 172.21.15.70:0/2528862644 conn(0x7f45e40fd2e0 msgr2=0x7f45e4106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.298+0000 7f45eaa35640 1 -- 172.21.15.70:0/2528862644 shutdown_connections 2024-09-12T01:53:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:31.298+0000 7f45eaa35640 1 -- 172.21.15.70:0/2528862644 wait complete. 2024-09-12T01:53:31.955 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar cf doc.tar linux-4.0.5 2024-09-12T01:53:32.902 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar xf doc.tar 2024-09-12T01:53:32.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:32 smithi191 ceph-mon[35770]: pgmap v378: 97 pgs: 97 active+clean; 88 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 7.4 MiB/s wr, 42 op/s 2024-09-12T01:53:33.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:32 smithi152 ceph-mon[35055]: pgmap v378: 97 pgs: 97 active+clean; 88 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 7.4 MiB/s wr, 42 op/s 2024-09-12T01:53:33.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:32 smithi070 ceph-mon[31177]: pgmap v378: 97 pgs: 97 active+clean; 88 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 7.4 MiB/s wr, 42 op/s 2024-09-12T01:53:34.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:34 smithi191 ceph-mon[35770]: pgmap v379: 97 pgs: 97 active+clean; 88 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 6.1 MiB/s wr, 322 op/s 2024-09-12T01:53:35.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:34 smithi152 ceph-mon[35055]: pgmap v379: 97 pgs: 97 active+clean; 88 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 6.1 MiB/s wr, 322 op/s 2024-09-12T01:53:35.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:34 smithi070 ceph-mon[31177]: pgmap v379: 97 pgs: 97 active+clean; 88 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 6.1 MiB/s wr, 322 op/s 2024-09-12T01:53:36.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:36 smithi191 ceph-mon[35770]: pgmap v380: 97 pgs: 97 active+clean; 85 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 4.3 MiB/s wr, 676 op/s 2024-09-12T01:53:37.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:36 smithi152 ceph-mon[35055]: pgmap v380: 97 pgs: 97 active+clean; 85 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 4.3 MiB/s wr, 676 op/s 2024-09-12T01:53:37.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:36 smithi070 ceph-mon[31177]: pgmap v380: 97 pgs: 97 active+clean; 85 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 4.3 MiB/s wr, 676 op/s 2024-09-12T01:53:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:38 smithi191 ceph-mon[35770]: pgmap v381: 97 pgs: 97 active+clean; 85 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.2 MiB/s wr, 784 op/s 2024-09-12T01:53:39.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:38 smithi152 ceph-mon[35055]: pgmap v381: 97 pgs: 97 active+clean; 85 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.2 MiB/s wr, 784 op/s 2024-09-12T01:53:39.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:38 smithi070 ceph-mon[31177]: pgmap v381: 97 pgs: 97 active+clean; 85 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.2 MiB/s wr, 784 op/s 2024-09-12T01:53:40.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:40 smithi191 ceph-mon[35770]: pgmap v382: 97 pgs: 97 active+clean; 88 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 1.1 MiB/s wr, 780 op/s 2024-09-12T01:53:41.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:40 smithi152 ceph-mon[35055]: pgmap v382: 97 pgs: 97 active+clean; 88 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 1.1 MiB/s wr, 780 op/s 2024-09-12T01:53:41.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:40 smithi070 ceph-mon[31177]: pgmap v382: 97 pgs: 97 active+clean; 88 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 1.1 MiB/s wr, 780 op/s 2024-09-12T01:53:42.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:42 smithi191 ceph-mon[35770]: pgmap v383: 97 pgs: 97 active+clean; 92 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 780 op/s 2024-09-12T01:53:43.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:42 smithi152 ceph-mon[35055]: pgmap v383: 97 pgs: 97 active+clean; 92 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 780 op/s 2024-09-12T01:53:43.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:42 smithi070 ceph-mon[31177]: pgmap v383: 97 pgs: 97 active+clean; 92 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 780 op/s 2024-09-12T01:53:44.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.387+0000 7f49be559640 1 -- 172.21.15.70:0/1732751992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b8100d10 msgr2=0x7f49b8101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:44.389 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.387+0000 7f49be559640 1 --2- 172.21.15.70:0/1732751992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b8100d10 0x7f49b8101190 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009900 tx=0x7f49ac02a410 comp rx=0 tx=0).stop 2024-09-12T01:53:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.387+0000 7f49be559640 1 -- 172.21.15.70:0/1732751992 shutdown_connections 2024-09-12T01:53:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.387+0000 7f49be559640 1 --2- 172.21.15.70:0/1732751992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49b81016d0 0x7f49b8108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.387+0000 7f49be559640 1 --2- 172.21.15.70:0/1732751992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b8100d10 0x7f49b8101190 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.387+0000 7f49be559640 1 --2- 172.21.15.70:0/1732751992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b8101fe0 0x7f49b81023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.387+0000 7f49be559640 1 -- 172.21.15.70:0/1732751992 >> 172.21.15.70:0/1732751992 conn(0x7f49b80fb930 msgr2=0x7f49b80fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.387+0000 7f49be559640 1 -- 172.21.15.70:0/1732751992 shutdown_connections 2024-09-12T01:53:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.387+0000 7f49be559640 1 -- 172.21.15.70:0/1732751992 wait complete. 2024-09-12T01:53:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49be559640 1 Processor -- start 2024-09-12T01:53:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49be559640 1 -- start start 2024-09-12T01:53:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49be559640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b8100d10 0x7f49b810b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49be559640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49b81016d0 0x7f49b8109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49be559640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b8101fe0 0x7f49b8109f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49be559640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49b810d940 con 0x7f49b8100d10 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49be559640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f49b810d7c0 con 0x7f49b8101fe0 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49be559640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f49b810dac0 con 0x7f49b81016d0 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b8100d10 0x7f49b810b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b8100d10 0x7f49b810b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40254/0 (socket says 172.21.15.70:40254) 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49b7fff640 1 -- 172.21.15.70:0/808262271 learned_addr learned my addr 172.21.15.70:0/808262271 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49b77fe640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49b81016d0 0x7f49b8109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49bcaf6640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b8101fe0 0x7f49b8109f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49b7fff640 1 -- 172.21.15.70:0/808262271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49b81016d0 msgr2=0x7f49b8109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49b7fff640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49b81016d0 0x7f49b8109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.388+0000 7f49b7fff640 1 -- 172.21.15.70:0/808262271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b8101fe0 msgr2=0x7f49b8109f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.389+0000 7f49b7fff640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b8101fe0 0x7f49b8109f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.389+0000 7f49b7fff640 1 -- 172.21.15.70:0/808262271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b810a7f0 con 0x7f49b8100d10 2024-09-12T01:53:44.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.389+0000 7f49bcaf6640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b8101fe0 0x7f49b8109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:44.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.389+0000 7f49b7fff640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b8100d10 0x7f49b810b3e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f49a800e9c0 tx=0x7f49a800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:44.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.389+0000 7f49b57fa640 1 -- 172.21.15.70:0/808262271 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a800cd80 con 0x7f49b8100d10 2024-09-12T01:53:44.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.389+0000 7f49b57fa640 1 -- 172.21.15.70:0/808262271 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f49a80035f0 con 0x7f49b8100d10 2024-09-12T01:53:44.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.389+0000 7f49be559640 1 -- 172.21.15.70:0/808262271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b81a1fb0 con 0x7f49b8100d10 2024-09-12T01:53:44.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.389+0000 7f49b57fa640 1 -- 172.21.15.70:0/808262271 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8010690 con 0x7f49b8100d10 2024-09-12T01:53:44.392 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.389+0000 7f49be559640 1 -- 172.21.15.70:0/808262271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b81a23b0 con 0x7f49b8100d10 2024-09-12T01:53:44.398 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.391+0000 7f49b57fa640 1 -- 172.21.15.70:0/808262271 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f49a80037a0 con 0x7f49b8100d10 2024-09-12T01:53:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49c13d0740 1 Processor -- start 2024-09-12T01:53:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49c13d0740 1 -- start start 2024-09-12T01:53:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49c13d0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ed9a0 0x5583ee6edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49c13d0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6ee2e0 0x5583ee6f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49c13d0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6f3370 0x5583ee6f5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49c13d0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583ee6512f0 con 0x5583ee6f3370 2024-09-12T01:53:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49c13d0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5583ee5f9270 con 0x5583ee6ed9a0 2024-09-12T01:53:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49c13d0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5583ee64d2b0 con 0x5583ee6ee2e0 2024-09-12T01:53:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49b77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6f3370 0x5583ee6f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49bcaf6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ed9a0 0x5583ee6edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49b7fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6ee2e0 0x5583ee6f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49bcaf6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ed9a0 0x5583ee6edda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:48718/0 (socket says 172.21.15.70:48718) 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49b57fa640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f49a00a2c30 0x7f49a00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49bcaf6640 1 -- 172.21.15.70:0/1160329172 learned_addr learned my addr 172.21.15.70:0/1160329172 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.392+0000 7f49bcaf6640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f49a00a2c30 0x7f49a00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.393+0000 7f49bcaf6640 1 -- 172.21.15.70:0/1160329172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6ee2e0 msgr2=0x5583ee6f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.393+0000 7f49bcaf6640 1 --2- 172.21.15.70:0/1160329172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6ee2e0 0x5583ee6f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.393+0000 7f49bcaf6640 1 -- 172.21.15.70:0/1160329172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6f3370 msgr2=0x5583ee6f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.393+0000 7f49bcaf6640 1 --2- 172.21.15.70:0/1160329172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6f3370 0x5583ee6f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.393+0000 7f49b57fa640 1 -- 172.21.15.70:0/808262271 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f49a80cf570 con 0x7f49b8100d10 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.393+0000 7f49bcaf6640 1 -- 172.21.15.70:0/1160329172 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583ee5f8340 con 0x5583ee6ed9a0 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.393+0000 7f49bcaf6640 1 --2- 172.21.15.70:0/1160329172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ed9a0 0x5583ee6edda0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49b0013a60 tx=0x7f49b0013f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a650d9d372d8e96d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.393+0000 7f49bcaf6640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f49a00a2c30 0x7f49a00a50f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f49b001b000 tx=0x7f49b001e000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.393+0000 7f499e7fc640 1 -- 172.21.15.70:0/1160329172 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b000dbb0 con 0x5583ee6ed9a0 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.393+0000 7f499e7fc640 1 -- 172.21.15.70:0/1160329172 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f49b000dd50 con 0x5583ee6ed9a0 2024-09-12T01:53:44.400 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.393+0000 7f499e7fc640 1 -- 172.21.15.70:0/1160329172 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b001fd30 con 0x5583ee6ed9a0 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.394+0000 7f49c13d0740 1 -- 172.21.15.70:0/1160329172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ed9a0 msgr2=0x5583ee6edda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.394+0000 7f49c13d0740 1 --2- 172.21.15.70:0/1160329172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ed9a0 0x5583ee6edda0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49b0013a60 tx=0x7f49b0013f20 comp rx=0 tx=0).stop 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.394+0000 7f49c13d0740 1 -- 172.21.15.70:0/1160329172 shutdown_connections 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.394+0000 7f49c13d0740 1 --2- 172.21.15.70:0/1160329172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6f3370 0x5583ee6f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.394+0000 7f49c13d0740 1 --2- 172.21.15.70:0/1160329172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6ee2e0 0x5583ee6f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.394+0000 7f49c13d0740 1 --2- 172.21.15.70:0/1160329172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ed9a0 0x5583ee6edda0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.394+0000 7f49c13d0740 1 -- 172.21.15.70:0/1160329172 >> 172.21.15.70:0/1160329172 conn(0x5583ee6e9010 msgr2=0x5583ee6e9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.394+0000 7f49c13d0740 1 -- 172.21.15.70:0/1160329172 shutdown_connections 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.394+0000 7f49c13d0740 1 -- 172.21.15.70:0/1160329172 wait complete. 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.394+0000 7f49c13d0740 1 -- start start 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49c13d0740 1 Processor -- start 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49c13d0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 0x5583ee6f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.401 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49c13d0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6ee2e0 0x5583ee6f8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49c13d0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6f3370 0x5583ee6ff1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49c13d0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583ee6f62e0 con 0x5583ee6ed9a0 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49c13d0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5583ee5da290 con 0x5583ee6f3370 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49c13d0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5583ee6f6460 con 0x5583ee6ee2e0 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49c13d0740 10 client.0 _ll_register_callbacks cb 0x5583ee60b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 0x5583ee6f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 0x5583ee6f7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40274/0 (socket says 172.21.15.70:40274) 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49b7fff640 1 -- 172.21.15.70:0/273841460 learned_addr learned my addr 172.21.15.70:0/273841460 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49b77fe640 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6ee2e0 0x5583ee6f8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49bcaf6640 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6f3370 0x5583ee6ff1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49b7fff640 1 -- 172.21.15.70:0/273841460 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6ee2e0 msgr2=0x5583ee6f8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49b7fff640 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6ee2e0 0x5583ee6f8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49b7fff640 1 -- 172.21.15.70:0/273841460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6f3370 msgr2=0x5583ee6ff1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49b7fff640 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6f3370 0x5583ee6ff1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49b7fff640 1 -- 172.21.15.70:0/273841460 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583ee364210 con 0x5583ee6ed9a0 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49b7fff640 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 0x5583ee6f7c50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f49a80058c0 tx=0x7f49a8097a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3879a4c4950375 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49977fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49977fe640 1 -- 172.21.15.70:0/273841460 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8003bc0 con 0x5583ee6ed9a0 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49977fe640 1 -- 172.21.15.70:0/273841460 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f49a80a45b0 con 0x5583ee6ed9a0 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.395+0000 7f49c13d0740 1 -- 172.21.15.70:0/273841460 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49b000dd50 con 0x5583ee6ed9a0 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.396+0000 7f49977fe640 1 -- 172.21.15.70:0/273841460 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f49a809c4d0 con 0x5583ee6ed9a0 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.396+0000 7f49c13d0740 10 client.16077 fetch_fsmap learned FSMap version 29 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.396+0000 7f49c13d0740 1 -- 172.21.15.70:0/273841460 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5583ee430620 con 0x5583ee6ed9a0 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.396+0000 7f49977fe640 1 -- 172.21.15.70:0/273841460 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f49b000dd50 con 0x5583ee6ed9a0 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.396+0000 7f49977fe640 1 -- 172.21.15.70:0/273841460 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f49a80b1020 con 0x5583ee6ed9a0 2024-09-12T01:53:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.396+0000 7f49c13d0740 10 client.16077 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.396+0000 7f49c13d0740 10 client.16077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.396+0000 7f49c13d0740 20 client.16077 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.396+0000 7f49c13d0740 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5583ee7038c0 0x5583ee705d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.396+0000 7f49c13d0740 4 client.16077 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.396+0000 7f49c13d0740 1 -- 172.21.15.70:0/273841460 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583ee65ea20 con 0x5583ee7038c0 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.396+0000 7f49b77fe640 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5583ee7038c0 0x5583ee705d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.397+0000 7f49b77fe640 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5583ee7038c0 0x5583ee705d10 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ba53b62cb279419 server_cookie=c0dde121ca5a8e81 in_seq=0 out_seq=0 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.397+0000 7f49977fe640 10 client.16077 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.397+0000 7f49977fe640 1 -- 172.21.15.70:0/273841460 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583ee65ea20 con 0x5583ee7038c0 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.397+0000 7f49977fe640 10 client.16077 handle_command_reply: tid=0 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.397+0000 7f49c13d0740 1 client.16077 shutdown 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.397+0000 7f49c13d0740 1 -- 172.21.15.70:0/273841460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 msgr2=0x5583ee6f7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:44.404 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.397+0000 7f49c13d0740 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 0x5583ee6f7c50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f49a80058c0 tx=0x7f49a8097a10 comp rx=0 tx=0).stop 2024-09-12T01:53:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.397+0000 7f49c13d0740 1 -- 172.21.15.70:0/273841460 shutdown_connections 2024-09-12T01:53:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.398+0000 7f49c13d0740 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5583ee7038c0 0x5583ee705d10 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.398+0000 7f49c13d0740 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6f3370 0x5583ee6ff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.398+0000 7f49c13d0740 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6ee2e0 0x5583ee6f8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.398+0000 7f49977fe640 0 client.16077 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.398+0000 7f49c13d0740 1 --2- 172.21.15.70:0/273841460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 0x5583ee6f7c50 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.398+0000 7f49c13d0740 1 -- 172.21.15.70:0/273841460 >> 172.21.15.70:0/273841460 conn(0x5583ee6e9010 msgr2=0x5583ee6ea820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.398+0000 7f49c13d0740 1 -- 172.21.15.70:0/273841460 shutdown_connections 2024-09-12T01:53:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.398+0000 7f49c13d0740 1 -- 172.21.15.70:0/273841460 wait complete. 2024-09-12T01:53:44.405 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.398+0000 7f49c13d0740 20 client.16077 trim_cache size 0 max 16384 2024-09-12T01:53:44.417 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.412+0000 7f49c13d0740 1 Processor -- start 2024-09-12T01:53:44.417 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.412+0000 7f49c13d0740 1 -- start start 2024-09-12T01:53:44.417 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.412+0000 7f49c13d0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ed9a0 0x5583ee6f8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.417 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.412+0000 7f49c13d0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ee2e0 0x5583ee6ff190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.412+0000 7f49c13d0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6f3370 0x5583ee6ea400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.412+0000 7f49c13d0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49b81ab380 con 0x5583ee6ee2e0 2024-09-12T01:53:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.412+0000 7f49c13d0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f49b81acef0 con 0x5583ee6ed9a0 2024-09-12T01:53:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.412+0000 7f49c13d0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f49b81aba50 con 0x5583ee6f3370 2024-09-12T01:53:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.412+0000 7f49b77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ee2e0 0x5583ee6ff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.412+0000 7f49b77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ee2e0 0x5583ee6ff190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40280/0 (socket says 172.21.15.70:40280) 2024-09-12T01:53:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.412+0000 7f49b77fe640 1 -- 172.21.15.70:0/2223040282 learned_addr learned my addr 172.21.15.70:0/2223040282 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.412+0000 7f49bcaf6640 1 --2- 172.21.15.70:0/2223040282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6f3370 0x5583ee6ea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.413+0000 7f49b7fff640 1 --2- 172.21.15.70:0/2223040282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ed9a0 0x5583ee6f8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.413+0000 7f49b77fe640 1 -- 172.21.15.70:0/2223040282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6f3370 msgr2=0x5583ee6ea400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.413+0000 7f49b77fe640 1 --2- 172.21.15.70:0/2223040282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6f3370 0x5583ee6ea400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.413+0000 7f49b77fe640 1 -- 172.21.15.70:0/2223040282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ed9a0 msgr2=0x5583ee6f8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.413+0000 7f49b77fe640 1 --2- 172.21.15.70:0/2223040282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ed9a0 0x5583ee6f8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.413+0000 7f49b77fe640 1 -- 172.21.15.70:0/2223040282 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583ee6e8e30 con 0x5583ee6ee2e0 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.413+0000 7f49b77fe640 1 --2- 172.21.15.70:0/2223040282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ee2e0 0x5583ee6ff190 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009900 tx=0x7f49ac005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457077fe1feaf73f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.413+0000 7f499dffb640 1 -- 172.21.15.70:0/2223040282 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac04a070 con 0x5583ee6ee2e0 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.413+0000 7f499dffb640 1 -- 172.21.15.70:0/2223040282 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f49ac005050 con 0x5583ee6ee2e0 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.413+0000 7f499dffb640 1 -- 172.21.15.70:0/2223040282 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac035040 con 0x5583ee6ee2e0 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.414+0000 7f49c13d0740 1 -- 172.21.15.70:0/2223040282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ee2e0 msgr2=0x5583ee6ff190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.414+0000 7f49c13d0740 1 --2- 172.21.15.70:0/2223040282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ee2e0 0x5583ee6ff190 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009900 tx=0x7f49ac005a20 comp rx=0 tx=0).stop 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.414+0000 7f49c13d0740 1 -- 172.21.15.70:0/2223040282 shutdown_connections 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.414+0000 7f49c13d0740 1 --2- 172.21.15.70:0/2223040282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6f3370 0x5583ee6ea400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.414+0000 7f49c13d0740 1 --2- 172.21.15.70:0/2223040282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ee2e0 0x5583ee6ff190 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.414+0000 7f49c13d0740 1 --2- 172.21.15.70:0/2223040282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ed9a0 0x5583ee6f8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.414+0000 7f49c13d0740 1 -- 172.21.15.70:0/2223040282 >> 172.21.15.70:0/2223040282 conn(0x5583ee6e9010 msgr2=0x5583ee6e81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.414+0000 7f49c13d0740 1 -- 172.21.15.70:0/2223040282 shutdown_connections 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.414+0000 7f49c13d0740 1 -- 172.21.15.70:0/2223040282 wait complete. 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.414+0000 7f49c13d0740 1 -- start start 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.414+0000 7f49c13d0740 1 Processor -- start 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49c13d0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 0x5583ee6fc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49c13d0740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ee2e0 0x5583ee6fcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49c13d0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6f3370 0x5583ee6fdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49c13d0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49b81ac7f0 con 0x5583ee6ed9a0 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49c13d0740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f49b81ac120 con 0x5583ee6ee2e0 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49c13d0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f49b81a9340 con 0x5583ee6f3370 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49c13d0740 10 client.0 _ll_register_callbacks cb 0x7f49a8003db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 0x5583ee6fc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 0x5583ee6fc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40284/0 (socket says 172.21.15.70:40284) 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49b7fff640 1 -- 172.21.15.70:0/427494613 learned_addr learned my addr 172.21.15.70:0/427494613 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49bcaf6640 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6f3370 0x5583ee6fdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49b77fe640 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ee2e0 0x5583ee6fcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49b7fff640 1 -- 172.21.15.70:0/427494613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6f3370 msgr2=0x5583ee6fdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49b7fff640 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6f3370 0x5583ee6fdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49b7fff640 1 -- 172.21.15.70:0/427494613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ee2e0 msgr2=0x5583ee6fcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49b7fff640 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ee2e0 0x5583ee6fcf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49b7fff640 1 -- 172.21.15.70:0/427494613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583ee6fe550 con 0x5583ee6ed9a0 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49b77fe640 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ee2e0 0x5583ee6fcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49bcaf6640 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6f3370 0x5583ee6fdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49b7fff640 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 0x5583ee6fc9f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f49a8098750 tx=0x7f49a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2464d5861ea1dac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49977fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49977fe640 1 -- 172.21.15.70:0/427494613 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a80aa020 con 0x5583ee6ed9a0 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49977fe640 1 -- 172.21.15.70:0/427494613 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f49a8097b20 con 0x5583ee6ed9a0 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49c13d0740 1 -- 172.21.15.70:0/427494613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49ac005050 con 0x5583ee6ed9a0 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49977fe640 1 -- 172.21.15.70:0/427494613 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f49a8003bc0 con 0x5583ee6ed9a0 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49c13d0740 10 client.16083 fetch_fsmap learned FSMap version 29 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.415+0000 7f49c13d0740 1 -- 172.21.15.70:0/427494613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5583ee76e7a0 con 0x5583ee6ed9a0 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.416+0000 7f49977fe640 1 -- 172.21.15.70:0/427494613 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f49ac005050 con 0x5583ee6ed9a0 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.416+0000 7f49977fe640 1 -- 172.21.15.70:0/427494613 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f49a80b1070 con 0x5583ee6ed9a0 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.416+0000 7f49c13d0740 10 client.16083 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.416+0000 7f49c13d0740 10 client.16083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.416+0000 7f49c13d0740 20 client.16083 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.416+0000 7f49c13d0740 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5583ee76ee70 0x5583ee771290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.416+0000 7f49c13d0740 4 client.16083 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:53:44.422 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.416+0000 7f49c13d0740 1 -- 172.21.15.70:0/427494613 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5583ee658d70 con 0x5583ee76ee70 2024-09-12T01:53:44.423 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.416+0000 7f49b77fe640 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5583ee76ee70 0x5583ee771290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:44.423 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.416+0000 7f49977fe640 10 client.16083 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:44.423 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:44.416+0000 7f49b77fe640 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5583ee76ee70 0x5583ee771290 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85e3a85732f58307 server_cookie=439a62270adba037 in_seq=0 out_seq=0 2024-09-12T01:53:44.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:44 smithi191 ceph-mon[35770]: pgmap v384: 97 pgs: 97 active+clean; 96 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 782 op/s 2024-09-12T01:53:44.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:44 smithi191 ceph-mon[35770]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:45.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:44 smithi152 ceph-mon[35055]: pgmap v384: 97 pgs: 97 active+clean; 96 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 782 op/s 2024-09-12T01:53:45.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:44 smithi152 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:45.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:44 smithi070 ceph-mon[31177]: pgmap v384: 97 pgs: 97 active+clean; 96 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 782 op/s 2024-09-12T01:53:45.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:44 smithi070 ceph-mon[31177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:45.206 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49977fe640 1 -- 172.21.15.70:0/427494613 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5583ee658d70 con 0x5583ee76ee70 2024-09-12T01:53:45.206 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49977fe640 10 client.16083 handle_command_reply: tid=0 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49c13d0740 1 client.16083 shutdown 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49c13d0740 1 -- 172.21.15.70:0/427494613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 msgr2=0x5583ee6fc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49c13d0740 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 0x5583ee6fc9f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f49a8098750 tx=0x7f49a8017000 comp rx=0 tx=0).stop 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49c13d0740 1 -- 172.21.15.70:0/427494613 shutdown_connections 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49c13d0740 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5583ee76ee70 0x5583ee771290 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49977fe640 0 client.16083 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49c13d0740 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5583ee6f3370 0x5583ee6fdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49c13d0740 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5583ee6ee2e0 0x5583ee6fcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49c13d0740 1 --2- 172.21.15.70:0/427494613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583ee6ed9a0 0x5583ee6fc9f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49c13d0740 1 -- 172.21.15.70:0/427494613 >> 172.21.15.70:0/427494613 conn(0x5583ee6e9010 msgr2=0x5583ee6e93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49c13d0740 1 -- 172.21.15.70:0/427494613 shutdown_connections 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.206+0000 7f49c13d0740 1 -- 172.21.15.70:0/427494613 wait complete. 2024-09-12T01:53:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.207+0000 7f49c13d0740 20 client.16083 trim_cache size 0 max 16384 2024-09-12T01:53:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:53:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:53:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:53:45.208 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:53:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.207+0000 7f49be559640 1 -- 172.21.15.70:0/808262271 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f49a00a2c30 msgr2=0x7f49a00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.207+0000 7f49be559640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f49a00a2c30 0x7f49a00a50f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f49b001b000 tx=0x7f49b001e000 comp rx=0 tx=0).stop 2024-09-12T01:53:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.207+0000 7f49be559640 1 -- 172.21.15.70:0/808262271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b8100d10 msgr2=0x7f49b810b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.207+0000 7f49be559640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b8100d10 0x7f49b810b3e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f49a800e9c0 tx=0x7f49a800ee80 comp rx=0 tx=0).stop 2024-09-12T01:53:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.207+0000 7f49be559640 1 -- 172.21.15.70:0/808262271 shutdown_connections 2024-09-12T01:53:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.207+0000 7f49be559640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f49a00a2c30 0x7f49a00a50f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.207+0000 7f49be559640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f49b8101fe0 0x7f49b8109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.207+0000 7f49be559640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49b81016d0 0x7f49b8109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.207+0000 7f49be559640 1 --2- 172.21.15.70:0/808262271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b8100d10 0x7f49b810b3e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.207+0000 7f49be559640 1 -- 172.21.15.70:0/808262271 >> 172.21.15.70:0/808262271 conn(0x7f49b80fb930 msgr2=0x7f49b8105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.208+0000 7f49be559640 1 -- 172.21.15.70:0/808262271 shutdown_connections 2024-09-12T01:53:45.209 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:45.208+0000 7f49be559640 1 -- 172.21.15.70:0/808262271 wait complete. 2024-09-12T01:53:46.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:46 smithi191 ceph-mon[35770]: pgmap v385: 97 pgs: 97 active+clean; 104 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 653 op/s 2024-09-12T01:53:47.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:46 smithi152 ceph-mon[35055]: pgmap v385: 97 pgs: 97 active+clean; 104 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 653 op/s 2024-09-12T01:53:47.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:46 smithi070 ceph-mon[31177]: pgmap v385: 97 pgs: 97 active+clean; 104 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 653 op/s 2024-09-12T01:53:47.680 INFO:tasks.workunit.client.0.smithi070.stderr:+ sync 2024-09-12T01:53:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:48 smithi191 ceph-mon[35770]: pgmap v386: 97 pgs: 97 active+clean; 113 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 777 op/s 2024-09-12T01:53:49.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:48 smithi152 ceph-mon[35055]: pgmap v386: 97 pgs: 97 active+clean; 113 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 777 op/s 2024-09-12T01:53:49.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:48 smithi070 ceph-mon[31177]: pgmap v386: 97 pgs: 97 active+clean; 113 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 777 op/s 2024-09-12T01:53:49.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:49 smithi191 ceph-mon[35770]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:50.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:49 smithi152 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:50.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:49 smithi070 ceph-mon[31177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:50.809 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar c linux-4.0.5 2024-09-12T01:53:50.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:50 smithi191 ceph-mon[35770]: pgmap v387: 97 pgs: 97 active+clean; 119 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 1.25k op/s 2024-09-12T01:53:51.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:50 smithi152 ceph-mon[35055]: pgmap v387: 97 pgs: 97 active+clean; 119 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 1.25k op/s 2024-09-12T01:53:51.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:50 smithi070 ceph-mon[31177]: pgmap v387: 97 pgs: 97 active+clean; 119 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 1.25k op/s 2024-09-12T01:53:51.171 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.4 2024-09-12T01:53:51.172 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:53:51.230 INFO:tasks.workunit.client.0.smithi070.stderr:+ rm -rf linux-4.0.5 2024-09-12T01:53:51.423 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:51.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:51 smithi070 ceph-mon[31177]: pgmap v388: 97 pgs: 97 active+clean; 152 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.3 MiB/s wr, 1.76k op/s 2024-09-12T01:53:51.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.856+0000 7f26e374a640 1 -- 172.21.15.70:0/1851492414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc100e20 msgr2=0x7f26dc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:51.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.856+0000 7f26e374a640 1 --2- 172.21.15.70:0/1851492414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc100e20 0x7f26dc101200 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009900 tx=0x7f26cc02a480 comp rx=0 tx=0).stop 2024-09-12T01:53:51.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.856+0000 7f26e374a640 1 -- 172.21.15.70:0/1851492414 shutdown_connections 2024-09-12T01:53:51.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.856+0000 7f26e374a640 1 --2- 172.21.15.70:0/1851492414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26dc102ef0 0x7f26dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:51.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.856+0000 7f26e374a640 1 --2- 172.21.15.70:0/1851492414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26dc102570 0x7f26dc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:51.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.856+0000 7f26e374a640 1 --2- 172.21.15.70:0/1851492414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc100e20 0x7f26dc101200 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:51.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.856+0000 7f26e374a640 1 -- 172.21.15.70:0/1851492414 >> 172.21.15.70:0/1851492414 conn(0x7f26dc0fc7d0 msgr2=0x7f26dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:51.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.856+0000 7f26e374a640 1 -- 172.21.15.70:0/1851492414 shutdown_connections 2024-09-12T01:53:51.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.856+0000 7f26e374a640 1 -- 172.21.15.70:0/1851492414 wait complete. 2024-09-12T01:53:51.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.856+0000 7f26e374a640 1 Processor -- start 2024-09-12T01:53:51.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e374a640 1 -- start start 2024-09-12T01:53:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e374a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc100e20 0x7f26dc198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e374a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26dc102570 0x7f26dc198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e374a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26dc102ef0 0x7f26dc19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e374a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc111070 con 0x7f26dc100e20 2024-09-12T01:53:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e374a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc110ef0 con 0x7f26dc102570 2024-09-12T01:53:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e374a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f26dc1111f0 con 0x7f26dc102ef0 2024-09-12T01:53:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e14e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc100e20 0x7f26dc198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e14e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc100e20 0x7f26dc198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41464/0 (socket says 172.21.15.70:41464) 2024-09-12T01:53:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e14e6640 1 -- 172.21.15.70:0/427909015 learned_addr learned my addr 172.21.15.70:0/427909015 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e0ce5640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26dc102570 0x7f26dc198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e1ce7640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26dc102ef0 0x7f26dc19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:51.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e14e6640 1 -- 172.21.15.70:0/427909015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26dc102ef0 msgr2=0x7f26dc19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e14e6640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26dc102ef0 0x7f26dc19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e14e6640 1 -- 172.21.15.70:0/427909015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26dc102570 msgr2=0x7f26dc198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e14e6640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26dc102570 0x7f26dc198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e14e6640 1 -- 172.21.15.70:0/427909015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26dc19d600 con 0x7f26dc100e20 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.857+0000 7f26e14e6640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc100e20 0x7f26dc198650 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f26cc006010 tx=0x7f26cc004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.858+0000 7f26d27fc640 1 -- 172.21.15.70:0/427909015 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc03f030 con 0x7f26dc100e20 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.858+0000 7f26d27fc640 1 -- 172.21.15.70:0/427909015 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f26cc005500 con 0x7f26dc100e20 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.858+0000 7f26e374a640 1 -- 172.21.15.70:0/427909015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26dc19d890 con 0x7f26dc100e20 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.858+0000 7f26d27fc640 1 -- 172.21.15.70:0/427909015 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc035070 con 0x7f26dc100e20 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.858+0000 7f26e374a640 1 -- 172.21.15.70:0/427909015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26dc1a51d0 con 0x7f26dc100e20 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.859+0000 7f26e374a640 1 -- 172.21.15.70:0/427909015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26dc1021b0 con 0x7f26dc100e20 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.860+0000 7f26d27fc640 1 -- 172.21.15.70:0/427909015 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f26cc042030 con 0x7f26dc100e20 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.860+0000 7f26d27fc640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f26c80a2b80 0x7f26c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:51.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.860+0000 7f26e0ce5640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f26c80a2b80 0x7f26c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:51.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.860+0000 7f26d27fc640 1 -- 172.21.15.70:0/427909015 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f26cc0ef390 con 0x7f26dc100e20 2024-09-12T01:53:51.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.861+0000 7f26e0ce5640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f26c80a2b80 0x7f26c80a5040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0fffe0 tx=0x7f26d800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:51.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:51.864+0000 7f26d27fc640 1 -- 172.21.15.70:0/427909015 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26cc0bbca0 con 0x7f26dc100e20 2024-09-12T01:53:51.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:51 smithi191 ceph-mon[35770]: pgmap v388: 97 pgs: 97 active+clean; 152 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.3 MiB/s wr, 1.76k op/s 2024-09-12T01:53:52.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:51 smithi152 ceph-mon[35055]: pgmap v388: 97 pgs: 97 active+clean; 152 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.3 MiB/s wr, 1.76k op/s 2024-09-12T01:53:52.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.075+0000 7f26e374a640 1 -- 172.21.15.70:0/427909015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26dc1999b0 con 0x7f26dc100e20 2024-09-12T01:53:52.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.075+0000 7f26d27fc640 1 -- 172.21.15.70:0/427909015 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11982 (secure 0 0 0) 0x7f26cc0bffa0 con 0x7f26dc100e20 2024-09-12T01:53:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:53:52.076 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":30,"btime":"2024-09-12T01:53:48:607818+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:53:47.611494+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24427,24433,24437,24445,24452]},"id":1}]} 2024-09-12T01:53:52.076 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 30 2024-09-12T01:53:52.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.078+0000 7f26e374a640 1 -- 172.21.15.70:0/427909015 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f26c80a2b80 msgr2=0x7f26c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:52.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.078+0000 7f26e374a640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f26c80a2b80 0x7f26c80a5040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0fffe0 tx=0x7f26d800b390 comp rx=0 tx=0).stop 2024-09-12T01:53:52.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.078+0000 7f26e374a640 1 -- 172.21.15.70:0/427909015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc100e20 msgr2=0x7f26dc198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:52.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.078+0000 7f26e374a640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc100e20 0x7f26dc198650 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f26cc006010 tx=0x7f26cc004c00 comp rx=0 tx=0).stop 2024-09-12T01:53:52.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.078+0000 7f26e374a640 1 -- 172.21.15.70:0/427909015 shutdown_connections 2024-09-12T01:53:52.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.078+0000 7f26e374a640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f26c80a2b80 0x7f26c80a5040 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:52.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.078+0000 7f26e374a640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26dc102ef0 0x7f26dc19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:52.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.078+0000 7f26e374a640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26dc102570 0x7f26dc198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:52.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.078+0000 7f26e374a640 1 --2- 172.21.15.70:0/427909015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26dc100e20 0x7f26dc198650 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:52.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.078+0000 7f26e374a640 1 -- 172.21.15.70:0/427909015 >> 172.21.15.70:0/427909015 conn(0x7f26dc0fc7d0 msgr2=0x7f26dc06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:52.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.078+0000 7f26e374a640 1 -- 172.21.15.70:0/427909015 shutdown_connections 2024-09-12T01:53:52.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:52.078+0000 7f26e374a640 1 -- 172.21.15.70:0/427909015 wait complete. 2024-09-12T01:53:52.733 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24452 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0' 2024-09-12T01:53:52.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24452 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0 2024-09-12T01:53:52.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:53:52.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:52 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/427909015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:53:52.944 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:52 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/427909015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:53:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:52 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/427909015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:53:53.039 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:53.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.518+0000 7fa448ea2640 1 -- 172.21.15.70:0/4274345270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa444100e20 msgr2=0x7fa444101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:53.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.518+0000 7fa448ea2640 1 --2- 172.21.15.70:0/4274345270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa444100e20 0x7fa444101200 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009900 tx=0x7fa43c02a480 comp rx=0 tx=0).stop 2024-09-12T01:53:53.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.518+0000 7fa448ea2640 1 -- 172.21.15.70:0/4274345270 shutdown_connections 2024-09-12T01:53:53.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.518+0000 7fa448ea2640 1 --2- 172.21.15.70:0/4274345270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa444102ef0 0x7fa44410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.518+0000 7fa448ea2640 1 --2- 172.21.15.70:0/4274345270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa444102570 0x7fa4441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.518+0000 7fa448ea2640 1 --2- 172.21.15.70:0/4274345270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa444100e20 0x7fa444101200 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.518+0000 7fa448ea2640 1 -- 172.21.15.70:0/4274345270 >> 172.21.15.70:0/4274345270 conn(0x7fa4440fc7d0 msgr2=0x7fa4440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.518+0000 7fa448ea2640 1 -- 172.21.15.70:0/4274345270 shutdown_connections 2024-09-12T01:53:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.518+0000 7fa448ea2640 1 -- 172.21.15.70:0/4274345270 wait complete. 2024-09-12T01:53:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.519+0000 7fa448ea2640 1 Processor -- start 2024-09-12T01:53:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.519+0000 7fa448ea2640 1 -- start start 2024-09-12T01:53:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.519+0000 7fa448ea2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa444100e20 0x7fa444198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.519+0000 7fa448ea2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa444102570 0x7fa444198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.519+0000 7fa448ea2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa444102ef0 0x7fa44419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa448ea2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441110f0 con 0x7fa444100e20 2024-09-12T01:53:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa448ea2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa444110f70 con 0x7fa444102570 2024-09-12T01:53:53.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa448ea2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa444111270 con 0x7fa444102ef0 2024-09-12T01:53:53.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa44259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa444100e20 0x7fa444198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa44259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa444100e20 0x7fa444198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41488/0 (socket says 172.21.15.70:41488) 2024-09-12T01:53:53.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa44259c640 1 -- 172.21.15.70:0/4056049020 learned_addr learned my addr 172.21.15.70:0/4056049020 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:53.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa441d9b640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa444102570 0x7fa444198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa442d9d640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa444102ef0 0x7fa44419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa441d9b640 1 -- 172.21.15.70:0/4056049020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa444102ef0 msgr2=0x7fa44419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:53.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa441d9b640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa444102ef0 0x7fa44419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa441d9b640 1 -- 172.21.15.70:0/4056049020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa444100e20 msgr2=0x7fa444198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:53.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa441d9b640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa444100e20 0x7fa444198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa441d9b640 1 -- 172.21.15.70:0/4056049020 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44419d5f0 con 0x7fa444102570 2024-09-12T01:53:53.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa44259c640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa444100e20 0x7fa444198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:53.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa441d9b640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa444102570 0x7fa444198b80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa43800e9f0 tx=0x7fa43800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:53.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa4337fe640 1 -- 172.21.15.70:0/4056049020 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43800ccc0 con 0x7fa444102570 2024-09-12T01:53:53.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.520+0000 7fa448ea2640 1 -- 172.21.15.70:0/4056049020 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44419d8e0 con 0x7fa444102570 2024-09-12T01:53:53.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.521+0000 7fa4337fe640 1 -- 172.21.15.70:0/4056049020 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa438010930 con 0x7fa444102570 2024-09-12T01:53:53.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.521+0000 7fa448ea2640 1 -- 172.21.15.70:0/4056049020 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4440fcbb0 con 0x7fa444102570 2024-09-12T01:53:53.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.521+0000 7fa4337fe640 1 -- 172.21.15.70:0/4056049020 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4380189f0 con 0x7fa444102570 2024-09-12T01:53:53.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.523+0000 7fa44b27b740 1 Processor -- start 2024-09-12T01:53:53.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.523+0000 7fa4337fe640 1 -- 172.21.15.70:0/4056049020 <== mon.2 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa438010ae0 con 0x7fa444102570 2024-09-12T01:53:53.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.523+0000 7fa44b27b740 1 -- start start 2024-09-12T01:53:53.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.523+0000 7fa44b27b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.523+0000 7fa44b27b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.523+0000 7fa44b27b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 0x55899e4b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.523+0000 7fa44b27b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55899e40a2a0 con 0x55899e4a5080 2024-09-12T01:53:53.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.523+0000 7fa44b27b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55899e3b1b10 con 0x55899e4af940 2024-09-12T01:53:53.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.523+0000 7fa44b27b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55899e406260 con 0x55899e4a4760 2024-09-12T01:53:53.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa44259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa442d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa442d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4a4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:36048/0 (socket says 172.21.15.70:36048) 2024-09-12T01:53:53.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa442d9d640 1 -- 172.21.15.70:0/1273109984 learned_addr learned my addr 172.21.15.70:0/1273109984 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:53.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa441d9b640 1 --2- 172.21.15.70:0/1273109984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 0x55899e4b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa442d9d640 1 -- 172.21.15.70:0/1273109984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 msgr2=0x55899e4b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:53.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa442d9d640 1 --2- 172.21.15.70:0/1273109984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 0x55899e4b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa442d9d640 1 -- 172.21.15.70:0/1273109984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 msgr2=0x55899e4af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:53.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa442d9d640 1 --2- 172.21.15.70:0/1273109984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa442d9d640 1 -- 172.21.15.70:0/1273109984 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55899e17bb90 con 0x55899e4a4760 2024-09-12T01:53:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa4337fe640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa42c0a2b80 0x7fa42c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa44259c640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa42c0a2b80 0x7fa42c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa4337fe640 1 -- 172.21.15.70:0/4056049020 <== mon.2 v2:172.21.15.152:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa4380cf310 con 0x7fa444102570 2024-09-12T01:53:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa442d9d640 1 --2- 172.21.15.70:0/1273109984 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4a4b40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa434009f70 tx=0x7fa434010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f992cc66432e3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa430ff9640 1 -- 172.21.15.70:0/1273109984 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434016070 con 0x55899e4a4760 2024-09-12T01:53:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa430ff9640 1 -- 172.21.15.70:0/1273109984 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa434004d20 con 0x55899e4a4760 2024-09-12T01:53:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.524+0000 7fa430ff9640 1 -- 172.21.15.70:0/1273109984 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434012990 con 0x55899e4a4760 2024-09-12T01:53:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.525+0000 7fa44b27b740 1 -- 172.21.15.70:0/1273109984 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 msgr2=0x55899e4a4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.525+0000 7fa44259c640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa42c0a2b80 0x7fa42c0a5040 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa43c031580 tx=0x7fa43c0046c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.525+0000 7fa44b27b740 1 --2- 172.21.15.70:0/1273109984 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4a4b40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa434009f70 tx=0x7fa434010800 comp rx=0 tx=0).stop 2024-09-12T01:53:53.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.525+0000 7fa44b27b740 1 -- 172.21.15.70:0/1273109984 shutdown_connections 2024-09-12T01:53:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.525+0000 7fa44b27b740 1 --2- 172.21.15.70:0/1273109984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 0x55899e4b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.525+0000 7fa44b27b740 1 --2- 172.21.15.70:0/1273109984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.525+0000 7fa44b27b740 1 --2- 172.21.15.70:0/1273109984 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4a4b40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.525+0000 7fa44b27b740 1 -- 172.21.15.70:0/1273109984 >> 172.21.15.70:0/1273109984 conn(0x55899e4a0cf0 msgr2=0x55899e4a10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.525+0000 7fa44b27b740 1 -- 172.21.15.70:0/1273109984 shutdown_connections 2024-09-12T01:53:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.525+0000 7fa44b27b740 1 -- 172.21.15.70:0/1273109984 wait complete. 2024-09-12T01:53:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa44b27b740 1 -- start start 2024-09-12T01:53:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa44b27b740 1 Processor -- start 2024-09-12T01:53:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa44b27b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4a4760 0x55899e4ac820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa44b27b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a5080 0x55899e4acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa44b27b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4af940 0x55899e4ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa44b27b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55899e4b2510 con 0x55899e4af940 2024-09-12T01:53:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa44b27b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55899e3926e0 con 0x55899e4a4760 2024-09-12T01:53:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa44b27b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55899e4b2690 con 0x55899e4a5080 2024-09-12T01:53:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa44b27b740 10 client.0 _ll_register_callbacks cb 0x55899e3b6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa44259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4a4760 0x55899e4ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa442d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4af940 0x55899e4ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa44259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4a4760 0x55899e4ac820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:53702/0 (socket says 172.21.15.70:53702) 2024-09-12T01:53:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa44259c640 1 -- 172.21.15.70:0/298120034 learned_addr learned my addr 172.21.15.70:0/298120034 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa441d9b640 1 --2- 172.21.15.70:0/298120034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a5080 0x55899e4acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa442d9d640 1 -- 172.21.15.70:0/298120034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a5080 msgr2=0x55899e4acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa442d9d640 1 --2- 172.21.15.70:0/298120034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a5080 0x55899e4acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa442d9d640 1 -- 172.21.15.70:0/298120034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4a4760 msgr2=0x55899e4ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa442d9d640 1 --2- 172.21.15.70:0/298120034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4a4760 0x55899e4ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.526+0000 7fa442d9d640 1 -- 172.21.15.70:0/298120034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55899e4bba00 con 0x55899e4af940 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa442d9d640 1 --2- 172.21.15.70:0/298120034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4af940 0x55899e4ad2a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa434011010 tx=0x7fa434004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fc343475a1b0ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa429ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa429ffb640 1 -- 172.21.15.70:0/298120034 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434029060 con 0x55899e4af940 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa429ffb640 1 -- 172.21.15.70:0/298120034 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa4340129e0 con 0x55899e4af940 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa44b27b740 1 -- 172.21.15.70:0/298120034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa434004d20 con 0x55899e4af940 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa429ffb640 1 -- 172.21.15.70:0/298120034 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa434016070 con 0x55899e4af940 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa44b27b740 10 client.16101 fetch_fsmap learned FSMap version 31 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa44b27b740 1 -- 172.21.15.70:0/298120034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55899e4be390 con 0x55899e4af940 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa429ffb640 1 -- 172.21.15.70:0/298120034 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa434004d20 con 0x55899e4af940 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa429ffb640 1 -- 172.21.15.70:0/298120034 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7fa43402e070 con 0x55899e4af940 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa44b27b740 10 client.16101 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa44b27b740 10 client.16101 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:53:53.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa44b27b740 20 client.16101 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa44b27b740 1 --2- 172.21.15.70:0/298120034 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55899e4bf850 0x55899e4c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa44b27b740 4 client.16101 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.527+0000 7fa44b27b740 1 -- 172.21.15.70:0/298120034 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55899e4179d0 con 0x55899e4bf850 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.528+0000 7fa44259c640 1 --2- 172.21.15.70:0/298120034 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55899e4bf850 0x55899e4c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.528+0000 7fa429ffb640 10 client.16101 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.528+0000 7fa44259c640 1 --2- 172.21.15.70:0/298120034 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55899e4bf850 0x55899e4c1c40 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff6e1ddb2f1fcc18 server_cookie=6348c622f070258 in_seq=0 out_seq=0 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa429ffb640 1 -- 172.21.15.70:0/298120034 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55899e4179d0 con 0x55899e4bf850 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa429ffb640 10 client.16101 handle_command_reply: tid=0 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa44b27b740 1 client.16101 shutdown 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa44b27b740 1 -- 172.21.15.70:0/298120034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4af940 msgr2=0x55899e4ad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa44b27b740 1 --2- 172.21.15.70:0/298120034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4af940 0x55899e4ad2a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa434011010 tx=0x7fa434004c70 comp rx=0 tx=0).stop 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa44b27b740 1 -- 172.21.15.70:0/298120034 shutdown_connections 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa44b27b740 1 --2- 172.21.15.70:0/298120034 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55899e4bf850 0x55899e4c1c40 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa44b27b740 1 --2- 172.21.15.70:0/298120034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4af940 0x55899e4ad2a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa44b27b740 1 --2- 172.21.15.70:0/298120034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a5080 0x55899e4acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa44b27b740 1 --2- 172.21.15.70:0/298120034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4a4760 0x55899e4ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa44b27b740 1 -- 172.21.15.70:0/298120034 >> 172.21.15.70:0/298120034 conn(0x55899e4a0cf0 msgr2=0x55899e49fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:53.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa429ffb640 0 client.16101 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:53.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa44b27b740 1 -- 172.21.15.70:0/298120034 shutdown_connections 2024-09-12T01:53:53.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa44b27b740 1 -- 172.21.15.70:0/298120034 wait complete. 2024-09-12T01:53:53.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.529+0000 7fa44b27b740 20 client.16101 trim_cache size 0 max 16384 2024-09-12T01:53:53.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.547+0000 7fa44b27b740 1 Processor -- start 2024-09-12T01:53:53.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.547+0000 7fa44b27b740 1 -- start start 2024-09-12T01:53:53.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.547+0000 7fa44b27b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.547+0000 7fa44b27b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.547+0000 7fa44b27b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 0x55899e4a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.547+0000 7fa44b27b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441af970 con 0x55899e4a5080 2024-09-12T01:53:53.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.547+0000 7fa44b27b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441b1540 con 0x55899e4af940 2024-09-12T01:53:53.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.547+0000 7fa44b27b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441b0040 con 0x55899e4a4760 2024-09-12T01:53:53.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.547+0000 7fa441d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.547+0000 7fa441d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41516/0 (socket says 172.21.15.70:41516) 2024-09-12T01:53:53.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.547+0000 7fa441d9b640 1 -- 172.21.15.70:0/3790071891 learned_addr learned my addr 172.21.15.70:0/3790071891 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:53.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.548+0000 7fa442d9d640 1 --2- 172.21.15.70:0/3790071891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 0x55899e4a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.548+0000 7fa44259c640 1 --2- 172.21.15.70:0/3790071891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.548+0000 7fa441d9b640 1 -- 172.21.15.70:0/3790071891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 msgr2=0x55899e4c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:53.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.548+0000 7fa441d9b640 1 --2- 172.21.15.70:0/3790071891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.548+0000 7fa441d9b640 1 -- 172.21.15.70:0/3790071891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 msgr2=0x55899e4a9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:53.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.548+0000 7fa441d9b640 1 --2- 172.21.15.70:0/3790071891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 0x55899e4a9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.548+0000 7fa441d9b640 1 -- 172.21.15.70:0/3790071891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55899e4a4eb0 con 0x55899e4a5080 2024-09-12T01:53:53.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.548+0000 7fa441d9b640 1 --2- 172.21.15.70:0/3790071891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4c77e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa4380cce10 tx=0x7fa43800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc12c01475b9d820 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:53.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.548+0000 7fa42bfff640 1 -- 172.21.15.70:0/3790071891 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43809bc20 con 0x55899e4a5080 2024-09-12T01:53:53.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.548+0000 7fa42bfff640 1 -- 172.21.15.70:0/3790071891 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa43809ff20 con 0x55899e4a5080 2024-09-12T01:53:53.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.548+0000 7fa42bfff640 1 -- 172.21.15.70:0/3790071891 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa438018b90 con 0x55899e4a5080 2024-09-12T01:53:53.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.549+0000 7fa44b27b740 1 -- 172.21.15.70:0/3790071891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 msgr2=0x55899e4c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:53.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.549+0000 7fa44b27b740 1 --2- 172.21.15.70:0/3790071891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4c77e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa4380cce10 tx=0x7fa43800cf70 comp rx=0 tx=0).stop 2024-09-12T01:53:53.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.549+0000 7fa44b27b740 1 -- 172.21.15.70:0/3790071891 shutdown_connections 2024-09-12T01:53:53.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.549+0000 7fa44b27b740 1 --2- 172.21.15.70:0/3790071891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 0x55899e4a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.549+0000 7fa44b27b740 1 --2- 172.21.15.70:0/3790071891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4c77e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.549+0000 7fa44b27b740 1 --2- 172.21.15.70:0/3790071891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.549+0000 7fa44b27b740 1 -- 172.21.15.70:0/3790071891 >> 172.21.15.70:0/3790071891 conn(0x55899e4a0cf0 msgr2=0x55899e4ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:53.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.549+0000 7fa44b27b740 1 -- 172.21.15.70:0/3790071891 shutdown_connections 2024-09-12T01:53:53.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.549+0000 7fa44b27b740 1 -- 172.21.15.70:0/3790071891 wait complete. 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.549+0000 7fa44b27b740 1 -- start start 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.549+0000 7fa44b27b740 1 Processor -- start 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44b27b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44b27b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44b27b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 0x55899e529270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44b27b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441b0de0 con 0x55899e4a5080 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44b27b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441b0710 con 0x55899e4af940 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44b27b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441ad930 con 0x55899e4a4760 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44b27b740 10 client.0 _ll_register_callbacks cb 0x7fa434009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa441d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa441d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4b3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41526/0 (socket says 172.21.15.70:41526) 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa441d9b640 1 -- 172.21.15.70:0/2163190394 learned_addr learned my addr 172.21.15.70:0/2163190394 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:53.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44259c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa442d9d640 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 0x55899e529270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44259c640 1 -- 172.21.15.70:0/2163190394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 msgr2=0x55899e529270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44259c640 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 0x55899e529270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44259c640 1 -- 172.21.15.70:0/2163190394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 msgr2=0x55899e4b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44259c640 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44259c640 1 -- 172.21.15.70:0/2163190394 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55899e5297b0 con 0x55899e4a4760 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa441d9b640 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa44259c640 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4b3a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55899e4c21e0 tx=0x7fa43c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=316466532762c2f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.550+0000 7fa429ffb640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa429ffb640 1 -- 172.21.15.70:0/2163190394 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c035040 con 0x55899e4a4760 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa429ffb640 1 -- 172.21.15.70:0/2163190394 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa43c054680 con 0x55899e4a4760 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa44b27b740 1 -- 172.21.15.70:0/2163190394 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa43809ff20 con 0x55899e4a4760 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa429ffb640 1 -- 172.21.15.70:0/2163190394 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa43c054880 con 0x55899e4a4760 2024-09-12T01:53:53.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa44b27b740 10 client.25333 fetch_fsmap learned FSMap version 31 2024-09-12T01:53:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa44b27b740 1 -- 172.21.15.70:0/2163190394 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55899e52a9d0 con 0x55899e4a4760 2024-09-12T01:53:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa429ffb640 1 -- 172.21.15.70:0/2163190394 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa43809ff20 con 0x55899e4a4760 2024-09-12T01:53:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa429ffb640 1 -- 172.21.15.70:0/2163190394 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7fa43c05a030 con 0x55899e4a4760 2024-09-12T01:53:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa44b27b740 10 client.25333 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T01:53:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa44b27b740 10 client.25333 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:53:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa44b27b740 20 client.25333 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa44b27b740 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55899e52b1a0 0x55899e52d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa44b27b740 4 client.25333 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}] 2024-09-12T01:53:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.551+0000 7fa44b27b740 1 -- 172.21.15.70:0/2163190394 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}) -- 0x55899e411d20 con 0x55899e52b1a0 2024-09-12T01:53:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.552+0000 7fa441d9b640 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55899e52b1a0 0x55899e52d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.552+0000 7fa441d9b640 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55899e52b1a0 0x55899e52d5c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b609d20ba55561bd server_cookie=1ff6fe4921858030 in_seq=0 out_seq=0 2024-09-12T01:53:53.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:53.552+0000 7fa429ffb640 10 client.25333 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:53.611 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:53.890 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:53 smithi070 ceph-mon[31177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:53.890 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:53 smithi070 ceph-mon[31177]: pgmap v389: 97 pgs: 97 active+clean; 150 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.5 MiB/s wr, 1.89k op/s 2024-09-12T01:53:53.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:53 smithi191 ceph-mon[35770]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:53.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:53 smithi191 ceph-mon[35770]: pgmap v389: 97 pgs: 97 active+clean; 150 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.5 MiB/s wr, 1.89k op/s 2024-09-12T01:53:54.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:53 smithi152 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:54.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:53 smithi152 ceph-mon[35055]: pgmap v389: 97 pgs: 97 active+clean; 150 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.5 MiB/s wr, 1.89k op/s 2024-09-12T01:53:54.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.108+0000 7f93d856f640 1 -- 172.21.15.70:0/320894219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93d0101df0 msgr2=0x7f93d01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:54.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.108+0000 7f93d856f640 1 --2- 172.21.15.70:0/320894219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93d0101df0 0x7f93d01021d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009ca0 tx=0x7f93cc02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.108+0000 7f93d856f640 1 -- 172.21.15.70:0/320894219 shutdown_connections 2024-09-12T01:53:54.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.108+0000 7f93d856f640 1 --2- 172.21.15.70:0/320894219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93d0106f20 0x7f93d010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.108+0000 7f93d856f640 1 --2- 172.21.15.70:0/320894219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d01027a0 0x7f93d01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.108+0000 7f93d856f640 1 --2- 172.21.15.70:0/320894219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93d0101df0 0x7f93d01021d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.108+0000 7f93d856f640 1 -- 172.21.15.70:0/320894219 >> 172.21.15.70:0/320894219 conn(0x7f93d00fd8f0 msgr2=0x7f93d00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:54.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.108+0000 7f93d856f640 1 -- 172.21.15.70:0/320894219 shutdown_connections 2024-09-12T01:53:54.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.108+0000 7f93d856f640 1 -- 172.21.15.70:0/320894219 wait complete. 2024-09-12T01:53:54.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d856f640 1 Processor -- start 2024-09-12T01:53:54.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d856f640 1 -- start start 2024-09-12T01:53:54.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d856f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93d0101df0 0x7f93d0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d856f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d01027a0 0x7f93d0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d856f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93d0106f20 0x7f93d019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d856f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01120a0 con 0x7f93d0106f20 2024-09-12T01:53:54.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d856f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0111f20 con 0x7f93d01027a0 2024-09-12T01:53:54.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d856f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0112220 con 0x7f93d0101df0 2024-09-12T01:53:54.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d6b0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93d0106f20 0x7f93d019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d630b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93d0101df0 0x7f93d0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d5b0a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d01027a0 0x7f93d0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d6b0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93d0106f20 0x7f93d019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41550/0 (socket says 172.21.15.70:41550) 2024-09-12T01:53:54.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d6b0c640 1 -- 172.21.15.70:0/2538251230 learned_addr learned my addr 172.21.15.70:0/2538251230 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:54.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d6b0c640 1 -- 172.21.15.70:0/2538251230 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93d0101df0 msgr2=0x7f93d0198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:54.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d6b0c640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93d0101df0 0x7f93d0198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d6b0c640 1 -- 172.21.15.70:0/2538251230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d01027a0 msgr2=0x7f93d0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:54.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d6b0c640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d01027a0 0x7f93d0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d6b0c640 1 -- 172.21.15.70:0/2538251230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d019d530 con 0x7f93d0106f20 2024-09-12T01:53:54.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.109+0000 7f93d5b0a640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d01027a0 0x7f93d0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:54.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.110+0000 7f93d6b0c640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93d0106f20 0x7f93d019ce50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f93c800d950 tx=0x7f93c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:54.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.110+0000 7f93c77fe640 1 -- 172.21.15.70:0/2538251230 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8017030 con 0x7f93d0106f20 2024-09-12T01:53:54.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.110+0000 7f93d856f640 1 -- 172.21.15.70:0/2538251230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d019d820 con 0x7f93d0106f20 2024-09-12T01:53:54.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.110+0000 7f93c77fe640 1 -- 172.21.15.70:0/2538251230 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f93c8004020 con 0x7f93d0106f20 2024-09-12T01:53:54.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.110+0000 7f93c77fe640 1 -- 172.21.15.70:0/2538251230 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8003cf0 con 0x7f93d0106f20 2024-09-12T01:53:54.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.110+0000 7f93d856f640 1 -- 172.21.15.70:0/2538251230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d0074420 con 0x7f93d0106f20 2024-09-12T01:53:54.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.112+0000 7f93c77fe640 1 -- 172.21.15.70:0/2538251230 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f93c801a070 con 0x7f93d0106f20 2024-09-12T01:53:54.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.113+0000 7f93c77fe640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93bc0a2b80 0x7f93bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.113+0000 7f93da948740 1 Processor -- start 2024-09-12T01:53:54.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.113+0000 7f93c77fe640 1 -- 172.21.15.70:0/2538251230 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f93c80ce9a0 con 0x7f93d0106f20 2024-09-12T01:53:54.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.113+0000 7f93d630b640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93bc0a2b80 0x7f93bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.113+0000 7f93da948740 1 -- start start 2024-09-12T01:53:54.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93da948740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55868540a4a0 0x55868540a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93da948740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 0x558685415140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93da948740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558685415680 0x558685417a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93da948740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5586853702e0 con 0x55868540adc0 2024-09-12T01:53:54.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93da948740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x558685317ce0 con 0x558685415680 2024-09-12T01:53:54.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93da948740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55868536c2a0 con 0x55868540a4a0 2024-09-12T01:53:54.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d5b0a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 0x558685415140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d630b640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93bc0a2b80 0x7f93bc0a5040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f93cc005fe0 tx=0x7f93cc005f70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:54.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d630b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55868540a4a0 0x55868540a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d5b0a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 0x558685415140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41560/0 (socket says 172.21.15.70:41560) 2024-09-12T01:53:54.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d5b0a640 1 -- 172.21.15.70:0/1431259528 learned_addr learned my addr 172.21.15.70:0/1431259528 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:54.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d6b0c640 1 --2- 172.21.15.70:0/1431259528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558685415680 0x558685417a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d6b0c640 1 -- 172.21.15.70:0/1431259528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55868540a4a0 msgr2=0x55868540a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:54.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d6b0c640 1 --2- 172.21.15.70:0/1431259528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55868540a4a0 0x55868540a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d6b0c640 1 -- 172.21.15.70:0/1431259528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 msgr2=0x558685415140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:54.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d6b0c640 1 --2- 172.21.15.70:0/1431259528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 0x558685415140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d6b0c640 1 -- 172.21.15.70:0/1431259528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586852fc440 con 0x558685415680 2024-09-12T01:53:54.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d5b0a640 1 --2- 172.21.15.70:0/1431259528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 0x558685415140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:54.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.114+0000 7f93d6b0c640 1 --2- 172.21.15.70:0/1431259528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558685415680 0x558685417a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f93c80cc4a0 tx=0x7f93c80035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c32ecddb5f07df0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.115+0000 7f93c4ff9640 1 -- 172.21.15.70:0/1431259528 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c809b200 con 0x558685415680 2024-09-12T01:53:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.115+0000 7f93c4ff9640 1 -- 172.21.15.70:0/1431259528 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f93c809f5b0 con 0x558685415680 2024-09-12T01:53:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.115+0000 7f93c4ff9640 1 -- 172.21.15.70:0/1431259528 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c809f380 con 0x558685415680 2024-09-12T01:53:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.116+0000 7f93da948740 1 -- 172.21.15.70:0/1431259528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558685415680 msgr2=0x558685417a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.116+0000 7f93da948740 1 --2- 172.21.15.70:0/1431259528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558685415680 0x558685417a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f93c80cc4a0 tx=0x7f93c80035f0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.116+0000 7f93da948740 1 -- 172.21.15.70:0/1431259528 shutdown_connections 2024-09-12T01:53:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.116+0000 7f93da948740 1 --2- 172.21.15.70:0/1431259528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558685415680 0x558685417a70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.116+0000 7f93da948740 1 --2- 172.21.15.70:0/1431259528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 0x558685415140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.116+0000 7f93da948740 1 --2- 172.21.15.70:0/1431259528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55868540a4a0 0x55868540a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.116+0000 7f93da948740 1 -- 172.21.15.70:0/1431259528 >> 172.21.15.70:0/1431259528 conn(0x558685406a30 msgr2=0x558685406e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.116+0000 7f93da948740 1 -- 172.21.15.70:0/1431259528 shutdown_connections 2024-09-12T01:53:54.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.116+0000 7f93da948740 1 -- 172.21.15.70:0/1431259528 wait complete. 2024-09-12T01:53:54.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.116+0000 7f93da948740 1 -- start start 2024-09-12T01:53:54.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.116+0000 7f93da948740 1 Processor -- start 2024-09-12T01:53:54.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93da948740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540a4a0 0x558685414f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93da948740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 0x5586854121e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93da948740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558685415680 0x558685412720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93da948740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5586854182f0 con 0x55868540adc0 2024-09-12T01:53:54.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93da948740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55868532b050 con 0x55868540a4a0 2024-09-12T01:53:54.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93da948740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x558685418470 con 0x558685415680 2024-09-12T01:53:54.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93da948740 10 client.0 _ll_register_callbacks cb 0x55868536b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:54.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93d630b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540a4a0 0x558685414f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93d6b0c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558685415680 0x558685412720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93d5b0a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 0x5586854121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93d630b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540a4a0 0x558685414f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:53760/0 (socket says 172.21.15.70:53760) 2024-09-12T01:53:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93d630b640 1 -- 172.21.15.70:0/2621383191 learned_addr learned my addr 172.21.15.70:0/2621383191 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93d630b640 1 -- 172.21.15.70:0/2621383191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558685415680 msgr2=0x558685412720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93d630b640 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558685415680 0x558685412720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93d630b640 1 -- 172.21.15.70:0/2621383191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 msgr2=0x5586854121e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93d630b640 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 0x5586854121e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93d630b640 1 -- 172.21.15.70:0/2621383191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586850e13c0 con 0x55868540a4a0 2024-09-12T01:53:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93d6b0c640 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558685415680 0x558685412720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.117+0000 7f93d5b0a640 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 0x5586854121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.118+0000 7f93d630b640 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540a4a0 0x558685414f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93cc035000 tx=0x7f93cc02a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1e9aa315fa5ff07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:54.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.118+0000 7f93b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-09-12T01:53:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.118+0000 7f93b9ffb640 1 -- 172.21.15.70:0/2621383191 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc056060 con 0x55868540a4a0 2024-09-12T01:53:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.118+0000 7f93da948740 1 -- 172.21.15.70:0/2621383191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93c809f5b0 con 0x55868540a4a0 2024-09-12T01:53:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.118+0000 7f93b9ffb640 1 -- 172.21.15.70:0/2621383191 <== mon.2 v2:172.21.15.152:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f93cc02fcf0 con 0x55868540a4a0 2024-09-12T01:53:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.118+0000 7f93b9ffb640 1 -- 172.21.15.70:0/2621383191 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f93cc0319e0 con 0x55868540a4a0 2024-09-12T01:53:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.118+0000 7f93da948740 10 client.25478 fetch_fsmap learned FSMap version 31 2024-09-12T01:53:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.118+0000 7f93da948740 1 -- 172.21.15.70:0/2621383191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558685423c60 con 0x55868540a4a0 2024-09-12T01:53:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.118+0000 7f93b9ffb640 1 -- 172.21.15.70:0/2621383191 <== mon.2 v2:172.21.15.152:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f93c809f5b0 con 0x55868540a4a0 2024-09-12T01:53:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.119+0000 7f93b9ffb640 1 -- 172.21.15.70:0/2621383191 <== mon.2 v2:172.21.15.152:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f93cc0487e0 con 0x55868540a4a0 2024-09-12T01:53:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.119+0000 7f93da948740 10 client.25478 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T01:53:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.119+0000 7f93da948740 10 client.25478 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:54.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.119+0000 7f93da948740 20 client.25478 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:54.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.119+0000 7f93da948740 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558685425150 0x558685427570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.119+0000 7f93da948740 4 client.25478 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:54.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.119+0000 7f93da948740 1 -- 172.21.15.70:0/2621383191 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55868537d850 con 0x558685425150 2024-09-12T01:53:54.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.119+0000 7f93d5b0a640 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558685425150 0x558685427570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.119+0000 7f93d5b0a640 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558685425150 0x558685427570 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e3a0b179079087 server_cookie=edddf3f95604f8c0 in_seq=0 out_seq=0 2024-09-12T01:53:54.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.119+0000 7f93b9ffb640 10 client.25478 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:54.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93b9ffb640 1 -- 172.21.15.70:0/2621383191 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55868537d850 con 0x558685425150 2024-09-12T01:53:54.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93b9ffb640 10 client.25478 handle_command_reply: tid=0 2024-09-12T01:53:54.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93da948740 1 client.25478 shutdown 2024-09-12T01:53:54.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93da948740 1 -- 172.21.15.70:0/2621383191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540a4a0 msgr2=0x558685414f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:54.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93da948740 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540a4a0 0x558685414f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93cc035000 tx=0x7f93cc02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93da948740 1 -- 172.21.15.70:0/2621383191 shutdown_connections 2024-09-12T01:53:54.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93da948740 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558685425150 0x558685427570 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93da948740 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558685415680 0x558685412720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93da948740 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540adc0 0x5586854121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93b9ffb640 0 client.25478 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:54.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93da948740 1 --2- 172.21.15.70:0/2621383191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540a4a0 0x558685414f30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93da948740 1 -- 172.21.15.70:0/2621383191 >> 172.21.15.70:0/2621383191 conn(0x558685406a30 msgr2=0x55868540c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:54.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93da948740 1 -- 172.21.15.70:0/2621383191 shutdown_connections 2024-09-12T01:53:54.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93da948740 1 -- 172.21.15.70:0/2621383191 wait complete. 2024-09-12T01:53:54.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.122+0000 7f93da948740 20 client.25478 trim_cache size 0 max 16384 2024-09-12T01:53:54.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.144+0000 7f93da948740 1 Processor -- start 2024-09-12T01:53:54.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.144+0000 7f93da948740 1 -- start start 2024-09-12T01:53:54.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93da948740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540a4a0 0x5586854215a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93da948740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540adc0 0x558685406e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93da948740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558685415680 0x55868540d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93da948740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01af8d0 con 0x55868540a4a0 2024-09-12T01:53:54.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93da948740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01b14a0 con 0x55868540adc0 2024-09-12T01:53:54.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93da948740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01affa0 con 0x558685415680 2024-09-12T01:53:54.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93d630b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540a4a0 0x5586854215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93d630b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540a4a0 0x5586854215a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41580/0 (socket says 172.21.15.70:41580) 2024-09-12T01:53:54.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93d630b640 1 -- 172.21.15.70:0/1309488369 learned_addr learned my addr 172.21.15.70:0/1309488369 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:54.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93d5b0a640 1 --2- 172.21.15.70:0/1309488369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540adc0 0x558685406e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93d6b0c640 1 --2- 172.21.15.70:0/1309488369 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558685415680 0x55868540d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93d630b640 1 -- 172.21.15.70:0/1309488369 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558685415680 msgr2=0x55868540d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:54.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93d630b640 1 --2- 172.21.15.70:0/1309488369 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558685415680 0x55868540d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93d630b640 1 -- 172.21.15.70:0/1309488369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540adc0 msgr2=0x558685406e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:54.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93d630b640 1 --2- 172.21.15.70:0/1309488369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540adc0 0x558685406e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93d630b640 1 -- 172.21.15.70:0/1309488369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558685411190 con 0x55868540a4a0 2024-09-12T01:53:54.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93d630b640 1 --2- 172.21.15.70:0/1309488369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540a4a0 0x5586854215a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009bf0 tx=0x7f93cc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3d99e6438fd0cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:54.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.145+0000 7f93bbfff640 1 -- 172.21.15.70:0/1309488369 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc060020 con 0x55868540a4a0 2024-09-12T01:53:54.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.146+0000 7f93bbfff640 1 -- 172.21.15.70:0/1309488369 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f93cc036040 con 0x55868540a4a0 2024-09-12T01:53:54.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.146+0000 7f93bbfff640 1 -- 172.21.15.70:0/1309488369 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc056040 con 0x55868540a4a0 2024-09-12T01:53:54.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.146+0000 7f93da948740 1 -- 172.21.15.70:0/1309488369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540a4a0 msgr2=0x5586854215a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:54.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.146+0000 7f93da948740 1 --2- 172.21.15.70:0/1309488369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540a4a0 0x5586854215a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009bf0 tx=0x7f93cc0095c0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.146+0000 7f93da948740 1 -- 172.21.15.70:0/1309488369 shutdown_connections 2024-09-12T01:53:54.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.146+0000 7f93da948740 1 --2- 172.21.15.70:0/1309488369 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558685415680 0x55868540d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.146+0000 7f93da948740 1 --2- 172.21.15.70:0/1309488369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540adc0 0x558685406e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.146+0000 7f93da948740 1 --2- 172.21.15.70:0/1309488369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55868540a4a0 0x5586854215a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.146+0000 7f93da948740 1 -- 172.21.15.70:0/1309488369 >> 172.21.15.70:0/1309488369 conn(0x558685406a30 msgr2=0x55868540d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:54.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.147+0000 7f93da948740 1 -- 172.21.15.70:0/1309488369 shutdown_connections 2024-09-12T01:53:54.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.147+0000 7f93da948740 1 -- 172.21.15.70:0/1309488369 wait complete. 2024-09-12T01:53:54.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.147+0000 7f93da948740 1 -- start start 2024-09-12T01:53:54.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.147+0000 7f93da948740 1 Processor -- start 2024-09-12T01:53:54.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.147+0000 7f93da948740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540a4a0 0x5586854909a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.147+0000 7f93da948740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55868540adc0 0x558685490ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.147+0000 7f93da948740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558685415680 0x558685418cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.147+0000 7f93da948740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01b0d40 con 0x558685415680 2024-09-12T01:53:54.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.147+0000 7f93da948740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01b0670 con 0x55868540a4a0 2024-09-12T01:53:54.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.147+0000 7f93da948740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01ad890 con 0x55868540adc0 2024-09-12T01:53:54.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.147+0000 7f93da948740 10 client.0 _ll_register_callbacks cb 0x7f93cc031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:54.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.147+0000 7f93d6b0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558685415680 0x558685418cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93d5b0a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55868540adc0 0x558685490ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93d6b0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558685415680 0x558685418cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41584/0 (socket says 172.21.15.70:41584) 2024-09-12T01:53:54.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93d6b0c640 1 -- 172.21.15.70:0/1459550812 learned_addr learned my addr 172.21.15.70:0/1459550812 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:54.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93d630b640 1 --2- 172.21.15.70:0/1459550812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540a4a0 0x5586854909a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93d6b0c640 1 -- 172.21.15.70:0/1459550812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55868540adc0 msgr2=0x558685490ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:54.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93d6b0c640 1 --2- 172.21.15.70:0/1459550812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55868540adc0 0x558685490ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93d6b0c640 1 -- 172.21.15.70:0/1459550812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540a4a0 msgr2=0x5586854909a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:54.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93d6b0c640 1 --2- 172.21.15.70:0/1459550812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540a4a0 0x5586854909a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93d6b0c640 1 -- 172.21.15.70:0/1459550812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586854152a0 con 0x558685415680 2024-09-12T01:53:54.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93d6b0c640 1 --2- 172.21.15.70:0/1459550812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558685415680 0x558685418cb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f93c809b190 tx=0x7f93c8005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f022763d8c7b6ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:54.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:54.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93b9ffb640 1 -- 172.21.15.70:0/1459550812 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c80a3e70 con 0x558685415680 2024-09-12T01:53:54.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93b9ffb640 1 -- 172.21.15.70:0/1459550812 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f93c80b40d0 con 0x558685415680 2024-09-12T01:53:54.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93da948740 1 -- 172.21.15.70:0/1459550812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93cc036040 con 0x558685415680 2024-09-12T01:53:54.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93b9ffb640 1 -- 172.21.15.70:0/1459550812 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f93c809f5b0 con 0x558685415680 2024-09-12T01:53:54.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93da948740 10 client.16125 fetch_fsmap learned FSMap version 31 2024-09-12T01:53:54.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.148+0000 7f93da948740 1 -- 172.21.15.70:0/1459550812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558685497f70 con 0x558685415680 2024-09-12T01:53:54.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.149+0000 7f93b9ffb640 1 -- 172.21.15.70:0/1459550812 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f93cc036040 con 0x558685415680 2024-09-12T01:53:54.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.149+0000 7f93b9ffb640 1 -- 172.21.15.70:0/1459550812 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f93c8024060 con 0x558685415680 2024-09-12T01:53:54.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.149+0000 7f93da948740 10 client.16125 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T01:53:54.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.149+0000 7f93da948740 10 client.16125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:54.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.149+0000 7f93da948740 20 client.16125 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:54.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.149+0000 7f93da948740 1 --2- 172.21.15.70:0/1459550812 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558685498240 0x55868549a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:54.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.149+0000 7f93da948740 4 client.16125 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:53:54.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.149+0000 7f93da948740 1 -- 172.21.15.70:0/1459550812 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558685377d60 con 0x558685498240 2024-09-12T01:53:54.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.149+0000 7f93d630b640 1 --2- 172.21.15.70:0/1459550812 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558685498240 0x55868549a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:54.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.150+0000 7f93d630b640 1 --2- 172.21.15.70:0/1459550812 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558685498240 0x55868549a630 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b380ab44bae35b8 server_cookie=a2aa7e15c3d026c2 in_seq=0 out_seq=0 2024-09-12T01:53:54.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.150+0000 7f93b9ffb640 10 client.16125 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:54.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.151+0000 7f93b9ffb640 1 -- 172.21.15.70:0/1459550812 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558685377d60 con 0x558685498240 2024-09-12T01:53:54.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.151+0000 7f93b9ffb640 10 client.16125 handle_command_reply: tid=0 2024-09-12T01:53:54.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.151+0000 7f93da948740 1 client.16125 shutdown 2024-09-12T01:53:54.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93da948740 1 -- 172.21.15.70:0/1459550812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558685415680 msgr2=0x558685418cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:54.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93da948740 1 --2- 172.21.15.70:0/1459550812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558685415680 0x558685418cb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f93c809b190 tx=0x7f93c8005cf0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93da948740 1 -- 172.21.15.70:0/1459550812 shutdown_connections 2024-09-12T01:53:54.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93da948740 1 --2- 172.21.15.70:0/1459550812 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558685498240 0x55868549a630 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93da948740 1 --2- 172.21.15.70:0/1459550812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558685415680 0x558685418cb0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93da948740 1 --2- 172.21.15.70:0/1459550812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55868540adc0 0x558685490ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93da948740 1 --2- 172.21.15.70:0/1459550812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55868540a4a0 0x5586854909a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93da948740 1 -- 172.21.15.70:0/1459550812 >> 172.21.15.70:0/1459550812 conn(0x558685406a30 msgr2=0x55868540d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93b9ffb640 0 client.16125 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93da948740 1 -- 172.21.15.70:0/1459550812 shutdown_connections 2024-09-12T01:53:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93da948740 1 -- 172.21.15.70:0/1459550812 wait complete. 2024-09-12T01:53:54.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93da948740 20 client.16125 trim_cache size 0 max 16384 2024-09-12T01:53:54.160 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:53:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-12T01:53:54.160 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-12T01:53:54.160 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:53:54.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93d856f640 1 -- 172.21.15.70:0/2538251230 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93bc0a2b80 msgr2=0x7f93bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:54.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93d856f640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93bc0a2b80 0x7f93bc0a5040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f93cc005fe0 tx=0x7f93cc005f70 comp rx=0 tx=0).stop 2024-09-12T01:53:54.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93d856f640 1 -- 172.21.15.70:0/2538251230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93d0106f20 msgr2=0x7f93d019ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:54.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.152+0000 7f93d856f640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93d0106f20 0x7f93d019ce50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f93c800d950 tx=0x7f93c800de10 comp rx=0 tx=0).stop 2024-09-12T01:53:54.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.153+0000 7f93d856f640 1 -- 172.21.15.70:0/2538251230 shutdown_connections 2024-09-12T01:53:54.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.153+0000 7f93d856f640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93bc0a2b80 0x7f93bc0a5040 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.153+0000 7f93d856f640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f93d0106f20 0x7f93d019ce50 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.153+0000 7f93d856f640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d01027a0 0x7f93d0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.153+0000 7f93d856f640 1 --2- 172.21.15.70:0/2538251230 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93d0101df0 0x7f93d0198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:54.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.153+0000 7f93d856f640 1 -- 172.21.15.70:0/2538251230 >> 172.21.15.70:0/2538251230 conn(0x7f93d00fd8f0 msgr2=0x7f93d00fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:54.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.153+0000 7f93d856f640 1 -- 172.21.15.70:0/2538251230 shutdown_connections 2024-09-12T01:53:54.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:54.153+0000 7f93d856f640 1 -- 172.21.15.70:0/2538251230 wait complete. 2024-09-12T01:53:54.971 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:53:54.971 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:53:55.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa429ffb640 1 -- 172.21.15.70:0/2163190394 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55899e411d20 con 0x55899e52b1a0 2024-09-12T01:53:55.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa429ffb640 10 client.25333 handle_command_reply: tid=0 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa44b27b740 1 client.25333 shutdown 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa44b27b740 1 -- 172.21.15.70:0/2163190394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 msgr2=0x55899e4b3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa44b27b740 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4b3a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55899e4c21e0 tx=0x7fa43c009260 comp rx=0 tx=0).stop 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa44b27b740 1 -- 172.21.15.70:0/2163190394 shutdown_connections 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa44b27b740 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55899e52b1a0 0x55899e52d5c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa44b27b740 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55899e4af940 0x55899e529270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa44b27b740 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55899e4a5080 0x55899e4b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa429ffb640 0 client.25333 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa44b27b740 1 --2- 172.21.15.70:0/2163190394 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55899e4a4760 0x55899e4b3a80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa44b27b740 1 -- 172.21.15.70:0/2163190394 >> 172.21.15.70:0/2163190394 conn(0x55899e4a0cf0 msgr2=0x55899e49f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa44b27b740 1 -- 172.21.15.70:0/2163190394 shutdown_connections 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa44b27b740 1 -- 172.21.15.70:0/2163190394 wait complete. 2024-09-12T01:53:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.192+0000 7fa44b27b740 20 client.25333 trim_cache size 0 max 16384 2024-09-12T01:53:55.194 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:53:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 31, 2024-09-12T01:53:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24452, 2024-09-12T01:53:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 6, 2024-09-12T01:53:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-12T01:53:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "460d82a8": { 2024-09-12T01:53:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 6, 2024-09-12T01:53:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-12T01:53:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-12T01:53:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 133.4, 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:53:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:53:55.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:53:55.196 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:53:55.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.193+0000 7fa448ea2640 1 -- 172.21.15.70:0/4056049020 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa42c0a2b80 msgr2=0x7fa42c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:55.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.193+0000 7fa448ea2640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa42c0a2b80 0x7fa42c0a5040 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa43c031580 tx=0x7fa43c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:53:55.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.193+0000 7fa448ea2640 1 -- 172.21.15.70:0/4056049020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa444102570 msgr2=0x7fa444198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:55.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.193+0000 7fa448ea2640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa444102570 0x7fa444198b80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa43800e9f0 tx=0x7fa43800eeb0 comp rx=0 tx=0).stop 2024-09-12T01:53:55.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.193+0000 7fa448ea2640 1 -- 172.21.15.70:0/4056049020 shutdown_connections 2024-09-12T01:53:55.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.193+0000 7fa448ea2640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa42c0a2b80 0x7fa42c0a5040 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:55.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.193+0000 7fa448ea2640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa444102ef0 0x7fa44419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:55.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.193+0000 7fa448ea2640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa444102570 0x7fa444198b80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:55.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.193+0000 7fa448ea2640 1 --2- 172.21.15.70:0/4056049020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa444100e20 0x7fa444198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:55.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.193+0000 7fa448ea2640 1 -- 172.21.15.70:0/4056049020 >> 172.21.15.70:0/4056049020 conn(0x7fa4440fc7d0 msgr2=0x7fa44406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:55.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.193+0000 7fa448ea2640 1 -- 172.21.15.70:0/4056049020 shutdown_connections 2024-09-12T01:53:55.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:55.193+0000 7fa448ea2640 1 -- 172.21.15.70:0/4056049020 wait complete. 2024-09-12T01:53:55.922 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '460d82a8', quiesce took 4.8 seconds. Will release after: 8.600000000000001 2024-09-12T01:53:55.925 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.379+0000 7fa91d285640 1 -- 172.21.15.70:0/4060533396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa918101400 msgr2=0x7fa91810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:56.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.379+0000 7fa91d285640 1 --2- 172.21.15.70:0/4060533396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa918101400 0x7fa91810d930 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa910009cd0 tx=0x7fa91002a8e0 comp rx=0 tx=0).stop 2024-09-12T01:53:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.379+0000 7fa91d285640 1 -- 172.21.15.70:0/4060533396 shutdown_connections 2024-09-12T01:53:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.379+0000 7fa91d285640 1 --2- 172.21.15.70:0/4060533396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa918101400 0x7fa91810d930 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.379+0000 7fa91d285640 1 --2- 172.21.15.70:0/4060533396 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa918100a60 0x7fa918100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.379+0000 7fa91d285640 1 --2- 172.21.15.70:0/4060533396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa918106a60 0x7fa918106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.379+0000 7fa91d285640 1 -- 172.21.15.70:0/4060533396 >> 172.21.15.70:0/4060533396 conn(0x7fa9180fc780 msgr2=0x7fa9180feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.379+0000 7fa91d285640 1 -- 172.21.15.70:0/4060533396 shutdown_connections 2024-09-12T01:53:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.379+0000 7fa91d285640 1 -- 172.21.15.70:0/4060533396 wait complete. 2024-09-12T01:53:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.379+0000 7fa91d285640 1 Processor -- start 2024-09-12T01:53:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa91d285640 1 -- start start 2024-09-12T01:53:56.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa91d285640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa918100a60 0x7fa9180fce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa91d285640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa918101400 0x7fa9180fd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa91d285640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa918106a60 0x7fa9180fd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa91d285640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa918110f80 con 0x7fa918100a60 2024-09-12T01:53:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa91d285640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa918110e00 con 0x7fa918101400 2024-09-12T01:53:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa91d285640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa918111100 con 0x7fa918106a60 2024-09-12T01:53:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa916ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa918100a60 0x7fa9180fce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa916ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa918100a60 0x7fa9180fce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41604/0 (socket says 172.21.15.70:41604) 2024-09-12T01:53:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa916ffd640 1 -- 172.21.15.70:0/2031199899 learned_addr learned my addr 172.21.15.70:0/2031199899 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa9167fc640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa918101400 0x7fa9180fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa9177fe640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa918106a60 0x7fa9180fd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa916ffd640 1 -- 172.21.15.70:0/2031199899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa918106a60 msgr2=0x7fa9180fd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:56.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa916ffd640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa918106a60 0x7fa9180fd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa916ffd640 1 -- 172.21.15.70:0/2031199899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa918101400 msgr2=0x7fa9180fd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa916ffd640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa918101400 0x7fa9180fd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa916ffd640 1 -- 172.21.15.70:0/2031199899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9181a6990 con 0x7fa918100a60 2024-09-12T01:53:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa9167fc640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa918101400 0x7fa9180fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.380+0000 7fa916ffd640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa918100a60 0x7fa9180fce10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa90800d950 tx=0x7fa90800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.381+0000 7fa90ffff640 1 -- 172.21.15.70:0/2031199899 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908017070 con 0x7fa918100a60 2024-09-12T01:53:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.381+0000 7fa91d285640 1 -- 172.21.15.70:0/2031199899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9181a6c80 con 0x7fa918100a60 2024-09-12T01:53:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.381+0000 7fa90ffff640 1 -- 172.21.15.70:0/2031199899 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa908009c30 con 0x7fa918100a60 2024-09-12T01:53:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.381+0000 7fa90ffff640 1 -- 172.21.15.70:0/2031199899 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90800f740 con 0x7fa918100a60 2024-09-12T01:53:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.381+0000 7fa91d285640 1 -- 172.21.15.70:0/2031199899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9181a71c0 con 0x7fa918100a60 2024-09-12T01:53:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.382+0000 7fa91d285640 1 -- 172.21.15.70:0/2031199899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa918100ec0 con 0x7fa918100a60 2024-09-12T01:53:56.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.383+0000 7fa90ffff640 1 -- 172.21.15.70:0/2031199899 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa908010a80 con 0x7fa918100a60 2024-09-12T01:53:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.383+0000 7fa90ffff640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa9040a2b80 0x7fa9040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.383+0000 7fa9167fc640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa9040a2b80 0x7fa9040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.383+0000 7fa90ffff640 1 -- 172.21.15.70:0/2031199899 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa9080cece0 con 0x7fa918100a60 2024-09-12T01:53:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.384+0000 7fa9167fc640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa9040a2b80 0x7fa9040a5040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa9000058c0 tx=0x7fa900005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:56.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.388+0000 7fa90ffff640 1 -- 172.21.15.70:0/2031199899 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa908009de0 con 0x7fa918100a60 2024-09-12T01:53:56.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.592+0000 7fa91d285640 1 -- 172.21.15.70:0/2031199899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa91802d7c0 con 0x7fa918100a60 2024-09-12T01:53:56.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.593+0000 7fa90ffff640 1 -- 172.21.15.70:0/2031199899 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11984 (secure 0 0 0) 0x7fa90809bc40 con 0x7fa918100a60 2024-09-12T01:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:53:56.593 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":31,"btime":"2024-09-12T01:53:52:674986+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:53:52.608110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:53:56.593 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 31 2024-09-12T01:53:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.595+0000 7fa91d285640 1 -- 172.21.15.70:0/2031199899 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa9040a2b80 msgr2=0x7fa9040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.595+0000 7fa91d285640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa9040a2b80 0x7fa9040a5040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa9000058c0 tx=0x7fa900005850 comp rx=0 tx=0).stop 2024-09-12T01:53:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.595+0000 7fa91d285640 1 -- 172.21.15.70:0/2031199899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa918100a60 msgr2=0x7fa9180fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.595+0000 7fa91d285640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa918100a60 0x7fa9180fce10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa90800d950 tx=0x7fa90800de10 comp rx=0 tx=0).stop 2024-09-12T01:53:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.595+0000 7fa91d285640 1 -- 172.21.15.70:0/2031199899 shutdown_connections 2024-09-12T01:53:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.595+0000 7fa91d285640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa9040a2b80 0x7fa9040a5040 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:56.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.595+0000 7fa91d285640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa918106a60 0x7fa9180fd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.595+0000 7fa91d285640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa918101400 0x7fa9180fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.595+0000 7fa91d285640 1 --2- 172.21.15.70:0/2031199899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa918100a60 0x7fa9180fce10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.595+0000 7fa91d285640 1 -- 172.21.15.70:0/2031199899 >> 172.21.15.70:0/2031199899 conn(0x7fa9180fc780 msgr2=0x7fa91806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.595+0000 7fa91d285640 1 -- 172.21.15.70:0/2031199899 shutdown_connections 2024-09-12T01:53:56.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:56.595+0000 7fa91d285640 1 -- 172.21.15.70:0/2031199899 wait complete. 2024-09-12T01:53:56.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:56 smithi191 ceph-mon[35770]: pgmap v390: 97 pgs: 97 active+clean; 154 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.8 MiB/s wr, 2.08k op/s 2024-09-12T01:53:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:56 smithi152 ceph-mon[35055]: pgmap v390: 97 pgs: 97 active+clean; 154 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.8 MiB/s wr, 2.08k op/s 2024-09-12T01:53:57.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:56 smithi070 ceph-mon[31177]: pgmap v390: 97 pgs: 97 active+clean; 154 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.8 MiB/s wr, 2.08k op/s 2024-09-12T01:53:57.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:53:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:57.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:57 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2031199899' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:53:57.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:57 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2031199899' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:53:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.966+0000 7fb5785a0640 1 -- 172.21.15.70:0/1607427585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb57010c170 msgr2=0x7fb57010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.966+0000 7fb5785a0640 1 --2- 172.21.15.70:0/1607427585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb57010c170 0x7fb57010e610 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb568009ca0 tx=0x7fb56802a950 comp rx=0 tx=0).stop 2024-09-12T01:53:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.966+0000 7fb5785a0640 1 -- 172.21.15.70:0/1607427585 shutdown_connections 2024-09-12T01:53:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.966+0000 7fb5785a0640 1 --2- 172.21.15.70:0/1607427585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb57010c170 0x7fb57010e610 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.966+0000 7fb5785a0640 1 --2- 172.21.15.70:0/1607427585 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb570103660 0x7fb57010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.967+0000 7fb5785a0640 1 --2- 172.21.15.70:0/1607427585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb570102d40 0x7fb570103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.967+0000 7fb5785a0640 1 -- 172.21.15.70:0/1607427585 >> 172.21.15.70:0/1607427585 conn(0x7fb5700fc7a0 msgr2=0x7fb5700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.967+0000 7fb5785a0640 1 -- 172.21.15.70:0/1607427585 shutdown_connections 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.967+0000 7fb5785a0640 1 -- 172.21.15.70:0/1607427585 wait complete. 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.967+0000 7fb5785a0640 1 Processor -- start 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.967+0000 7fb5785a0640 1 -- start start 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.967+0000 7fb5785a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb570102d40 0x7fb570198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.967+0000 7fb5785a0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb570103660 0x7fb570198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb5785a0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb57010c170 0x7fb57019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb5785a0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb5701120f0 con 0x7fb570102d40 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb5785a0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb570111f70 con 0x7fb57010c170 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb5785a0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb570112270 con 0x7fb570103660 2024-09-12T01:53:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb57633c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb570102d40 0x7fb570198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb57633c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb570102d40 0x7fb570198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41620/0 (socket says 172.21.15.70:41620) 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb57633c640 1 -- 172.21.15.70:0/1173890976 learned_addr learned my addr 172.21.15.70:0/1173890976 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb575b3b640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb570103660 0x7fb570198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb57633c640 1 -- 172.21.15.70:0/1173890976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb570103660 msgr2=0x7fb570198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb57633c640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb570103660 0x7fb570198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb57633c640 1 -- 172.21.15.70:0/1173890976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb57010c170 msgr2=0x7fb57019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb57633c640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb57010c170 0x7fb57019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb57633c640 1 -- 172.21.15.70:0/1173890976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57019d540 con 0x7fb570102d40 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb57633c640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb570102d40 0x7fb570198590 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00c890 tx=0x7fb56c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb5677fe640 1 -- 172.21.15.70:0/1173890976 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c004220 con 0x7fb570102d40 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb5677fe640 1 -- 172.21.15.70:0/1173890976 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb56c0043c0 con 0x7fb570102d40 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb5677fe640 1 -- 172.21.15.70:0/1173890976 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c004b10 con 0x7fb570102d40 2024-09-12T01:53:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb5785a0640 1 -- 172.21.15.70:0/1173890976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb57019d830 con 0x7fb570102d40 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.968+0000 7fb5785a0640 1 -- 172.21.15.70:0/1173890976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5701a5110 con 0x7fb570102d40 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.970+0000 7fb5677fe640 1 -- 172.21.15.70:0/1173890976 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb56c0051b0 con 0x7fb570102d40 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb57a979740 1 Processor -- start 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb57a979740 1 -- start start 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb57a979740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668fb40 0x55b9e668e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb57a979740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668e5d0 0x55b9e668ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb57a979740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e669b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb57a979740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b9e65f42f0 con 0x55b9e6699370 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb57a979740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b9e659bcf0 con 0x55b9e668e5d0 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb57a979740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b9e65f02b0 con 0x55b9e668fb40 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb5677fe640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb55c0a2c00 0x7fb55c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb575b3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e669b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb575b3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e669b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41628/0 (socket says 172.21.15.70:41628) 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb575b3b640 1 -- 172.21.15.70:0/4273517781 learned_addr learned my addr 172.21.15.70:0/4273517781 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb576b3d640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb55c0a2c00 0x7fb55c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.971+0000 7fb57633c640 1 --2- 172.21.15.70:0/4273517781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668e5d0 0x55b9e668ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.972+0000 7fb576b3d640 1 --2- 172.21.15.70:0/4273517781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668fb40 0x55b9e668e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.972+0000 7fb5677fe640 1 -- 172.21.15.70:0/1173890976 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb56c0cf130 con 0x7fb570102d40 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.972+0000 7fb575b3b640 1 -- 172.21.15.70:0/4273517781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668fb40 msgr2=0x55b9e668e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.972+0000 7fb575b3b640 1 --2- 172.21.15.70:0/4273517781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668fb40 0x55b9e668e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.972+0000 7fb575b3b640 1 -- 172.21.15.70:0/4273517781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668e5d0 msgr2=0x55b9e668ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.972+0000 7fb575b3b640 1 --2- 172.21.15.70:0/4273517781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668e5d0 0x55b9e668ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.972+0000 7fb575b3b640 1 -- 172.21.15.70:0/4273517781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9e65803a0 con 0x55b9e6699370 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.972+0000 7fb575b3b640 1 --2- 172.21.15.70:0/4273517781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e669b760 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb560007740 tx=0x7fb560007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467ec98841c82838 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.972+0000 7fb576b3d640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb55c0a2c00 0x7fb55c0a50c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb568030040 tx=0x7fb568005c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.972+0000 7fb564ff9640 1 -- 172.21.15.70:0/4273517781 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56000d740 con 0x55b9e6699370 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.972+0000 7fb564ff9640 1 -- 172.21.15.70:0/4273517781 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb560018070 con 0x55b9e6699370 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.972+0000 7fb564ff9640 1 -- 172.21.15.70:0/4273517781 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5600123e0 con 0x55b9e6699370 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.973+0000 7fb57a979740 1 -- 172.21.15.70:0/4273517781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 msgr2=0x55b9e669b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.973+0000 7fb57a979740 1 --2- 172.21.15.70:0/4273517781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e669b760 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb560007740 tx=0x7fb560007b40 comp rx=0 tx=0).stop 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.973+0000 7fb57a979740 1 -- 172.21.15.70:0/4273517781 shutdown_connections 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.973+0000 7fb57a979740 1 --2- 172.21.15.70:0/4273517781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e669b760 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.973+0000 7fb57a979740 1 --2- 172.21.15.70:0/4273517781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668e5d0 0x55b9e668ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.973+0000 7fb57a979740 1 --2- 172.21.15.70:0/4273517781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668fb40 0x55b9e668e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.973+0000 7fb57a979740 1 -- 172.21.15.70:0/4273517781 >> 172.21.15.70:0/4273517781 conn(0x55b9e6657310 msgr2=0x55b9e668ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.973+0000 7fb57a979740 1 -- 172.21.15.70:0/4273517781 shutdown_connections 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.973+0000 7fb57a979740 1 -- 172.21.15.70:0/4273517781 wait complete. 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.973+0000 7fb57a979740 1 -- start start 2024-09-12T01:53:57.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.973+0000 7fb57a979740 1 Processor -- start 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb57a979740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668e5d0 0x55b9e6698d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb57a979740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668fb40 0x55b9e6695fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb57a979740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e66965d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb57a979740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b9e669c070 con 0x55b9e6699370 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb57a979740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b9e65af060 con 0x55b9e668e5d0 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb57a979740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b9e669c1f0 con 0x55b9e668fb40 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb57a979740 10 client.0 _ll_register_callbacks cb 0x55b9e63028c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb576b3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e66965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb576b3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e66965d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41632/0 (socket says 172.21.15.70:41632) 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb576b3d640 1 -- 172.21.15.70:0/2852700058 learned_addr learned my addr 172.21.15.70:0/2852700058 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb575b3b640 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668fb40 0x55b9e6695fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb57633c640 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668e5d0 0x55b9e6698d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb576b3d640 1 -- 172.21.15.70:0/2852700058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668fb40 msgr2=0x55b9e6695fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb576b3d640 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668fb40 0x55b9e6695fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb576b3d640 1 -- 172.21.15.70:0/2852700058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668e5d0 msgr2=0x55b9e6698d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb576b3d640 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668e5d0 0x55b9e6698d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb576b3d640 1 -- 172.21.15.70:0/2852700058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9e63653c0 con 0x55b9e6699370 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb57633c640 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668e5d0 0x55b9e6698d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb576b3d640 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e66965d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb5680306c0 tx=0x7fb5680095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44283e91cba7d711 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb559ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb559ffb640 1 -- 172.21.15.70:0/2852700058 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56802fc90 con 0x55b9e6699370 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb559ffb640 1 -- 172.21.15.70:0/2852700058 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb568048450 con 0x55b9e6699370 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb57a979740 1 -- 172.21.15.70:0/2852700058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb560018070 con 0x55b9e6699370 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.974+0000 7fb559ffb640 1 -- 172.21.15.70:0/2852700058 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb568048650 con 0x55b9e6699370 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.975+0000 7fb57a979740 10 client.16143 fetch_fsmap learned FSMap version 32 2024-09-12T01:53:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.975+0000 7fb57a979740 1 -- 172.21.15.70:0/2852700058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b9e66a7ad0 con 0x55b9e6699370 2024-09-12T01:53:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.975+0000 7fb559ffb640 1 -- 172.21.15.70:0/2852700058 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb560018070 con 0x55b9e6699370 2024-09-12T01:53:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.975+0000 7fb559ffb640 1 -- 172.21.15.70:0/2852700058 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fb568045040 con 0x55b9e6699370 2024-09-12T01:53:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.975+0000 7fb57a979740 10 client.16143 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:53:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.975+0000 7fb57a979740 10 client.16143 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T01:53:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.975+0000 7fb57a979740 20 client.16143 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.975+0000 7fb57a979740 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55b9e66a8f90 0x55b9e66ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.975+0000 7fb57a979740 4 client.16143 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.975+0000 7fb57a979740 1 -- 172.21.15.70:0/2852700058 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9e6601860 con 0x55b9e66a8f90 2024-09-12T01:53:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.975+0000 7fb57633c640 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55b9e66a8f90 0x55b9e66ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.976+0000 7fb559ffb640 10 client.16143 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:53:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.976+0000 7fb57633c640 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55b9e66a8f90 0x55b9e66ab3c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9927ae5993b29b03 server_cookie=2199ff030402e5a2 in_seq=0 out_seq=0 2024-09-12T01:53:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.976+0000 7fb559ffb640 1 -- 172.21.15.70:0/2852700058 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9e6601860 con 0x55b9e66a8f90 2024-09-12T01:53:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.976+0000 7fb559ffb640 10 client.16143 handle_command_reply: tid=0 2024-09-12T01:53:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.976+0000 7fb57a979740 1 client.16143 shutdown 2024-09-12T01:53:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.976+0000 7fb57a979740 1 -- 172.21.15.70:0/2852700058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 msgr2=0x55b9e66965d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.976+0000 7fb57a979740 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e66965d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb5680306c0 tx=0x7fb5680095c0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.976+0000 7fb57a979740 1 -- 172.21.15.70:0/2852700058 shutdown_connections 2024-09-12T01:53:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.976+0000 7fb57a979740 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55b9e66a8f90 0x55b9e66ab3c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.977+0000 7fb57a979740 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e66965d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.977+0000 7fb57a979740 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668fb40 0x55b9e6695fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.977+0000 7fb57a979740 1 --2- 172.21.15.70:0/2852700058 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668e5d0 0x55b9e6698d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.977+0000 7fb57a979740 1 -- 172.21.15.70:0/2852700058 >> 172.21.15.70:0/2852700058 conn(0x55b9e6657310 msgr2=0x55b9e6690960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:57.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.977+0000 7fb559ffb640 0 client.16143 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:53:57.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.977+0000 7fb57a979740 1 -- 172.21.15.70:0/2852700058 shutdown_connections 2024-09-12T01:53:57.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.977+0000 7fb57a979740 1 -- 172.21.15.70:0/2852700058 wait complete. 2024-09-12T01:53:57.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.977+0000 7fb57a979740 20 client.16143 trim_cache size 0 max 16384 2024-09-12T01:53:57.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.989+0000 7fb57a979740 1 Processor -- start 2024-09-12T01:53:57.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.989+0000 7fb57a979740 1 -- start start 2024-09-12T01:53:57.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.989+0000 7fb57a979740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668e5d0 0x55b9e668ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb57a979740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668fb40 0x55b9e66a5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb57a979740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e6691120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb57a979740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb5701ad720 con 0x55b9e6699370 2024-09-12T01:53:57.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb57a979740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb5701af320 con 0x55b9e668fb40 2024-09-12T01:53:57.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb57a979740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb5701addf0 con 0x55b9e668e5d0 2024-09-12T01:53:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb576b3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e6691120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb576b3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e6691120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41646/0 (socket says 172.21.15.70:41646) 2024-09-12T01:53:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb576b3d640 1 -- 172.21.15.70:0/3311246071 learned_addr learned my addr 172.21.15.70:0/3311246071 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb57633c640 1 --2- 172.21.15.70:0/3311246071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668e5d0 0x55b9e668ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb575b3b640 1 --2- 172.21.15.70:0/3311246071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668fb40 0x55b9e66a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb576b3d640 1 -- 172.21.15.70:0/3311246071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668e5d0 msgr2=0x55b9e668ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb576b3d640 1 --2- 172.21.15.70:0/3311246071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668e5d0 0x55b9e668ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb576b3d640 1 -- 172.21.15.70:0/3311246071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668fb40 msgr2=0x55b9e66a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb576b3d640 1 --2- 172.21.15.70:0/3311246071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668fb40 0x55b9e66a5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb576b3d640 1 -- 172.21.15.70:0/3311246071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9e6694530 con 0x55b9e6699370 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb575b3b640 1 --2- 172.21.15.70:0/3311246071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668fb40 0x55b9e66a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb576b3d640 1 --2- 172.21.15.70:0/3311246071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e6691120 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb56802ae70 tx=0x7fb5680485e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1bf246d71222e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb55bfff640 1 -- 172.21.15.70:0/3311246071 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56802f830 con 0x55b9e6699370 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb55bfff640 1 -- 172.21.15.70:0/3311246071 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb56802fac0 con 0x55b9e6699370 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.990+0000 7fb55bfff640 1 -- 172.21.15.70:0/3311246071 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568052410 con 0x55b9e6699370 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.991+0000 7fb57a979740 1 -- 172.21.15.70:0/3311246071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 msgr2=0x55b9e6691120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.991+0000 7fb57a979740 1 --2- 172.21.15.70:0/3311246071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e6691120 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb56802ae70 tx=0x7fb5680485e0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.991+0000 7fb57a979740 1 -- 172.21.15.70:0/3311246071 shutdown_connections 2024-09-12T01:53:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.991+0000 7fb57a979740 1 --2- 172.21.15.70:0/3311246071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e6699370 0x55b9e6691120 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.991+0000 7fb57a979740 1 --2- 172.21.15.70:0/3311246071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e668fb40 0x55b9e66a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.991+0000 7fb57a979740 1 --2- 172.21.15.70:0/3311246071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668e5d0 0x55b9e668ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.991+0000 7fb57a979740 1 -- 172.21.15.70:0/3311246071 >> 172.21.15.70:0/3311246071 conn(0x55b9e6657310 msgr2=0x55b9e668a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.991+0000 7fb57a979740 1 -- 172.21.15.70:0/3311246071 shutdown_connections 2024-09-12T01:53:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.991+0000 7fb57a979740 1 -- 172.21.15.70:0/3311246071 wait complete. 2024-09-12T01:53:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.991+0000 7fb57a979740 1 -- start start 2024-09-12T01:53:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.991+0000 7fb57a979740 1 Processor -- start 2024-09-12T01:53:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb57a979740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668e5d0 0x55b9e669ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb57a979740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e668fb40 0x55b9e669cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb57a979740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e6699370 0x55b9e6711c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb57a979740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb5701aebc0 con 0x55b9e668fb40 2024-09-12T01:53:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb57a979740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb5701ae4f0 con 0x55b9e6699370 2024-09-12T01:53:58.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb57a979740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb5701ab6e0 con 0x55b9e668e5d0 2024-09-12T01:53:58.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb57a979740 10 client.0 _ll_register_callbacks cb 0x7fb568009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:58.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb575b3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e668fb40 0x55b9e669cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb575b3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e668fb40 0x55b9e669cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41648/0 (socket says 172.21.15.70:41648) 2024-09-12T01:53:58.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb575b3b640 1 -- 172.21.15.70:0/692717199 learned_addr learned my addr 172.21.15.70:0/692717199 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:58.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb57633c640 1 --2- 172.21.15.70:0/692717199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668e5d0 0x55b9e669ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb575b3b640 1 -- 172.21.15.70:0/692717199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668e5d0 msgr2=0x55b9e669ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:58.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb575b3b640 1 --2- 172.21.15.70:0/692717199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668e5d0 0x55b9e669ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb575b3b640 1 -- 172.21.15.70:0/692717199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e6699370 msgr2=0x55b9e6711c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:58.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb575b3b640 1 --2- 172.21.15.70:0/692717199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e6699370 0x55b9e6711c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb575b3b640 1 -- 172.21.15.70:0/692717199 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9e6712190 con 0x55b9e668fb40 2024-09-12T01:53:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb575b3b640 1 --2- 172.21.15.70:0/692717199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e668fb40 0x55b9e669cf40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55b9e668f070 tx=0x7fb5600136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7394faae25593f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb559ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb559ffb640 1 -- 172.21.15.70:0/692717199 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56000d740 con 0x55b9e668fb40 2024-09-12T01:53:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb559ffb640 1 -- 172.21.15.70:0/692717199 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb56000d8e0 con 0x55b9e668fb40 2024-09-12T01:53:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb57a979740 1 -- 172.21.15.70:0/692717199 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb56802fac0 con 0x55b9e668fb40 2024-09-12T01:53:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb559ffb640 1 -- 172.21.15.70:0/692717199 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb56000dae0 con 0x55b9e668fb40 2024-09-12T01:53:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb57a979740 10 client.16149 fetch_fsmap learned FSMap version 32 2024-09-12T01:53:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.992+0000 7fb57a979740 1 -- 172.21.15.70:0/692717199 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b9e6713400 con 0x55b9e668fb40 2024-09-12T01:53:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.993+0000 7fb559ffb640 1 -- 172.21.15.70:0/692717199 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb56802fac0 con 0x55b9e668fb40 2024-09-12T01:53:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.993+0000 7fb559ffb640 1 -- 172.21.15.70:0/692717199 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fb560032400 con 0x55b9e668fb40 2024-09-12T01:53:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.993+0000 7fb57a979740 10 client.16149 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.993+0000 7fb57a979740 10 client.16149 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.993+0000 7fb57a979740 20 client.16149 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.993+0000 7fb57a979740 1 --2- 172.21.15.70:0/692717199 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55b9e6713920 0x55b9e6715d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.993+0000 7fb57a979740 4 client.16149 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.993+0000 7fb57a979740 1 -- 172.21.15.70:0/692717199 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b9e65fbd70 con 0x55b9e6713920 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.993+0000 7fb57633c640 1 --2- 172.21.15.70:0/692717199 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55b9e6713920 0x55b9e6715d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb559ffb640 10 client.16149 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57633c640 1 --2- 172.21.15.70:0/692717199 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55b9e6713920 0x55b9e6715d10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=15324c6edda73c7b server_cookie=172a38a14d2f5c99 in_seq=0 out_seq=0 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb559ffb640 1 -- 172.21.15.70:0/692717199 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b9e65fbd70 con 0x55b9e6713920 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb559ffb640 10 client.16149 handle_command_reply: tid=0 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57a979740 1 client.16149 shutdown 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57a979740 1 -- 172.21.15.70:0/692717199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e668fb40 msgr2=0x55b9e669cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57a979740 1 --2- 172.21.15.70:0/692717199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e668fb40 0x55b9e669cf40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55b9e668f070 tx=0x7fb5600136b0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57a979740 1 -- 172.21.15.70:0/692717199 shutdown_connections 2024-09-12T01:53:58.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57a979740 1 --2- 172.21.15.70:0/692717199 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55b9e6713920 0x55b9e6715d10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57a979740 1 --2- 172.21.15.70:0/692717199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b9e6699370 0x55b9e6711c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57a979740 1 --2- 172.21.15.70:0/692717199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b9e668fb40 0x55b9e669cf40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb559ffb640 0 client.16149 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:53:58.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57a979740 1 --2- 172.21.15.70:0/692717199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b9e668e5d0 0x55b9e669ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57a979740 1 -- 172.21.15.70:0/692717199 >> 172.21.15.70:0/692717199 conn(0x55b9e6657310 msgr2=0x55b9e6697840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:58.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57a979740 1 -- 172.21.15.70:0/692717199 shutdown_connections 2024-09-12T01:53:58.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57a979740 1 -- 172.21.15.70:0/692717199 wait complete. 2024-09-12T01:53:58.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.994+0000 7fb57a979740 20 client.16149 trim_cache size 0 max 16384 2024-09-12T01:53:58.004 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:53:58.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.995+0000 7fb5785a0640 1 -- 172.21.15.70:0/1173890976 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb55c0a2c00 msgr2=0x7fb55c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.995+0000 7fb5785a0640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb55c0a2c00 0x7fb55c0a50c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb568030040 tx=0x7fb568005c50 comp rx=0 tx=0).stop 2024-09-12T01:53:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.995+0000 7fb5785a0640 1 -- 172.21.15.70:0/1173890976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb570102d40 msgr2=0x7fb570198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.995+0000 7fb5785a0640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb570102d40 0x7fb570198590 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00c890 tx=0x7fb56c00cd50 comp rx=0 tx=0).stop 2024-09-12T01:53:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.995+0000 7fb5785a0640 1 -- 172.21.15.70:0/1173890976 shutdown_connections 2024-09-12T01:53:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.995+0000 7fb5785a0640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fb55c0a2c00 0x7fb55c0a50c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.995+0000 7fb5785a0640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb57010c170 0x7fb57019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.995+0000 7fb5785a0640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb570103660 0x7fb570198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.995+0000 7fb5785a0640 1 --2- 172.21.15.70:0/1173890976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb570102d40 0x7fb570198590 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.995+0000 7fb5785a0640 1 -- 172.21.15.70:0/1173890976 >> 172.21.15.70:0/1173890976 conn(0x7fb5700fc7a0 msgr2=0x7fb5700fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.995+0000 7fb5785a0640 1 -- 172.21.15.70:0/1173890976 shutdown_connections 2024-09-12T01:53:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:57.995+0000 7fb5785a0640 1 -- 172.21.15.70:0/1173890976 wait complete. 2024-09-12T01:53:58.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:57 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2031199899' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:53:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.294+0000 7fa748c0e640 1 -- 172.21.15.70:0/3596742011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa744101b60 msgr2=0x7fa744101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.294+0000 7fa748c0e640 1 --2- 172.21.15.70:0/3596742011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa744101b60 0x7fa744101f60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa734009900 tx=0x7fa73402a410 comp rx=0 tx=0).stop 2024-09-12T01:53:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.294+0000 7fa748c0e640 1 -- 172.21.15.70:0/3596742011 shutdown_connections 2024-09-12T01:53:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.294+0000 7fa748c0e640 1 --2- 172.21.15.70:0/3596742011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa744103710 0x7fa744109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.294+0000 7fa748c0e640 1 --2- 172.21.15.70:0/3596742011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa744102d50 0x7fa7441031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.294+0000 7fa748c0e640 1 --2- 172.21.15.70:0/3596742011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa744101b60 0x7fa744101f60 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.294+0000 7fa748c0e640 1 -- 172.21.15.70:0/3596742011 >> 172.21.15.70:0/3596742011 conn(0x7fa7440fd2e0 msgr2=0x7fa7440ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.294+0000 7fa748c0e640 1 -- 172.21.15.70:0/3596742011 shutdown_connections 2024-09-12T01:53:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.294+0000 7fa748c0e640 1 -- 172.21.15.70:0/3596742011 wait complete. 2024-09-12T01:53:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.295+0000 7fa748c0e640 1 Processor -- start 2024-09-12T01:53:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.295+0000 7fa748c0e640 1 -- start start 2024-09-12T01:53:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.295+0000 7fa748c0e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa744101b60 0x7fa744075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.295+0000 7fa748c0e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa744102d50 0x7fa7440745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.295+0000 7fa748c0e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa744103710 0x7fa744074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.295+0000 7fa748c0e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa74410d940 con 0x7fa744102d50 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.295+0000 7fa748c0e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa74410d7c0 con 0x7fa744103710 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.295+0000 7fa748c0e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa74410dac0 con 0x7fa744101b60 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.295+0000 7fa741d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa744102d50 0x7fa7440745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.295+0000 7fa741d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa744102d50 0x7fa7440745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41666/0 (socket says 172.21.15.70:41666) 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.295+0000 7fa741d9b640 1 -- 172.21.15.70:0/3832892154 learned_addr learned my addr 172.21.15.70:0/3832892154 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa74259c640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa744101b60 0x7fa744075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa741d9b640 1 -- 172.21.15.70:0/3832892154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa744101b60 msgr2=0x7fa744075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa741d9b640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa744101b60 0x7fa744075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa741d9b640 1 -- 172.21.15.70:0/3832892154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa744103710 msgr2=0x7fa744074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa742d9d640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa744103710 0x7fa744074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa741d9b640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa744103710 0x7fa744074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa741d9b640 1 -- 172.21.15.70:0/3832892154 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7440753b0 con 0x7fa744102d50 2024-09-12T01:53:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa742d9d640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa744103710 0x7fa744074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa741d9b640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa744102d50 0x7fa7440745e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa73800c970 tx=0x7fa73800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa7337fe640 1 -- 172.21.15.70:0/3832892154 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738007bb0 con 0x7fa744102d50 2024-09-12T01:53:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa7337fe640 1 -- 172.21.15.70:0/3832892154 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa738007d50 con 0x7fa744102d50 2024-09-12T01:53:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa748c0e640 1 -- 172.21.15.70:0/3832892154 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7441a1f70 con 0x7fa744102d50 2024-09-12T01:53:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa7337fe640 1 -- 172.21.15.70:0/3832892154 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73800f4b0 con 0x7fa744102d50 2024-09-12T01:53:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.296+0000 7fa748c0e640 1 -- 172.21.15.70:0/3832892154 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7441a2380 con 0x7fa744102d50 2024-09-12T01:53:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.298+0000 7fa7337fe640 1 -- 172.21.15.70:0/3832892154 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa7380046c0 con 0x7fa744102d50 2024-09-12T01:53:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.298+0000 7fa74ba84740 1 Processor -- start 2024-09-12T01:53:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa74ba84740 1 -- start start 2024-09-12T01:53:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa74ba84740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1079a0 0x55fe2b107da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa74ba84740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b1082e0 0x55fe2b10cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa74ba84740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b10d370 0x55fe2b10f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa74ba84740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fe2b06b2f0 con 0x55fe2b10d370 2024-09-12T01:53:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa74ba84740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fe2b013270 con 0x55fe2b1079a0 2024-09-12T01:53:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa74ba84740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fe2b0672b0 con 0x55fe2b1082e0 2024-09-12T01:53:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa741d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b10d370 0x55fe2b10f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa741d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b10d370 0x55fe2b10f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41678/0 (socket says 172.21.15.70:41678) 2024-09-12T01:53:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa741d9b640 1 -- 172.21.15.70:0/1592052940 learned_addr learned my addr 172.21.15.70:0/1592052940 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa742d9d640 1 --2- 172.21.15.70:0/1592052940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1079a0 0x55fe2b107da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa74259c640 1 --2- 172.21.15.70:0/1592052940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b1082e0 0x55fe2b10cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa741d9b640 1 -- 172.21.15.70:0/1592052940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b1082e0 msgr2=0x55fe2b10cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa741d9b640 1 --2- 172.21.15.70:0/1592052940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b1082e0 0x55fe2b10cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa741d9b640 1 -- 172.21.15.70:0/1592052940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1079a0 msgr2=0x55fe2b107da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa741d9b640 1 --2- 172.21.15.70:0/1592052940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1079a0 0x55fe2b107da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa741d9b640 1 -- 172.21.15.70:0/1592052940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2b012340 con 0x55fe2b10d370 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa7337fe640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa72c0a2c30 0x7fa72c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.299+0000 7fa741d9b640 1 --2- 172.21.15.70:0/1592052940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b10d370 0x55fe2b10f830 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa7380d5470 tx=0x7fa7380d5930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4183136b02d4a7ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.300+0000 7fa742d9d640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa72c0a2c30 0x7fa72c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.300+0000 7fa7337fe640 1 -- 172.21.15.70:0/3832892154 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa7380cee30 con 0x7fa744102d50 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.300+0000 7fa730ff9640 1 -- 172.21.15.70:0/1592052940 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738097930 con 0x55fe2b10d370 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.300+0000 7fa730ff9640 1 -- 172.21.15.70:0/1592052940 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa73809bd90 con 0x55fe2b10d370 2024-09-12T01:53:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.300+0000 7fa730ff9640 1 -- 172.21.15.70:0/1592052940 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73809aff0 con 0x55fe2b10d370 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.300+0000 7fa74ba84740 1 -- 172.21.15.70:0/1592052940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b10d370 msgr2=0x55fe2b10f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.300+0000 7fa742d9d640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa72c0a2c30 0x7fa72c0a50f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa73c005fd0 tx=0x7fa73c0086a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.300+0000 7fa74ba84740 1 --2- 172.21.15.70:0/1592052940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b10d370 0x55fe2b10f830 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa7380d5470 tx=0x7fa7380d5930 comp rx=0 tx=0).stop 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.300+0000 7fa74ba84740 1 -- 172.21.15.70:0/1592052940 shutdown_connections 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.300+0000 7fa74ba84740 1 --2- 172.21.15.70:0/1592052940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b10d370 0x55fe2b10f830 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.300+0000 7fa74ba84740 1 --2- 172.21.15.70:0/1592052940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b1082e0 0x55fe2b10cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.300+0000 7fa74ba84740 1 --2- 172.21.15.70:0/1592052940 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1079a0 0x55fe2b107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74ba84740 1 -- 172.21.15.70:0/1592052940 >> 172.21.15.70:0/1592052940 conn(0x55fe2b103010 msgr2=0x55fe2b103410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74ba84740 1 -- 172.21.15.70:0/1592052940 shutdown_connections 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74ba84740 1 -- 172.21.15.70:0/1592052940 wait complete. 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74ba84740 1 -- start start 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74ba84740 1 Processor -- start 2024-09-12T01:53:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74ba84740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1079a0 0x55fe2b111ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74ba84740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 0x55fe2b1120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74ba84740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b10d370 0x55fe2b119120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74ba84740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fe2b110340 con 0x55fe2b1082e0 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74ba84740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55fe2aff4290 con 0x55fe2b1079a0 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74ba84740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fe2b1104c0 con 0x55fe2b10d370 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74ba84740 10 client.0 _ll_register_callbacks cb 0x55fe2b025140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa741d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 0x55fe2b1120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa741d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 0x55fe2b1120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41692/0 (socket says 172.21.15.70:41692) 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa741d9b640 1 -- 172.21.15.70:0/2510492692 learned_addr learned my addr 172.21.15.70:0/2510492692 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa74259c640 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1079a0 0x55fe2b111ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa742d9d640 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b10d370 0x55fe2b119120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.301+0000 7fa741d9b640 1 -- 172.21.15.70:0/2510492692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b10d370 msgr2=0x55fe2b119120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa741d9b640 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b10d370 0x55fe2b119120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa741d9b640 1 -- 172.21.15.70:0/2510492692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1079a0 msgr2=0x55fe2b111ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa741d9b640 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1079a0 0x55fe2b111ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa741d9b640 1 -- 172.21.15.70:0/2510492692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe2ad7e210 con 0x55fe2b1082e0 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa74259c640 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1079a0 0x55fe2b111ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa742d9d640 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b10d370 0x55fe2b119120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa741d9b640 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 0x55fe2b1120e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa7380d5e30 tx=0x7fa738004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b665cb46d3a9ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa729ffb640 1 -- 172.21.15.70:0/2510492692 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73801d070 con 0x55fe2b1082e0 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa729ffb640 1 -- 172.21.15.70:0/2510492692 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa738099990 con 0x55fe2b1082e0 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa74ba84740 1 -- 172.21.15.70:0/2510492692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa73809bd90 con 0x55fe2b1082e0 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa729ffb640 1 -- 172.21.15.70:0/2510492692 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa73809b1d0 con 0x55fe2b1082e0 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa74ba84740 10 client.16161 fetch_fsmap learned FSMap version 32 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa74ba84740 1 -- 172.21.15.70:0/2510492692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fe2ae4a620 con 0x55fe2b1082e0 2024-09-12T01:53:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa729ffb640 1 -- 172.21.15.70:0/2510492692 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa73809bd90 con 0x55fe2b1082e0 2024-09-12T01:53:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa729ffb640 1 -- 172.21.15.70:0/2510492692 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fa738060be0 con 0x55fe2b1082e0 2024-09-12T01:53:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa74ba84740 10 client.16161 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:53:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa74ba84740 10 client.16161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa74ba84740 20 client.16161 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa74ba84740 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55fe2b11d420 0x55fe2b11f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa74ba84740 4 client.16161 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.302+0000 7fa74ba84740 1 -- 172.21.15.70:0/2510492692 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe2b078a20 con 0x55fe2b11d420 2024-09-12T01:53:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.303+0000 7fa74259c640 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55fe2b11d420 0x55fe2b11f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.303+0000 7fa729ffb640 10 client.16161 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.303+0000 7fa74259c640 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55fe2b11d420 0x55fe2b11f810 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78b3f67d7b293cd5 server_cookie=2a4461ba35c71c6b in_seq=0 out_seq=0 2024-09-12T01:53:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa729ffb640 1 -- 172.21.15.70:0/2510492692 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe2b078a20 con 0x55fe2b11d420 2024-09-12T01:53:58.311 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa729ffb640 10 client.16161 handle_command_reply: tid=0 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa74ba84740 1 client.16161 shutdown 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa74ba84740 1 -- 172.21.15.70:0/2510492692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 msgr2=0x55fe2b1120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa74ba84740 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 0x55fe2b1120e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa7380d5e30 tx=0x7fa738004b00 comp rx=0 tx=0).stop 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa74ba84740 1 -- 172.21.15.70:0/2510492692 shutdown_connections 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa74ba84740 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55fe2b11d420 0x55fe2b11f810 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa74ba84740 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b10d370 0x55fe2b119120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa74ba84740 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 0x55fe2b1120e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa729ffb640 0 client.16161 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa74ba84740 1 --2- 172.21.15.70:0/2510492692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1079a0 0x55fe2b111ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa74ba84740 1 -- 172.21.15.70:0/2510492692 >> 172.21.15.70:0/2510492692 conn(0x55fe2b103010 msgr2=0x55fe2b104820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa74ba84740 1 -- 172.21.15.70:0/2510492692 shutdown_connections 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa74ba84740 1 -- 172.21.15.70:0/2510492692 wait complete. 2024-09-12T01:53:58.312 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.304+0000 7fa74ba84740 20 client.16161 trim_cache size 0 max 16384 2024-09-12T01:53:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.318+0000 7fa74ba84740 1 Processor -- start 2024-09-12T01:53:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.318+0000 7fa74ba84740 1 -- start start 2024-09-12T01:53:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.318+0000 7fa74ba84740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b103010 0x55fe2b1020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.318+0000 7fa74ba84740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b1079a0 0x55fe2b1190e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.318+0000 7fa74ba84740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 0x55fe2b106410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.318+0000 7fa74ba84740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa7441ab280 con 0x55fe2b1082e0 2024-09-12T01:53:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.318+0000 7fa74ba84740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa7441ace80 con 0x55fe2b103010 2024-09-12T01:53:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.318+0000 7fa74ba84740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa7441ab950 con 0x55fe2b1079a0 2024-09-12T01:53:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa742d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 0x55fe2b106410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.323 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa742d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 0x55fe2b106410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41702/0 (socket says 172.21.15.70:41702) 2024-09-12T01:53:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa742d9d640 1 -- 172.21.15.70:0/2136199372 learned_addr learned my addr 172.21.15.70:0/2136199372 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa74259c640 1 --2- 172.21.15.70:0/2136199372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b103010 0x55fe2b1020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa741d9b640 1 --2- 172.21.15.70:0/2136199372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b1079a0 0x55fe2b1190e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa742d9d640 1 -- 172.21.15.70:0/2136199372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b1079a0 msgr2=0x55fe2b1190e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa742d9d640 1 --2- 172.21.15.70:0/2136199372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b1079a0 0x55fe2b1190e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa742d9d640 1 -- 172.21.15.70:0/2136199372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b103010 msgr2=0x55fe2b1020b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa742d9d640 1 --2- 172.21.15.70:0/2136199372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b103010 0x55fe2b1020b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa742d9d640 1 -- 172.21.15.70:0/2136199372 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2b11fb80 con 0x55fe2b1082e0 2024-09-12T01:53:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa741d9b640 1 --2- 172.21.15.70:0/2136199372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b1079a0 0x55fe2b1190e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa74259c640 1 --2- 172.21.15.70:0/2136199372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b103010 0x55fe2b1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:53:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa742d9d640 1 --2- 172.21.15.70:0/2136199372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 0x55fe2b106410 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa73c01d610 tx=0x7fa73c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac42ac73e99e848 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa72bfff640 1 -- 172.21.15.70:0/2136199372 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c026630 con 0x55fe2b1082e0 2024-09-12T01:53:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa72bfff640 1 -- 172.21.15.70:0/2136199372 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa73c01a920 con 0x55fe2b1082e0 2024-09-12T01:53:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.319+0000 7fa72bfff640 1 -- 172.21.15.70:0/2136199372 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c01c9f0 con 0x55fe2b1082e0 2024-09-12T01:53:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.320+0000 7fa74ba84740 1 -- 172.21.15.70:0/2136199372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 msgr2=0x55fe2b106410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.320+0000 7fa74ba84740 1 --2- 172.21.15.70:0/2136199372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 0x55fe2b106410 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa73c01d610 tx=0x7fa73c013000 comp rx=0 tx=0).stop 2024-09-12T01:53:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.320+0000 7fa74ba84740 1 -- 172.21.15.70:0/2136199372 shutdown_connections 2024-09-12T01:53:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.320+0000 7fa74ba84740 1 --2- 172.21.15.70:0/2136199372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1082e0 0x55fe2b106410 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.320+0000 7fa74ba84740 1 --2- 172.21.15.70:0/2136199372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b1079a0 0x55fe2b1190e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.320+0000 7fa74ba84740 1 --2- 172.21.15.70:0/2136199372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b103010 0x55fe2b1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.320+0000 7fa74ba84740 1 -- 172.21.15.70:0/2136199372 >> 172.21.15.70:0/2136199372 conn(0x55fe2b108da0 msgr2=0x55fe2b1019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.320+0000 7fa74ba84740 1 -- 172.21.15.70:0/2136199372 shutdown_connections 2024-09-12T01:53:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.320+0000 7fa74ba84740 1 -- 172.21.15.70:0/2136199372 wait complete. 2024-09-12T01:53:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.320+0000 7fa74ba84740 1 -- start start 2024-09-12T01:53:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.320+0000 7fa74ba84740 1 Processor -- start 2024-09-12T01:53:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.320+0000 7fa74ba84740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b103010 0x55fe2b115f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa74ba84740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1079a0 0x55fe2b1164c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa74ba84740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1082e0 0x55fe2b186030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa74ba84740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa7441ac720 con 0x55fe2b1079a0 2024-09-12T01:53:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa74ba84740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa7441ac050 con 0x55fe2b1082e0 2024-09-12T01:53:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa74ba84740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa7441a9240 con 0x55fe2b103010 2024-09-12T01:53:58.326 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa741d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1079a0 0x55fe2b1164c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa74ba84740 10 client.0 _ll_register_callbacks cb 0x7fa73c008570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa741d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1079a0 0x55fe2b1164c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41708/0 (socket says 172.21.15.70:41708) 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa741d9b640 1 -- 172.21.15.70:0/422698698 learned_addr learned my addr 172.21.15.70:0/422698698 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa74259c640 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b103010 0x55fe2b115f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa742d9d640 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1082e0 0x55fe2b186030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa741d9b640 1 -- 172.21.15.70:0/422698698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b103010 msgr2=0x55fe2b115f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa741d9b640 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b103010 0x55fe2b115f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa741d9b640 1 -- 172.21.15.70:0/422698698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1082e0 msgr2=0x55fe2b186030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa741d9b640 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1082e0 0x55fe2b186030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa741d9b640 1 -- 172.21.15.70:0/422698698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe2b186570 con 0x55fe2b1079a0 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa741d9b640 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1079a0 0x55fe2b1164c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa7380058c0 tx=0x7fa7380cf0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9534f0fb3c167e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa729ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa729ffb640 1 -- 172.21.15.70:0/422698698 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73801d020 con 0x55fe2b1079a0 2024-09-12T01:53:58.327 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa729ffb640 1 -- 172.21.15.70:0/422698698 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa7380d2ba0 con 0x55fe2b1079a0 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa74ba84740 1 -- 172.21.15.70:0/422698698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa73c01a920 con 0x55fe2b1079a0 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa729ffb640 1 -- 172.21.15.70:0/422698698 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa73809b460 con 0x55fe2b1079a0 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa74ba84740 10 client.16167 fetch_fsmap learned FSMap version 32 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa74ba84740 1 -- 172.21.15.70:0/422698698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fe2b187790 con 0x55fe2b1079a0 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.321+0000 7fa729ffb640 1 -- 172.21.15.70:0/422698698 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa73c01a920 con 0x55fe2b1079a0 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.322+0000 7fa729ffb640 1 -- 172.21.15.70:0/422698698 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fa738060be0 con 0x55fe2b1079a0 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.322+0000 7fa74ba84740 10 client.16167 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.322+0000 7fa74ba84740 10 client.16167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.322+0000 7fa74ba84740 20 client.16167 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.322+0000 7fa74ba84740 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55fe2b10d370 0x55fe2b18a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.322+0000 7fa74ba84740 4 client.16167 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.322+0000 7fa74ba84740 1 -- 172.21.15.70:0/422698698 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe2b072d70 con 0x55fe2b10d370 2024-09-12T01:53:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.322+0000 7fa74259c640 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55fe2b10d370 0x55fe2b18a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.322+0000 7fa729ffb640 10 client.16167 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.322+0000 7fa74259c640 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55fe2b10d370 0x55fe2b18a040 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adef68a549c3aff2 server_cookie=e23d6b9fd3d774ce in_seq=0 out_seq=0 2024-09-12T01:53:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa729ffb640 1 -- 172.21.15.70:0/422698698 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe2b072d70 con 0x55fe2b10d370 2024-09-12T01:53:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa729ffb640 10 client.16167 handle_command_reply: tid=0 2024-09-12T01:53:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa74ba84740 1 client.16167 shutdown 2024-09-12T01:53:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa74ba84740 1 -- 172.21.15.70:0/422698698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1079a0 msgr2=0x55fe2b1164c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa74ba84740 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1079a0 0x55fe2b1164c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa7380058c0 tx=0x7fa7380cf0b0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa74ba84740 1 -- 172.21.15.70:0/422698698 shutdown_connections 2024-09-12T01:53:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa74ba84740 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55fe2b10d370 0x55fe2b18a040 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa74ba84740 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe2b1082e0 0x55fe2b186030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa729ffb640 0 client.16167 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:53:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa74ba84740 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe2b1079a0 0x55fe2b1164c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa74ba84740 1 --2- 172.21.15.70:0/422698698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fe2b103010 0x55fe2b115f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa74ba84740 1 -- 172.21.15.70:0/422698698 >> 172.21.15.70:0/422698698 conn(0x55fe2b108da0 msgr2=0x55fe2b1021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa74ba84740 1 -- 172.21.15.70:0/422698698 shutdown_connections 2024-09-12T01:53:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa74ba84740 1 -- 172.21.15.70:0/422698698 wait complete. 2024-09-12T01:53:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.424+0000 7fa74ba84740 20 client.16167 trim_cache size 0 max 16384 2024-09-12T01:53:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:53:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:53:58.426 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:53:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:53:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.425+0000 7fa748c0e640 1 -- 172.21.15.70:0/3832892154 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa72c0a2c30 msgr2=0x7fa72c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.425+0000 7fa748c0e640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa72c0a2c30 0x7fa72c0a50f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa73c005fd0 tx=0x7fa73c0086a0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.427 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.425+0000 7fa748c0e640 1 -- 172.21.15.70:0/3832892154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa744102d50 msgr2=0x7fa7440745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.425+0000 7fa748c0e640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa744102d50 0x7fa7440745e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa73800c970 tx=0x7fa73800ce30 comp rx=0 tx=0).stop 2024-09-12T01:53:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.425+0000 7fa748c0e640 1 -- 172.21.15.70:0/3832892154 shutdown_connections 2024-09-12T01:53:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.425+0000 7fa748c0e640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa72c0a2c30 0x7fa72c0a50f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.425+0000 7fa748c0e640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa744103710 0x7fa744074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.425+0000 7fa748c0e640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa744102d50 0x7fa7440745e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.425+0000 7fa748c0e640 1 --2- 172.21.15.70:0/3832892154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa744101b60 0x7fa744075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.425+0000 7fa748c0e640 1 -- 172.21.15.70:0/3832892154 >> 172.21.15.70:0/3832892154 conn(0x7fa7440fd2e0 msgr2=0x7fa744106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.425+0000 7fa748c0e640 1 -- 172.21.15.70:0/3832892154 shutdown_connections 2024-09-12T01:53:58.428 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:53:58.425+0000 7fa748c0e640 1 -- 172.21.15.70:0/3832892154 wait complete. 2024-09-12T01:53:58.740 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:58 smithi070 ceph-mon[31177]: pgmap v391: 97 pgs: 97 active+clean; 154 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.1 MiB/s wr, 1.97k op/s 2024-09-12T01:53:58.741 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:58 smithi070 ceph-mon[31177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:58.766 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:53:58.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:58 smithi191 ceph-mon[35770]: pgmap v391: 97 pgs: 97 active+clean; 154 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.1 MiB/s wr, 1.97k op/s 2024-09-12T01:53:58.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:58 smithi191 ceph-mon[35770]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:59.010 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:53:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:58 smithi152 ceph-mon[35055]: pgmap v391: 97 pgs: 97 active+clean; 154 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.1 MiB/s wr, 1.97k op/s 2024-09-12T01:53:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:58 smithi152 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:59.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.484+0000 7f6f86a9b640 1 -- 172.21.15.70:0/2582641361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f80102ea0 msgr2=0x7f6f801005f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:59.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.484+0000 7f6f86a9b640 1 --2- 172.21.15.70:0/2582641361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f80102ea0 0x7f6f801005f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009900 tx=0x7f6f7002a480 comp rx=0 tx=0).stop 2024-09-12T01:53:59.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.484+0000 7f6f86a9b640 1 -- 172.21.15.70:0/2582641361 shutdown_connections 2024-09-12T01:53:59.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.484+0000 7f6f86a9b640 1 --2- 172.21.15.70:0/2582641361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f80100c10 0x7f6f80110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.484+0000 7f6f86a9b640 1 --2- 172.21.15.70:0/2582641361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f80102ea0 0x7f6f801005f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.484+0000 7f6f86a9b640 1 --2- 172.21.15.70:0/2582641361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f80102ac0 0x7f6f801000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.484+0000 7f6f86a9b640 1 -- 172.21.15.70:0/2582641361 >> 172.21.15.70:0/2582641361 conn(0x7f6f80077210 msgr2=0x7f6f800fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.484+0000 7f6f86a9b640 1 -- 172.21.15.70:0/2582641361 shutdown_connections 2024-09-12T01:53:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.484+0000 7f6f86a9b640 1 -- 172.21.15.70:0/2582641361 wait complete. 2024-09-12T01:53:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.485+0000 7f6f86a9b640 1 Processor -- start 2024-09-12T01:53:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.485+0000 7f6f86a9b640 1 -- start start 2024-09-12T01:53:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.485+0000 7f6f86a9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f80100c10 0x7f6f8019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.485+0000 7f6f86a9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f80102ac0 0x7f6f8019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.485+0000 7f6f86a9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f80102ea0 0x7f6f8019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.485+0000 7f6f86a9b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6f801142a0 con 0x7f6f80100c10 2024-09-12T01:53:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.485+0000 7f6f86a9b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6f80114120 con 0x7f6f80102ea0 2024-09-12T01:53:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.485+0000 7f6f86a9b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6f80114420 con 0x7f6f80102ac0 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.485+0000 7f6f84837640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f80100c10 0x7f6f8019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.485+0000 7f6f84837640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f80100c10 0x7f6f8019a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41712/0 (socket says 172.21.15.70:41712) 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.485+0000 7f6f84837640 1 -- 172.21.15.70:0/852559973 learned_addr learned my addr 172.21.15.70:0/852559973 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.485+0000 7f6f77fff640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f80102ac0 0x7f6f8019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.486+0000 7f6f85038640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f80102ea0 0x7f6f8019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.486+0000 7f6f84837640 1 -- 172.21.15.70:0/852559973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f80102ac0 msgr2=0x7f6f8019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.486+0000 7f6f84837640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f80102ac0 0x7f6f8019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.486+0000 7f6f84837640 1 -- 172.21.15.70:0/852559973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f80102ea0 msgr2=0x7f6f8019efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.486+0000 7f6f84837640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f80102ea0 0x7f6f8019efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.486+0000 7f6f84837640 1 -- 172.21.15.70:0/852559973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8019f690 con 0x7f6f80100c10 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.486+0000 7f6f84837640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f80100c10 0x7f6f8019a6e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00d770 tx=0x7f6f7c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.486+0000 7f6f75ffb640 1 -- 172.21.15.70:0/852559973 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c017070 con 0x7f6f80100c10 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.486+0000 7f6f75ffb640 1 -- 172.21.15.70:0/852559973 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f7c005520 con 0x7f6f80100c10 2024-09-12T01:53:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.486+0000 7f6f86a9b640 1 -- 172.21.15.70:0/852559973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8019f980 con 0x7f6f80100c10 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.486+0000 7f6f75ffb640 1 -- 172.21.15.70:0/852559973 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c010460 con 0x7f6f80100c10 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.486+0000 7f6f86a9b640 1 -- 172.21.15.70:0/852559973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f801a7260 con 0x7f6f80100c10 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.488+0000 7f6f75ffb640 1 -- 172.21.15.70:0/852559973 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6f7c004ea0 con 0x7f6f80100c10 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f88e74740 1 Processor -- start 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f88e74740 1 -- start start 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f88e74740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f7ab40 0x563470f79090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f88e74740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 0x563470f79a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f75ffb640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6f680a2c00 0x7f6f680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f88e74740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f84370 0x563470f86760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f88e74740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563470edf2f0 con 0x563470f795d0 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f88e74740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563470e86cf0 con 0x563470f84370 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f88e74740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563470edb2b0 con 0x563470f7ab40 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f84837640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 0x563470f79a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f84837640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 0x563470f79a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41728/0 (socket says 172.21.15.70:41728) 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f84837640 1 -- 172.21.15.70:0/525610011 learned_addr learned my addr 172.21.15.70:0/525610011 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f77fff640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6f680a2c00 0x7f6f680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f85038640 1 --2- 172.21.15.70:0/525610011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f84370 0x563470f86760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f75ffb640 1 -- 172.21.15.70:0/852559973 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6f7c0ceaa0 con 0x7f6f80100c10 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f85038640 1 --2- 172.21.15.70:0/525610011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f7ab40 0x563470f79090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f84837640 1 -- 172.21.15.70:0/525610011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f7ab40 msgr2=0x563470f79090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.489+0000 7f6f84837640 1 --2- 172.21.15.70:0/525610011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f7ab40 0x563470f79090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.490+0000 7f6f84837640 1 -- 172.21.15.70:0/525610011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f84370 msgr2=0x563470f86760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.490+0000 7f6f84837640 1 --2- 172.21.15.70:0/525610011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f84370 0x563470f86760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.490+0000 7f6f84837640 1 -- 172.21.15.70:0/525610011 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563470e6b3a0 con 0x563470f795d0 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.490+0000 7f6f84837640 1 --2- 172.21.15.70:0/525610011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 0x563470f79a10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0cc4d0 tx=0x7f6f7c004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e61b55d6835b7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.490+0000 7f6f77fff640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6f680a2c00 0x7f6f680a50c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009230 tx=0x7f6f700058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.490+0000 7f6f66ffd640 1 -- 172.21.15.70:0/525610011 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c020040 con 0x563470f795d0 2024-09-12T01:53:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.490+0000 7f6f66ffd640 1 -- 172.21.15.70:0/525610011 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f7c09b2c0 con 0x563470f795d0 2024-09-12T01:53:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.490+0000 7f6f66ffd640 1 -- 172.21.15.70:0/525610011 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c097930 con 0x563470f795d0 2024-09-12T01:53:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.490+0000 7f6f88e74740 1 -- 172.21.15.70:0/525610011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 msgr2=0x563470f79a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.490+0000 7f6f88e74740 1 --2- 172.21.15.70:0/525610011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 0x563470f79a10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0cc4d0 tx=0x7f6f7c004940 comp rx=0 tx=0).stop 2024-09-12T01:53:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 -- 172.21.15.70:0/525610011 shutdown_connections 2024-09-12T01:53:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 --2- 172.21.15.70:0/525610011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f84370 0x563470f86760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 --2- 172.21.15.70:0/525610011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 0x563470f79a10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 --2- 172.21.15.70:0/525610011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f7ab40 0x563470f79090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 -- 172.21.15.70:0/525610011 >> 172.21.15.70:0/525610011 conn(0x563470f42310 msgr2=0x563470f75c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 -- 172.21.15.70:0/525610011 shutdown_connections 2024-09-12T01:53:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 -- 172.21.15.70:0/525610011 wait complete. 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 -- start start 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 Processor -- start 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f795d0 0x563470f83d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f7ab40 0x563470f81030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 0x563470f81640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563470f87010 con 0x563470f84370 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563470e9a060 con 0x563470f795d0 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563470f87190 con 0x563470f7ab40 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.491+0000 7f6f88e74740 10 client.0 _ll_register_callbacks cb 0x563470bed8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f85038640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 0x563470f81640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f85038640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 0x563470f81640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41730/0 (socket says 172.21.15.70:41730) 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f85038640 1 -- 172.21.15.70:0/3100481053 learned_addr learned my addr 172.21.15.70:0/3100481053 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f84837640 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f795d0 0x563470f83d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f77fff640 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f7ab40 0x563470f81030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f85038640 1 -- 172.21.15.70:0/3100481053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f7ab40 msgr2=0x563470f81030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f85038640 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f7ab40 0x563470f81030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f85038640 1 -- 172.21.15.70:0/3100481053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f795d0 msgr2=0x563470f83d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f85038640 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f795d0 0x563470f83d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f85038640 1 -- 172.21.15.70:0/3100481053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563470c503c0 con 0x563470f84370 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f85038640 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 0x563470f81640 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6f78011a90 tx=0x7f6f78011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3a84af98d1e391 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f5ffff640 1 -- 172.21.15.70:0/3100481053 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7801a440 con 0x563470f84370 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f5ffff640 1 -- 172.21.15.70:0/3100481053 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6f7800e430 con 0x563470f84370 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f88e74740 1 -- 172.21.15.70:0/3100481053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f7c09b2c0 con 0x563470f84370 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f5ffff640 1 -- 172.21.15.70:0/3100481053 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6f7800e630 con 0x563470f84370 2024-09-12T01:53:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f88e74740 10 client.16179 fetch_fsmap learned FSMap version 33 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f88e74740 1 -- 172.21.15.70:0/3100481053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563470f92b40 con 0x563470f84370 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.492+0000 7f6f5ffff640 1 -- 172.21.15.70:0/3100481053 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f7c09b2c0 con 0x563470f84370 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.493+0000 7f6f5ffff640 1 -- 172.21.15.70:0/3100481053 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f6f78018070 con 0x563470f84370 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.493+0000 7f6f88e74740 10 client.16179 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.493+0000 7f6f88e74740 10 client.16179 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.493+0000 7f6f88e74740 20 client.16179 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.493+0000 7f6f88e74740 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x563470f93f50 0x563470f96380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.493+0000 7f6f88e74740 4 client.16179 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.493+0000 7f6f88e74740 1 -- 172.21.15.70:0/3100481053 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563470eec860 con 0x563470f93f50 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.493+0000 7f6f84837640 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x563470f93f50 0x563470f96380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.493+0000 7f6f84837640 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x563470f93f50 0x563470f96380 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=77e2655b8151e8d server_cookie=7534365898e8bf8c in_seq=0 out_seq=0 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.493+0000 7f6f5ffff640 10 client.16179 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f5ffff640 1 -- 172.21.15.70:0/3100481053 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563470eec860 con 0x563470f93f50 2024-09-12T01:53:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f5ffff640 10 client.16179 handle_command_reply: tid=0 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f88e74740 1 client.16179 shutdown 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f88e74740 1 -- 172.21.15.70:0/3100481053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 msgr2=0x563470f81640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f88e74740 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 0x563470f81640 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6f78011a90 tx=0x7f6f78011f50 comp rx=0 tx=0).stop 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f88e74740 1 -- 172.21.15.70:0/3100481053 shutdown_connections 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f88e74740 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x563470f93f50 0x563470f96380 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f88e74740 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 0x563470f81640 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f88e74740 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f7ab40 0x563470f81030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f88e74740 1 --2- 172.21.15.70:0/3100481053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f795d0 0x563470f83d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f5ffff640 0 client.16179 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f88e74740 1 -- 172.21.15.70:0/3100481053 >> 172.21.15.70:0/3100481053 conn(0x563470f42310 msgr2=0x563470f7b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f88e74740 1 -- 172.21.15.70:0/3100481053 shutdown_connections 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f88e74740 1 -- 172.21.15.70:0/3100481053 wait complete. 2024-09-12T01:53:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.494+0000 7f6f88e74740 20 client.16179 trim_cache size 0 max 16384 2024-09-12T01:53:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.507+0000 7f6f88e74740 1 Processor -- start 2024-09-12T01:53:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f88e74740 1 -- start start 2024-09-12T01:53:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f88e74740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 0x563470f902b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f88e74740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f7ab40 0x563470f7c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f88e74740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f84370 0x563470f7c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f88e74740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6f801af8a0 con 0x563470f795d0 2024-09-12T01:53:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f88e74740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6f801b14d0 con 0x563470f7ab40 2024-09-12T01:53:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f88e74740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6f801aff70 con 0x563470f84370 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f84837640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 0x563470f902b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f84837640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 0x563470f902b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41734/0 (socket says 172.21.15.70:41734) 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f84837640 1 -- 172.21.15.70:0/3602577905 learned_addr learned my addr 172.21.15.70:0/3602577905 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f77fff640 1 --2- 172.21.15.70:0/3602577905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f7ab40 0x563470f7c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f85038640 1 --2- 172.21.15.70:0/3602577905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f84370 0x563470f7c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f84837640 1 -- 172.21.15.70:0/3602577905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f84370 msgr2=0x563470f7c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f84837640 1 --2- 172.21.15.70:0/3602577905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f84370 0x563470f7c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f84837640 1 -- 172.21.15.70:0/3602577905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f7ab40 msgr2=0x563470f7c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f84837640 1 --2- 172.21.15.70:0/3602577905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f7ab40 0x563470f7c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f84837640 1 -- 172.21.15.70:0/3602577905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563470f86f50 con 0x563470f795d0 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f84837640 1 --2- 172.21.15.70:0/3602577905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 0x563470f902b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009fd0 tx=0x7f6f7c0bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6db2e44440bda2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.508+0000 7f6f667fc640 1 -- 172.21.15.70:0/3602577905 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c0b9070 con 0x563470f795d0 2024-09-12T01:53:59.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.509+0000 7f6f667fc640 1 -- 172.21.15.70:0/3602577905 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f7c09b2c0 con 0x563470f795d0 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.509+0000 7f6f667fc640 1 -- 172.21.15.70:0/3602577905 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c020040 con 0x563470f795d0 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.509+0000 7f6f88e74740 1 -- 172.21.15.70:0/3602577905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 msgr2=0x563470f902b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.509+0000 7f6f88e74740 1 --2- 172.21.15.70:0/3602577905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 0x563470f902b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009fd0 tx=0x7f6f7c0bb040 comp rx=0 tx=0).stop 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.509+0000 7f6f88e74740 1 -- 172.21.15.70:0/3602577905 shutdown_connections 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.509+0000 7f6f88e74740 1 --2- 172.21.15.70:0/3602577905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f84370 0x563470f7c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.509+0000 7f6f88e74740 1 --2- 172.21.15.70:0/3602577905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f7ab40 0x563470f7c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.509+0000 7f6f88e74740 1 --2- 172.21.15.70:0/3602577905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f795d0 0x563470f902b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.509+0000 7f6f88e74740 1 -- 172.21.15.70:0/3602577905 >> 172.21.15.70:0/3602577905 conn(0x563470f42310 msgr2=0x563470f80120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.509+0000 7f6f88e74740 1 -- 172.21.15.70:0/3602577905 shutdown_connections 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.509+0000 7f6f88e74740 1 -- 172.21.15.70:0/3602577905 wait complete. 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.510+0000 7f6f88e74740 1 -- start start 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.510+0000 7f6f88e74740 1 Processor -- start 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.510+0000 7f6f88e74740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f795d0 0x563470f8cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.510+0000 7f6f88e74740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f7ab40 0x563470f87f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.510+0000 7f6f88e74740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 0x563470f88490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.510+0000 7f6f88e74740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6f801b0d40 con 0x563470f84370 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.510+0000 7f6f88e74740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6f801b0670 con 0x563470f7ab40 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.510+0000 7f6f88e74740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6f801ad860 con 0x563470f795d0 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.510+0000 7f6f88e74740 10 client.0 _ll_register_callbacks cb 0x7f6f78007740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f85038640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 0x563470f88490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f85038640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 0x563470f88490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41750/0 (socket says 172.21.15.70:41750) 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f85038640 1 -- 172.21.15.70:0/2804942155 learned_addr learned my addr 172.21.15.70:0/2804942155 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f84837640 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f795d0 0x563470f8cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f77fff640 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f7ab40 0x563470f87f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f85038640 1 -- 172.21.15.70:0/2804942155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f795d0 msgr2=0x563470f8cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f85038640 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f795d0 0x563470f8cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f85038640 1 -- 172.21.15.70:0/2804942155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f7ab40 msgr2=0x563470f87f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:53:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f85038640 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f7ab40 0x563470f87f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f85038640 1 -- 172.21.15.70:0/2804942155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563470f88cc0 con 0x563470f84370 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f85038640 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 0x563470f88490 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6f78012fd0 tx=0x7f6f78010870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75764320f88b0b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f5ffff640 1 -- 172.21.15.70:0/2804942155 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78003b70 con 0x563470f84370 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f5ffff640 1 -- 172.21.15.70:0/2804942155 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6f78003d10 con 0x563470f84370 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f88e74740 1 -- 172.21.15.70:0/2804942155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f7c09b2c0 con 0x563470f84370 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f5ffff640 1 -- 172.21.15.70:0/2804942155 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6f7800e7d0 con 0x563470f84370 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f88e74740 10 client.16185 fetch_fsmap learned FSMap version 33 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.511+0000 7f6f88e74740 1 -- 172.21.15.70:0/2804942155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563470ffecb0 con 0x563470f84370 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.512+0000 7f6f5ffff640 1 -- 172.21.15.70:0/2804942155 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f7c09b2c0 con 0x563470f84370 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.512+0000 7f6f5ffff640 1 -- 172.21.15.70:0/2804942155 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f6f78018040 con 0x563470f84370 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.512+0000 7f6f88e74740 10 client.16185 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.512+0000 7f6f88e74740 10 client.16185 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T01:53:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.512+0000 7f6f88e74740 20 client.16185 populate_metadata read hostname 'smithi070' 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.512+0000 7f6f88e74740 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x563470fff370 0x563471001790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.512+0000 7f6f88e74740 4 client.16185 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.512+0000 7f6f88e74740 1 -- 172.21.15.70:0/2804942155 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563470ee6d70 con 0x563470fff370 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.512+0000 7f6f84837640 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x563470fff370 0x563471001790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f5ffff640 10 client.16185 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f84837640 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x563470fff370 0x563471001790 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8f6b340ad0a10ad6 server_cookie=81638ece58dd01cf in_seq=0 out_seq=0 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f5ffff640 1 -- 172.21.15.70:0/2804942155 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563470ee6d70 con 0x563470fff370 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f5ffff640 10 client.16185 handle_command_reply: tid=0 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f88e74740 1 client.16185 shutdown 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f88e74740 1 -- 172.21.15.70:0/2804942155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 msgr2=0x563470f88490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f88e74740 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 0x563470f88490 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6f78012fd0 tx=0x7f6f78010870 comp rx=0 tx=0).stop 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f88e74740 1 -- 172.21.15.70:0/2804942155 shutdown_connections 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f88e74740 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x563470fff370 0x563471001790 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f88e74740 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563470f84370 0x563470f88490 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f88e74740 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563470f7ab40 0x563470f87f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f88e74740 1 --2- 172.21.15.70:0/2804942155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563470f795d0 0x563470f8cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f5ffff640 0 client.16185 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:53:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.513+0000 7f6f88e74740 1 -- 172.21.15.70:0/2804942155 >> 172.21.15.70:0/2804942155 conn(0x563470f42310 msgr2=0x563470f82890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f88e74740 1 -- 172.21.15.70:0/2804942155 shutdown_connections 2024-09-12T01:53:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f88e74740 1 -- 172.21.15.70:0/2804942155 wait complete. 2024-09-12T01:53:59.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f88e74740 20 client.16185 trim_cache size 0 max 16384 2024-09-12T01:53:59.523 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:53:59.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f86a9b640 1 -- 172.21.15.70:0/852559973 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6f680a2c00 msgr2=0x7f6f680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:59.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f86a9b640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6f680a2c00 0x7f6f680a50c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009230 tx=0x7f6f700058d0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f86a9b640 1 -- 172.21.15.70:0/852559973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f80100c10 msgr2=0x7f6f8019a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f86a9b640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f80100c10 0x7f6f8019a6e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00d770 tx=0x7f6f7c00dc30 comp rx=0 tx=0).stop 2024-09-12T01:53:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f86a9b640 1 -- 172.21.15.70:0/852559973 shutdown_connections 2024-09-12T01:53:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f86a9b640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6f680a2c00 0x7f6f680a50c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f86a9b640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f80102ea0 0x7f6f8019efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f86a9b640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6f80102ac0 0x7f6f8019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f86a9b640 1 --2- 172.21.15.70:0/852559973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f80100c10 0x7f6f8019a6e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f86a9b640 1 -- 172.21.15.70:0/852559973 >> 172.21.15.70:0/852559973 conn(0x7f6f80077210 msgr2=0x7f6f800fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f86a9b640 1 -- 172.21.15.70:0/852559973 shutdown_connections 2024-09-12T01:53:59.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:53:59.514+0000 7f6f86a9b640 1 -- 172.21.15.70:0/852559973 wait complete. 2024-09-12T01:53:59.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:53:59 smithi070 ceph-mon[31177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:53:59.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:53:59 smithi191 ceph-mon[35770]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:00.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:53:59 smithi152 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:00.259 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:54:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:00.886 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:00 smithi070 ceph-mon[31177]: pgmap v392: 97 pgs: 97 active+clean; 146 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 1.51k op/s 2024-09-12T01:54:00.913 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:00 smithi152 ceph-mon[35055]: pgmap v392: 97 pgs: 97 active+clean; 146 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 1.51k op/s 2024-09-12T01:54:00.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:00 smithi191 ceph-mon[35770]: pgmap v392: 97 pgs: 97 active+clean; 146 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 1.51k op/s 2024-09-12T01:54:00.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.967+0000 7f60a1a43640 1 -- 172.21.15.70:0/2300022102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f609c106f10 msgr2=0x7f609c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:00.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.967+0000 7f60a1a43640 1 --2- 172.21.15.70:0/2300022102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f609c106f10 0x7f609c10ea90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6094009900 tx=0x7f609402a410 comp rx=0 tx=0).stop 2024-09-12T01:54:00.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.967+0000 7f60a1a43640 1 -- 172.21.15.70:0/2300022102 shutdown_connections 2024-09-12T01:54:00.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.967+0000 7f60a1a43640 1 --2- 172.21.15.70:0/2300022102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f609c106f10 0x7f609c10ea90 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.967+0000 7f60a1a43640 1 --2- 172.21.15.70:0/2300022102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f609c102790 0x7f609c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.967+0000 7f60a1a43640 1 --2- 172.21.15.70:0/2300022102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609c101de0 0x7f609c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.967+0000 7f60a1a43640 1 -- 172.21.15.70:0/2300022102 >> 172.21.15.70:0/2300022102 conn(0x7f609c0fd8c0 msgr2=0x7f609c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:00.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.967+0000 7f60a1a43640 1 -- 172.21.15.70:0/2300022102 shutdown_connections 2024-09-12T01:54:00.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.967+0000 7f60a1a43640 1 -- 172.21.15.70:0/2300022102 wait complete. 2024-09-12T01:54:00.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f60a1a43640 1 Processor -- start 2024-09-12T01:54:00.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f60a1a43640 1 -- start start 2024-09-12T01:54:00.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f60a1a43640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f609c101de0 0x7f609c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f60a1a43640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f609c102790 0x7f609c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f60a1a43640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609c106f10 0x7f609c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f60a1a43640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1120d0 con 0x7f609c101de0 2024-09-12T01:54:00.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f60a1a43640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f609c111f50 con 0x7f609c102790 2024-09-12T01:54:00.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f60a1a43640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f609c112250 con 0x7f609c106f10 2024-09-12T01:54:00.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f609affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f609c101de0 0x7f609c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f609affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f609c101de0 0x7f609c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54076/0 (socket says 172.21.15.70:54076) 2024-09-12T01:54:00.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f609affd640 1 -- 172.21.15.70:0/2417527642 learned_addr learned my addr 172.21.15.70:0/2417527642 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:00.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f609a7fc640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f609c102790 0x7f609c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.968+0000 7f609b7fe640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609c106f10 0x7f609c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.969+0000 7f609affd640 1 -- 172.21.15.70:0/2417527642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609c106f10 msgr2=0x7f609c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:00.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.969+0000 7f609affd640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609c106f10 0x7f609c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.969+0000 7f609affd640 1 -- 172.21.15.70:0/2417527642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f609c102790 msgr2=0x7f609c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:00.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.969+0000 7f609affd640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f609c102790 0x7f609c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.969+0000 7f609affd640 1 -- 172.21.15.70:0/2417527642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c1a69a0 con 0x7f609c101de0 2024-09-12T01:54:00.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.969+0000 7f609affd640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f609c101de0 0x7f609c0744f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f608c00ba50 tx=0x7f608c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:00.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.969+0000 7f60a0a41640 1 -- 172.21.15.70:0/2417527642 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c019070 con 0x7f609c101de0 2024-09-12T01:54:00.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.969+0000 7f60a0a41640 1 -- 172.21.15.70:0/2417527642 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f608c00cb20 con 0x7f609c101de0 2024-09-12T01:54:00.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.969+0000 7f60a1a43640 1 -- 172.21.15.70:0/2417527642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609c1a6c90 con 0x7f609c101de0 2024-09-12T01:54:00.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.969+0000 7f60a0a41640 1 -- 172.21.15.70:0/2417527642 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c007670 con 0x7f609c101de0 2024-09-12T01:54:00.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.969+0000 7f60a1a43640 1 -- 172.21.15.70:0/2417527642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609c1a7180 con 0x7f609c101de0 2024-09-12T01:54:00.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.972+0000 7f60a3e1c740 1 Processor -- start 2024-09-12T01:54:00.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.972+0000 7f60a3e1c740 1 -- start start 2024-09-12T01:54:00.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.972+0000 7f60a0a41640 1 -- 172.21.15.70:0/2417527642 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f608c01c070 con 0x7f609c101de0 2024-09-12T01:54:00.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.972+0000 7f60a3e1c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637aab40 0x562f637a9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.972+0000 7f60a3e1c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637a95d0 0x562f637a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.972+0000 7f60a3e1c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.972+0000 7f60a3e1c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562f6370f2f0 con 0x562f637b4370 2024-09-12T01:54:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.972+0000 7f60a3e1c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562f636b6cf0 con 0x562f637a95d0 2024-09-12T01:54:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.972+0000 7f60a3e1c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562f6370b2b0 con 0x562f637aab40 2024-09-12T01:54:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.972+0000 7f609a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.972+0000 7f609a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54084/0 (socket says 172.21.15.70:54084) 2024-09-12T01:54:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.972+0000 7f609a7fc640 1 -- 172.21.15.70:0/931989922 learned_addr learned my addr 172.21.15.70:0/931989922 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f609b7fe640 1 --2- 172.21.15.70:0/931989922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637aab40 0x562f637a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f609affd640 1 --2- 172.21.15.70:0/931989922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637a95d0 0x562f637a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f609a7fc640 1 -- 172.21.15.70:0/931989922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637aab40 msgr2=0x562f637a9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f609a7fc640 1 --2- 172.21.15.70:0/931989922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637aab40 0x562f637a9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f609a7fc640 1 -- 172.21.15.70:0/931989922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637a95d0 msgr2=0x562f637a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f609a7fc640 1 --2- 172.21.15.70:0/931989922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637a95d0 0x562f637a9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f609a7fc640 1 -- 172.21.15.70:0/931989922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f6369b3a0 con 0x562f637b4370 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f609affd640 1 --2- 172.21.15.70:0/931989922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637a95d0 0x562f637a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f60a0a41640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f60880a2b80 0x7f60880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f609a7fc640 1 --2- 172.21.15.70:0/931989922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b6760 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f608400aca0 tx=0x7f608400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504d34f2386a7ceb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f6091ffb640 1 -- 172.21.15.70:0/931989922 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608401d070 con 0x562f637b4370 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f609b7fe640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f60880a2b80 0x7f60880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f60a0a41640 1 -- 172.21.15.70:0/2417527642 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f608c0ce620 con 0x7f609c101de0 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f6091ffb640 1 -- 172.21.15.70:0/931989922 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6084018b40 con 0x562f637b4370 2024-09-12T01:54:00.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.973+0000 7f6091ffb640 1 -- 172.21.15.70:0/931989922 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6084010cd0 con 0x562f637b4370 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.974+0000 7f60a3e1c740 1 -- 172.21.15.70:0/931989922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 msgr2=0x562f637b6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.974+0000 7f609b7fe640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f60880a2b80 0x7f60880a5040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f60940096c0 tx=0x7f6094009610 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.974+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/931989922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b6760 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f608400aca0 tx=0x7f608400f790 comp rx=0 tx=0).stop 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.974+0000 7f60a3e1c740 1 -- 172.21.15.70:0/931989922 shutdown_connections 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.974+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/931989922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b6760 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.974+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/931989922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637a95d0 0x562f637a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.974+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/931989922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637aab40 0x562f637a9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.974+0000 7f60a3e1c740 1 -- 172.21.15.70:0/931989922 >> 172.21.15.70:0/931989922 conn(0x562f63772310 msgr2=0x562f637a5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.974+0000 7f60a3e1c740 1 -- 172.21.15.70:0/931989922 shutdown_connections 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.974+0000 7f60a3e1c740 1 -- 172.21.15.70:0/931989922 wait complete. 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.974+0000 7f60a3e1c740 1 -- start start 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f60a3e1c740 1 Processor -- start 2024-09-12T01:54:00.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f60a3e1c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637a95d0 0x562f637b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f60a3e1c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637aab40 0x562f637b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f60a3e1c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f60a3e1c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562f637b7070 con 0x562f637b4370 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f60a3e1c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562f636ca060 con 0x562f637aab40 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f60a3e1c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562f637b71f0 con 0x562f637a95d0 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f60a3e1c740 10 client.0 _ll_register_callbacks cb 0x562f6341d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54096/0 (socket says 172.21.15.70:54096) 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f609b7fe640 1 -- 172.21.15.70:0/2208725420 learned_addr learned my addr 172.21.15.70:0/2208725420 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f609affd640 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637a95d0 0x562f637b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.975+0000 7f609a7fc640 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637aab40 0x562f637b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f609affd640 1 -- 172.21.15.70:0/2208725420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637aab40 msgr2=0x562f637b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f609affd640 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637aab40 0x562f637b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f609affd640 1 -- 172.21.15.70:0/2208725420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 msgr2=0x562f637b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f609affd640 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f609affd640 1 -- 172.21.15.70:0/2208725420 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f634803c0 con 0x562f637a95d0 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f609b7fe640 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f609affd640 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637a95d0 0x562f637b3d30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x562f637a6ac0 tx=0x7f608c09ab30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa651f50a0455365 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f607affd640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f607affd640 1 -- 172.21.15.70:0/2208725420 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c0a3af0 con 0x562f637a95d0 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f60a3e1c740 1 -- 172.21.15.70:0/2208725420 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6084018b40 con 0x562f637a95d0 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f607affd640 1 -- 172.21.15.70:0/2208725420 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f608c00ccd0 con 0x562f637a95d0 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f607affd640 1 -- 172.21.15.70:0/2208725420 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f608c0b7050 con 0x562f637a95d0 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f60a3e1c740 10 client.25402 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f60a3e1c740 1 -- 172.21.15.70:0/2208725420 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562f637c2bb0 con 0x562f637a95d0 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f607affd640 1 -- 172.21.15.70:0/2208725420 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6084018b40 con 0x562f637a95d0 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.976+0000 7f607affd640 1 -- 172.21.15.70:0/2208725420 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f608c09a510 con 0x562f637a95d0 2024-09-12T01:54:00.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.977+0000 7f60a3e1c740 10 client.25402 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:00.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.977+0000 7f60a3e1c740 10 client.25402 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:54:00.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.977+0000 7f60a3e1c740 20 client.25402 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:00.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.977+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x562f637c3fc0 0x562f637c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.977+0000 7f60a3e1c740 4 client.25402 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:00.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.977+0000 7f60a3e1c740 1 -- 172.21.15.70:0/2208725420 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f6371c860 con 0x562f637c3fc0 2024-09-12T01:54:00.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.977+0000 7f609a7fc640 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x562f637c3fc0 0x562f637c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.977+0000 7f607affd640 10 client.25402 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:54:00.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.977+0000 7f609a7fc640 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x562f637c3fc0 0x562f637c63d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ab657114744e5ad server_cookie=bc061457762d75d9 in_seq=0 out_seq=0 2024-09-12T01:54:00.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f607affd640 1 -- 172.21.15.70:0/2208725420 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f6371c860 con 0x562f637c3fc0 2024-09-12T01:54:00.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f607affd640 10 client.25402 handle_command_reply: tid=0 2024-09-12T01:54:00.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f60a3e1c740 1 client.25402 shutdown 2024-09-12T01:54:00.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f60a3e1c740 1 -- 172.21.15.70:0/2208725420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637a95d0 msgr2=0x562f637b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:00.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637a95d0 0x562f637b3d30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x562f637a6ac0 tx=0x7f608c09ab30 comp rx=0 tx=0).stop 2024-09-12T01:54:00.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f60a3e1c740 1 -- 172.21.15.70:0/2208725420 shutdown_connections 2024-09-12T01:54:00.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x562f637c3fc0 0x562f637c63d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637aab40 0x562f637b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f607affd640 0 client.25402 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:54:00.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/2208725420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637a95d0 0x562f637b3d30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f60a3e1c740 1 -- 172.21.15.70:0/2208725420 >> 172.21.15.70:0/2208725420 conn(0x562f63772310 msgr2=0x562f637ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:00.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.978+0000 7f60a3e1c740 1 -- 172.21.15.70:0/2208725420 shutdown_connections 2024-09-12T01:54:00.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.979+0000 7f60a3e1c740 1 -- 172.21.15.70:0/2208725420 wait complete. 2024-09-12T01:54:00.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.979+0000 7f60a3e1c740 20 client.25402 trim_cache size 0 max 16384 2024-09-12T01:54:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.991+0000 7f60a3e1c740 1 Processor -- start 2024-09-12T01:54:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.991+0000 7f60a3e1c740 1 -- start start 2024-09-12T01:54:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.991+0000 7f60a3e1c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637a95d0 0x562f637a8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.991+0000 7f60a3e1c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637aab40 0x562f637ac120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.991+0000 7f60a3e1c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637ac660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.991+0000 7f60a3e1c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1af800 con 0x562f637b4370 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.991+0000 7f60a3e1c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1b1430 con 0x562f637aab40 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.991+0000 7f60a3e1c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1afed0 con 0x562f637a95d0 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637ac660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54104/0 (socket says 172.21.15.70:54104) 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f609b7fe640 1 -- 172.21.15.70:0/709148132 learned_addr learned my addr 172.21.15.70:0/709148132 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f609affd640 1 --2- 172.21.15.70:0/709148132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637a95d0 0x562f637a8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f609a7fc640 1 --2- 172.21.15.70:0/709148132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637aab40 0x562f637ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f609b7fe640 1 -- 172.21.15.70:0/709148132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637a95d0 msgr2=0x562f637a8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f609b7fe640 1 --2- 172.21.15.70:0/709148132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637a95d0 0x562f637a8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f609b7fe640 1 -- 172.21.15.70:0/709148132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637aab40 msgr2=0x562f637ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f609b7fe640 1 --2- 172.21.15.70:0/709148132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637aab40 0x562f637ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f609b7fe640 1 -- 172.21.15.70:0/709148132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f637aff90 con 0x562f637b4370 2024-09-12T01:54:00.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f609b7fe640 1 --2- 172.21.15.70:0/709148132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637ac660 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6094004140 tx=0x7f609403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8d0a815729557 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:00.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f60917fa640 1 -- 172.21.15.70:0/709148132 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094035040 con 0x562f637b4370 2024-09-12T01:54:00.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f60917fa640 1 -- 172.21.15.70:0/709148132 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f609404f070 con 0x562f637b4370 2024-09-12T01:54:00.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.992+0000 7f60917fa640 1 -- 172.21.15.70:0/709148132 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094054b70 con 0x562f637b4370 2024-09-12T01:54:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.993+0000 7f60a3e1c740 1 -- 172.21.15.70:0/709148132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 msgr2=0x562f637ac660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.993+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/709148132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637ac660 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6094004140 tx=0x7f609403f000 comp rx=0 tx=0).stop 2024-09-12T01:54:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.993+0000 7f60a3e1c740 1 -- 172.21.15.70:0/709148132 shutdown_connections 2024-09-12T01:54:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.993+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/709148132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637ac660 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.993+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/709148132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637aab40 0x562f637ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.993+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/709148132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637a95d0 0x562f637a8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.993+0000 7f60a3e1c740 1 -- 172.21.15.70:0/709148132 >> 172.21.15.70:0/709148132 conn(0x562f63772310 msgr2=0x562f637a4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.993+0000 7f60a3e1c740 1 -- 172.21.15.70:0/709148132 shutdown_connections 2024-09-12T01:54:00.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.993+0000 7f60a3e1c740 1 -- 172.21.15.70:0/709148132 wait complete. 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.993+0000 7f60a3e1c740 1 -- start start 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f60a3e1c740 1 Processor -- start 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f60a3e1c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637a95d0 0x562f637b8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f60a3e1c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637aab40 0x562f637b88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f60a3e1c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f60a3e1c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1b0ca0 con 0x562f637b4370 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f60a3e1c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1b05d0 con 0x562f637a95d0 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f60a3e1c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1ad7c0 con 0x562f637aab40 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f60a3e1c740 10 client.0 _ll_register_callbacks cb 0x7f608c09ad00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54120/0 (socket says 172.21.15.70:54120) 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f609b7fe640 1 -- 172.21.15.70:0/542573158 learned_addr learned my addr 172.21.15.70:0/542573158 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:00.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f609affd640 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637a95d0 0x562f637b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f609a7fc640 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637aab40 0x562f637b88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f609b7fe640 1 -- 172.21.15.70:0/542573158 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637aab40 msgr2=0x562f637b88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f609b7fe640 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637aab40 0x562f637b88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f609b7fe640 1 -- 172.21.15.70:0/542573158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637a95d0 msgr2=0x562f637b8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f609b7fe640 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637a95d0 0x562f637b8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.994+0000 7f609b7fe640 1 -- 172.21.15.70:0/542573158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f6382de10 con 0x562f637b4370 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f609b7fe640 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b8e10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6094004230 tx=0x7f6094054770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8c889700888466 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f607affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f607affd640 1 -- 172.21.15.70:0/542573158 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094061060 con 0x562f637b4370 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f607affd640 1 -- 172.21.15.70:0/542573158 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f60940037f0 con 0x562f637b4370 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f60a3e1c740 1 -- 172.21.15.70:0/542573158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f609404f070 con 0x562f637b4370 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f607affd640 1 -- 172.21.15.70:0/542573158 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f60940039f0 con 0x562f637b4370 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f60a3e1c740 10 client.16203 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:00.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f60a3e1c740 1 -- 172.21.15.70:0/542573158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562f6382f0d0 con 0x562f637b4370 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f607affd640 1 -- 172.21.15.70:0/542573158 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f609404f070 con 0x562f637b4370 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f607affd640 1 -- 172.21.15.70:0/542573158 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f6094066070 con 0x562f637b4370 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f60a3e1c740 10 client.16203 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f60a3e1c740 10 client.16203 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f60a3e1c740 20 client.16203 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x562f6382f740 0x562f63831b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f60a3e1c740 4 client.16203 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.995+0000 7f60a3e1c740 1 -- 172.21.15.70:0/542573158 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562f63716d70 con 0x562f6382f740 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f609affd640 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x562f6382f740 0x562f63831b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f607affd640 10 client.16203 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f609affd640 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x562f6382f740 0x562f63831b30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e48aac21062e611a server_cookie=6b5381a8c17e6a8a in_seq=0 out_seq=0 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f607affd640 1 -- 172.21.15.70:0/542573158 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562f63716d70 con 0x562f6382f740 2024-09-12T01:54:01.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f607affd640 10 client.16203 handle_command_reply: tid=0 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f60a3e1c740 1 client.16203 shutdown 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f60a3e1c740 1 -- 172.21.15.70:0/542573158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 msgr2=0x562f637b8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b8e10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6094004230 tx=0x7f6094054770 comp rx=0 tx=0).stop 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f60a3e1c740 1 -- 172.21.15.70:0/542573158 shutdown_connections 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x562f6382f740 0x562f63831b30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f637b4370 0x562f637b8e10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562f637aab40 0x562f637b88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f607affd640 0 client.16203 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.996+0000 7f60a3e1c740 1 --2- 172.21.15.70:0/542573158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562f637a95d0 0x562f637b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a3e1c740 1 -- 172.21.15.70:0/542573158 >> 172.21.15.70:0/542573158 conn(0x562f63772310 msgr2=0x562f637b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a3e1c740 1 -- 172.21.15.70:0/542573158 shutdown_connections 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a3e1c740 1 -- 172.21.15.70:0/542573158 wait complete. 2024-09-12T01:54:01.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a3e1c740 20 client.16203 trim_cache size 0 max 16384 2024-09-12T01:54:01.002 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:54:01.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a1a43640 1 -- 172.21.15.70:0/2417527642 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f60880a2b80 msgr2=0x7f60880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:01.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a1a43640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f60880a2b80 0x7f60880a5040 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f60940096c0 tx=0x7f6094009610 comp rx=0 tx=0).stop 2024-09-12T01:54:01.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a1a43640 1 -- 172.21.15.70:0/2417527642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f609c101de0 msgr2=0x7f609c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:01.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a1a43640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f609c101de0 0x7f609c0744f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f608c00ba50 tx=0x7f608c00be50 comp rx=0 tx=0).stop 2024-09-12T01:54:01.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a1a43640 1 -- 172.21.15.70:0/2417527642 shutdown_connections 2024-09-12T01:54:01.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a1a43640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f60880a2b80 0x7f60880a5040 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:01.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a1a43640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609c106f10 0x7f609c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:01.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a1a43640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f609c102790 0x7f609c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:01.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a1a43640 1 --2- 172.21.15.70:0/2417527642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f609c101de0 0x7f609c0744f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:01.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a1a43640 1 -- 172.21.15.70:0/2417527642 >> 172.21.15.70:0/2417527642 conn(0x7f609c0fd8c0 msgr2=0x7f609c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:01.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a1a43640 1 -- 172.21.15.70:0/2417527642 shutdown_connections 2024-09-12T01:54:01.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:00.997+0000 7f60a1a43640 1 -- 172.21.15.70:0/2417527642 wait complete. 2024-09-12T01:54:01.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:54:01.954 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:02.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.394+0000 7f188d041640 1 -- 172.21.15.70:0/2559319812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1888101de0 msgr2=0x7f18881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:02.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.394+0000 7f188d041640 1 --2- 172.21.15.70:0/2559319812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1888101de0 0x7f18881021c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f187c009ca0 tx=0x7f187c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.394+0000 7f188d041640 1 -- 172.21.15.70:0/2559319812 shutdown_connections 2024-09-12T01:54:02.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.394+0000 7f188d041640 1 --2- 172.21.15.70:0/2559319812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1888106f10 0x7f188810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.394+0000 7f188d041640 1 --2- 172.21.15.70:0/2559319812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1888102790 0x7f18881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.394+0000 7f188d041640 1 --2- 172.21.15.70:0/2559319812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1888101de0 0x7f18881021c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.394+0000 7f188d041640 1 -- 172.21.15.70:0/2559319812 >> 172.21.15.70:0/2559319812 conn(0x7f18880fd8c0 msgr2=0x7f18880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.394+0000 7f188d041640 1 -- 172.21.15.70:0/2559319812 shutdown_connections 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.394+0000 7f188d041640 1 -- 172.21.15.70:0/2559319812 wait complete. 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.395+0000 7f188d041640 1 Processor -- start 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.395+0000 7f188d041640 1 -- start start 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.395+0000 7f188d041640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1888101de0 0x7f1888198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.395+0000 7f188d041640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1888102790 0x7f1888198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.395+0000 7f188d041640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1888106f10 0x7f188819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.395+0000 7f188d041640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1888112150 con 0x7f1888106f10 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.395+0000 7f188d041640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1888111fd0 con 0x7f1888101de0 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.395+0000 7f188d041640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f18881122d0 con 0x7f1888102790 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.395+0000 7f188759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1888106f10 0x7f188819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.395+0000 7f188759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1888106f10 0x7f188819cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54138/0 (socket says 172.21.15.70:54138) 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.395+0000 7f188759e640 1 -- 172.21.15.70:0/1792576173 learned_addr learned my addr 172.21.15.70:0/1792576173 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.395+0000 7f1886d9d640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1888101de0 0x7f1888198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f188659c640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1888102790 0x7f1888198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f188759e640 1 -- 172.21.15.70:0/1792576173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1888102790 msgr2=0x7f1888198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f188759e640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1888102790 0x7f1888198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f188759e640 1 -- 172.21.15.70:0/1792576173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1888101de0 msgr2=0x7f1888198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f188759e640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1888101de0 0x7f1888198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f188759e640 1 -- 172.21.15.70:0/1792576173 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188819d620 con 0x7f1888106f10 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f1886d9d640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1888101de0 0x7f1888198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f188659c640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1888102790 0x7f1888198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f188759e640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1888106f10 0x7f188819cf40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1880009fd0 tx=0x7f188000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f186ffff640 1 -- 172.21.15.70:0/1792576173 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880011830 con 0x7f1888106f10 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f186ffff640 1 -- 172.21.15.70:0/1792576173 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1880016070 con 0x7f1888106f10 2024-09-12T01:54:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f188d041640 1 -- 172.21.15.70:0/1792576173 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188819d910 con 0x7f1888106f10 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f186ffff640 1 -- 172.21.15.70:0/1792576173 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188000f2e0 con 0x7f1888106f10 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.396+0000 7f188d041640 1 -- 172.21.15.70:0/1792576173 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18881a51f0 con 0x7f1888106f10 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.398+0000 7f186ffff640 1 -- 172.21.15.70:0/1792576173 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f188001b460 con 0x7f1888106f10 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188f41a740 1 Processor -- start 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188f41a740 1 -- start start 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f186ffff640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f18700a2b80 0x7f18700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188f41a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5a1b40 0x56238e5a0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188f41a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a05d0 0x56238e5a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188f41a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 0x56238e5b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188f41a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56238e5062f0 con 0x56238e5af780 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188f41a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56238e4adcf0 con 0x56238e5a1b40 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188f41a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56238e5022b0 con 0x56238e5a05d0 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188659c640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f18700a2b80 0x7f18700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f186ffff640 1 -- 172.21.15.70:0/1792576173 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f18800ce7d0 con 0x7f1888106f10 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 0x56238e5b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 0x56238e5b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54140/0 (socket says 172.21.15.70:54140) 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188759e640 1 -- 172.21.15.70:0/131793217 learned_addr learned my addr 172.21.15.70:0/131793217 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f1886d9d640 1 --2- 172.21.15.70:0/131793217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5a1b40 0x56238e5a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188659c640 1 --2- 172.21.15.70:0/131793217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a05d0 0x56238e5a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188759e640 1 -- 172.21.15.70:0/131793217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a05d0 msgr2=0x56238e5a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188759e640 1 --2- 172.21.15.70:0/131793217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a05d0 0x56238e5a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188759e640 1 -- 172.21.15.70:0/131793217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5a1b40 msgr2=0x56238e5a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188759e640 1 --2- 172.21.15.70:0/131793217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5a1b40 0x56238e5a0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188759e640 1 -- 172.21.15.70:0/131793217 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56238e4923a0 con 0x56238e5af780 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.399+0000 7f188659c640 1 --2- 172.21.15.70:0/131793217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a05d0 0x56238e5a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.400+0000 7f188659c640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f18700a2b80 0x7f18700a5040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f18880fdce0 tx=0x7f18780093e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.400+0000 7f188759e640 1 --2- 172.21.15.70:0/131793217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 0x56238e5b1b70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1880097450 tx=0x7f18800047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cde89e338e6361 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.400+0000 7f186d7fa640 1 -- 172.21.15.70:0/131793217 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188009b6f0 con 0x56238e5af780 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.400+0000 7f186d7fa640 1 -- 172.21.15.70:0/131793217 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f188009aff0 con 0x56238e5af780 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.400+0000 7f186d7fa640 1 -- 172.21.15.70:0/131793217 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18800105a0 con 0x56238e5af780 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 -- 172.21.15.70:0/131793217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 msgr2=0x56238e5b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 --2- 172.21.15.70:0/131793217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 0x56238e5b1b70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1880097450 tx=0x7f18800047d0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 -- 172.21.15.70:0/131793217 shutdown_connections 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 --2- 172.21.15.70:0/131793217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 0x56238e5b1b70 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 --2- 172.21.15.70:0/131793217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a05d0 0x56238e5a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 --2- 172.21.15.70:0/131793217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5a1b40 0x56238e5a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 -- 172.21.15.70:0/131793217 >> 172.21.15.70:0/131793217 conn(0x56238e569310 msgr2=0x56238e59cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 -- 172.21.15.70:0/131793217 shutdown_connections 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 -- 172.21.15.70:0/131793217 wait complete. 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 -- start start 2024-09-12T01:54:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 Processor -- start 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a05d0 0x56238e5af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a1b40 0x56238e5ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5af780 0x56238e5acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56238e5b2420 con 0x56238e5a05d0 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56238e4c1060 con 0x56238e5af780 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x56238e5b25a0 con 0x56238e5a1b40 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f188f41a740 10 client.0 _ll_register_callbacks cb 0x56238e2148c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f1886d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a05d0 0x56238e5af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f1886d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a05d0 0x56238e5af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54144/0 (socket says 172.21.15.70:54144) 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.401+0000 7f1886d9d640 1 -- 172.21.15.70:0/3614632207 learned_addr learned my addr 172.21.15.70:0/3614632207 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f188759e640 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5af780 0x56238e5acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f188659c640 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a1b40 0x56238e5ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f1886d9d640 1 -- 172.21.15.70:0/3614632207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a1b40 msgr2=0x56238e5ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f1886d9d640 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a1b40 0x56238e5ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f1886d9d640 1 -- 172.21.15.70:0/3614632207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5af780 msgr2=0x56238e5acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f1886d9d640 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5af780 0x56238e5acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f1886d9d640 1 -- 172.21.15.70:0/3614632207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56238e2773c0 con 0x56238e5a05d0 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f188659c640 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a1b40 0x56238e5ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f188759e640 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5af780 0x56238e5acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f1886d9d640 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a05d0 0x56238e5af1f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f187c003ba0 tx=0x7f187c003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d719e67a6e761eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f186aff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f186aff5640 1 -- 172.21.15.70:0/3614632207 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c049060 con 0x56238e5a05d0 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f186aff5640 1 -- 172.21.15.70:0/3614632207 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f187c031450 con 0x56238e5a05d0 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f188f41a740 1 -- 172.21.15.70:0/3614632207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f188009aff0 con 0x56238e5a05d0 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f186aff5640 1 -- 172.21.15.70:0/3614632207 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f187c031650 con 0x56238e5a05d0 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f188f41a740 10 client.16215 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f188f41a740 1 -- 172.21.15.70:0/3614632207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56238e5bdec0 con 0x56238e5a05d0 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.402+0000 7f186aff5640 1 -- 172.21.15.70:0/3614632207 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f188009aff0 con 0x56238e5a05d0 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.403+0000 7f186aff5640 1 -- 172.21.15.70:0/3614632207 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f187c04e070 con 0x56238e5a05d0 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.403+0000 7f188f41a740 10 client.16215 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.403+0000 7f188f41a740 10 client.16215 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.403+0000 7f188f41a740 20 client.16215 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.403+0000 7f188f41a740 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x56238e5bf3d0 0x56238e5c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.403+0000 7f188f41a740 4 client.16215 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.403+0000 7f188f41a740 1 -- 172.21.15.70:0/3614632207 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56238e513860 con 0x56238e5bf3d0 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.403+0000 7f188659c640 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x56238e5bf3d0 0x56238e5c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.403+0000 7f188659c640 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x56238e5bf3d0 0x56238e5c1870 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=66a6f69b1c764b58 server_cookie=e31b9648c3e4458c in_seq=0 out_seq=0 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.403+0000 7f186aff5640 10 client.16215 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.404+0000 7f186aff5640 1 -- 172.21.15.70:0/3614632207 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56238e513860 con 0x56238e5bf3d0 2024-09-12T01:54:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.404+0000 7f186aff5640 10 client.16215 handle_command_reply: tid=0 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.404+0000 7f188f41a740 1 client.16215 shutdown 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.404+0000 7f188f41a740 1 -- 172.21.15.70:0/3614632207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a05d0 msgr2=0x56238e5af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.404+0000 7f188f41a740 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a05d0 0x56238e5af1f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f187c003ba0 tx=0x7f187c003bd0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.404+0000 7f188f41a740 1 -- 172.21.15.70:0/3614632207 shutdown_connections 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.404+0000 7f188f41a740 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x56238e5bf3d0 0x56238e5c1870 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.404+0000 7f188f41a740 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5af780 0x56238e5acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.404+0000 7f188f41a740 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a1b40 0x56238e5ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.404+0000 7f186aff5640 0 client.16215 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.404+0000 7f188f41a740 1 --2- 172.21.15.70:0/3614632207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a05d0 0x56238e5af1f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.404+0000 7f188f41a740 1 -- 172.21.15.70:0/3614632207 >> 172.21.15.70:0/3614632207 conn(0x56238e569310 msgr2=0x56238e5a2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.405+0000 7f188f41a740 1 -- 172.21.15.70:0/3614632207 shutdown_connections 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.405+0000 7f188f41a740 1 -- 172.21.15.70:0/3614632207 wait complete. 2024-09-12T01:54:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.405+0000 7f188f41a740 20 client.16215 trim_cache size 0 max 16384 2024-09-12T01:54:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.418+0000 7f188f41a740 1 Processor -- start 2024-09-12T01:54:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.418+0000 7f188f41a740 1 -- start start 2024-09-12T01:54:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.418+0000 7f188f41a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5a05d0 0x56238e5abd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.418+0000 7f188f41a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a1b40 0x56238e5bb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.418+0000 7f188f41a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 0x56238e5a2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.418+0000 7f188f41a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18881ab5f0 con 0x56238e5af780 2024-09-12T01:54:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.418+0000 7f188f41a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f18881ad220 con 0x56238e5a05d0 2024-09-12T01:54:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.418+0000 7f188f41a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f18881abcc0 con 0x56238e5a1b40 2024-09-12T01:54:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.418+0000 7f188759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 0x56238e5a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.418+0000 7f188759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 0x56238e5a2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54148/0 (socket says 172.21.15.70:54148) 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.418+0000 7f188759e640 1 -- 172.21.15.70:0/2405102389 learned_addr learned my addr 172.21.15.70:0/2405102389 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.418+0000 7f1886d9d640 1 --2- 172.21.15.70:0/2405102389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5a05d0 0x56238e5abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.419+0000 7f188659c640 1 --2- 172.21.15.70:0/2405102389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a1b40 0x56238e5bb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.419+0000 7f188759e640 1 -- 172.21.15.70:0/2405102389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a1b40 msgr2=0x56238e5bb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.419+0000 7f188759e640 1 --2- 172.21.15.70:0/2405102389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a1b40 0x56238e5bb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.419+0000 7f188759e640 1 -- 172.21.15.70:0/2405102389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5a05d0 msgr2=0x56238e5abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.419+0000 7f188759e640 1 --2- 172.21.15.70:0/2405102389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5a05d0 0x56238e5abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.419+0000 7f188759e640 1 -- 172.21.15.70:0/2405102389 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56238e59ddd0 con 0x56238e5af780 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.419+0000 7f188759e640 1 --2- 172.21.15.70:0/2405102389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 0x56238e5a2880 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f18800992a0 tx=0x7f188009a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c5700f3d6dd02f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.419+0000 7f186cff9640 1 -- 172.21.15.70:0/2405102389 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880079e60 con 0x56238e5af780 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.419+0000 7f186cff9640 1 -- 172.21.15.70:0/2405102389 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f188009b6f0 con 0x56238e5af780 2024-09-12T01:54:02.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.419+0000 7f186cff9640 1 -- 172.21.15.70:0/2405102389 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880097660 con 0x56238e5af780 2024-09-12T01:54:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 -- 172.21.15.70:0/2405102389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 msgr2=0x56238e5a2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 --2- 172.21.15.70:0/2405102389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 0x56238e5a2880 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f18800992a0 tx=0x7f188009a950 comp rx=0 tx=0).stop 2024-09-12T01:54:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 -- 172.21.15.70:0/2405102389 shutdown_connections 2024-09-12T01:54:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 --2- 172.21.15.70:0/2405102389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5af780 0x56238e5a2880 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 --2- 172.21.15.70:0/2405102389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a1b40 0x56238e5bb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 --2- 172.21.15.70:0/2405102389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5a05d0 0x56238e5abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 -- 172.21.15.70:0/2405102389 >> 172.21.15.70:0/2405102389 conn(0x56238e569310 msgr2=0x56238e5a2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 -- 172.21.15.70:0/2405102389 shutdown_connections 2024-09-12T01:54:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 -- 172.21.15.70:0/2405102389 wait complete. 2024-09-12T01:54:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 -- start start 2024-09-12T01:54:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 Processor -- start 2024-09-12T01:54:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a05d0 0x56238e5b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a1b40 0x56238e5b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5af780 0x56238e628100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18881aca90 con 0x56238e5a1b40 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f18881ac3c0 con 0x56238e5af780 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f18881a95b0 con 0x56238e5a05d0 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188f41a740 10 client.0 _ll_register_callbacks cb 0x7f187c009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a1b40 0x56238e5b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a1b40 0x56238e5b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54154/0 (socket says 172.21.15.70:54154) 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.420+0000 7f188659c640 1 -- 172.21.15.70:0/565114376 learned_addr learned my addr 172.21.15.70:0/565114376 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f1886d9d640 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a05d0 0x56238e5b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f188759e640 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5af780 0x56238e628100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f188659c640 1 -- 172.21.15.70:0/565114376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a05d0 msgr2=0x56238e5b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f188659c640 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a05d0 0x56238e5b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f188659c640 1 -- 172.21.15.70:0/565114376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5af780 msgr2=0x56238e628100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f188659c640 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5af780 0x56238e628100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f188659c640 1 -- 172.21.15.70:0/565114376 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56238e628640 con 0x56238e5a1b40 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f188759e640 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5af780 0x56238e628100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f188659c640 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a1b40 0x56238e5b32f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x56238e59dac0 tx=0x7f18780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7962f8ecbfbd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f186aff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f186aff5640 1 -- 172.21.15.70:0/565114376 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878030060 con 0x56238e5a1b40 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f186aff5640 1 -- 172.21.15.70:0/565114376 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1878016df0 con 0x56238e5a1b40 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f188f41a740 1 -- 172.21.15.70:0/565114376 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f188009b6f0 con 0x56238e5a1b40 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f186aff5640 1 -- 172.21.15.70:0/565114376 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1878024410 con 0x56238e5a1b40 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f188f41a740 10 client.16221 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f188f41a740 1 -- 172.21.15.70:0/565114376 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56238e6299a0 con 0x56238e5a1b40 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.421+0000 7f186aff5640 1 -- 172.21.15.70:0/565114376 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f188009b6f0 con 0x56238e5a1b40 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.422+0000 7f186aff5640 1 -- 172.21.15.70:0/565114376 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f1878035070 con 0x56238e5a1b40 2024-09-12T01:54:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.422+0000 7f188f41a740 10 client.16221 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.422+0000 7f188f41a740 10 client.16221 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.422+0000 7f188f41a740 20 client.16221 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.422+0000 7f188f41a740 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x56238e62a100 0x56238e62c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.422+0000 7f188f41a740 4 client.16221 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.422+0000 7f188f41a740 1 -- 172.21.15.70:0/565114376 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56238e50dd70 con 0x56238e62a100 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.422+0000 7f1886d9d640 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x56238e62a100 0x56238e62c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.422+0000 7f1886d9d640 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x56238e62a100 0x56238e62c520 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5d036bd6a32d9728 server_cookie=e8bb64f1aad6832b in_seq=0 out_seq=0 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.422+0000 7f186aff5640 10 client.16221 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f186aff5640 1 -- 172.21.15.70:0/565114376 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56238e50dd70 con 0x56238e62a100 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f186aff5640 10 client.16221 handle_command_reply: tid=0 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188f41a740 1 client.16221 shutdown 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188f41a740 1 -- 172.21.15.70:0/565114376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a1b40 msgr2=0x56238e5b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188f41a740 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a1b40 0x56238e5b32f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x56238e59dac0 tx=0x7f18780046c0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188f41a740 1 -- 172.21.15.70:0/565114376 shutdown_connections 2024-09-12T01:54:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188f41a740 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x56238e62a100 0x56238e62c520 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188f41a740 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56238e5af780 0x56238e628100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188f41a740 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56238e5a1b40 0x56238e5b32f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188f41a740 1 --2- 172.21.15.70:0/565114376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56238e5a05d0 0x56238e5b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188f41a740 1 -- 172.21.15.70:0/565114376 >> 172.21.15.70:0/565114376 conn(0x56238e569310 msgr2=0x56238e5ab460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f186aff5640 0 client.16221 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:54:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188f41a740 1 -- 172.21.15.70:0/565114376 shutdown_connections 2024-09-12T01:54:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188f41a740 1 -- 172.21.15.70:0/565114376 wait complete. 2024-09-12T01:54:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188f41a740 20 client.16221 trim_cache size 0 max 16384 2024-09-12T01:54:02.428 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:54:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188d041640 1 -- 172.21.15.70:0/1792576173 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f18700a2b80 msgr2=0x7f18700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188d041640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f18700a2b80 0x7f18700a5040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f18880fdce0 tx=0x7f18780093e0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188d041640 1 -- 172.21.15.70:0/1792576173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1888106f10 msgr2=0x7f188819cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.423+0000 7f188d041640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1888106f10 0x7f188819cf40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1880009fd0 tx=0x7f188000b8e0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.424+0000 7f188d041640 1 -- 172.21.15.70:0/1792576173 shutdown_connections 2024-09-12T01:54:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.424+0000 7f188d041640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f18700a2b80 0x7f18700a5040 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.424+0000 7f188d041640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1888106f10 0x7f188819cf40 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.424+0000 7f188d041640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1888102790 0x7f1888198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.424+0000 7f188d041640 1 --2- 172.21.15.70:0/1792576173 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1888101de0 0x7f1888198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.424+0000 7f188d041640 1 -- 172.21.15.70:0/1792576173 >> 172.21.15.70:0/1792576173 conn(0x7f18880fd8c0 msgr2=0x7f18880fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.424+0000 7f188d041640 1 -- 172.21.15.70:0/1792576173 shutdown_connections 2024-09-12T01:54:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:02.424+0000 7f188d041640 1 -- 172.21.15.70:0/1792576173 wait complete. 2024-09-12T01:54:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:02 smithi070 ceph-mon[31177]: pgmap v393: 97 pgs: 97 active+clean; 134 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 939 op/s 2024-09-12T01:54:02.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:02 smithi191 ceph-mon[35770]: pgmap v393: 97 pgs: 97 active+clean; 134 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 939 op/s 2024-09-12T01:54:03.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:02 smithi152 ceph-mon[35055]: pgmap v393: 97 pgs: 97 active+clean; 134 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.8 MiB/s wr, 939 op/s 2024-09-12T01:54:03.060 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:54:03.302 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:03.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.784+0000 7f68ad0ef640 1 -- 172.21.15.70:0/2644381309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68a8106a80 msgr2=0x7f68a8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:03.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.784+0000 7f68ad0ef640 1 --2- 172.21.15.70:0/2644381309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68a8106a80 0x7f68a8106e60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6898009930 tx=0x7f689802a420 comp rx=0 tx=0).stop 2024-09-12T01:54:03.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.784+0000 7f68ad0ef640 1 -- 172.21.15.70:0/2644381309 shutdown_connections 2024-09-12T01:54:03.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.784+0000 7f68ad0ef640 1 --2- 172.21.15.70:0/2644381309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68a8101420 0x7f68a810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.784+0000 7f68ad0ef640 1 --2- 172.21.15.70:0/2644381309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a8100a80 0x7f68a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.784+0000 7f68ad0ef640 1 --2- 172.21.15.70:0/2644381309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68a8106a80 0x7f68a8106e60 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.784+0000 7f68ad0ef640 1 -- 172.21.15.70:0/2644381309 >> 172.21.15.70:0/2644381309 conn(0x7f68a80fc7a0 msgr2=0x7f68a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:03.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.784+0000 7f68ad0ef640 1 -- 172.21.15.70:0/2644381309 shutdown_connections 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.784+0000 7f68ad0ef640 1 -- 172.21.15.70:0/2644381309 wait complete. 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.785+0000 7f68ad0ef640 1 Processor -- start 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.785+0000 7f68ad0ef640 1 -- start start 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68ad0ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68a8100a80 0x7f68a81993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68ad0ef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a8101420 0x7f68a8199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68ad0ef640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68a8106a80 0x7f68a81a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68ad0ef640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68a8110fe0 con 0x7f68a8100a80 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68ad0ef640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f68a8110e60 con 0x7f68a8101420 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68ad0ef640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f68a8111160 con 0x7f68a8106a80 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68a6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68a8100a80 0x7f68a81993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68a6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68a8100a80 0x7f68a81993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54178/0 (socket says 172.21.15.70:54178) 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68a6d9d640 1 -- 172.21.15.70:0/1512325561 learned_addr learned my addr 172.21.15.70:0/1512325561 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:03.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68a659c640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a8101420 0x7f68a8199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68a759e640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68a8106a80 0x7f68a81a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68a6d9d640 1 -- 172.21.15.70:0/1512325561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68a8106a80 msgr2=0x7f68a81a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68a6d9d640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68a8106a80 0x7f68a81a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68a6d9d640 1 -- 172.21.15.70:0/1512325561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a8101420 msgr2=0x7f68a8199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68a6d9d640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a8101420 0x7f68a8199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68a6d9d640 1 -- 172.21.15.70:0/1512325561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a81a49b0 con 0x7f68a8100a80 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68a6d9d640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68a8100a80 0x7f68a81993f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6898009230 tx=0x7f6898004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f688ffff640 1 -- 172.21.15.70:0/1512325561 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689803f030 con 0x7f68a8100a80 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68ad0ef640 1 -- 172.21.15.70:0/1512325561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a81a4b80 con 0x7f68a8100a80 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.786+0000 7f68ad0ef640 1 -- 172.21.15.70:0/1512325561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a81a5030 con 0x7f68a8100a80 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.787+0000 7f688ffff640 1 -- 172.21.15.70:0/1512325561 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6898003af0 con 0x7f68a8100a80 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.787+0000 7f688ffff640 1 -- 172.21.15.70:0/1512325561 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898049060 con 0x7f68a8100a80 2024-09-12T01:54:03.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f688ffff640 1 -- 172.21.15.70:0/1512325561 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6898042030 con 0x7f68a8100a80 2024-09-12T01:54:03.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68af4c8740 1 Processor -- start 2024-09-12T01:54:03.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68af4c8740 1 -- start start 2024-09-12T01:54:03.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68af4c8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618924a0b40 0x56189249f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68af4c8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56189249f5d0 0x56189249fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68af4c8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 0x5618924ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68af4c8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5618924052f0 con 0x5618924aa370 2024-09-12T01:54:03.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68af4c8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5618923accf0 con 0x56189249f5d0 2024-09-12T01:54:03.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68af4c8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5618924012b0 con 0x5618924a0b40 2024-09-12T01:54:03.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 0x5618924ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 0x5618924ac760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54190/0 (socket says 172.21.15.70:54190) 2024-09-12T01:54:03.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68a659c640 1 -- 172.21.15.70:0/1388585769 learned_addr learned my addr 172.21.15.70:0/1388585769 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:03.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68a759e640 1 --2- 172.21.15.70:0/1388585769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618924a0b40 0x56189249f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f688ffff640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f68900a2b80 0x7f68900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.789+0000 7f68a6d9d640 1 --2- 172.21.15.70:0/1388585769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56189249f5d0 0x56189249fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.790+0000 7f68a759e640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f68900a2b80 0x7f68900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.790+0000 7f68a659c640 1 -- 172.21.15.70:0/1388585769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618924a0b40 msgr2=0x56189249f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:03.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.790+0000 7f68a659c640 1 --2- 172.21.15.70:0/1388585769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618924a0b40 0x56189249f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.790+0000 7f68a659c640 1 -- 172.21.15.70:0/1388585769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56189249f5d0 msgr2=0x56189249fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:03.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.790+0000 7f68a659c640 1 --2- 172.21.15.70:0/1388585769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56189249f5d0 0x56189249fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.790+0000 7f68a659c640 1 -- 172.21.15.70:0/1388585769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618923913a0 con 0x5618924aa370 2024-09-12T01:54:03.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.790+0000 7f688ffff640 1 -- 172.21.15.70:0/1512325561 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f68980ef0a0 con 0x7f68a8100a80 2024-09-12T01:54:03.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.790+0000 7f68a659c640 1 --2- 172.21.15.70:0/1388585769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 0x5618924ac760 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f689c00bcb0 tx=0x7f689c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5679430c0c5de4c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:03.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.790+0000 7f68a759e640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f68900a2b80 0x7f68900a5040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009fd0 tx=0x7f68a0004a40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:03.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.790+0000 7f688d7fa640 1 -- 172.21.15.70:0/1388585769 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c004030 con 0x5618924aa370 2024-09-12T01:54:03.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.790+0000 7f688d7fa640 1 -- 172.21.15.70:0/1388585769 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f689c0041d0 con 0x5618924aa370 2024-09-12T01:54:03.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.790+0000 7f688d7fa640 1 -- 172.21.15.70:0/1388585769 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c0118b0 con 0x5618924aa370 2024-09-12T01:54:03.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 -- 172.21.15.70:0/1388585769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 msgr2=0x5618924ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:03.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 --2- 172.21.15.70:0/1388585769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 0x5618924ac760 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f689c00bcb0 tx=0x7f689c0107a0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 -- 172.21.15.70:0/1388585769 shutdown_connections 2024-09-12T01:54:03.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 --2- 172.21.15.70:0/1388585769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 0x5618924ac760 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 --2- 172.21.15.70:0/1388585769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56189249f5d0 0x56189249fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 --2- 172.21.15.70:0/1388585769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618924a0b40 0x56189249f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 -- 172.21.15.70:0/1388585769 >> 172.21.15.70:0/1388585769 conn(0x561892468310 msgr2=0x56189249bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:03.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 -- 172.21.15.70:0/1388585769 shutdown_connections 2024-09-12T01:54:03.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 -- 172.21.15.70:0/1388585769 wait complete. 2024-09-12T01:54:03.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 -- start start 2024-09-12T01:54:03.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 Processor -- start 2024-09-12T01:54:03.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56189249f5d0 0x5618924a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 0x5618924a6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618924aa370 0x5618924a7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5618924ad070 con 0x5618924a0b40 2024-09-12T01:54:03.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5618923c0060 con 0x56189249f5d0 2024-09-12T01:54:03.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.791+0000 7f68af4c8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5618924ad1f0 con 0x5618924aa370 2024-09-12T01:54:03.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68af4c8740 10 client.0 _ll_register_callbacks cb 0x5618921138c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:03.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 0x5618924a6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 0x5618924a6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54206/0 (socket says 172.21.15.70:54206) 2024-09-12T01:54:03.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68a659c640 1 -- 172.21.15.70:0/3489827706 learned_addr learned my addr 172.21.15.70:0/3489827706 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:03.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68a759e640 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618924aa370 0x5618924a7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68a6d9d640 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56189249f5d0 0x5618924a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68a659c640 1 -- 172.21.15.70:0/3489827706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618924aa370 msgr2=0x5618924a7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:03.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68a659c640 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618924aa370 0x5618924a7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68a659c640 1 -- 172.21.15.70:0/3489827706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56189249f5d0 msgr2=0x5618924a9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:03.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68a659c640 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56189249f5d0 0x5618924a9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68a659c640 1 -- 172.21.15.70:0/3489827706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618921763c0 con 0x5618924a0b40 2024-09-12T01:54:03.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68a659c640 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 0x5618924a6fd0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f689c005cd0 tx=0x7f689c00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f197714454db40b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:03.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f688aff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:03.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f688aff5640 1 -- 172.21.15.70:0/3489827706 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c004000 con 0x5618924a0b40 2024-09-12T01:54:03.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f688aff5640 1 -- 172.21.15.70:0/3489827706 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f689c0035f0 con 0x5618924a0b40 2024-09-12T01:54:03.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68af4c8740 1 -- 172.21.15.70:0/3489827706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f689c0041d0 con 0x5618924a0b40 2024-09-12T01:54:03.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f688aff5640 1 -- 172.21.15.70:0/3489827706 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f689c0037f0 con 0x5618924a0b40 2024-09-12T01:54:03.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68af4c8740 10 client.16233 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:03.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.792+0000 7f68af4c8740 1 -- 172.21.15.70:0/3489827706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5618924b8b20 con 0x5618924a0b40 2024-09-12T01:54:03.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.793+0000 7f688aff5640 1 -- 172.21.15.70:0/3489827706 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f689c0041d0 con 0x5618924a0b40 2024-09-12T01:54:03.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.793+0000 7f688aff5640 1 -- 172.21.15.70:0/3489827706 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f689c004960 con 0x5618924a0b40 2024-09-12T01:54:03.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.793+0000 7f68af4c8740 10 client.16233 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:03.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.793+0000 7f68af4c8740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:03.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.793+0000 7f68af4c8740 20 client.16233 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:03.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.793+0000 7f68af4c8740 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5618924b9e70 0x5618924bc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.793+0000 7f68af4c8740 4 client.16233 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:03.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.793+0000 7f68af4c8740 1 -- 172.21.15.70:0/3489827706 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561892412860 con 0x5618924b9e70 2024-09-12T01:54:03.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.793+0000 7f68a6d9d640 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5618924b9e70 0x5618924bc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.794+0000 7f68a6d9d640 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5618924b9e70 0x5618924bc2a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68d036a3d8272984 server_cookie=4848d0e9a7f530bd in_seq=0 out_seq=0 2024-09-12T01:54:03.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.794+0000 7f688aff5640 10 client.16233 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:03.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.794+0000 7f688aff5640 1 -- 172.21.15.70:0/3489827706 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561892412860 con 0x5618924b9e70 2024-09-12T01:54:03.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.794+0000 7f688aff5640 10 client.16233 handle_command_reply: tid=0 2024-09-12T01:54:03.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.794+0000 7f68af4c8740 1 client.16233 shutdown 2024-09-12T01:54:03.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.795+0000 7f68af4c8740 1 -- 172.21.15.70:0/3489827706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 msgr2=0x5618924a6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:03.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.795+0000 7f68af4c8740 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 0x5618924a6fd0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f689c005cd0 tx=0x7f689c00bfd0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.795+0000 7f68af4c8740 1 -- 172.21.15.70:0/3489827706 shutdown_connections 2024-09-12T01:54:03.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.795+0000 7f68af4c8740 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5618924b9e70 0x5618924bc2a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.795+0000 7f68af4c8740 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5618924aa370 0x5618924a7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.795+0000 7f688aff5640 0 client.16233 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:03.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.795+0000 7f68af4c8740 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 0x5618924a6fd0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.795+0000 7f68af4c8740 1 --2- 172.21.15.70:0/3489827706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56189249f5d0 0x5618924a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.795+0000 7f68af4c8740 1 -- 172.21.15.70:0/3489827706 >> 172.21.15.70:0/3489827706 conn(0x561892468310 msgr2=0x5618924a1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:03.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.795+0000 7f68af4c8740 1 -- 172.21.15.70:0/3489827706 shutdown_connections 2024-09-12T01:54:03.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.795+0000 7f68af4c8740 1 -- 172.21.15.70:0/3489827706 wait complete. 2024-09-12T01:54:03.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.795+0000 7f68af4c8740 20 client.16233 trim_cache size 0 max 16384 2024-09-12T01:54:03.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.807+0000 7f68af4c8740 1 Processor -- start 2024-09-12T01:54:03.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.807+0000 7f68af4c8740 1 -- start start 2024-09-12T01:54:03.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68af4c8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56189249f5d0 0x5618924a6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68af4c8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618924a0b40 0x5618924a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68af4c8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 0x5618924a2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68af4c8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f689400e4a0 con 0x5618924aa370 2024-09-12T01:54:03.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68af4c8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f68940100d0 con 0x5618924a0b40 2024-09-12T01:54:03.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68af4c8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f689400eb70 con 0x56189249f5d0 2024-09-12T01:54:03.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68a759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 0x5618924a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68a759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 0x5618924a2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54216/0 (socket says 172.21.15.70:54216) 2024-09-12T01:54:03.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68a759e640 1 -- 172.21.15.70:0/4097498536 learned_addr learned my addr 172.21.15.70:0/4097498536 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68a6d9d640 1 --2- 172.21.15.70:0/4097498536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56189249f5d0 0x5618924a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68a659c640 1 --2- 172.21.15.70:0/4097498536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618924a0b40 0x5618924a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68a759e640 1 -- 172.21.15.70:0/4097498536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56189249f5d0 msgr2=0x5618924a6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68a759e640 1 --2- 172.21.15.70:0/4097498536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56189249f5d0 0x5618924a6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68a759e640 1 -- 172.21.15.70:0/4097498536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618924a0b40 msgr2=0x5618924a8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68a759e640 1 --2- 172.21.15.70:0/4097498536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618924a0b40 0x5618924a8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68a759e640 1 -- 172.21.15.70:0/4097498536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618924aa090 con 0x5618924aa370 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f68a759e640 1 --2- 172.21.15.70:0/4097498536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 0x5618924a2120 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f68a000cf10 tx=0x7f68a00098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115d06399f138c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.808+0000 7f688cff9640 1 -- 172.21.15.70:0/4097498536 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0015050 con 0x5618924aa370 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.809+0000 7f688cff9640 1 -- 172.21.15.70:0/4097498536 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f68a0016040 con 0x5618924aa370 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.809+0000 7f688cff9640 1 -- 172.21.15.70:0/4097498536 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a000a6f0 con 0x5618924aa370 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.809+0000 7f68af4c8740 1 -- 172.21.15.70:0/4097498536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 msgr2=0x5618924a2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.809+0000 7f68af4c8740 1 --2- 172.21.15.70:0/4097498536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 0x5618924a2120 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f68a000cf10 tx=0x7f68a00098d0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.809+0000 7f68af4c8740 1 -- 172.21.15.70:0/4097498536 shutdown_connections 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.809+0000 7f68af4c8740 1 --2- 172.21.15.70:0/4097498536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924aa370 0x5618924a2120 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.809+0000 7f68af4c8740 1 --2- 172.21.15.70:0/4097498536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618924a0b40 0x5618924a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.809+0000 7f68af4c8740 1 --2- 172.21.15.70:0/4097498536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56189249f5d0 0x5618924a6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.809+0000 7f68af4c8740 1 -- 172.21.15.70:0/4097498536 >> 172.21.15.70:0/4097498536 conn(0x561892468310 msgr2=0x5618924a8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.809+0000 7f68af4c8740 1 -- 172.21.15.70:0/4097498536 shutdown_connections 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.809+0000 7f68af4c8740 1 -- 172.21.15.70:0/4097498536 wait complete. 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68af4c8740 1 -- start start 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68af4c8740 1 Processor -- start 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68af4c8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56189249f5d0 0x5618924b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68af4c8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 0x5618924ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68af4c8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618924aa370 0x5618924ae670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68af4c8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f689400f940 con 0x5618924a0b40 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68af4c8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f689400f270 con 0x5618924aa370 2024-09-12T01:54:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68af4c8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f689400c460 con 0x56189249f5d0 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 0x5618924ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 0x5618924ae080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54232/0 (socket says 172.21.15.70:54232) 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68a659c640 1 -- 172.21.15.70:0/3867300259 learned_addr learned my addr 172.21.15.70:0/3867300259 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68af4c8740 10 client.0 _ll_register_callbacks cb 0x7f68a0009730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68a6d9d640 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56189249f5d0 0x5618924b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68a759e640 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618924aa370 0x5618924ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68a659c640 1 -- 172.21.15.70:0/3867300259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56189249f5d0 msgr2=0x5618924b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68a659c640 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56189249f5d0 0x5618924b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68a659c640 1 -- 172.21.15.70:0/3867300259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618924aa370 msgr2=0x5618924ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68a659c640 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618924aa370 0x5618924ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68a659c640 1 -- 172.21.15.70:0/3867300259 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618924aeea0 con 0x5618924a0b40 2024-09-12T01:54:03.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68a6d9d640 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56189249f5d0 0x5618924b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.810+0000 7f68a759e640 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618924aa370 0x5618924ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f68a659c640 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 0x5618924ae080 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f689c004f20 tx=0x7f689c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184f81503627ed5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f688aff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f688aff5640 1 -- 172.21.15.70:0/3867300259 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c0116e0 con 0x5618924a0b40 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f688aff5640 1 -- 172.21.15.70:0/3867300259 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f689c011980 con 0x5618924a0b40 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f68af4c8740 1 -- 172.21.15.70:0/3867300259 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68a0016040 con 0x5618924a0b40 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f688aff5640 1 -- 172.21.15.70:0/3867300259 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f689c011b80 con 0x5618924a0b40 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f68af4c8740 10 client.16239 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f68af4c8740 1 -- 172.21.15.70:0/3867300259 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561892524c30 con 0x5618924a0b40 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f688aff5640 1 -- 172.21.15.70:0/3867300259 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f68a0016040 con 0x5618924a0b40 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f688aff5640 1 -- 172.21.15.70:0/3867300259 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f689c005340 con 0x5618924a0b40 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f68af4c8740 10 client.16239 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f68af4c8740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f68af4c8740 20 client.16239 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f68af4c8740 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561892525380 0x5618925277a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f68af4c8740 4 client.16239 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.811+0000 7f68af4c8740 1 -- 172.21.15.70:0/3867300259 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56189240cd70 con 0x561892525380 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f68a6d9d640 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561892525380 0x5618925277a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f688aff5640 10 client.16239 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f68a6d9d640 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561892525380 0x5618925277a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe278014adf99be8 server_cookie=d10e28012c937a37 in_seq=0 out_seq=0 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f688aff5640 1 -- 172.21.15.70:0/3867300259 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56189240cd70 con 0x561892525380 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f688aff5640 10 client.16239 handle_command_reply: tid=0 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f68af4c8740 1 client.16239 shutdown 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f68af4c8740 1 -- 172.21.15.70:0/3867300259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 msgr2=0x5618924ae080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f68af4c8740 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 0x5618924ae080 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f689c004f20 tx=0x7f689c0035f0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f68af4c8740 1 -- 172.21.15.70:0/3867300259 shutdown_connections 2024-09-12T01:54:03.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f68af4c8740 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561892525380 0x5618925277a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f68af4c8740 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5618924aa370 0x5618924ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f68af4c8740 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5618924a0b40 0x5618924ae080 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f688aff5640 0 client.16239 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:03.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f68af4c8740 1 --2- 172.21.15.70:0/3867300259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56189249f5d0 0x5618924b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.812+0000 7f68af4c8740 1 -- 172.21.15.70:0/3867300259 >> 172.21.15.70:0/3867300259 conn(0x561892468310 msgr2=0x5618924a9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:03.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68af4c8740 1 -- 172.21.15.70:0/3867300259 shutdown_connections 2024-09-12T01:54:03.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68af4c8740 1 -- 172.21.15.70:0/3867300259 wait complete. 2024-09-12T01:54:03.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68af4c8740 20 client.16239 trim_cache size 0 max 16384 2024-09-12T01:54:03.827 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:54:03.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68ad0ef640 1 -- 172.21.15.70:0/1512325561 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f68900a2b80 msgr2=0x7f68900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:03.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68ad0ef640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f68900a2b80 0x7f68900a5040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009fd0 tx=0x7f68a0004a40 comp rx=0 tx=0).stop 2024-09-12T01:54:03.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68ad0ef640 1 -- 172.21.15.70:0/1512325561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68a8100a80 msgr2=0x7f68a81993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:03.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68ad0ef640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68a8100a80 0x7f68a81993f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6898009230 tx=0x7f6898004270 comp rx=0 tx=0).stop 2024-09-12T01:54:03.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68ad0ef640 1 -- 172.21.15.70:0/1512325561 shutdown_connections 2024-09-12T01:54:03.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68ad0ef640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f68900a2b80 0x7f68900a5040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68ad0ef640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68a8106a80 0x7f68a81a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68ad0ef640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68a8101420 0x7f68a8199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68ad0ef640 1 --2- 172.21.15.70:0/1512325561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68a8100a80 0x7f68a81993f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:03.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68ad0ef640 1 -- 172.21.15.70:0/1512325561 >> 172.21.15.70:0/1512325561 conn(0x7f68a80fc7a0 msgr2=0x7f68a80fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:03.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.813+0000 7f68ad0ef640 1 -- 172.21.15.70:0/1512325561 shutdown_connections 2024-09-12T01:54:03.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:03.814+0000 7f68ad0ef640 1 -- 172.21.15.70:0/1512325561 wait complete. 2024-09-12T01:54:04.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:04.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:04 smithi070 ceph-mon[31177]: pgmap v394: 97 pgs: 97 active+clean; 134 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 444 op/s 2024-09-12T01:54:04.769 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:04.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:04 smithi191 ceph-mon[35770]: pgmap v394: 97 pgs: 97 active+clean; 134 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 444 op/s 2024-09-12T01:54:05.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:04 smithi152 ceph-mon[35055]: pgmap v394: 97 pgs: 97 active+clean; 134 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 444 op/s 2024-09-12T01:54:05.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.249+0000 7f1886325640 1 -- 172.21.15.70:0/29275576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1880101de0 msgr2=0x7f18801021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:05.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.249+0000 7f1886325640 1 --2- 172.21.15.70:0/29275576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1880101de0 0x7f18801021c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1870009900 tx=0x7f187002a410 comp rx=0 tx=0).stop 2024-09-12T01:54:05.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.249+0000 7f1886325640 1 -- 172.21.15.70:0/29275576 shutdown_connections 2024-09-12T01:54:05.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.249+0000 7f1886325640 1 --2- 172.21.15.70:0/29275576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1880106f10 0x7f188010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:05.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.249+0000 7f1886325640 1 --2- 172.21.15.70:0/29275576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1880102790 0x7f18801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:05.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.249+0000 7f1886325640 1 --2- 172.21.15.70:0/29275576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1880101de0 0x7f18801021c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:05.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.249+0000 7f1886325640 1 -- 172.21.15.70:0/29275576 >> 172.21.15.70:0/29275576 conn(0x7f18800fd8c0 msgr2=0x7f18800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:05.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.249+0000 7f1886325640 1 -- 172.21.15.70:0/29275576 shutdown_connections 2024-09-12T01:54:05.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.249+0000 7f1886325640 1 -- 172.21.15.70:0/29275576 wait complete. 2024-09-12T01:54:05.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.250+0000 7f1886325640 1 Processor -- start 2024-09-12T01:54:05.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.250+0000 7f1886325640 1 -- start start 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.250+0000 7f1886325640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1880101de0 0x7f1880198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.250+0000 7f1886325640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1880102790 0x7f1880198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.250+0000 7f1886325640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1880106f10 0x7f188019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.250+0000 7f1886325640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1880112150 con 0x7f1880101de0 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.250+0000 7f1886325640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1880111fd0 con 0x7f1880106f10 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.250+0000 7f1886325640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f18801122d0 con 0x7f1880102790 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.250+0000 7f187ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1880101de0 0x7f1880198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.250+0000 7f187ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1880101de0 0x7f1880198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54252/0 (socket says 172.21.15.70:54252) 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.250+0000 7f187ffff640 1 -- 172.21.15.70:0/3178000844 learned_addr learned my addr 172.21.15.70:0/3178000844 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f187f7fe640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1880102790 0x7f1880198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f18848c2640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1880106f10 0x7f188019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f187ffff640 1 -- 172.21.15.70:0/3178000844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1880102790 msgr2=0x7f1880198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f187ffff640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1880102790 0x7f1880198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:05.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f187ffff640 1 -- 172.21.15.70:0/3178000844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1880106f10 msgr2=0x7f188019cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f187ffff640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1880106f10 0x7f188019cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f187ffff640 1 -- 172.21.15.70:0/3178000844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188019d620 con 0x7f1880101de0 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f18848c2640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1880106f10 0x7f188019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f187ffff640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1880101de0 0x7f1880198670 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1870006010 tx=0x7f18700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f187d7fa640 1 -- 172.21.15.70:0/3178000844 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187003f030 con 0x7f1880101de0 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f187d7fa640 1 -- 172.21.15.70:0/3178000844 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1870003d00 con 0x7f1880101de0 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f187d7fa640 1 -- 172.21.15.70:0/3178000844 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870035070 con 0x7f1880101de0 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f1886325640 1 -- 172.21.15.70:0/3178000844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188019d8b0 con 0x7f1880101de0 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.251+0000 7f1886325640 1 -- 172.21.15.70:0/3178000844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18801a51f0 con 0x7f1880101de0 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.252+0000 7f1886325640 1 -- 172.21.15.70:0/3178000844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18801032c0 con 0x7f1880101de0 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.253+0000 7f187d7fa640 1 -- 172.21.15.70:0/3178000844 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1870042030 con 0x7f1880101de0 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.254+0000 7f187d7fa640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f18680a2b80 0x7f18680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:05.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.254+0000 7f187f7fe640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f18680a2b80 0x7f18680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:05.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.254+0000 7f187d7fa640 1 -- 172.21.15.70:0/3178000844 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f18700efa90 con 0x7f1880101de0 2024-09-12T01:54:05.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.254+0000 7f187f7fe640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f18680a2b80 0x7f18680a5040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f18800fdce0 tx=0x7f1874008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:05.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.258+0000 7f187d7fa640 1 -- 172.21.15.70:0/3178000844 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18700bc9f0 con 0x7f1880101de0 2024-09-12T01:54:05.461 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:54:05.461 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:54:05.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.465+0000 7f1886325640 1 -- 172.21.15.70:0/3178000844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f188010a0f0 con 0x7f1880101de0 2024-09-12T01:54:05.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.465+0000 7f187d7fa640 1 -- 172.21.15.70:0/3178000844 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11987 (secure 0 0 0) 0x7f18700bc2f0 con 0x7f1880101de0 2024-09-12T01:54:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:54:05.468 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":33,"btime":"2024-09-12T01:53:58:589034+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:53:57.614645+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:54:05.469 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 33 2024-09-12T01:54:05.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.468+0000 7f1886325640 1 -- 172.21.15.70:0/3178000844 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f18680a2b80 msgr2=0x7f18680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:05.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.468+0000 7f1886325640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f18680a2b80 0x7f18680a5040 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f18800fdce0 tx=0x7f1874008040 comp rx=0 tx=0).stop 2024-09-12T01:54:05.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.468+0000 7f1886325640 1 -- 172.21.15.70:0/3178000844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1880101de0 msgr2=0x7f1880198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:05.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.468+0000 7f1886325640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1880101de0 0x7f1880198670 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f1870006010 tx=0x7f18700042f0 comp rx=0 tx=0).stop 2024-09-12T01:54:05.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.468+0000 7f1886325640 1 -- 172.21.15.70:0/3178000844 shutdown_connections 2024-09-12T01:54:05.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.468+0000 7f1886325640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f18680a2b80 0x7f18680a5040 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:05.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.468+0000 7f1886325640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1880106f10 0x7f188019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:05.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.468+0000 7f1886325640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1880102790 0x7f1880198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:05.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.468+0000 7f1886325640 1 --2- 172.21.15.70:0/3178000844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1880101de0 0x7f1880198670 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:05.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.468+0000 7f1886325640 1 -- 172.21.15.70:0/3178000844 >> 172.21.15.70:0/3178000844 conn(0x7f18800fd8c0 msgr2=0x7f18800fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:05.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.468+0000 7f1886325640 1 -- 172.21.15.70:0/3178000844 shutdown_connections 2024-09-12T01:54:05.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:05.468+0000 7f1886325640 1 -- 172.21.15.70:0/3178000844 wait complete. 2024-09-12T01:54:05.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:05 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3178000844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:05.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:05 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3178000844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:06.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:05 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3178000844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:06.185 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24452 quiesce db --set-id 460d82a8 --release --await' 2024-09-12T01:54:06.185 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24452 quiesce db --set-id 460d82a8 --release --await 2024-09-12T01:54:06.275 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:06.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.736+0000 7f973ce70640 1 -- 172.21.15.70:0/2605044517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97381036c0 msgr2=0x7f973810bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:06.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.736+0000 7f973ce70640 1 --2- 172.21.15.70:0/2605044517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97381036c0 0x7f973810bbb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f972c009900 tx=0x7f972c02a480 comp rx=0 tx=0).stop 2024-09-12T01:54:06.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.736+0000 7f973ce70640 1 -- 172.21.15.70:0/2605044517 shutdown_connections 2024-09-12T01:54:06.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.736+0000 7f973ce70640 1 --2- 172.21.15.70:0/2605044517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f973810c180 0x7f973810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.736+0000 7f973ce70640 1 --2- 172.21.15.70:0/2605044517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97381036c0 0x7f973810bbb0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.736+0000 7f973ce70640 1 --2- 172.21.15.70:0/2605044517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9738102da0 0x7f9738103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.736+0000 7f973ce70640 1 -- 172.21.15.70:0/2605044517 >> 172.21.15.70:0/2605044517 conn(0x7f97380fc7a0 msgr2=0x7f97380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:06.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.736+0000 7f973ce70640 1 -- 172.21.15.70:0/2605044517 shutdown_connections 2024-09-12T01:54:06.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.736+0000 7f973ce70640 1 -- 172.21.15.70:0/2605044517 wait complete. 2024-09-12T01:54:06.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.737+0000 7f973ce70640 1 Processor -- start 2024-09-12T01:54:06.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.737+0000 7f973ce70640 1 -- start start 2024-09-12T01:54:06.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.737+0000 7f973ce70640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9738102da0 0x7f97381984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.737+0000 7f973ce70640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97381036c0 0x7f9738198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.737+0000 7f973ce70640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f973810c180 0x7f973819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.737+0000 7f973ce70640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f97381120d0 con 0x7f9738102da0 2024-09-12T01:54:06.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.737+0000 7f973ce70640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9738111f50 con 0x7f973810c180 2024-09-12T01:54:06.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.737+0000 7f973ce70640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9738112250 con 0x7f97381036c0 2024-09-12T01:54:06.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.737+0000 7f973659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9738102da0 0x7f97381984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f973659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9738102da0 0x7f97381984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54264/0 (socket says 172.21.15.70:54264) 2024-09-12T01:54:06.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f973659c640 1 -- 172.21.15.70:0/191081100 learned_addr learned my addr 172.21.15.70:0/191081100 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:06.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f9735d9b640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97381036c0 0x7f9738198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f973659c640 1 -- 172.21.15.70:0/191081100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97381036c0 msgr2=0x7f9738198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:06.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f973659c640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97381036c0 0x7f9738198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f973659c640 1 -- 172.21.15.70:0/191081100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f973810c180 msgr2=0x7f973819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:06.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f973659c640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f973810c180 0x7f973819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f973659c640 1 -- 172.21.15.70:0/191081100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973819d4a0 con 0x7f9738102da0 2024-09-12T01:54:06.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f973659c640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9738102da0 0x7f97381984f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f972800c970 tx=0x7f972800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:06.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f97277fe640 1 -- 172.21.15.70:0/191081100 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9728007bb0 con 0x7f9738102da0 2024-09-12T01:54:06.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f973ce70640 1 -- 172.21.15.70:0/191081100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973819d790 con 0x7f9738102da0 2024-09-12T01:54:06.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f97277fe640 1 -- 172.21.15.70:0/191081100 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9728007d50 con 0x7f9738102da0 2024-09-12T01:54:06.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f97277fe640 1 -- 172.21.15.70:0/191081100 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972800f4b0 con 0x7f9738102da0 2024-09-12T01:54:06.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.738+0000 7f973ce70640 1 -- 172.21.15.70:0/191081100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97381a5070 con 0x7f9738102da0 2024-09-12T01:54:06.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.740+0000 7f97277fe640 1 -- 172.21.15.70:0/191081100 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f97280046c0 con 0x7f9738102da0 2024-09-12T01:54:06.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f973f249740 1 Processor -- start 2024-09-12T01:54:06.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f973f249740 1 -- start start 2024-09-12T01:54:06.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f97277fe640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f97200a2b80 0x7f97200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f973f249740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 0x562154fe2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f973f249740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe3480 0x562154fed800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f973f249740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fedd40 0x562154ff0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f973f249740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562154f48280 con 0x562154fe2b60 2024-09-12T01:54:06.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f973f249740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562154eefb10 con 0x562154fedd40 2024-09-12T01:54:06.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f973f249740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562154f44240 con 0x562154fe3480 2024-09-12T01:54:06.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f973659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 0x562154fe2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f9736d9d640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f97200a2b80 0x7f97200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f973659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 0x562154fe2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54280/0 (socket says 172.21.15.70:54280) 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.741+0000 7f973659c640 1 -- 172.21.15.70:0/944968988 learned_addr learned my addr 172.21.15.70:0/944968988 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f9735d9b640 1 --2- 172.21.15.70:0/944968988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe3480 0x562154fed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f97277fe640 1 -- 172.21.15.70:0/191081100 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f97280ceeb0 con 0x7f9738102da0 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f9736d9d640 1 --2- 172.21.15.70:0/944968988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fedd40 0x562154ff0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f973659c640 1 -- 172.21.15.70:0/944968988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe3480 msgr2=0x562154fed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f973659c640 1 --2- 172.21.15.70:0/944968988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe3480 0x562154fed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f973659c640 1 -- 172.21.15.70:0/944968988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fedd40 msgr2=0x562154ff0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f973659c640 1 --2- 172.21.15.70:0/944968988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fedd40 0x562154ff0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f973659c640 1 -- 172.21.15.70:0/944968988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562154efc1f0 con 0x562154fe2b60 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f9735d9b640 1 --2- 172.21.15.70:0/944968988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe3480 0x562154fed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f9736d9d640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f97200a2b80 0x7f97200a5040 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9730005c40 tx=0x7f9730015900 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:06.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f973659c640 1 --2- 172.21.15.70:0/944968988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 0x562154fe2f40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9728005780 tx=0x7f972801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2ce5a2947e90b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f9724ff9640 1 -- 172.21.15.70:0/944968988 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97280b4af0 con 0x562154fe2b60 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f9724ff9640 1 -- 172.21.15.70:0/944968988 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f972809be10 con 0x562154fe2b60 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.742+0000 7f9724ff9640 1 -- 172.21.15.70:0/944968988 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97280b3c40 con 0x562154fe2b60 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.743+0000 7f973f249740 1 -- 172.21.15.70:0/944968988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 msgr2=0x562154fe2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.743+0000 7f973f249740 1 --2- 172.21.15.70:0/944968988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 0x562154fe2f40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9728005780 tx=0x7f972801baf0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.743+0000 7f973f249740 1 -- 172.21.15.70:0/944968988 shutdown_connections 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.743+0000 7f973f249740 1 --2- 172.21.15.70:0/944968988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fedd40 0x562154ff0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.743+0000 7f973f249740 1 --2- 172.21.15.70:0/944968988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe3480 0x562154fed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.743+0000 7f973f249740 1 --2- 172.21.15.70:0/944968988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 0x562154fe2f40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.743+0000 7f973f249740 1 -- 172.21.15.70:0/944968988 >> 172.21.15.70:0/944968988 conn(0x562154fdf0f0 msgr2=0x562154fdf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.743+0000 7f973f249740 1 -- 172.21.15.70:0/944968988 shutdown_connections 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.743+0000 7f973f249740 1 -- 172.21.15.70:0/944968988 wait complete. 2024-09-12T01:54:06.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.743+0000 7f973f249740 1 -- start start 2024-09-12T01:54:06.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.743+0000 7f973f249740 1 Processor -- start 2024-09-12T01:54:06.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973f249740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 0x562154feaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973f249740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fe3480 0x562154feb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973f249740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fedd40 0x562154feb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973f249740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562154ff4d20 con 0x562154fe2b60 2024-09-12T01:54:06.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973f249740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562154f02f10 con 0x562154fe3480 2024-09-12T01:54:06.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973f249740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562154ff4ea0 con 0x562154fedd40 2024-09-12T01:54:06.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973f249740 10 client.0 _ll_register_callbacks cb 0x562154ecba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:06.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 0x562154feaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 0x562154feaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54294/0 (socket says 172.21.15.70:54294) 2024-09-12T01:54:06.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973659c640 1 -- 172.21.15.70:0/136536961 learned_addr learned my addr 172.21.15.70:0/136536961 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:06.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f9735d9b640 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fe3480 0x562154feb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f9736d9d640 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fedd40 0x562154feb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973659c640 1 -- 172.21.15.70:0/136536961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fedd40 msgr2=0x562154feb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:06.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973659c640 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fedd40 0x562154feb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973659c640 1 -- 172.21.15.70:0/136536961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fe3480 msgr2=0x562154feb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:06.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973659c640 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fe3480 0x562154feb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973659c640 1 -- 172.21.15.70:0/136536961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562154cb96a0 con 0x562154fe2b60 2024-09-12T01:54:06.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f9735d9b640 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fe3480 0x562154feb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:06.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973659c640 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 0x562154feaca0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f972809b410 tx=0x7f972809b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7bc329baa5fc92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:06.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f971dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:06.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f971dffb640 1 -- 172.21.15.70:0/136536961 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972801d040 con 0x562154fe2b60 2024-09-12T01:54:06.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f971dffb640 1 -- 172.21.15.70:0/136536961 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f972809b970 con 0x562154fe2b60 2024-09-12T01:54:06.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973f249740 1 -- 172.21.15.70:0/136536961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f972809be10 con 0x562154fe2b60 2024-09-12T01:54:06.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f971dffb640 1 -- 172.21.15.70:0/136536961 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f97280b4910 con 0x562154fe2b60 2024-09-12T01:54:06.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973f249740 10 client.16257 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:06.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.744+0000 7f973f249740 1 -- 172.21.15.70:0/136536961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5621550009a0 con 0x562154fe2b60 2024-09-12T01:54:06.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.745+0000 7f971dffb640 1 -- 172.21.15.70:0/136536961 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f972809be10 con 0x562154fe2b60 2024-09-12T01:54:06.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.745+0000 7f971dffb640 1 -- 172.21.15.70:0/136536961 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f97280a3ef0 con 0x562154fe2b60 2024-09-12T01:54:06.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.745+0000 7f973f249740 10 client.16257 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:06.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.745+0000 7f973f249740 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:06.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.745+0000 7f973f249740 20 client.16257 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:06.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.745+0000 7f973f249740 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5621550020c0 0x562155004560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.745+0000 7f973f249740 4 client.16257 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:06.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.745+0000 7f973f249740 1 -- 172.21.15.70:0/136536961 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562154f557f0 con 0x5621550020c0 2024-09-12T01:54:06.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.746+0000 7f9735d9b640 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5621550020c0 0x562155004560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.747+0000 7f971dffb640 10 client.16257 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:06.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.747+0000 7f9735d9b640 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5621550020c0 0x562155004560 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20be5547dca8e20d server_cookie=f418d6c2c517a9e3 in_seq=0 out_seq=0 2024-09-12T01:54:06.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.747+0000 7f971dffb640 1 -- 172.21.15.70:0/136536961 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562154f557f0 con 0x5621550020c0 2024-09-12T01:54:06.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.747+0000 7f971dffb640 10 client.16257 handle_command_reply: tid=0 2024-09-12T01:54:06.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.747+0000 7f973f249740 1 client.16257 shutdown 2024-09-12T01:54:06.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.748+0000 7f973f249740 1 -- 172.21.15.70:0/136536961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 msgr2=0x562154feaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:06.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.748+0000 7f973f249740 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 0x562154feaca0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f972809b410 tx=0x7f972809b710 comp rx=0 tx=0).stop 2024-09-12T01:54:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.748+0000 7f973f249740 1 -- 172.21.15.70:0/136536961 shutdown_connections 2024-09-12T01:54:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.748+0000 7f973f249740 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5621550020c0 0x562155004560 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.748+0000 7f973f249740 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fedd40 0x562154feb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.748+0000 7f973f249740 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fe3480 0x562154feb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.748+0000 7f973f249740 1 --2- 172.21.15.70:0/136536961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe2b60 0x562154feaca0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.748+0000 7f973f249740 1 -- 172.21.15.70:0/136536961 >> 172.21.15.70:0/136536961 conn(0x562154fdf0f0 msgr2=0x562154fe4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:06.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.748+0000 7f971dffb640 0 client.16257 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:06.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.748+0000 7f973f249740 1 -- 172.21.15.70:0/136536961 shutdown_connections 2024-09-12T01:54:06.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.748+0000 7f973f249740 1 -- 172.21.15.70:0/136536961 wait complete. 2024-09-12T01:54:06.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.748+0000 7f973f249740 20 client.16257 trim_cache size 0 max 16384 2024-09-12T01:54:06.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.765+0000 7f973f249740 1 Processor -- start 2024-09-12T01:54:06.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f973f249740 1 -- start start 2024-09-12T01:54:06.766 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:06 smithi070 ceph-mon[31177]: pgmap v395: 97 pgs: 97 active+clean; 134 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 926 KiB/s wr, 317 op/s 2024-09-12T01:54:06.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f973f249740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fe3480 0x562154fe4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f973f249740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fedd40 0x562155009e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f973f249740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe9d90 0x56215500a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f973f249740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f97381ab3f0 con 0x562154fedd40 2024-09-12T01:54:06.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f973f249740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f97381ad020 con 0x562154fe3480 2024-09-12T01:54:06.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f973f249740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f97381abac0 con 0x562154fe9d90 2024-09-12T01:54:06.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f9735d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fedd40 0x562155009e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f9735d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fedd40 0x562155009e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54300/0 (socket says 172.21.15.70:54300) 2024-09-12T01:54:06.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f9735d9b640 1 -- 172.21.15.70:0/4260298005 learned_addr learned my addr 172.21.15.70:0/4260298005 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:06.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f9736d9d640 1 --2- 172.21.15.70:0/4260298005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe9d90 0x56215500a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f973659c640 1 --2- 172.21.15.70:0/4260298005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fe3480 0x562154fe4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f9735d9b640 1 -- 172.21.15.70:0/4260298005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe9d90 msgr2=0x56215500a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:06.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f9735d9b640 1 --2- 172.21.15.70:0/4260298005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe9d90 0x56215500a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f9735d9b640 1 -- 172.21.15.70:0/4260298005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fe3480 msgr2=0x562154fe4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:06.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.766+0000 7f9735d9b640 1 --2- 172.21.15.70:0/4260298005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fe3480 0x562154fe4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.767+0000 7f9735d9b640 1 -- 172.21.15.70:0/4260298005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562154fdeb90 con 0x562154fedd40 2024-09-12T01:54:06.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.767+0000 7f973659c640 1 --2- 172.21.15.70:0/4260298005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fe3480 0x562154fe4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:06.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.767+0000 7f9735d9b640 1 --2- 172.21.15.70:0/4260298005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fedd40 0x562155009e30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f972c009230 tx=0x7f972c009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e30c12c2cf30394 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:06.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.767+0000 7f971ffff640 1 -- 172.21.15.70:0/4260298005 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c035070 con 0x562154fedd40 2024-09-12T01:54:06.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.767+0000 7f971ffff640 1 -- 172.21.15.70:0/4260298005 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f972c048070 con 0x562154fedd40 2024-09-12T01:54:06.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.767+0000 7f971ffff640 1 -- 172.21.15.70:0/4260298005 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c0318a0 con 0x562154fedd40 2024-09-12T01:54:06.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.768+0000 7f973f249740 1 -- 172.21.15.70:0/4260298005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fedd40 msgr2=0x562155009e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:06.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.768+0000 7f973f249740 1 --2- 172.21.15.70:0/4260298005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fedd40 0x562155009e30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f972c009230 tx=0x7f972c009680 comp rx=0 tx=0).stop 2024-09-12T01:54:06.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.768+0000 7f973f249740 1 -- 172.21.15.70:0/4260298005 shutdown_connections 2024-09-12T01:54:06.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.768+0000 7f973f249740 1 --2- 172.21.15.70:0/4260298005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe9d90 0x56215500a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.768+0000 7f973f249740 1 --2- 172.21.15.70:0/4260298005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fedd40 0x562155009e30 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.768+0000 7f973f249740 1 --2- 172.21.15.70:0/4260298005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fe3480 0x562154fe4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.768+0000 7f973f249740 1 -- 172.21.15.70:0/4260298005 >> 172.21.15.70:0/4260298005 conn(0x562154fdf0f0 msgr2=0x562154fe45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:06.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.768+0000 7f973f249740 1 -- 172.21.15.70:0/4260298005 shutdown_connections 2024-09-12T01:54:06.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.768+0000 7f973f249740 1 -- 172.21.15.70:0/4260298005 wait complete. 2024-09-12T01:54:06.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.768+0000 7f973f249740 1 -- start start 2024-09-12T01:54:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.769+0000 7f973f249740 1 Processor -- start 2024-09-12T01:54:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.769+0000 7f973f249740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe3480 0x562154ffa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.769+0000 7f973f249740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe9d90 0x562154ffa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.769+0000 7f973f249740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fedd40 0x562154fe7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.769+0000 7f973f249740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f97381ac890 con 0x562154fe3480 2024-09-12T01:54:06.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.769+0000 7f973f249740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f97381ac1c0 con 0x562154fedd40 2024-09-12T01:54:06.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.769+0000 7f973f249740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f97381a93b0 con 0x562154fe9d90 2024-09-12T01:54:06.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.769+0000 7f973f249740 10 client.0 _ll_register_callbacks cb 0x7f9728097a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:06.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.769+0000 7f973659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe3480 0x562154ffa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.769+0000 7f973659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe3480 0x562154ffa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54312/0 (socket says 172.21.15.70:54312) 2024-09-12T01:54:06.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.769+0000 7f973659c640 1 -- 172.21.15.70:0/1487048666 learned_addr learned my addr 172.21.15.70:0/1487048666 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:06.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.769+0000 7f9735d9b640 1 --2- 172.21.15.70:0/1487048666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe9d90 0x562154ffa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f973659c640 1 -- 172.21.15.70:0/1487048666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe9d90 msgr2=0x562154ffa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:06.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f973659c640 1 --2- 172.21.15.70:0/1487048666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe9d90 0x562154ffa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f973659c640 1 -- 172.21.15.70:0/1487048666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fedd40 msgr2=0x562154fe7af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:54:06.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f973659c640 1 --2- 172.21.15.70:0/1487048666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fedd40 0x562154fe7af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f973659c640 1 -- 172.21.15.70:0/1487048666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562154fe8190 con 0x562154fe3480 2024-09-12T01:54:06.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f973659c640 1 --2- 172.21.15.70:0/1487048666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe3480 0x562154ffa180 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f972809b6a0 tx=0x7f9728097370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92dfbde5f2dbf8af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:06.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f971dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:06.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f971dffb640 1 -- 172.21.15.70:0/1487048666 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972801d040 con 0x562154fe3480 2024-09-12T01:54:06.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f971dffb640 1 -- 172.21.15.70:0/1487048666 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f97280afc30 con 0x562154fe3480 2024-09-12T01:54:06.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f973f249740 1 -- 172.21.15.70:0/1487048666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f972c048070 con 0x562154fe3480 2024-09-12T01:54:06.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f971dffb640 1 -- 172.21.15.70:0/1487048666 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f97280afe30 con 0x562154fe3480 2024-09-12T01:54:06.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f973f249740 10 client.16263 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:06.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.770+0000 7f973f249740 1 -- 172.21.15.70:0/1487048666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562154ff7c50 con 0x562154fe3480 2024-09-12T01:54:06.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.771+0000 7f971dffb640 1 -- 172.21.15.70:0/1487048666 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f972c048070 con 0x562154fe3480 2024-09-12T01:54:06.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.771+0000 7f971dffb640 1 -- 172.21.15.70:0/1487048666 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f972809ab60 con 0x562154fe3480 2024-09-12T01:54:06.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.771+0000 7f973f249740 10 client.16263 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:06.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.771+0000 7f973f249740 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:06.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.771+0000 7f973f249740 20 client.16263 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:06.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.771+0000 7f973f249740 1 --2- 172.21.15.70:0/1487048666 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5621550717a0 0x562155073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:06.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.771+0000 7f973f249740 4 client.16263 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:54:06.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.771+0000 7f973f249740 1 -- 172.21.15.70:0/1487048666 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562154f4fd00 con 0x5621550717a0 2024-09-12T01:54:06.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.772+0000 7f9735d9b640 1 --2- 172.21.15.70:0/1487048666 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5621550717a0 0x562155073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:06.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.772+0000 7f971dffb640 10 client.16263 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:06.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.772+0000 7f9735d9b640 1 --2- 172.21.15.70:0/1487048666 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5621550717a0 0x562155073bc0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98b41afdcde22f9a server_cookie=8b212c2a31329c65 in_seq=0 out_seq=0 2024-09-12T01:54:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f971dffb640 1 -- 172.21.15.70:0/1487048666 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562154f4fd00 con 0x5621550717a0 2024-09-12T01:54:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f971dffb640 10 client.16263 handle_command_reply: tid=0 2024-09-12T01:54:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f973f249740 1 client.16263 shutdown 2024-09-12T01:54:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f973f249740 1 -- 172.21.15.70:0/1487048666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe3480 msgr2=0x562154ffa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f973f249740 1 --2- 172.21.15.70:0/1487048666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe3480 0x562154ffa180 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f972809b6a0 tx=0x7f9728097370 comp rx=0 tx=0).stop 2024-09-12T01:54:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f973f249740 1 -- 172.21.15.70:0/1487048666 shutdown_connections 2024-09-12T01:54:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f973f249740 1 --2- 172.21.15.70:0/1487048666 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5621550717a0 0x562155073bc0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f973f249740 1 --2- 172.21.15.70:0/1487048666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562154fedd40 0x562154fe7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f971dffb640 0 client.16263 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f973f249740 1 --2- 172.21.15.70:0/1487048666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562154fe9d90 0x562154ffa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f973f249740 1 --2- 172.21.15.70:0/1487048666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562154fe3480 0x562154ffa180 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f973f249740 1 -- 172.21.15.70:0/1487048666 >> 172.21.15.70:0/1487048666 conn(0x562154fdf0f0 msgr2=0x562154feb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:06.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f973f249740 1 -- 172.21.15.70:0/1487048666 shutdown_connections 2024-09-12T01:54:06.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.773+0000 7f973f249740 1 -- 172.21.15.70:0/1487048666 wait complete. 2024-09-12T01:54:06.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973f249740 20 client.16263 trim_cache size 0 max 16384 2024-09-12T01:54:06.787 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:54:06.787 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-12T01:54:06.787 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "efec413c-4140-4f71-ac26-2d714874e9f4", 2024-09-12T01:54:06.788 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-12T01:54:06.788 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:54:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973ce70640 1 -- 172.21.15.70:0/191081100 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f97200a2b80 msgr2=0x7f97200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973ce70640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f97200a2b80 0x7f97200a5040 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9730005c40 tx=0x7f9730015900 comp rx=0 tx=0).stop 2024-09-12T01:54:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973ce70640 1 -- 172.21.15.70:0/191081100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9738102da0 msgr2=0x7f97381984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973ce70640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9738102da0 0x7f97381984f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f972800c970 tx=0x7f972800ce30 comp rx=0 tx=0).stop 2024-09-12T01:54:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973ce70640 1 -- 172.21.15.70:0/191081100 shutdown_connections 2024-09-12T01:54:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973ce70640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f97200a2b80 0x7f97200a5040 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973ce70640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f973810c180 0x7f973819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973ce70640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97381036c0 0x7f9738198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973ce70640 1 --2- 172.21.15.70:0/191081100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9738102da0 0x7f97381984f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:06.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973ce70640 1 -- 172.21.15.70:0/191081100 >> 172.21.15.70:0/191081100 conn(0x7f97380fc7a0 msgr2=0x7f97380fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:06.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973ce70640 1 -- 172.21.15.70:0/191081100 shutdown_connections 2024-09-12T01:54:06.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:06.774+0000 7f973ce70640 1 -- 172.21.15.70:0/191081100 wait complete. 2024-09-12T01:54:06.790 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:06.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:06 smithi191 ceph-mon[35770]: pgmap v395: 97 pgs: 97 active+clean; 134 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 926 KiB/s wr, 317 op/s 2024-09-12T01:54:07.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:06 smithi152 ceph-mon[35055]: pgmap v395: 97 pgs: 97 active+clean; 134 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 926 KiB/s wr, 317 op/s 2024-09-12T01:54:07.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:54:07.693 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:07 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:54:07.693 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:07 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:54:07.694 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:07 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:07.694 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:07 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:07.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.924+0000 7f1551d82640 1 -- 172.21.15.70:0/2007854972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f154c101df0 msgr2=0x7f154c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.924+0000 7f1551d82640 1 --2- 172.21.15.70:0/2007854972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f154c101df0 0x7f154c1021d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f153c009900 tx=0x7f153c02a410 comp rx=0 tx=0).stop 2024-09-12T01:54:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.924+0000 7f1551d82640 1 -- 172.21.15.70:0/2007854972 shutdown_connections 2024-09-12T01:54:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.924+0000 7f1551d82640 1 --2- 172.21.15.70:0/2007854972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f154c106f20 0x7f154c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.924+0000 7f1551d82640 1 --2- 172.21.15.70:0/2007854972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f154c1027a0 0x7f154c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.924+0000 7f1551d82640 1 --2- 172.21.15.70:0/2007854972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f154c101df0 0x7f154c1021d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.924+0000 7f1551d82640 1 -- 172.21.15.70:0/2007854972 >> 172.21.15.70:0/2007854972 conn(0x7f154c0fd8b0 msgr2=0x7f154c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.924+0000 7f1551d82640 1 -- 172.21.15.70:0/2007854972 shutdown_connections 2024-09-12T01:54:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.924+0000 7f1551d82640 1 -- 172.21.15.70:0/2007854972 wait complete. 2024-09-12T01:54:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.924+0000 7f1551d82640 1 Processor -- start 2024-09-12T01:54:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f1551d82640 1 -- start start 2024-09-12T01:54:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f1551d82640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f154c101df0 0x7f154c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f1551d82640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f154c1027a0 0x7f154c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f1551d82640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f154c106f20 0x7f154c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f1551d82640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f154c112060 con 0x7f154c106f20 2024-09-12T01:54:07.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f1551d82640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f154c111ee0 con 0x7f154c101df0 2024-09-12T01:54:07.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f1551d82640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f154c1121e0 con 0x7f154c1027a0 2024-09-12T01:54:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f154bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f154c106f20 0x7f154c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f154b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f154c101df0 0x7f154c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f154bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f154c106f20 0x7f154c19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54338/0 (socket says 172.21.15.70:54338) 2024-09-12T01:54:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f154bfff640 1 -- 172.21.15.70:0/988883812 learned_addr learned my addr 172.21.15.70:0/988883812 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f154affd640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f154c1027a0 0x7f154c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f154bfff640 1 -- 172.21.15.70:0/988883812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f154c1027a0 msgr2=0x7f154c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f154bfff640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f154c1027a0 0x7f154c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f154bfff640 1 -- 172.21.15.70:0/988883812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f154c101df0 msgr2=0x7f154c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f154bfff640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f154c101df0 0x7f154c198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.925+0000 7f154bfff640 1 -- 172.21.15.70:0/988883812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154c19d4d0 con 0x7f154c106f20 2024-09-12T01:54:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.926+0000 7f154bfff640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f154c106f20 0x7f154c19cdf0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f154400cad0 tx=0x7f154400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.926+0000 7f1548ff9640 1 -- 172.21.15.70:0/988883812 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154400ae20 con 0x7f154c106f20 2024-09-12T01:54:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.926+0000 7f1548ff9640 1 -- 172.21.15.70:0/988883812 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1544004b20 con 0x7f154c106f20 2024-09-12T01:54:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.926+0000 7f1551d82640 1 -- 172.21.15.70:0/988883812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154c19d7c0 con 0x7f154c106f20 2024-09-12T01:54:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.926+0000 7f1548ff9640 1 -- 172.21.15.70:0/988883812 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154400f780 con 0x7f154c106f20 2024-09-12T01:54:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.926+0000 7f1551d82640 1 -- 172.21.15.70:0/988883812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f154c1a50a0 con 0x7f154c106f20 2024-09-12T01:54:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.928+0000 7f1548ff9640 1 -- 172.21.15.70:0/988883812 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1544004cd0 con 0x7f154c106f20 2024-09-12T01:54:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f155415b740 1 Processor -- start 2024-09-12T01:54:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f155415b740 1 -- start start 2024-09-12T01:54:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f155415b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e582684060 0x55e582684440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f155415b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684980 0x55e58268ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f155415b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e58268f240 0x55e582691630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f155415b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e5825e9620 con 0x55e58268f240 2024-09-12T01:54:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f155415b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e582590e50 con 0x55e582684980 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f155415b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e5825e55e0 con 0x55e582684060 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f1548ff9640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f15340a2c00 0x7f15340a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f154affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e58268f240 0x55e582691630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f154affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e58268f240 0x55e582691630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54346/0 (socket says 172.21.15.70:54346) 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f154affd640 1 -- 172.21.15.70:0/370543137 learned_addr learned my addr 172.21.15.70:0/370543137 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f154b7fe640 1 --2- 172.21.15.70:0/370543137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684980 0x55e58268ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f1548ff9640 1 -- 172.21.15.70:0/988883812 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f15440cef30 con 0x7f154c106f20 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.929+0000 7f154bfff640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f15340a2c00 0x7f15340a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.930+0000 7f154affd640 1 --2- 172.21.15.70:0/370543137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e582684060 0x55e582684440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.930+0000 7f154b7fe640 1 -- 172.21.15.70:0/370543137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e582684060 msgr2=0x55e582684440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.930+0000 7f154b7fe640 1 --2- 172.21.15.70:0/370543137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e582684060 0x55e582684440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.930+0000 7f154b7fe640 1 -- 172.21.15.70:0/370543137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e58268f240 msgr2=0x55e582691630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.930+0000 7f154b7fe640 1 --2- 172.21.15.70:0/370543137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e58268f240 0x55e582691630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.930+0000 7f154b7fe640 1 -- 172.21.15.70:0/370543137 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e582581d40 con 0x55e582684980 2024-09-12T01:54:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.930+0000 7f154affd640 1 --2- 172.21.15.70:0/370543137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e582684060 0x55e582684440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.930+0000 7f154bfff640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f15340a2c00 0x7f15340a50c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f15440a3ed0 tx=0x7f15440058f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.930+0000 7f154b7fe640 1 --2- 172.21.15.70:0/370543137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684980 0x55e58268ed00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f153c005940 tx=0x7f153c031770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ffa6da044978dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.930+0000 7f1531ffb640 1 -- 172.21.15.70:0/370543137 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c040070 con 0x55e582684980 2024-09-12T01:54:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.930+0000 7f1531ffb640 1 -- 172.21.15.70:0/370543137 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f153c005020 con 0x55e582684980 2024-09-12T01:54:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.930+0000 7f1531ffb640 1 -- 172.21.15.70:0/370543137 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c035040 con 0x55e582684980 2024-09-12T01:54:07.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.931+0000 7f155415b740 1 -- 172.21.15.70:0/370543137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684980 msgr2=0x55e58268ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:07.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.931+0000 7f155415b740 1 --2- 172.21.15.70:0/370543137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684980 0x55e58268ed00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f153c005940 tx=0x7f153c031770 comp rx=0 tx=0).stop 2024-09-12T01:54:07.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.931+0000 7f155415b740 1 -- 172.21.15.70:0/370543137 shutdown_connections 2024-09-12T01:54:07.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.931+0000 7f155415b740 1 --2- 172.21.15.70:0/370543137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e58268f240 0x55e582691630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.931+0000 7f155415b740 1 --2- 172.21.15.70:0/370543137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684980 0x55e58268ed00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.931+0000 7f155415b740 1 --2- 172.21.15.70:0/370543137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e582684060 0x55e582684440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.931+0000 7f155415b740 1 -- 172.21.15.70:0/370543137 >> 172.21.15.70:0/370543137 conn(0x55e5826805f0 msgr2=0x55e5826809d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:07.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.931+0000 7f155415b740 1 -- 172.21.15.70:0/370543137 shutdown_connections 2024-09-12T01:54:07.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.931+0000 7f155415b740 1 -- 172.21.15.70:0/370543137 wait complete. 2024-09-12T01:54:07.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f155415b740 1 -- start start 2024-09-12T01:54:07.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f155415b740 1 Processor -- start 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f155415b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684060 0x55e58268c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f155415b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 0x55e58268c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f155415b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e58268f240 0x55e58268cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f155415b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e582691e10 con 0x55e582684980 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f155415b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e582571f10 con 0x55e582684060 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f155415b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e582691f90 con 0x55e58268f240 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f155415b740 10 client.0 _ll_register_callbacks cb 0x55e582595db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f154b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 0x55e58268c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f154b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 0x55e58268c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54350/0 (socket says 172.21.15.70:54350) 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f154b7fe640 1 -- 172.21.15.70:0/4051037650 learned_addr learned my addr 172.21.15.70:0/4051037650 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.932+0000 7f154affd640 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684060 0x55e58268c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f154affd640 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e58268f240 0x55e58268cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f154b7fe640 1 -- 172.21.15.70:0/4051037650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e58268f240 msgr2=0x55e58268cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f154b7fe640 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e58268f240 0x55e58268cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f154b7fe640 1 -- 172.21.15.70:0/4051037650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684060 msgr2=0x55e58268c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f154b7fe640 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684060 0x55e58268c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f154b7fe640 1 -- 172.21.15.70:0/4051037650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5822f8580 con 0x55e582684980 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f154affd640 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e58268f240 0x55e58268cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f154b7fe640 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 0x55e58268c660 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f153c006010 tx=0x7f153c005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391a76600c3a159f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f152affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f152affd640 1 -- 172.21.15.70:0/4051037650 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c040070 con 0x55e582684980 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f152affd640 1 -- 172.21.15.70:0/4051037650 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f153c031a20 con 0x55e582684980 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f155415b740 1 -- 172.21.15.70:0/4051037650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f153c005020 con 0x55e582684980 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.933+0000 7f152affd640 1 -- 172.21.15.70:0/4051037650 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f153c035030 con 0x55e582684980 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.934+0000 7f155415b740 10 client.16275 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.934+0000 7f155415b740 1 -- 172.21.15.70:0/4051037650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e5823c2960 con 0x55e582684980 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.934+0000 7f152affd640 1 -- 172.21.15.70:0/4051037650 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f153c005020 con 0x55e582684980 2024-09-12T01:54:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.934+0000 7f152affd640 1 -- 172.21.15.70:0/4051037650 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f153c003850 con 0x55e582684980 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.934+0000 7f155415b740 10 client.16275 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.934+0000 7f155415b740 10 client.16275 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.934+0000 7f155415b740 20 client.16275 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.934+0000 7f155415b740 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e58269ebb0 0x55e5826a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.934+0000 7f155415b740 4 client.16275 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.934+0000 7f155415b740 1 -- 172.21.15.70:0/4051037650 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5825f6b90 con 0x55e58269ebb0 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.934+0000 7f154affd640 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e58269ebb0 0x55e5826a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.935+0000 7f154affd640 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e58269ebb0 0x55e5826a0fa0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26d47ab9f43be37 server_cookie=46740affbf2d3b38 in_seq=0 out_seq=0 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.935+0000 7f152affd640 10 client.16275 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.935+0000 7f152affd640 1 -- 172.21.15.70:0/4051037650 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5825f6b90 con 0x55e58269ebb0 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.936+0000 7f152affd640 10 client.16275 handle_command_reply: tid=0 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.936+0000 7f155415b740 1 client.16275 shutdown 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.936+0000 7f155415b740 1 -- 172.21.15.70:0/4051037650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 msgr2=0x55e58268c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.936+0000 7f155415b740 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 0x55e58268c660 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f153c006010 tx=0x7f153c005400 comp rx=0 tx=0).stop 2024-09-12T01:54:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.936+0000 7f155415b740 1 -- 172.21.15.70:0/4051037650 shutdown_connections 2024-09-12T01:54:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.936+0000 7f155415b740 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e58269ebb0 0x55e5826a0fa0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.936+0000 7f155415b740 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e58268f240 0x55e58268cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.936+0000 7f155415b740 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 0x55e58268c660 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.936+0000 7f152affd640 0 client.16275 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.936+0000 7f155415b740 1 --2- 172.21.15.70:0/4051037650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684060 0x55e58268c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.936+0000 7f155415b740 1 -- 172.21.15.70:0/4051037650 >> 172.21.15.70:0/4051037650 conn(0x55e5826805f0 msgr2=0x55e5826862d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.936+0000 7f155415b740 1 -- 172.21.15.70:0/4051037650 shutdown_connections 2024-09-12T01:54:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.937+0000 7f155415b740 1 -- 172.21.15.70:0/4051037650 wait complete. 2024-09-12T01:54:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.937+0000 7f155415b740 20 client.16275 trim_cache size 0 max 16384 2024-09-12T01:54:07.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:07 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:54:07.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:07 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:54:07.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:07 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:07.942 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:07 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:07.950 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:07.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.954+0000 7f155415b740 1 Processor -- start 2024-09-12T01:54:07.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.954+0000 7f155415b740 1 -- start start 2024-09-12T01:54:07.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.954+0000 7f155415b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684060 0x55e582686ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.954+0000 7f155415b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684980 0x55e58267f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.954+0000 7f155415b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e58268f240 0x55e5826a6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.954+0000 7f155415b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f154c1ad710 con 0x55e582684060 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.954+0000 7f155415b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f154c1af340 con 0x55e582684980 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.954+0000 7f155415b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f154c1adde0 con 0x55e58268f240 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f154affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684060 0x55e582686ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f154affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684060 0x55e582686ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54366/0 (socket says 172.21.15.70:54366) 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f154affd640 1 -- 172.21.15.70:0/1532906949 learned_addr learned my addr 172.21.15.70:0/1532906949 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f154affd640 1 --2- 172.21.15.70:0/1532906949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e58268f240 0x55e5826a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f154b7fe640 1 --2- 172.21.15.70:0/1532906949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684980 0x55e58267f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f154affd640 1 -- 172.21.15.70:0/1532906949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e58268f240 msgr2=0x55e5826a6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f154affd640 1 --2- 172.21.15.70:0/1532906949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e58268f240 0x55e5826a6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f154affd640 1 -- 172.21.15.70:0/1532906949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684980 msgr2=0x55e58267f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f154affd640 1 --2- 172.21.15.70:0/1532906949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684980 0x55e58267f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f154affd640 1 -- 172.21.15.70:0/1532906949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5826a1310 con 0x55e582684060 2024-09-12T01:54:07.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f154affd640 1 --2- 172.21.15.70:0/1532906949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684060 0x55e582686ac0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x55e5826a14e0 tx=0x7f1540015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6673ec7eef890b0c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:07.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f15317fa640 1 -- 172.21.15.70:0/1532906949 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1540004020 con 0x55e582684060 2024-09-12T01:54:07.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f15317fa640 1 -- 172.21.15.70:0/1532906949 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1540027070 con 0x55e582684060 2024-09-12T01:54:07.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.955+0000 7f15317fa640 1 -- 172.21.15.70:0/1532906949 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15400049c0 con 0x55e582684060 2024-09-12T01:54:07.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.956+0000 7f155415b740 1 -- 172.21.15.70:0/1532906949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684060 msgr2=0x55e582686ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:07.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.956+0000 7f155415b740 1 --2- 172.21.15.70:0/1532906949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684060 0x55e582686ac0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x55e5826a14e0 tx=0x7f1540015040 comp rx=0 tx=0).stop 2024-09-12T01:54:07.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.956+0000 7f155415b740 1 -- 172.21.15.70:0/1532906949 shutdown_connections 2024-09-12T01:54:07.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.956+0000 7f155415b740 1 --2- 172.21.15.70:0/1532906949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e58268f240 0x55e5826a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.956+0000 7f155415b740 1 --2- 172.21.15.70:0/1532906949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e582684980 0x55e58267f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.956+0000 7f155415b740 1 --2- 172.21.15.70:0/1532906949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684060 0x55e582686ac0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.956+0000 7f155415b740 1 -- 172.21.15.70:0/1532906949 >> 172.21.15.70:0/1532906949 conn(0x55e5826805f0 msgr2=0x55e58267ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:07.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.956+0000 7f155415b740 1 -- 172.21.15.70:0/1532906949 shutdown_connections 2024-09-12T01:54:07.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.956+0000 7f155415b740 1 -- 172.21.15.70:0/1532906949 wait complete. 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.957+0000 7f155415b740 1 -- start start 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.957+0000 7f155415b740 1 Processor -- start 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.957+0000 7f155415b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e582684060 0x55e5826936d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.957+0000 7f155415b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 0x55e582693c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.957+0000 7f155415b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e58268f240 0x55e582708540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.957+0000 7f155415b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f154c1aebb0 con 0x55e582684980 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.957+0000 7f155415b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f154c1ae4e0 con 0x55e58268f240 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.957+0000 7f155415b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f154c1ab6d0 con 0x55e582684060 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.957+0000 7f155415b740 10 client.0 _ll_register_callbacks cb 0x7f153c005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.957+0000 7f154b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 0x55e582693c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.957+0000 7f154b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 0x55e582693c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54372/0 (socket says 172.21.15.70:54372) 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.957+0000 7f154b7fe640 1 -- 172.21.15.70:0/1155554834 learned_addr learned my addr 172.21.15.70:0/1155554834 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:07.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.958+0000 7f154affd640 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e58268f240 0x55e582708540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.958+0000 7f154affd640 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e582684060 0x55e5826936d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.958+0000 7f154affd640 1 -- 172.21.15.70:0/1155554834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e58268f240 msgr2=0x55e582708540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.958+0000 7f154affd640 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e58268f240 0x55e582708540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.958+0000 7f154affd640 1 -- 172.21.15.70:0/1155554834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 msgr2=0x55e582693c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.958+0000 7f154affd640 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 0x55e582693c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.958+0000 7f154affd640 1 -- 172.21.15.70:0/1155554834 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e582708a80 con 0x55e582684060 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.959+0000 7f154affd640 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e582684060 0x55e5826936d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f154000f600 tx=0x7f1540000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e47b530727398d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.959+0000 7f152affd640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.959+0000 7f152affd640 1 -- 172.21.15.70:0/1155554834 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1540011d00 con 0x55e582684060 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.959+0000 7f152affd640 1 -- 172.21.15.70:0/1155554834 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f15400035f0 con 0x55e582684060 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.959+0000 7f155415b740 1 -- 172.21.15.70:0/1155554834 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1540027070 con 0x55e582684060 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.959+0000 7f152affd640 1 -- 172.21.15.70:0/1155554834 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f15400037f0 con 0x55e582684060 2024-09-12T01:54:07.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.959+0000 7f155415b740 10 client.25462 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:07.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.959+0000 7f155415b740 1 -- 172.21.15.70:0/1155554834 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e582709dc0 con 0x55e582684060 2024-09-12T01:54:07.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.959+0000 7f152affd640 1 -- 172.21.15.70:0/1155554834 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1540027070 con 0x55e582684060 2024-09-12T01:54:07.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.959+0000 7f152affd640 1 -- 172.21.15.70:0/1155554834 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f154002d880 con 0x55e582684060 2024-09-12T01:54:07.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.960+0000 7f155415b740 10 client.25462 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:07.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.960+0000 7f155415b740 10 client.25462 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:54:07.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.960+0000 7f155415b740 20 client.25462 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:07.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.960+0000 7f155415b740 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e58270a4c0 0x55e58270c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:07.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.960+0000 7f155415b740 4 client.25462 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "460d82a8", "release": true, "await": true}] 2024-09-12T01:54:07.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.960+0000 7f155415b740 1 -- 172.21.15.70:0/1155554834 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "quiesce db", "set_id": "460d82a8", "release": true, "await": true}) -- 0x55e58267b950 con 0x55e58270a4c0 2024-09-12T01:54:07.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.960+0000 7f154b7fe640 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e58270a4c0 0x55e58270c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:07.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.960+0000 7f154b7fe640 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e58270a4c0 0x55e58270c8e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f952e506fd2c9ae7 server_cookie=d310f78bb19759d0 in_seq=0 out_seq=0 2024-09-12T01:54:07.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:07.960+0000 7f152affd640 10 client.25462 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:08.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:07 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:54:08.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:07 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:54:08.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:07 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:08.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:07 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:08.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.030+0000 7f152affd640 1 -- 172.21.15.70:0/1155554834 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55e58267b950 con 0x55e58270a4c0 2024-09-12T01:54:08.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.030+0000 7f152affd640 10 client.25462 handle_command_reply: tid=0 2024-09-12T01:54:08.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.030+0000 7f155415b740 1 client.25462 shutdown 2024-09-12T01:54:08.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f155415b740 1 -- 172.21.15.70:0/1155554834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e582684060 msgr2=0x55e5826936d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:08.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f155415b740 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e582684060 0x55e5826936d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f154000f600 tx=0x7f1540000bc0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f155415b740 1 -- 172.21.15.70:0/1155554834 shutdown_connections 2024-09-12T01:54:08.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f155415b740 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55e58270a4c0 0x55e58270c8e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f155415b740 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e58268f240 0x55e582708540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f152affd640 0 client.25462 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:08.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f155415b740 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e582684980 0x55e582693c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f155415b740 1 --2- 172.21.15.70:0/1155554834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e582684060 0x55e5826936d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f155415b740 1 -- 172.21.15.70:0/1155554834 >> 172.21.15.70:0/1155554834 conn(0x55e5826805f0 msgr2=0x55e58268c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:08.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f155415b740 1 -- 172.21.15.70:0/1155554834 shutdown_connections 2024-09-12T01:54:08.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f155415b740 1 -- 172.21.15.70:0/1155554834 wait complete. 2024-09-12T01:54:08.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f155415b740 20 client.25462 trim_cache size 0 max 16384 2024-09-12T01:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 33, 2024-09-12T01:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24452, 2024-09-12T01:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 8, 2024-09-12T01:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-12T01:54:08.033 INFO:teuthology.orchestra.run.smithi070.stdout: "460d82a8": { 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 8, 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 133.4, 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-12T01:54:08.034 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-12T01:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-12T01:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:08.035 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:54:08.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f1551d82640 1 -- 172.21.15.70:0/988883812 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f15340a2c00 msgr2=0x7f15340a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:08.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f1551d82640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f15340a2c00 0x7f15340a50c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f15440a3ed0 tx=0x7f15440058f0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f1551d82640 1 -- 172.21.15.70:0/988883812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f154c106f20 msgr2=0x7f154c19cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:08.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.031+0000 7f1551d82640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f154c106f20 0x7f154c19cdf0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f154400cad0 tx=0x7f154400cf90 comp rx=0 tx=0).stop 2024-09-12T01:54:08.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.032+0000 7f1551d82640 1 -- 172.21.15.70:0/988883812 shutdown_connections 2024-09-12T01:54:08.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.032+0000 7f1551d82640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f15340a2c00 0x7f15340a50c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.032+0000 7f1551d82640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f154c106f20 0x7f154c19cdf0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.032+0000 7f1551d82640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f154c1027a0 0x7f154c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.032+0000 7f1551d82640 1 --2- 172.21.15.70:0/988883812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f154c101df0 0x7f154c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.032+0000 7f1551d82640 1 -- 172.21.15.70:0/988883812 >> 172.21.15.70:0/988883812 conn(0x7f154c0fd8b0 msgr2=0x7f154c0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:08.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.032+0000 7f1551d82640 1 -- 172.21.15.70:0/988883812 shutdown_connections 2024-09-12T01:54:08.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.032+0000 7f1551d82640 1 -- 172.21.15.70:0/988883812 wait complete. 2024-09-12T01:54:08.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.659+0000 7f04c0ce3640 1 -- 172.21.15.70:0/2888172616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04bc102570 msgr2=0x7f04bc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.659+0000 7f04c0ce3640 1 --2- 172.21.15.70:0/2888172616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04bc102570 0x7f04bc1029b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009900 tx=0x7f04b002a480 comp rx=0 tx=0).stop 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.659+0000 7f04c0ce3640 1 -- 172.21.15.70:0/2888172616 shutdown_connections 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.659+0000 7f04c0ce3640 1 --2- 172.21.15.70:0/2888172616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04bc102ef0 0x7f04bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.659+0000 7f04c0ce3640 1 --2- 172.21.15.70:0/2888172616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04bc102570 0x7f04bc1029b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.659+0000 7f04c0ce3640 1 --2- 172.21.15.70:0/2888172616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04bc100e20 0x7f04bc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.659+0000 7f04c0ce3640 1 -- 172.21.15.70:0/2888172616 >> 172.21.15.70:0/2888172616 conn(0x7f04bc0fc7d0 msgr2=0x7f04bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.659+0000 7f04c0ce3640 1 -- 172.21.15.70:0/2888172616 shutdown_connections 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.659+0000 7f04c0ce3640 1 -- 172.21.15.70:0/2888172616 wait complete. 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04c0ce3640 1 Processor -- start 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04c0ce3640 1 -- start start 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04c0ce3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04bc100e20 0x7f04bc0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04c0ce3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04bc102570 0x7f04bc0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04c0ce3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04bc102ef0 0x7f04bc0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04c0ce3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc1110a0 con 0x7f04bc102ef0 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04c0ce3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc110f20 con 0x7f04bc100e20 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04c0ce3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc111220 con 0x7f04bc102570 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04bad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04bc102ef0 0x7f04bc0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04bad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04bc102ef0 0x7f04bc0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54392/0 (socket says 172.21.15.70:54392) 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04bad9d640 1 -- 172.21.15.70:0/1575119452 learned_addr learned my addr 172.21.15.70:0/1575119452 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04bc102570 0x7f04bc0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.660+0000 7f04ba59c640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04bc100e20 0x7f04bc0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.661+0000 7f04bad9d640 1 -- 172.21.15.70:0/1575119452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04bc102570 msgr2=0x7f04bc0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.661+0000 7f04bad9d640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04bc102570 0x7f04bc0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.661+0000 7f04bad9d640 1 -- 172.21.15.70:0/1575119452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04bc100e20 msgr2=0x7f04bc0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.661+0000 7f04bad9d640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04bc100e20 0x7f04bc0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.661+0000 7f04bad9d640 1 -- 172.21.15.70:0/1575119452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04bc1a6a70 con 0x7f04bc102ef0 2024-09-12T01:54:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.661+0000 7f04bad9d640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04bc102ef0 0x7f04bc0fd700 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f04b400cce0 tx=0x7f04b400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.661+0000 7f04ab7fe640 1 -- 172.21.15.70:0/1575119452 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b400f450 con 0x7f04bc102ef0 2024-09-12T01:54:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.661+0000 7f04c0ce3640 1 -- 172.21.15.70:0/1575119452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04bc1a6d60 con 0x7f04bc102ef0 2024-09-12T01:54:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.661+0000 7f04ab7fe640 1 -- 172.21.15.70:0/1575119452 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04b400faf0 con 0x7f04bc102ef0 2024-09-12T01:54:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.661+0000 7f04ab7fe640 1 -- 172.21.15.70:0/1575119452 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b4018cc0 con 0x7f04bc102ef0 2024-09-12T01:54:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.661+0000 7f04c0ce3640 1 -- 172.21.15.70:0/1575119452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04bc1a7270 con 0x7f04bc102ef0 2024-09-12T01:54:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.663+0000 7f04ab7fe640 1 -- 172.21.15.70:0/1575119452 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f04b400f5f0 con 0x7f04bc102ef0 2024-09-12T01:54:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.663+0000 7f04c30bc740 1 Processor -- start 2024-09-12T01:54:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04c30bc740 1 -- start start 2024-09-12T01:54:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04c30bc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2ae4a0 0x560d9b2ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04c30bc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2aedc0 0x560d9b2b9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04c30bc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2b9680 0x560d9b2bba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04c30bc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d9b2142e0 con 0x560d9b2b9680 2024-09-12T01:54:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04c30bc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560d9b1bbce0 con 0x560d9b2aedc0 2024-09-12T01:54:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04c30bc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560d9b2102a0 con 0x560d9b2ae4a0 2024-09-12T01:54:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04b9d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2b9680 0x560d9b2bba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04b9d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2ae4a0 0x560d9b2ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04ba59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2aedc0 0x560d9b2b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04b9d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2ae4a0 0x560d9b2ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:38600/0 (socket says 172.21.15.70:38600) 2024-09-12T01:54:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04b9d9b640 1 -- 172.21.15.70:0/398824688 learned_addr learned my addr 172.21.15.70:0/398824688 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04ab7fe640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f04a40a2b80 0x7f04a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04ba59c640 1 -- 172.21.15.70:0/398824688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2ae4a0 msgr2=0x560d9b2ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04ba59c640 1 --2- 172.21.15.70:0/398824688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2ae4a0 0x560d9b2ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04ba59c640 1 -- 172.21.15.70:0/398824688 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2b9680 msgr2=0x560d9b2bba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04ba59c640 1 --2- 172.21.15.70:0/398824688 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2b9680 0x560d9b2bba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.664+0000 7f04ba59c640 1 -- 172.21.15.70:0/398824688 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d9b1a0440 con 0x560d9b2aedc0 2024-09-12T01:54:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.665+0000 7f04bad9d640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f04a40a2b80 0x7f04a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.665+0000 7f04ba59c640 1 --2- 172.21.15.70:0/398824688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2aedc0 0x560d9b2b9140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009c00 tx=0x7f04ac011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab2cad5e57a43597 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.665+0000 7f04ab7fe640 1 -- 172.21.15.70:0/1575119452 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f04b40cf470 con 0x7f04bc102ef0 2024-09-12T01:54:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.665+0000 7f04a8ff9640 1 -- 172.21.15.70:0/398824688 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac004050 con 0x560d9b2aedc0 2024-09-12T01:54:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.665+0000 7f04bad9d640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f04a40a2b80 0x7f04a40a5040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f04b409b9d0 tx=0x7f04b4066950 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.665+0000 7f04a8ff9640 1 -- 172.21.15.70:0/398824688 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04ac005520 con 0x560d9b2aedc0 2024-09-12T01:54:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.665+0000 7f04a8ff9640 1 -- 172.21.15.70:0/398824688 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0035f0 con 0x560d9b2aedc0 2024-09-12T01:54:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.666+0000 7f04c30bc740 1 -- 172.21.15.70:0/398824688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2aedc0 msgr2=0x560d9b2b9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.666+0000 7f04c30bc740 1 --2- 172.21.15.70:0/398824688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2aedc0 0x560d9b2b9140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009c00 tx=0x7f04ac011810 comp rx=0 tx=0).stop 2024-09-12T01:54:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.666+0000 7f04c30bc740 1 -- 172.21.15.70:0/398824688 shutdown_connections 2024-09-12T01:54:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.666+0000 7f04c30bc740 1 --2- 172.21.15.70:0/398824688 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2b9680 0x560d9b2bba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.666+0000 7f04c30bc740 1 --2- 172.21.15.70:0/398824688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2aedc0 0x560d9b2b9140 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.666+0000 7f04c30bc740 1 --2- 172.21.15.70:0/398824688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2ae4a0 0x560d9b2ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.666+0000 7f04c30bc740 1 -- 172.21.15.70:0/398824688 >> 172.21.15.70:0/398824688 conn(0x560d9b2aaa30 msgr2=0x560d9b2aae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.666+0000 7f04c30bc740 1 -- 172.21.15.70:0/398824688 shutdown_connections 2024-09-12T01:54:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.666+0000 7f04c30bc740 1 -- 172.21.15.70:0/398824688 wait complete. 2024-09-12T01:54:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.666+0000 7f04c30bc740 1 -- start start 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.666+0000 7f04c30bc740 1 Processor -- start 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04c30bc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2ae4a0 0x560d9b2b8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04c30bc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2aedc0 0x560d9b2b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04c30bc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2b9680 0x560d9b2b6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04c30bc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d9b2bc250 con 0x560d9b2aedc0 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04c30bc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560d9b1cf050 con 0x560d9b2b9680 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04c30bc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560d9b2bc3d0 con 0x560d9b2ae4a0 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04c30bc740 10 client.0 _ll_register_callbacks cb 0x560d9b20f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04ba59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2aedc0 0x560d9b2b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04ba59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2aedc0 0x560d9b2b61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54414/0 (socket says 172.21.15.70:54414) 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04ba59c640 1 -- 172.21.15.70:0/782463504 learned_addr learned my addr 172.21.15.70:0/782463504 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04b9d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2ae4a0 0x560d9b2b8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2b9680 0x560d9b2b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04ba59c640 1 -- 172.21.15.70:0/782463504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2ae4a0 msgr2=0x560d9b2b8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04ba59c640 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2ae4a0 0x560d9b2b8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04ba59c640 1 -- 172.21.15.70:0/782463504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2b9680 msgr2=0x560d9b2b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04ba59c640 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2b9680 0x560d9b2b6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04ba59c640 1 -- 172.21.15.70:0/782463504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d9af853c0 con 0x560d9b2aedc0 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2b9680 0x560d9b2b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04ba59c640 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2aedc0 0x560d9b2b61f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f04ac012fd0 tx=0x7f04ac005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4257468b5654cfd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.667+0000 7f04a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04a1ffb640 1 -- 172.21.15.70:0/782463504 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac029070 con 0x560d9b2aedc0 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04a1ffb640 1 -- 172.21.15.70:0/782463504 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f04ac004e30 con 0x560d9b2aedc0 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04c30bc740 1 -- 172.21.15.70:0/782463504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04ac005520 con 0x560d9b2aedc0 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04a1ffb640 1 -- 172.21.15.70:0/782463504 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f04ac035050 con 0x560d9b2aedc0 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04c30bc740 10 client.16293 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04c30bc740 1 -- 172.21.15.70:0/782463504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560d9b2c7bd0 con 0x560d9b2aedc0 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04a1ffb640 1 -- 172.21.15.70:0/782463504 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04ac005520 con 0x560d9b2aedc0 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04a1ffb640 1 -- 172.21.15.70:0/782463504 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f04ac023430 con 0x560d9b2aedc0 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04c30bc740 10 client.16293 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04c30bc740 10 client.16293 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04c30bc740 20 client.16293 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04c30bc740 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560d9b2c8f20 0x560d9b2cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04c30bc740 4 client.16293 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.668+0000 7f04c30bc740 1 -- 172.21.15.70:0/782463504 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d9b221850 con 0x560d9b2c8f20 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.669+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560d9b2c8f20 0x560d9b2cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.669+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560d9b2c8f20 0x560d9b2cb310 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38916dddc543197f server_cookie=977e086bc8c01a28 in_seq=0 out_seq=0 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.669+0000 7f04a1ffb640 10 client.16293 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04a1ffb640 1 -- 172.21.15.70:0/782463504 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d9b221850 con 0x560d9b2c8f20 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04a1ffb640 10 client.16293 handle_command_reply: tid=0 2024-09-12T01:54:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04c30bc740 1 client.16293 shutdown 2024-09-12T01:54:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04c30bc740 1 -- 172.21.15.70:0/782463504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2aedc0 msgr2=0x560d9b2b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04c30bc740 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2aedc0 0x560d9b2b61f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f04ac012fd0 tx=0x7f04ac005750 comp rx=0 tx=0).stop 2024-09-12T01:54:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04c30bc740 1 -- 172.21.15.70:0/782463504 shutdown_connections 2024-09-12T01:54:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04c30bc740 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560d9b2c8f20 0x560d9b2cb310 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04c30bc740 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2b9680 0x560d9b2b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04c30bc740 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2aedc0 0x560d9b2b61f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04c30bc740 1 --2- 172.21.15.70:0/782463504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2ae4a0 0x560d9b2b8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04a1ffb640 0 client.16293 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04c30bc740 1 -- 172.21.15.70:0/782463504 >> 172.21.15.70:0/782463504 conn(0x560d9b2aaa30 msgr2=0x560d9b2b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04c30bc740 1 -- 172.21.15.70:0/782463504 shutdown_connections 2024-09-12T01:54:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04c30bc740 1 -- 172.21.15.70:0/782463504 wait complete. 2024-09-12T01:54:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.670+0000 7f04c30bc740 20 client.16293 trim_cache size 0 max 16384 2024-09-12T01:54:08.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04c30bc740 1 Processor -- start 2024-09-12T01:54:08.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04c30bc740 1 -- start start 2024-09-12T01:54:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04c30bc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2ae4a0 0x560d9b2b8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04c30bc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2aedc0 0x560d9b2d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04c30bc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2b9680 0x560d9b2d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04c30bc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc1af850 con 0x560d9b2ae4a0 2024-09-12T01:54:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04c30bc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc1b1480 con 0x560d9b2b9680 2024-09-12T01:54:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04c30bc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc1aff20 con 0x560d9b2aedc0 2024-09-12T01:54:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04b9d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2ae4a0 0x560d9b2b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04b9d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2ae4a0 0x560d9b2b8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54424/0 (socket says 172.21.15.70:54424) 2024-09-12T01:54:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04b9d9b640 1 -- 172.21.15.70:0/3723986035 learned_addr learned my addr 172.21.15.70:0/3723986035 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04ba59c640 1 --2- 172.21.15.70:0/3723986035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2aedc0 0x560d9b2d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/3723986035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2b9680 0x560d9b2d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04b9d9b640 1 -- 172.21.15.70:0/3723986035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2aedc0 msgr2=0x560d9b2d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:08.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/3723986035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2aedc0 0x560d9b2d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04b9d9b640 1 -- 172.21.15.70:0/3723986035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2b9680 msgr2=0x560d9b2d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:08.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/3723986035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2b9680 0x560d9b2d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04b9d9b640 1 -- 172.21.15.70:0/3723986035 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d9b2b51a0 con 0x560d9b2ae4a0 2024-09-12T01:54:08.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04ba59c640 1 --2- 172.21.15.70:0/3723986035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2aedc0 0x560d9b2d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:54:08.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.688+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/3723986035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2ae4a0 0x560d9b2b8160 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009230 tx=0x7f04b00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cca93bf5c2b0939 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:08.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.689+0000 7f04a3fff640 1 -- 172.21.15.70:0/3723986035 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0035040 con 0x560d9b2ae4a0 2024-09-12T01:54:08.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.689+0000 7f04a3fff640 1 -- 172.21.15.70:0/3723986035 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04b0005540 con 0x560d9b2ae4a0 2024-09-12T01:54:08.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.689+0000 7f04a3fff640 1 -- 172.21.15.70:0/3723986035 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0004d50 con 0x560d9b2ae4a0 2024-09-12T01:54:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.689+0000 7f04c30bc740 1 -- 172.21.15.70:0/3723986035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2ae4a0 msgr2=0x560d9b2b8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.689+0000 7f04c30bc740 1 --2- 172.21.15.70:0/3723986035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2ae4a0 0x560d9b2b8160 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009230 tx=0x7f04b00058d0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.689+0000 7f04c30bc740 1 -- 172.21.15.70:0/3723986035 shutdown_connections 2024-09-12T01:54:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.689+0000 7f04c30bc740 1 --2- 172.21.15.70:0/3723986035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2b9680 0x560d9b2d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.689+0000 7f04c30bc740 1 --2- 172.21.15.70:0/3723986035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2aedc0 0x560d9b2d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.689+0000 7f04c30bc740 1 --2- 172.21.15.70:0/3723986035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2ae4a0 0x560d9b2b8160 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.689+0000 7f04c30bc740 1 -- 172.21.15.70:0/3723986035 >> 172.21.15.70:0/3723986035 conn(0x560d9b2aaa30 msgr2=0x560d9b2b7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:08.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.689+0000 7f04c30bc740 1 -- 172.21.15.70:0/3723986035 shutdown_connections 2024-09-12T01:54:08.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.689+0000 7f04c30bc740 1 -- 172.21.15.70:0/3723986035 wait complete. 2024-09-12T01:54:08.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04c30bc740 1 -- start start 2024-09-12T01:54:08.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04c30bc740 1 Processor -- start 2024-09-12T01:54:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04c30bc740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2ae4a0 0x560d9b2c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04c30bc740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2aedc0 0x560d9b2bf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04c30bc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2b9680 0x560d9b2bf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04c30bc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc1b0cf0 con 0x560d9b2b9680 2024-09-12T01:54:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04c30bc740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc1b0620 con 0x560d9b2ae4a0 2024-09-12T01:54:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04c30bc740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc1ad810 con 0x560d9b2aedc0 2024-09-12T01:54:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04c30bc740 10 client.0 _ll_register_callbacks cb 0x7f04b0032dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04b9d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2b9680 0x560d9b2bf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04b9d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2b9680 0x560d9b2bf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54438/0 (socket says 172.21.15.70:54438) 2024-09-12T01:54:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04ba59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2aedc0 0x560d9b2bf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04b9d9b640 1 -- 172.21.15.70:0/3776812616 learned_addr learned my addr 172.21.15.70:0/3776812616 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/3776812616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2ae4a0 0x560d9b2c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04b9d9b640 1 -- 172.21.15.70:0/3776812616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2aedc0 msgr2=0x560d9b2bf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/3776812616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2aedc0 0x560d9b2bf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04b9d9b640 1 -- 172.21.15.70:0/3776812616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2ae4a0 msgr2=0x560d9b2c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/3776812616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2ae4a0 0x560d9b2c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.690+0000 7f04b9d9b640 1 -- 172.21.15.70:0/3776812616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d9b2b92b0 con 0x560d9b2b9680 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04b9d9b640 1 --2- 172.21.15.70:0/3776812616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2b9680 0x560d9b2bf690 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f04b00059a0 tx=0x7f04b0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffbb2524b059c0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04a1ffb640 1 -- 172.21.15.70:0/3776812616 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0035030 con 0x560d9b2b9680 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04a1ffb640 1 -- 172.21.15.70:0/3776812616 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f04b0031990 con 0x560d9b2b9680 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04c30bc740 1 -- 172.21.15.70:0/3776812616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04b0005540 con 0x560d9b2b9680 2024-09-12T01:54:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04a1ffb640 1 -- 172.21.15.70:0/3776812616 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f04b0004750 con 0x560d9b2b9680 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04c30bc740 10 client.16299 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04c30bc740 1 -- 172.21.15.70:0/3776812616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560d9b333990 con 0x560d9b2b9680 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04a1ffb640 1 -- 172.21.15.70:0/3776812616 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04b0005540 con 0x560d9b2b9680 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04a1ffb640 1 -- 172.21.15.70:0/3776812616 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f04b0003a70 con 0x560d9b2b9680 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04c30bc740 10 client.16299 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04c30bc740 10 client.16299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04c30bc740 20 client.16299 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04c30bc740 1 --2- 172.21.15.70:0/3776812616 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560d9b334050 0x560d9b336470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04c30bc740 4 client.16299 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.691+0000 7f04c30bc740 1 -- 172.21.15.70:0/3776812616 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560d9b21bd60 con 0x560d9b334050 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04ba59c640 1 --2- 172.21.15.70:0/3776812616 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560d9b334050 0x560d9b336470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04a1ffb640 10 client.16299 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04ba59c640 1 --2- 172.21.15.70:0/3776812616 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560d9b334050 0x560d9b336470 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25b3077b8295062b server_cookie=21ac7998fe151711 in_seq=0 out_seq=0 2024-09-12T01:54:08.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04a1ffb640 1 -- 172.21.15.70:0/3776812616 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x560d9b21bd60 con 0x560d9b334050 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04a1ffb640 10 client.16299 handle_command_reply: tid=0 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04c30bc740 1 client.16299 shutdown 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04c30bc740 1 -- 172.21.15.70:0/3776812616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2b9680 msgr2=0x560d9b2bf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04c30bc740 1 --2- 172.21.15.70:0/3776812616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2b9680 0x560d9b2bf690 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f04b00059a0 tx=0x7f04b0000bc0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04c30bc740 1 -- 172.21.15.70:0/3776812616 shutdown_connections 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04c30bc740 1 --2- 172.21.15.70:0/3776812616 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560d9b334050 0x560d9b336470 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04c30bc740 1 --2- 172.21.15.70:0/3776812616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d9b2b9680 0x560d9b2bf690 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04c30bc740 1 --2- 172.21.15.70:0/3776812616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560d9b2aedc0 0x560d9b2bf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04c30bc740 1 --2- 172.21.15.70:0/3776812616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560d9b2ae4a0 0x560d9b2c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04c30bc740 1 -- 172.21.15.70:0/3776812616 >> 172.21.15.70:0/3776812616 conn(0x560d9b2aaa30 msgr2=0x560d9b2b8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.692+0000 7f04a1ffb640 0 client.16299 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c30bc740 1 -- 172.21.15.70:0/3776812616 shutdown_connections 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c30bc740 1 -- 172.21.15.70:0/3776812616 wait complete. 2024-09-12T01:54:08.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c30bc740 20 client.16299 trim_cache size 0 max 16384 2024-09-12T01:54:08.701 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:54:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:54:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-12T01:54:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "efec413c-4140-4f71-ac26-2d714874e9f4": { 2024-09-12T01:54:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T01:54:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "efec413c-4140-4f71-ac26-2d714874e9f4", 2024-09-12T01:54:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-12T01:54:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:08.702 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:54:08.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c0ce3640 1 -- 172.21.15.70:0/1575119452 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f04a40a2b80 msgr2=0x7f04a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:08.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c0ce3640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f04a40a2b80 0x7f04a40a5040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f04b409b9d0 tx=0x7f04b4066950 comp rx=0 tx=0).stop 2024-09-12T01:54:08.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c0ce3640 1 -- 172.21.15.70:0/1575119452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04bc102ef0 msgr2=0x7f04bc0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:08.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c0ce3640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04bc102ef0 0x7f04bc0fd700 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f04b400cce0 tx=0x7f04b400a620 comp rx=0 tx=0).stop 2024-09-12T01:54:08.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c0ce3640 1 -- 172.21.15.70:0/1575119452 shutdown_connections 2024-09-12T01:54:08.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c0ce3640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f04a40a2b80 0x7f04a40a5040 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c0ce3640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04bc102ef0 0x7f04bc0fd700 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c0ce3640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04bc102570 0x7f04bc0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c0ce3640 1 --2- 172.21.15.70:0/1575119452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04bc100e20 0x7f04bc0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:08.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.693+0000 7f04c0ce3640 1 -- 172.21.15.70:0/1575119452 >> 172.21.15.70:0/1575119452 conn(0x7f04bc0fc7d0 msgr2=0x7f04bc06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:08.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.694+0000 7f04c0ce3640 1 -- 172.21.15.70:0/1575119452 shutdown_connections 2024-09-12T01:54:08.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:08.694+0000 7f04c0ce3640 1 -- 172.21.15.70:0/1575119452 wait complete. 2024-09-12T01:54:08.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:08 smithi191 ceph-mon[35770]: scrub queued for path: / 2024-09-12T01:54:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:08 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:08 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:54:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:08 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:54:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:08 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:08 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:08 smithi191 ceph-mon[35770]: pgmap v396: 97 pgs: 97 active+clean; 134 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 162 KiB/s wr, 155 op/s 2024-09-12T01:54:09.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:08 smithi152 ceph-mon[35055]: scrub queued for path: / 2024-09-12T01:54:09.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:08 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:09.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:08 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:54:09.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:08 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:54:09.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:08 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:09.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:08 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:09.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:08 smithi152 ceph-mon[35055]: pgmap v396: 97 pgs: 97 active+clean; 134 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 162 KiB/s wr, 155 op/s 2024-09-12T01:54:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:08 smithi070 ceph-mon[31177]: scrub queued for path: / 2024-09-12T01:54:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:08 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:08 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:54:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:08 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:54:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:08 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:08 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:08 smithi070 ceph-mon[31177]: pgmap v396: 97 pgs: 97 active+clean; 134 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 162 KiB/s wr, 155 op/s 2024-09-12T01:54:09.308 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '460d82a8', total seconds elapsed: 18.1 2024-09-12T01:54:09.911 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:09 smithi070 ceph-mon[31177]: pgmap v397: 97 pgs: 97 active+clean; 134 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 157 KiB/s wr, 171 op/s 2024-09-12T01:54:09.938 INFO:tasks.cephfs.filesystem:scrub status for tag:efec413c-4140-4f71-ac26-2d714874e9f4 - {'path': '/', 'tag': 'efec413c-4140-4f71-ac26-2d714874e9f4', 'options': 'recursive,force'} 2024-09-12T01:54:09.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:09 smithi191 ceph-mon[35770]: pgmap v397: 97 pgs: 97 active+clean; 134 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 157 KiB/s wr, 171 op/s 2024-09-12T01:54:10.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:09 smithi152 ceph-mon[35055]: pgmap v397: 97 pgs: 97 active+clean; 134 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 157 KiB/s wr, 171 op/s 2024-09-12T01:54:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.517+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/2630753733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a74100a40 msgr2=0x7f6a74100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.517+0000 7f6a7bc4c640 1 --2- 172.21.15.70:0/2630753733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a74100a40 0x7f6a74100e40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009860 tx=0x7f6a6802a340 comp rx=0 tx=0).stop 2024-09-12T01:54:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.517+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/2630753733 shutdown_connections 2024-09-12T01:54:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.517+0000 7f6a7bc4c640 1 --2- 172.21.15.70:0/2630753733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a741025f0 0x7f6a74108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.517+0000 7f6a7bc4c640 1 --2- 172.21.15.70:0/2630753733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a74101c30 0x7f6a741020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.517+0000 7f6a7bc4c640 1 --2- 172.21.15.70:0/2630753733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a74100a40 0x7f6a74100e40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.517+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/2630753733 >> 172.21.15.70:0/2630753733 conn(0x7f6a740fc1e0 msgr2=0x7f6a740fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.517+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/2630753733 shutdown_connections 2024-09-12T01:54:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.518+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/2630753733 wait complete. 2024-09-12T01:54:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.518+0000 7f6a7bc4c640 1 Processor -- start 2024-09-12T01:54:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.518+0000 7f6a7bc4c640 1 -- start start 2024-09-12T01:54:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a7bc4c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a74100a40 0x7f6a7419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a7bc4c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a74101c30 0x7f6a7419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a7bc4c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a741025f0 0x7f6a741a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a7bc4c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7410fb30 con 0x7f6a74100a40 2024-09-12T01:54:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a7bc4c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7410f9b0 con 0x7f6a741025f0 2024-09-12T01:54:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a7bc4c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7410fcb0 con 0x7f6a74101c30 2024-09-12T01:54:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a799e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a74100a40 0x7f6a7419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a799e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a74100a40 0x7f6a7419a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59708/0 (socket says 172.21.15.70:59708) 2024-09-12T01:54:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a799e8640 1 -- 172.21.15.70:0/4186661676 learned_addr learned my addr 172.21.15.70:0/4186661676 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a791e7640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a74101c30 0x7f6a7419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a7a1e9640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a741025f0 0x7f6a741a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a799e8640 1 -- 172.21.15.70:0/4186661676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a74101c30 msgr2=0x7f6a7419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a799e8640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a74101c30 0x7f6a7419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a799e8640 1 -- 172.21.15.70:0/4186661676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a741025f0 msgr2=0x7f6a741a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a799e8640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a741025f0 0x7f6a741a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a799e8640 1 -- 172.21.15.70:0/4186661676 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a741a1c70 con 0x7f6a74100a40 2024-09-12T01:54:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.519+0000 7f6a799e8640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a74100a40 0x7f6a7419a050 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6a680057c0 tx=0x7f6a680326f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.520+0000 7f6a66ffd640 1 -- 172.21.15.70:0/4186661676 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68040030 con 0x7f6a74100a40 2024-09-12T01:54:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.520+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/4186661676 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a741a1f00 con 0x7f6a74100a40 2024-09-12T01:54:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.520+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/4186661676 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a741a2360 con 0x7f6a74100a40 2024-09-12T01:54:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.520+0000 7f6a66ffd640 1 -- 172.21.15.70:0/4186661676 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a68038040 con 0x7f6a74100a40 2024-09-12T01:54:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.520+0000 7f6a66ffd640 1 -- 172.21.15.70:0/4186661676 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68037070 con 0x7f6a74100a40 2024-09-12T01:54:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.523+0000 7f6a66ffd640 1 -- 172.21.15.70:0/4186661676 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6a68043070 con 0x7f6a74100a40 2024-09-12T01:54:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.523+0000 7f6a7e9e4740 1 Processor -- start 2024-09-12T01:54:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.524+0000 7f6a7e9e4740 1 -- start start 2024-09-12T01:54:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.524+0000 7f6a7e9e4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 0x562e1420ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.524+0000 7f6a7e9e4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420b2e0 0x562e1420fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.524+0000 7f6a7e9e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 0x562e14212830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.524+0000 7f6a7e9e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e1416e2f0 con 0x562e14210370 2024-09-12T01:54:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.524+0000 7f6a7e9e4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562e14116270 con 0x562e1420b2e0 2024-09-12T01:54:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.524+0000 7f6a7e9e4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562e1416a2b0 con 0x562e1420a9a0 2024-09-12T01:54:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.524+0000 7f6a799e8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420b2e0 0x562e1420fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.524+0000 7f6a799e8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420b2e0 0x562e1420fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:44968/0 (socket says 172.21.15.70:44968) 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.524+0000 7f6a799e8640 1 -- 172.21.15.70:0/3328098490 learned_addr learned my addr 172.21.15.70:0/3328098490 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.524+0000 7f6a66ffd640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6a600a2cb0 0x7f6a600a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.525+0000 7f6a66ffd640 1 -- 172.21.15.70:0/4186661676 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6a680ee890 con 0x7f6a74100a40 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.525+0000 7f6a791e7640 1 --2- 172.21.15.70:0/3328098490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 0x562e14212830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.525+0000 7f6a799e8640 1 -- 172.21.15.70:0/3328098490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 msgr2=0x562e1420ada0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.525+0000 7f6a799e8640 1 --2- 172.21.15.70:0/3328098490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 0x562e1420ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.525+0000 7f6a799e8640 1 -- 172.21.15.70:0/3328098490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 msgr2=0x562e14212830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.525+0000 7f6a799e8640 1 --2- 172.21.15.70:0/3328098490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 0x562e14212830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.525+0000 7f6a799e8640 1 -- 172.21.15.70:0/3328098490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e14115340 con 0x562e1420b2e0 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.525+0000 7f6a799e8640 1 --2- 172.21.15.70:0/3328098490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420b2e0 0x562e1420fda0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a680badb0 tx=0x7f6a68005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d47d585710737899 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.525+0000 7f6a791e7640 1 --2- 172.21.15.70:0/3328098490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 0x562e14212830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.525+0000 7f6a7a1e9640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6a600a2cb0 0x7f6a600a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.526+0000 7f6a5ffff640 1 -- 172.21.15.70:0/3328098490 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a680baa10 con 0x562e1420b2e0 2024-09-12T01:54:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.526+0000 7f6a5ffff640 1 -- 172.21.15.70:0/3328098490 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a680bb7b0 con 0x562e1420b2e0 2024-09-12T01:54:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.526+0000 7f6a5ffff640 1 -- 172.21.15.70:0/3328098490 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a680ec460 con 0x562e1420b2e0 2024-09-12T01:54:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.527+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3328098490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420b2e0 msgr2=0x562e1420fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.527+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/3328098490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420b2e0 0x562e1420fda0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a680badb0 tx=0x7f6a68005f90 comp rx=0 tx=0).stop 2024-09-12T01:54:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.527+0000 7f6a7a1e9640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6a600a2cb0 0x7f6a600a5170 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c005fd0 tx=0x7f6a6c010040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.527+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3328098490 shutdown_connections 2024-09-12T01:54:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.527+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/3328098490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 0x562e14212830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.527+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/3328098490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420b2e0 0x562e1420fda0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.527+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/3328098490 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 0x562e1420ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.527+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3328098490 >> 172.21.15.70:0/3328098490 conn(0x562e14206010 msgr2=0x562e14206410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.528+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3328098490 shutdown_connections 2024-09-12T01:54:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.528+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3328098490 wait complete. 2024-09-12T01:54:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.528+0000 7f6a7e9e4740 1 -- start start 2024-09-12T01:54:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.528+0000 7f6a7e9e4740 1 Processor -- start 2024-09-12T01:54:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.529+0000 7f6a7e9e4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 0x562e142259b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.529+0000 7f6a7e9e4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420b2e0 0x562e14225ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.529+0000 7f6a7e9e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 0x562e1422cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.529+0000 7f6a7e9e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e14224110 con 0x562e14210370 2024-09-12T01:54:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.529+0000 7f6a7e9e4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562e140f7290 con 0x562e1420b2e0 2024-09-12T01:54:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.529+0000 7f6a7e9e4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562e14224290 con 0x562e1420a9a0 2024-09-12T01:54:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.529+0000 7f6a7e9e4740 10 client.0 _ll_register_callbacks cb 0x562e14128140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.529+0000 7f6a7a1e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 0x562e1422cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.529+0000 7f6a791e7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420b2e0 0x562e14225ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.529+0000 7f6a7a1e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 0x562e1422cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59720/0 (socket says 172.21.15.70:59720) 2024-09-12T01:54:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.529+0000 7f6a7a1e9640 1 -- 172.21.15.70:0/3486528247 learned_addr learned my addr 172.21.15.70:0/3486528247 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.529+0000 7f6a799e8640 1 --2- 172.21.15.70:0/3486528247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 0x562e142259b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.530+0000 7f6a7a1e9640 1 -- 172.21.15.70:0/3486528247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 msgr2=0x562e142259b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.530+0000 7f6a7a1e9640 1 --2- 172.21.15.70:0/3486528247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 0x562e142259b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.530+0000 7f6a7a1e9640 1 -- 172.21.15.70:0/3486528247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420b2e0 msgr2=0x562e14225ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.530+0000 7f6a7a1e9640 1 --2- 172.21.15.70:0/3486528247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420b2e0 0x562e14225ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.530+0000 7f6a7a1e9640 1 -- 172.21.15.70:0/3486528247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e13e81210 con 0x562e14210370 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.530+0000 7f6a7a1e9640 1 --2- 172.21.15.70:0/3486528247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 0x562e1422cf30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c003e00 tx=0x7f6a6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4027d50aedb2031 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.530+0000 7f6a5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.530+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/3486528247 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c01bb30 con 0x562e14210370 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.530+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/3486528247 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6a6c01bcd0 con 0x562e14210370 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.531+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3486528247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a680bb7b0 con 0x562e14210370 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.531+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/3486528247 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6a6c0268d0 con 0x562e14210370 2024-09-12T01:54:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.531+0000 7f6a7e9e4740 10 client.16305 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.531+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3486528247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562e13f4d620 con 0x562e14210370 2024-09-12T01:54:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.531+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/3486528247 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a680bb7b0 con 0x562e14210370 2024-09-12T01:54:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.531+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/3486528247 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f6a6c00b040 con 0x562e14210370 2024-09-12T01:54:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.531+0000 7f6a7e9e4740 10 client.16305 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.531+0000 7f6a7e9e4740 10 client.16305 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.531+0000 7f6a7e9e4740 20 client.16305 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.531+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/3486528247 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e142316d0 0x562e14233b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.531+0000 7f6a7e9e4740 4 client.16305 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.531+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3486528247 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e1417ba20 con 0x562e142316d0 2024-09-12T01:54:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.532+0000 7f6a799e8640 1 --2- 172.21.15.70:0/3486528247 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e142316d0 0x562e14233b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.532+0000 7f6a799e8640 1 --2- 172.21.15.70:0/3486528247 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e142316d0 0x562e14233b30 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fda2c45b9b8ae80 server_cookie=736e38c8c4ed03c0 in_seq=0 out_seq=0 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.532+0000 7f6a5d7fa640 10 client.16305 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.533+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/3486528247 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e1417ba20 con 0x562e142316d0 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.533+0000 7f6a5d7fa640 10 client.16305 handle_command_reply: tid=0 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.533+0000 7f6a7e9e4740 1 client.16305 shutdown 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.534+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3486528247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 msgr2=0x562e1422cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.534+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/3486528247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 0x562e1422cf30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c003e00 tx=0x7f6a6c004a40 comp rx=0 tx=0).stop 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.534+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3486528247 shutdown_connections 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.534+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/3486528247 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e142316d0 0x562e14233b30 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.534+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/3486528247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e14210370 0x562e1422cf30 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.534+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/3486528247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420b2e0 0x562e14225ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.534+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/3486528247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 0x562e142259b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.534+0000 7f6a5d7fa640 0 client.16305 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.534+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3486528247 >> 172.21.15.70:0/3486528247 conn(0x562e14206010 msgr2=0x562e14207820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.534+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3486528247 shutdown_connections 2024-09-12T01:54:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.534+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/3486528247 wait complete. 2024-09-12T01:54:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.534+0000 7f6a7e9e4740 20 client.16305 trim_cache size 0 max 16384 2024-09-12T01:54:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.560+0000 7f6a7e9e4740 1 Processor -- start 2024-09-12T01:54:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.560+0000 7f6a7e9e4740 1 -- start start 2024-09-12T01:54:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.560+0000 7f6a7e9e4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420a9a0 0x562e142050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.560+0000 7f6a7e9e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 0x562e1422cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.560+0000 7f6a799e8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420a9a0 0x562e142050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.560+0000 7f6a791e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 0x562e1422cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.560+0000 7f6a791e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 0x562e1422cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59730/0 (socket says 172.21.15.70:59730) 2024-09-12T01:54:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.560+0000 7f6a799e8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420a9a0 0x562e142050b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:44994/0 (socket says 172.21.15.70:44994) 2024-09-12T01:54:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.560+0000 7f6a791e7640 1 -- 172.21.15.70:0/2945653538 learned_addr learned my addr 172.21.15.70:0/2945653538 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/2945653538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e14210370 0x562e142383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/2945653538 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5800e4a0 con 0x562e1420b2e0 2024-09-12T01:54:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/2945653538 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6a580100d0 con 0x562e1420a9a0 2024-09-12T01:54:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/2945653538 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5800eb70 con 0x562e14210370 2024-09-12T01:54:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a7a1e9640 1 --2- 172.21.15.70:0/2945653538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e14210370 0x562e142383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a791e7640 1 -- 172.21.15.70:0/2945653538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e14210370 msgr2=0x562e142383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a791e7640 1 --2- 172.21.15.70:0/2945653538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e14210370 0x562e142383f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a791e7640 1 -- 172.21.15.70:0/2945653538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420a9a0 msgr2=0x562e142050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a791e7640 1 --2- 172.21.15.70:0/2945653538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420a9a0 0x562e142050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a791e7640 1 -- 172.21.15.70:0/2945653538 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e142341b0 con 0x562e1420b2e0 2024-09-12T01:54:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a7a1e9640 1 --2- 172.21.15.70:0/2945653538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e14210370 0x562e142383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a791e7640 1 --2- 172.21.15.70:0/2945653538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 0x562e1422cef0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000ad20 tx=0x7f6a70012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443b6eb3a2d526f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a5f7fe640 1 -- 172.21.15.70:0/2945653538 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7000ae10 con 0x562e1420b2e0 2024-09-12T01:54:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a5f7fe640 1 -- 172.21.15.70:0/2945653538 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a70005520 con 0x562e1420b2e0 2024-09-12T01:54:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.561+0000 7f6a5f7fe640 1 -- 172.21.15.70:0/2945653538 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7000f9f0 con 0x562e1420b2e0 2024-09-12T01:54:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.562+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/2945653538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 msgr2=0x562e1422cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.562+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/2945653538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 0x562e1422cef0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000ad20 tx=0x7f6a70012820 comp rx=0 tx=0).stop 2024-09-12T01:54:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.563+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/2945653538 shutdown_connections 2024-09-12T01:54:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.563+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/2945653538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e14210370 0x562e142383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.563+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/2945653538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 0x562e1422cef0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.563+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/2945653538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e1420a9a0 0x562e142050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.563+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/2945653538 >> 172.21.15.70:0/2945653538 conn(0x562e14206010 msgr2=0x562e142049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.563+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/2945653538 shutdown_connections 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.563+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/2945653538 wait complete. 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.563+0000 7f6a7e9e4740 1 -- start start 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.563+0000 7f6a7e9e4740 1 Processor -- start 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a7e9e4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 0x562e1422adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a7e9e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 0x562e1422b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a7e9e4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e14210370 0x562e1422c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a7e9e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5800f940 con 0x562e1420b2e0 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a799e8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 0x562e1422adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a799e8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 0x562e1422adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:32790/0 (socket says 172.21.15.70:32790) 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a791e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 0x562e1422b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a799e8640 1 -- 172.21.15.70:0/1765518618 learned_addr learned my addr 172.21.15.70:0/1765518618 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/1765518618 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5800f270 con 0x562e14210370 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/1765518618 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5800c460 con 0x562e1420a9a0 2024-09-12T01:54:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a7a1e9640 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e14210370 0x562e1422c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a7e9e4740 10 client.0 _ll_register_callbacks cb 0x7f6a6c00ee60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a791e7640 1 -- 172.21.15.70:0/1765518618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 msgr2=0x562e1422adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a791e7640 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 0x562e1422adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a791e7640 1 -- 172.21.15.70:0/1765518618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e14210370 msgr2=0x562e1422c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a791e7640 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e14210370 0x562e1422c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a791e7640 1 -- 172.21.15.70:0/1765518618 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e1422c910 con 0x562e1420b2e0 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.564+0000 7f6a7a1e9640 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e14210370 0x562e1422c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.565+0000 7f6a791e7640 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 0x562e1422b2f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x562e14205a40 tx=0x7f6a70005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe6b465bf03d9f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.565+0000 7f6a5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.565+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/1765518618 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a700048d0 con 0x562e1420b2e0 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.565+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/1765518618 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6a70018040 con 0x562e1420b2e0 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.565+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/1765518618 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a70005520 con 0x562e1420b2e0 2024-09-12T01:54:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.565+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/1765518618 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6a70004a70 con 0x562e1420b2e0 2024-09-12T01:54:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.565+0000 7f6a7e9e4740 10 client.16311 fetch_fsmap learned FSMap version 33 2024-09-12T01:54:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.565+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/1765518618 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562e1429cb80 con 0x562e1420b2e0 2024-09-12T01:54:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.565+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/1765518618 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a70005520 con 0x562e1420b2e0 2024-09-12T01:54:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.566+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/1765518618 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f6a7001c7d0 con 0x562e1420b2e0 2024-09-12T01:54:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.566+0000 7f6a7e9e4740 10 client.16311 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T01:54:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.566+0000 7f6a7e9e4740 10 client.16311 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.566+0000 7f6a7e9e4740 20 client.16311 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.566+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e1429d5d0 0x562e1429f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.566+0000 7f6a7e9e4740 4 client.16311 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:54:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.566+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/1765518618 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562e14175d70 con 0x562e1429d5d0 2024-09-12T01:54:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.566+0000 7f6a799e8640 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e1429d5d0 0x562e1429f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.566+0000 7f6a5d7fa640 10 client.16311 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:11.572 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.566+0000 7f6a799e8640 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e1429d5d0 0x562e1429f9f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adec2ae320394e35 server_cookie=a747ac88880471bc in_seq=0 out_seq=0 2024-09-12T01:54:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/1765518618 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562e14175d70 con 0x562e1429d5d0 2024-09-12T01:54:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a5d7fa640 10 client.16311 handle_command_reply: tid=0 2024-09-12T01:54:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a7e9e4740 1 client.16311 shutdown 2024-09-12T01:54:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/1765518618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 msgr2=0x562e1422b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 0x562e1422b2f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x562e14205a40 tx=0x7f6a70005450 comp rx=0 tx=0).stop 2024-09-12T01:54:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/1765518618 shutdown_connections 2024-09-12T01:54:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e1429d5d0 0x562e1429f9f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e14210370 0x562e1422c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a5d7fa640 0 client.16311 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e1420b2e0 0x562e1422b2f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a7e9e4740 1 --2- 172.21.15.70:0/1765518618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e1420a9a0 0x562e1422adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/1765518618 >> 172.21.15.70:0/1765518618 conn(0x562e14206010 msgr2=0x562e142051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/1765518618 shutdown_connections 2024-09-12T01:54:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a7e9e4740 1 -- 172.21.15.70:0/1765518618 wait complete. 2024-09-12T01:54:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.609+0000 7f6a7e9e4740 20 client.16311 trim_cache size 0 max 16384 2024-09-12T01:54:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:54:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:54:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:54:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:54:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.610+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/4186661676 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6a600a2cb0 msgr2=0x7f6a600a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.610+0000 7f6a7bc4c640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6a600a2cb0 0x7f6a600a5170 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c005fd0 tx=0x7f6a6c010040 comp rx=0 tx=0).stop 2024-09-12T01:54:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.610+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/4186661676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a74100a40 msgr2=0x7f6a7419a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.610+0000 7f6a7bc4c640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a74100a40 0x7f6a7419a050 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6a680057c0 tx=0x7f6a680326f0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.610+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/4186661676 shutdown_connections 2024-09-12T01:54:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.610+0000 7f6a7bc4c640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f6a600a2cb0 0x7f6a600a5170 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.610+0000 7f6a7bc4c640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a741025f0 0x7f6a741a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.610+0000 7f6a7bc4c640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a74101c30 0x7f6a7419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.610+0000 7f6a7bc4c640 1 --2- 172.21.15.70:0/4186661676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a74100a40 0x7f6a7419a050 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.610+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/4186661676 >> 172.21.15.70:0/4186661676 conn(0x7f6a740fc1e0 msgr2=0x7f6a74104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.610+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/4186661676 shutdown_connections 2024-09-12T01:54:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:11.610+0000 7f6a7bc4c640 1 -- 172.21.15.70:0/4186661676 wait complete. 2024-09-12T01:54:11.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:11 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:12.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:11 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:12.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:11 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:12 smithi191 ceph-mon[35770]: pgmap v398: 97 pgs: 97 active+clean; 134 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 75 KiB/s wr, 224 op/s 2024-09-12T01:54:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:12.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:12 smithi152 ceph-mon[35055]: pgmap v398: 97 pgs: 97 active+clean; 134 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 75 KiB/s wr, 224 op/s 2024-09-12T01:54:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:13.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:13.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:12 smithi070 ceph-mon[31177]: pgmap v398: 97 pgs: 97 active+clean; 134 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 75 KiB/s wr, 224 op/s 2024-09-12T01:54:13.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:13.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:13.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:54:13.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:13 smithi191 ceph-mon[35770]: scrub summary: idle 2024-09-12T01:54:13.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:13 smithi191 ceph-mon[35770]: scrub summary: idle 2024-09-12T01:54:13.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:13 smithi191 ceph-mon[35770]: scrub summary: idle 2024-09-12T01:54:13.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:13 smithi191 ceph-mon[35770]: scrub summary: idle 2024-09-12T01:54:14.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:13 smithi152 ceph-mon[35055]: scrub summary: idle 2024-09-12T01:54:14.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:13 smithi152 ceph-mon[35055]: scrub summary: idle 2024-09-12T01:54:14.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:13 smithi152 ceph-mon[35055]: scrub summary: idle 2024-09-12T01:54:14.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:13 smithi152 ceph-mon[35055]: scrub summary: idle 2024-09-12T01:54:14.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:13 smithi070 ceph-mon[31177]: scrub summary: idle 2024-09-12T01:54:14.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:13 smithi070 ceph-mon[31177]: scrub summary: idle 2024-09-12T01:54:14.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:13 smithi070 ceph-mon[31177]: scrub summary: idle 2024-09-12T01:54:14.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:13 smithi070 ceph-mon[31177]: scrub summary: idle 2024-09-12T01:54:14.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:14 smithi191 ceph-mon[35770]: pgmap v399: 97 pgs: 97 active+clean; 137 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 415 KiB/s wr, 254 op/s 2024-09-12T01:54:15.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:14 smithi152 ceph-mon[35055]: pgmap v399: 97 pgs: 97 active+clean; 137 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 415 KiB/s wr, 254 op/s 2024-09-12T01:54:15.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:14 smithi070 ceph-mon[31177]: pgmap v399: 97 pgs: 97 active+clean; 137 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 415 KiB/s wr, 254 op/s 2024-09-12T01:54:15.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:15 smithi191 ceph-mon[35770]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:16.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:15 smithi152 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:16.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:15 smithi070 ceph-mon[31177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:16.720 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar xf doc.tar 2024-09-12T01:54:16.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:16 smithi191 ceph-mon[35770]: pgmap v400: 97 pgs: 97 active+clean; 136 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 658 KiB/s wr, 317 op/s 2024-09-12T01:54:17.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:16 smithi152 ceph-mon[35055]: pgmap v400: 97 pgs: 97 active+clean; 136 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 658 KiB/s wr, 317 op/s 2024-09-12T01:54:17.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:16 smithi070 ceph-mon[31177]: pgmap v400: 97 pgs: 97 active+clean; 136 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 658 KiB/s wr, 317 op/s 2024-09-12T01:54:17.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:17 smithi191 ceph-mon[35770]: pgmap v401: 97 pgs: 97 active+clean; 132 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 780 KiB/s wr, 383 op/s 2024-09-12T01:54:18.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:17 smithi152 ceph-mon[35055]: pgmap v401: 97 pgs: 97 active+clean; 132 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 780 KiB/s wr, 383 op/s 2024-09-12T01:54:18.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:17 smithi070 ceph-mon[31177]: pgmap v401: 97 pgs: 97 active+clean; 132 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 780 KiB/s wr, 383 op/s 2024-09-12T01:54:20.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:20 smithi191 ceph-mon[35770]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:20.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:20 smithi191 ceph-mon[35770]: pgmap v402: 97 pgs: 97 active+clean; 129 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 818 KiB/s wr, 405 op/s 2024-09-12T01:54:20.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:20 smithi152 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:20.512 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:20 smithi152 ceph-mon[35055]: pgmap v402: 97 pgs: 97 active+clean; 129 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 818 KiB/s wr, 405 op/s 2024-09-12T01:54:20.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:20 smithi070 ceph-mon[31177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:20.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:20 smithi070 ceph-mon[31177]: pgmap v402: 97 pgs: 97 active+clean; 129 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 818 KiB/s wr, 405 op/s 2024-09-12T01:54:22.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:22 smithi191 ceph-mon[35770]: pgmap v403: 97 pgs: 97 active+clean; 132 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.3 MiB/s wr, 396 op/s 2024-09-12T01:54:23.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:22 smithi152 ceph-mon[35055]: pgmap v403: 97 pgs: 97 active+clean; 132 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.3 MiB/s wr, 396 op/s 2024-09-12T01:54:23.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:22 smithi070 ceph-mon[31177]: pgmap v403: 97 pgs: 97 active+clean; 132 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.3 MiB/s wr, 396 op/s 2024-09-12T01:54:23.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:23 smithi191 ceph-mon[35770]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:24.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:23 smithi152 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:24.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:23 smithi070 ceph-mon[31177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.702+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1674629309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8100a40 msgr2=0x7f3ff8100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.702+0000 7f3ffd83c640 1 --2- 172.21.15.70:0/1674629309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8100a40 0x7f3ff8100e40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009900 tx=0x7f3fe802a410 comp rx=0 tx=0).stop 2024-09-12T01:54:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.702+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1674629309 shutdown_connections 2024-09-12T01:54:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.702+0000 7f3ffd83c640 1 --2- 172.21.15.70:0/1674629309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ff81025f0 0x7f3ff8108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.702+0000 7f3ffd83c640 1 --2- 172.21.15.70:0/1674629309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ff8101c30 0x7f3ff81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.702+0000 7f3ffd83c640 1 --2- 172.21.15.70:0/1674629309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8100a40 0x7f3ff8100e40 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.702+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1674629309 >> 172.21.15.70:0/1674629309 conn(0x7f3ff80fc1e0 msgr2=0x7f3ff80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.702+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1674629309 shutdown_connections 2024-09-12T01:54:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.702+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1674629309 wait complete. 2024-09-12T01:54:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.703+0000 7f3ffd83c640 1 Processor -- start 2024-09-12T01:54:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.703+0000 7f3ffd83c640 1 -- start start 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.703+0000 7f3ffd83c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8100a40 0x7f3ff806a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.703+0000 7f3ffd83c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ff8101c30 0x7f3ff819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.703+0000 7f3ffd83c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ff81025f0 0x7f3ff819f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.703+0000 7f3ffd83c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff810c7e0 con 0x7f3ff8100a40 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.703+0000 7f3ffd83c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff810c660 con 0x7f3ff81025f0 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.703+0000 7f3ffd83c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff810c960 con 0x7f3ff8101c30 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.703+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8100a40 0x7f3ff806a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.703+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8100a40 0x7f3ff806a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33942/0 (socket says 172.21.15.70:33942) 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.703+0000 7f3ff6ffd640 1 -- 172.21.15.70:0/1967114853 learned_addr learned my addr 172.21.15.70:0/1967114853 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.703+0000 7f3ff77fe640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ff81025f0 0x7f3ff819f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.704+0000 7f3ff6ffd640 1 -- 172.21.15.70:0/1967114853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ff8101c30 msgr2=0x7f3ff819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.704+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ff8101c30 0x7f3ff819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.704+0000 7f3ff6ffd640 1 -- 172.21.15.70:0/1967114853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ff81025f0 msgr2=0x7f3ff819f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.704+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ff81025f0 0x7f3ff819f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.704+0000 7f3ff6ffd640 1 -- 172.21.15.70:0/1967114853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff819faa0 con 0x7f3ff8100a40 2024-09-12T01:54:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.704+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8100a40 0x7f3ff806a410 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009230 tx=0x7f3fe80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.704+0000 7f3ffc83a640 1 -- 172.21.15.70:0/1967114853 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe803f030 con 0x7f3ff8100a40 2024-09-12T01:54:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.704+0000 7f3ffc83a640 1 -- 172.21.15.70:0/1967114853 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3fe8003d00 con 0x7f3ff8100a40 2024-09-12T01:54:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.704+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1967114853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff819fcd0 con 0x7f3ff8100a40 2024-09-12T01:54:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.704+0000 7f3ffc83a640 1 -- 172.21.15.70:0/1967114853 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8035070 con 0x7f3ff8100a40 2024-09-12T01:54:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.704+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1967114853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff81a01c0 con 0x7f3ff8100a40 2024-09-12T01:54:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.706+0000 7f3ffc83a640 1 -- 172.21.15.70:0/1967114853 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3fe8042030 con 0x7f3ff8100a40 2024-09-12T01:54:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f3ffc83a640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3fe00a7040 0x7f3fe00a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f40005d8740 1 Processor -- start 2024-09-12T01:54:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f40005d8740 1 -- start start 2024-09-12T01:54:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f3ff67fc640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3fe00a7040 0x7f3fe00a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f3ffc83a640 1 -- 172.21.15.70:0/1967114853 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3fe80ef5f0 con 0x7f3ff8100a40 2024-09-12T01:54:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f40005d8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 0x558756911da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f40005d8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756916da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f40005d8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558756917370 0x558756919830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f40005d8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5587568752f0 con 0x5587569119a0 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f40005d8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55875681d270 con 0x5587569122e0 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f40005d8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5587568712b0 con 0x558756917370 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 0x558756911da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 0x558756911da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33954/0 (socket says 172.21.15.70:33954) 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f3ff6ffd640 1 -- 172.21.15.70:0/3902926134 learned_addr learned my addr 172.21.15.70:0/3902926134 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.707+0000 7f3ff67fc640 1 --2- 172.21.15.70:0/3902926134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756916da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f3ff6ffd640 1 -- 172.21.15.70:0/3902926134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558756917370 msgr2=0x558756919830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/3902926134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558756917370 0x558756919830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f3ff6ffd640 1 -- 172.21.15.70:0/3902926134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 msgr2=0x558756916da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/3902926134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756916da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f3ff6ffd640 1 -- 172.21.15.70:0/3902926134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55875681c340 con 0x5587569119a0 2024-09-12T01:54:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f3ff67fc640 1 --2- 172.21.15.70:0/3902926134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756916da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f3ff67fc640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3fe00a7040 0x7f3fe00a9500 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0058c0 tx=0x7f3fec005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/3902926134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 0x558756911da0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80bbde0 tx=0x7f3fe803b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd43f558bc34ea2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f3fddffb640 1 -- 172.21.15.70:0/3902926134 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8049040 con 0x5587569119a0 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f3fddffb640 1 -- 172.21.15.70:0/3902926134 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3fe80be070 con 0x5587569119a0 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f3fddffb640 1 -- 172.21.15.70:0/3902926134 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe80b84c0 con 0x5587569119a0 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f40005d8740 1 -- 172.21.15.70:0/3902926134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 msgr2=0x558756911da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.708+0000 7f40005d8740 1 --2- 172.21.15.70:0/3902926134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 0x558756911da0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80bbde0 tx=0x7f3fe803b790 comp rx=0 tx=0).stop 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 -- 172.21.15.70:0/3902926134 shutdown_connections 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 --2- 172.21.15.70:0/3902926134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558756917370 0x558756919830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 --2- 172.21.15.70:0/3902926134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756916da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 --2- 172.21.15.70:0/3902926134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 0x558756911da0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 -- 172.21.15.70:0/3902926134 >> 172.21.15.70:0/3902926134 conn(0x55875690d010 msgr2=0x55875690d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 -- 172.21.15.70:0/3902926134 shutdown_connections 2024-09-12T01:54:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 -- 172.21.15.70:0/3902926134 wait complete. 2024-09-12T01:54:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 -- start start 2024-09-12T01:54:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 Processor -- start 2024-09-12T01:54:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 0x55875691b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569122e0 0x55875691bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558756917370 0x558756922df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55875691a100 con 0x5587569119a0 2024-09-12T01:54:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5587567fe290 con 0x558756917370 2024-09-12T01:54:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.709+0000 7f40005d8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55875691a280 con 0x5587569122e0 2024-09-12T01:54:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f40005d8740 10 client.0 _ll_register_callbacks cb 0x55875682f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 0x55875691b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 0x55875691b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33968/0 (socket says 172.21.15.70:33968) 2024-09-12T01:54:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3ff6ffd640 1 -- 172.21.15.70:0/1493034091 learned_addr learned my addr 172.21.15.70:0/1493034091 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3ff77fe640 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558756917370 0x558756922df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3ff67fc640 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569122e0 0x55875691bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3ff6ffd640 1 -- 172.21.15.70:0/1493034091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569122e0 msgr2=0x55875691bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569122e0 0x55875691bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3ff6ffd640 1 -- 172.21.15.70:0/1493034091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558756917370 msgr2=0x558756922df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558756917370 0x558756922df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3ff6ffd640 1 -- 172.21.15.70:0/1493034091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558756588210 con 0x5587569119a0 2024-09-12T01:54:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3ff67fc640 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569122e0 0x55875691bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 0x55875691b870 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80c4590 tx=0x7f3fe8004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b0747a869e1ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3fd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3fd6ffd640 1 -- 172.21.15.70:0/1493034091 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe80d9070 con 0x5587569119a0 2024-09-12T01:54:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3fd6ffd640 1 -- 172.21.15.70:0/1493034091 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3fe80b84c0 con 0x5587569119a0 2024-09-12T01:54:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f40005d8740 1 -- 172.21.15.70:0/1493034091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fe80be070 con 0x5587569119a0 2024-09-12T01:54:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3fd6ffd640 1 -- 172.21.15.70:0/1493034091 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3fe8049050 con 0x5587569119a0 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f40005d8740 10 client.16323 fetch_fsmap learned FSMap version 36 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f40005d8740 1 -- 172.21.15.70:0/1493034091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558756654620 con 0x5587569119a0 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.710+0000 7f3fd6ffd640 1 -- 172.21.15.70:0/1493034091 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3fe80be070 con 0x5587569119a0 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.711+0000 7f3fd6ffd640 1 -- 172.21.15.70:0/1493034091 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8398+0+0 (secure 0 0 0) 0x7f3fe80bb2a0 con 0x5587569119a0 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.711+0000 7f40005d8740 10 client.16323 fetch_fsmap finished waiting for FSMap version 36 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.711+0000 7f40005d8740 10 client.16323 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.711+0000 7f40005d8740 20 client.16323 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.711+0000 7f40005d8740 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5587569273e0 0x5587569297d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.711+0000 7f40005d8740 4 client.16323 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.711+0000 7f40005d8740 1 -- 172.21.15.70:0/1493034091 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558756882a20 con 0x5587569273e0 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.711+0000 7f3ff67fc640 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5587569273e0 0x5587569297d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.711+0000 7f3fd6ffd640 10 client.16323 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.711+0000 7f3ff67fc640 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5587569273e0 0x5587569297d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2cefde97bc79cc8 server_cookie=7a84f4dbf3bd2183 in_seq=0 out_seq=0 2024-09-12T01:54:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.712+0000 7f3fd6ffd640 1 -- 172.21.15.70:0/1493034091 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558756882a20 con 0x5587569273e0 2024-09-12T01:54:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.712+0000 7f3fd6ffd640 10 client.16323 handle_command_reply: tid=0 2024-09-12T01:54:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.712+0000 7f40005d8740 1 client.16323 shutdown 2024-09-12T01:54:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.713+0000 7f40005d8740 1 -- 172.21.15.70:0/1493034091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 msgr2=0x55875691b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.713+0000 7f40005d8740 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 0x55875691b870 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80c4590 tx=0x7f3fe8004460 comp rx=0 tx=0).stop 2024-09-12T01:54:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.713+0000 7f40005d8740 1 -- 172.21.15.70:0/1493034091 shutdown_connections 2024-09-12T01:54:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.713+0000 7f40005d8740 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5587569273e0 0x5587569297d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.713+0000 7f40005d8740 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558756917370 0x558756922df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.713+0000 7f40005d8740 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569122e0 0x55875691bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.713+0000 7f3fd6ffd640 0 client.16323 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.713+0000 7f40005d8740 1 --2- 172.21.15.70:0/1493034091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5587569119a0 0x55875691b870 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.713+0000 7f40005d8740 1 -- 172.21.15.70:0/1493034091 >> 172.21.15.70:0/1493034091 conn(0x55875690d010 msgr2=0x55875690e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.713+0000 7f40005d8740 1 -- 172.21.15.70:0/1493034091 shutdown_connections 2024-09-12T01:54:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.713+0000 7f40005d8740 1 -- 172.21.15.70:0/1493034091 wait complete. 2024-09-12T01:54:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.713+0000 7f40005d8740 20 client.16323 trim_cache size 0 max 16384 2024-09-12T01:54:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f40005d8740 1 Processor -- start 2024-09-12T01:54:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f40005d8740 1 -- start start 2024-09-12T01:54:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f40005d8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569119a0 0x55875691be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f40005d8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756922db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f40005d8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 0x55875690e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f40005d8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff81a6ea0 con 0x558756917370 2024-09-12T01:54:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f40005d8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff81a8b60 con 0x5587569122e0 2024-09-12T01:54:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f40005d8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff81a75a0 con 0x5587569119a0 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f3ff77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 0x55875690e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f3ff77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 0x55875690e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33984/0 (socket says 172.21.15.70:33984) 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f3ff77fe640 1 -- 172.21.15.70:0/720637301 learned_addr learned my addr 172.21.15.70:0/720637301 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f3ff67fc640 1 --2- 172.21.15.70:0/720637301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756922db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/720637301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569119a0 0x55875691be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f3ff77fe640 1 -- 172.21.15.70:0/720637301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569119a0 msgr2=0x55875691be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f3ff77fe640 1 --2- 172.21.15.70:0/720637301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569119a0 0x55875691be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f3ff77fe640 1 -- 172.21.15.70:0/720637301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 msgr2=0x558756922db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f3ff77fe640 1 --2- 172.21.15.70:0/720637301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756922db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.727+0000 7f3ff77fe640 1 -- 172.21.15.70:0/720637301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558756929e00 con 0x558756917370 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f3ff77fe640 1 --2- 172.21.15.70:0/720637301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 0x55875690e690 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0007f60 tx=0x7f3ff0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13940efc6c77e039 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f3fdd7fa640 1 -- 172.21.15.70:0/720637301 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0003b80 con 0x558756917370 2024-09-12T01:54:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f3fdd7fa640 1 -- 172.21.15.70:0/720637301 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3ff0003d20 con 0x558756917370 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f3fdd7fa640 1 -- 172.21.15.70:0/720637301 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff001ab30 con 0x558756917370 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f40005d8740 1 -- 172.21.15.70:0/720637301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 msgr2=0x55875690e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f40005d8740 1 --2- 172.21.15.70:0/720637301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 0x55875690e690 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0007f60 tx=0x7f3ff0007f90 comp rx=0 tx=0).stop 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f40005d8740 1 -- 172.21.15.70:0/720637301 shutdown_connections 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f40005d8740 1 --2- 172.21.15.70:0/720637301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 0x55875690e690 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f40005d8740 1 --2- 172.21.15.70:0/720637301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756922db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f40005d8740 1 --2- 172.21.15.70:0/720637301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569119a0 0x55875691be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f40005d8740 1 -- 172.21.15.70:0/720637301 >> 172.21.15.70:0/720637301 conn(0x55875690d010 msgr2=0x55875690df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f40005d8740 1 -- 172.21.15.70:0/720637301 shutdown_connections 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.728+0000 7f40005d8740 1 -- 172.21.15.70:0/720637301 wait complete. 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f40005d8740 1 -- start start 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f40005d8740 1 Processor -- start 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f40005d8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569119a0 0x558756920680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f40005d8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756920bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f40005d8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 0x558756921bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f40005d8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff81a83d0 con 0x558756917370 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f40005d8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff81a7ca0 con 0x5587569122e0 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f40005d8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff81a4e60 con 0x5587569119a0 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f40005d8740 10 client.0 _ll_register_callbacks cb 0x7f3fe80bbc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f3ff67fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756920bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f3ff67fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756920bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:33474/0 (socket says 172.21.15.70:33474) 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f3ff77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 0x558756921bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f3ff67fc640 1 -- 172.21.15.70:0/445422999 learned_addr learned my addr 172.21.15.70:0/445422999 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.729+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569119a0 0x558756920680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3ff77fe640 1 -- 172.21.15.70:0/445422999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569119a0 msgr2=0x558756920680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3ff77fe640 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569119a0 0x558756920680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3ff77fe640 1 -- 172.21.15.70:0/445422999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 msgr2=0x558756920bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3ff77fe640 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756920bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3ff77fe640 1 -- 172.21.15.70:0/445422999 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587569221e0 con 0x558756917370 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3ff67fc640 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756920bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3ff77fe640 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 0x558756921bd0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0010d50 tx=0x7f3ff0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa6975193992e4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3fd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3fd6ffd640 1 -- 172.21.15.70:0/445422999 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0003b80 con 0x558756917370 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3fd6ffd640 1 -- 172.21.15.70:0/445422999 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3ff0004260 con 0x558756917370 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f40005d8740 1 -- 172.21.15.70:0/445422999 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ff0003d20 con 0x558756917370 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3fd6ffd640 1 -- 172.21.15.70:0/445422999 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3ff0007bf0 con 0x558756917370 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f40005d8740 10 client.16329 fetch_fsmap learned FSMap version 36 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f40005d8740 1 -- 172.21.15.70:0/445422999 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558756992270 con 0x558756917370 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3fd6ffd640 1 -- 172.21.15.70:0/445422999 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3ff0003d20 con 0x558756917370 2024-09-12T01:54:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f3fd6ffd640 1 -- 172.21.15.70:0/445422999 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8398+0+0 (secure 0 0 0) 0x7f3ff002fb30 con 0x558756917370 2024-09-12T01:54:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f40005d8740 10 client.16329 fetch_fsmap finished waiting for FSMap version 36 2024-09-12T01:54:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f40005d8740 10 client.16329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f40005d8740 20 client.16329 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f40005d8740 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558756992c60 0x558756995080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f40005d8740 4 client.16329 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:54:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.730+0000 7f40005d8740 1 -- 172.21.15.70:0/445422999 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55875687cd70 con 0x558756992c60 2024-09-12T01:54:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.731+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558756992c60 0x558756995080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.731+0000 7f3ff6ffd640 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558756992c60 0x558756995080 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad884cd668bab8b2 server_cookie=86da15c61430f31a in_seq=0 out_seq=0 2024-09-12T01:54:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:24.731+0000 7f3fd6ffd640 10 client.16329 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:24.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:24 smithi191 ceph-mon[35770]: pgmap v404: 97 pgs: 97 active+clean; 133 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 333 op/s 2024-09-12T01:54:25.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:24 smithi152 ceph-mon[35055]: pgmap v404: 97 pgs: 97 active+clean; 133 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 333 op/s 2024-09-12T01:54:25.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:24 smithi070 ceph-mon[31177]: pgmap v404: 97 pgs: 97 active+clean; 133 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 333 op/s 2024-09-12T01:54:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.725+0000 7f3fd6ffd640 1 -- 172.21.15.70:0/445422999 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55875687cd70 con 0x558756992c60 2024-09-12T01:54:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.725+0000 7f3fd6ffd640 10 client.16329 handle_command_reply: tid=0 2024-09-12T01:54:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.725+0000 7f40005d8740 1 client.16329 shutdown 2024-09-12T01:54:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f40005d8740 1 -- 172.21.15.70:0/445422999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 msgr2=0x558756921bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f40005d8740 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 0x558756921bd0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0010d50 tx=0x7f3ff0005a50 comp rx=0 tx=0).stop 2024-09-12T01:54:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f40005d8740 1 -- 172.21.15.70:0/445422999 shutdown_connections 2024-09-12T01:54:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f40005d8740 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x558756992c60 0x558756995080 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f40005d8740 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558756917370 0x558756921bd0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f40005d8740 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5587569122e0 0x558756920bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f40005d8740 1 --2- 172.21.15.70:0/445422999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5587569119a0 0x558756920680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f3fd6ffd640 0 client.16329 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f40005d8740 1 -- 172.21.15.70:0/445422999 >> 172.21.15.70:0/445422999 conn(0x55875690d010 msgr2=0x55875690c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f40005d8740 1 -- 172.21.15.70:0/445422999 shutdown_connections 2024-09-12T01:54:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f40005d8740 1 -- 172.21.15.70:0/445422999 wait complete. 2024-09-12T01:54:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f40005d8740 20 client.16329 trim_cache size 0 max 16384 2024-09-12T01:54:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:54:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:54:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:54:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:54:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.726+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1967114853 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3fe00a7040 msgr2=0x7f3fe00a9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.727+0000 7f3ffd83c640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3fe00a7040 0x7f3fe00a9500 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0058c0 tx=0x7f3fec005850 comp rx=0 tx=0).stop 2024-09-12T01:54:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.727+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1967114853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8100a40 msgr2=0x7f3ff806a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.727+0000 7f3ffd83c640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8100a40 0x7f3ff806a410 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009230 tx=0x7f3fe80042f0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.727+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1967114853 shutdown_connections 2024-09-12T01:54:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.727+0000 7f3ffd83c640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3fe00a7040 0x7f3fe00a9500 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.727+0000 7f3ffd83c640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ff81025f0 0x7f3ff819f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.727+0000 7f3ffd83c640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ff8101c30 0x7f3ff819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.727+0000 7f3ffd83c640 1 --2- 172.21.15.70:0/1967114853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8100a40 0x7f3ff806a410 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.727+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1967114853 >> 172.21.15.70:0/1967114853 conn(0x7f3ff80fc1e0 msgr2=0x7f3ff8104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.727+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1967114853 shutdown_connections 2024-09-12T01:54:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:25.727+0000 7f3ffd83c640 1 -- 172.21.15.70:0/1967114853 wait complete. 2024-09-12T01:54:26.562 INFO:tasks.workunit.client.0.smithi070.stderr:+ sync 2024-09-12T01:54:26.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:26 smithi191 ceph-mon[35770]: pgmap v405: 97 pgs: 97 active+clean; 148 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.4 MiB/s wr, 439 op/s 2024-09-12T01:54:27.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:26 smithi152 ceph-mon[35055]: pgmap v405: 97 pgs: 97 active+clean; 148 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.4 MiB/s wr, 439 op/s 2024-09-12T01:54:27.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:26 smithi070 ceph-mon[31177]: pgmap v405: 97 pgs: 97 active+clean; 148 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.4 MiB/s wr, 439 op/s 2024-09-12T01:54:27.692 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar c linux-4.0.5 2024-09-12T01:54:27.978 INFO:tasks.workunit.client.0.smithi070.stdout:Ok 2024-09-12T01:54:27.979 INFO:tasks.workunit.client.0.smithi070.stderr:+ echo Ok 2024-09-12T01:54:27.979 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:54:27.980 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:54:28.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:28 smithi191 ceph-mon[35770]: pgmap v406: 97 pgs: 97 active+clean; 154 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 689 op/s 2024-09-12T01:54:29.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:28 smithi152 ceph-mon[35055]: pgmap v406: 97 pgs: 97 active+clean; 154 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 689 op/s 2024-09-12T01:54:29.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:28 smithi070 ceph-mon[31177]: pgmap v406: 97 pgs: 97 active+clean; 154 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 689 op/s 2024-09-12T01:54:30.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:30 smithi191 ceph-mon[35770]: pgmap v407: 97 pgs: 97 active+clean; 150 MiB data, 991 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 902 op/s 2024-09-12T01:54:31.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:30 smithi152 ceph-mon[35055]: pgmap v407: 97 pgs: 97 active+clean; 150 MiB data, 991 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 902 op/s 2024-09-12T01:54:31.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:30 smithi070 ceph-mon[31177]: pgmap v407: 97 pgs: 97 active+clean; 150 MiB data, 991 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 902 op/s 2024-09-12T01:54:32.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:32 smithi191 ceph-mon[35770]: pgmap v408: 97 pgs: 97 active+clean; 154 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.2 MiB/s wr, 1.06k op/s 2024-09-12T01:54:33.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:32 smithi152 ceph-mon[35055]: pgmap v408: 97 pgs: 97 active+clean; 154 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.2 MiB/s wr, 1.06k op/s 2024-09-12T01:54:33.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:32 smithi070 ceph-mon[31177]: pgmap v408: 97 pgs: 97 active+clean; 154 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.2 MiB/s wr, 1.06k op/s 2024-09-12T01:54:34.424 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.7 2024-09-12T01:54:34.425 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:34.716 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:34.794 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:34 smithi070 ceph-mon[31177]: pgmap v409: 97 pgs: 97 active+clean; 146 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 1.06k op/s 2024-09-12T01:54:34.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:34 smithi191 ceph-mon[35770]: pgmap v409: 97 pgs: 97 active+clean; 146 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 1.06k op/s 2024-09-12T01:54:35.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:34 smithi152 ceph-mon[35055]: pgmap v409: 97 pgs: 97 active+clean; 146 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 1.06k op/s 2024-09-12T01:54:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.189+0000 7feb52696640 1 -- 172.21.15.70:0/3817588872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c100e20 msgr2=0x7feb4c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.189+0000 7feb52696640 1 --2- 172.21.15.70:0/3817588872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c100e20 0x7feb4c101200 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009900 tx=0x7feb3c02a480 comp rx=0 tx=0).stop 2024-09-12T01:54:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.189+0000 7feb52696640 1 -- 172.21.15.70:0/3817588872 shutdown_connections 2024-09-12T01:54:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.189+0000 7feb52696640 1 --2- 172.21.15.70:0/3817588872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb4c102ef0 0x7feb4c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.189+0000 7feb52696640 1 --2- 172.21.15.70:0/3817588872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb4c102570 0x7feb4c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.189+0000 7feb52696640 1 --2- 172.21.15.70:0/3817588872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c100e20 0x7feb4c101200 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.189+0000 7feb52696640 1 -- 172.21.15.70:0/3817588872 >> 172.21.15.70:0/3817588872 conn(0x7feb4c0fc7d0 msgr2=0x7feb4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.189+0000 7feb52696640 1 -- 172.21.15.70:0/3817588872 shutdown_connections 2024-09-12T01:54:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.189+0000 7feb52696640 1 -- 172.21.15.70:0/3817588872 wait complete. 2024-09-12T01:54:35.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.189+0000 7feb52696640 1 Processor -- start 2024-09-12T01:54:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.189+0000 7feb52696640 1 -- start start 2024-09-12T01:54:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb52696640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb4c100e20 0x7feb4c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb52696640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb4c102570 0x7feb4c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb52696640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c102ef0 0x7feb4c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb52696640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c1110a0 con 0x7feb4c102ef0 2024-09-12T01:54:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb52696640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c110f20 con 0x7feb4c102570 2024-09-12T01:54:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb52696640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c111220 con 0x7feb4c100e20 2024-09-12T01:54:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb50c33640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c102ef0 0x7feb4c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb50c33640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c102ef0 0x7feb4c19ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53716/0 (socket says 172.21.15.70:53716) 2024-09-12T01:54:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb4bfff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb4c100e20 0x7feb4c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb50c33640 1 -- 172.21.15.70:0/3368262814 learned_addr learned my addr 172.21.15.70:0/3368262814 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb4b7fe640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb4c102570 0x7feb4c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb50c33640 1 -- 172.21.15.70:0/3368262814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb4c100e20 msgr2=0x7feb4c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb50c33640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb4c100e20 0x7feb4c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb50c33640 1 -- 172.21.15.70:0/3368262814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb4c102570 msgr2=0x7feb4c198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb50c33640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb4c102570 0x7feb4c198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.190+0000 7feb50c33640 1 -- 172.21.15.70:0/3368262814 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c19d570 con 0x7feb4c102ef0 2024-09-12T01:54:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.191+0000 7feb50c33640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c102ef0 0x7feb4c19ce90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7feb44009fd0 tx=0x7feb4400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.191+0000 7feb497fa640 1 -- 172.21.15.70:0/3368262814 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb44017070 con 0x7feb4c102ef0 2024-09-12T01:54:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.191+0000 7feb497fa640 1 -- 172.21.15.70:0/3368262814 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feb44004020 con 0x7feb4c102ef0 2024-09-12T01:54:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.191+0000 7feb52696640 1 -- 172.21.15.70:0/3368262814 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4c19d860 con 0x7feb4c102ef0 2024-09-12T01:54:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.191+0000 7feb497fa640 1 -- 172.21.15.70:0/3368262814 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb440106c0 con 0x7feb4c102ef0 2024-09-12T01:54:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.191+0000 7feb52696640 1 -- 172.21.15.70:0/3368262814 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4c1a5140 con 0x7feb4c102ef0 2024-09-12T01:54:35.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.192+0000 7feb52696640 1 -- 172.21.15.70:0/3368262814 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4c101200 con 0x7feb4c102ef0 2024-09-12T01:54:35.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.193+0000 7feb497fa640 1 -- 172.21.15.70:0/3368262814 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7feb440041d0 con 0x7feb4c102ef0 2024-09-12T01:54:35.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.194+0000 7feb497fa640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7feb340a2c00 0x7feb340a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:35.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.194+0000 7feb4bfff640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7feb340a2c00 0x7feb340a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:35.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.194+0000 7feb497fa640 1 -- 172.21.15.70:0/3368262814 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7feb440cec20 con 0x7feb4c102ef0 2024-09-12T01:54:35.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.194+0000 7feb4bfff640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7feb340a2c00 0x7feb340a50c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009230 tx=0x7feb3c0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:35.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.198+0000 7feb497fa640 1 -- 172.21.15.70:0/3368262814 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb4409b530 con 0x7feb4c102ef0 2024-09-12T01:54:35.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.417+0000 7feb52696640 1 -- 172.21.15.70:0/3368262814 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb4c10a0a0 con 0x7feb4c102ef0 2024-09-12T01:54:35.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.418+0000 7feb497fa640 1 -- 172.21.15.70:0/3368262814 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11992 (secure 0 0 0) 0x7feb4409f830 con 0x7feb4c102ef0 2024-09-12T01:54:35.419 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:54:35.419 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":36,"btime":"2024-09-12T01:54:22:588853+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:54:21.765246+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24427,24433,24437,24445,24452]},"id":1}]} 2024-09-12T01:54:35.419 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 36 2024-09-12T01:54:35.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.421+0000 7feb52696640 1 -- 172.21.15.70:0/3368262814 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7feb340a2c00 msgr2=0x7feb340a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:35.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.421+0000 7feb52696640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7feb340a2c00 0x7feb340a50c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009230 tx=0x7feb3c0058d0 comp rx=0 tx=0).stop 2024-09-12T01:54:35.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.421+0000 7feb52696640 1 -- 172.21.15.70:0/3368262814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c102ef0 msgr2=0x7feb4c19ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:35.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.421+0000 7feb52696640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c102ef0 0x7feb4c19ce90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7feb44009fd0 tx=0x7feb4400b260 comp rx=0 tx=0).stop 2024-09-12T01:54:35.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.421+0000 7feb52696640 1 -- 172.21.15.70:0/3368262814 shutdown_connections 2024-09-12T01:54:35.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.421+0000 7feb52696640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7feb340a2c00 0x7feb340a50c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:35.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.421+0000 7feb52696640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb4c102ef0 0x7feb4c19ce90 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:35.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.421+0000 7feb52696640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb4c102570 0x7feb4c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:35.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.421+0000 7feb52696640 1 --2- 172.21.15.70:0/3368262814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb4c100e20 0x7feb4c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:35.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.421+0000 7feb52696640 1 -- 172.21.15.70:0/3368262814 >> 172.21.15.70:0/3368262814 conn(0x7feb4c0fc7d0 msgr2=0x7feb4c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:35.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.421+0000 7feb52696640 1 -- 172.21.15.70:0/3368262814 shutdown_connections 2024-09-12T01:54:35.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:35.421+0000 7feb52696640 1 -- 172.21.15.70:0/3368262814 wait complete. 2024-09-12T01:54:35.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:35 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3368262814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:35.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:35 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3368262814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:36.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:35 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3368262814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:36.215 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24452 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0' 2024-09-12T01:54:36.215 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24452 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0 2024-09-12T01:54:36.463 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:36.901 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:36 smithi070 ceph-mon[31177]: pgmap v410: 97 pgs: 97 active+clean; 95 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 1.14k op/s 2024-09-12T01:54:36.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:36 smithi191 ceph-mon[35770]: pgmap v410: 97 pgs: 97 active+clean; 95 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 1.14k op/s 2024-09-12T01:54:36.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.994+0000 7f7946945640 1 -- 172.21.15.70:0/3203557503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940101df0 msgr2=0x7f79401021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:36.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.994+0000 7f7946945640 1 --2- 172.21.15.70:0/3203557503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940101df0 0x7f79401021d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7930009900 tx=0x7f793002a410 comp rx=0 tx=0).stop 2024-09-12T01:54:36.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.994+0000 7f7946945640 1 -- 172.21.15.70:0/3203557503 shutdown_connections 2024-09-12T01:54:36.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.994+0000 7f7946945640 1 --2- 172.21.15.70:0/3203557503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7940106f20 0x7f794010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.994+0000 7f7946945640 1 --2- 172.21.15.70:0/3203557503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79401027a0 0x7f79401067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.994+0000 7f7946945640 1 --2- 172.21.15.70:0/3203557503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940101df0 0x7f79401021d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.994+0000 7f7946945640 1 -- 172.21.15.70:0/3203557503 >> 172.21.15.70:0/3203557503 conn(0x7f79400fd8f0 msgr2=0x7f79400ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:36.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.994+0000 7f7946945640 1 -- 172.21.15.70:0/3203557503 shutdown_connections 2024-09-12T01:54:36.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.994+0000 7f7946945640 1 -- 172.21.15.70:0/3203557503 wait complete. 2024-09-12T01:54:36.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.995+0000 7f7946945640 1 Processor -- start 2024-09-12T01:54:36.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.995+0000 7f7946945640 1 -- start start 2024-09-12T01:54:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.995+0000 7f7946945640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940101df0 0x7f79400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.995+0000 7f7946945640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79401027a0 0x7f7940074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.995+0000 7f7946945640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7940106f20 0x7f7940074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.995+0000 7f7946945640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7940112060 con 0x7f7940101df0 2024-09-12T01:54:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.995+0000 7f7946945640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7940111ee0 con 0x7f7940106f20 2024-09-12T01:54:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.995+0000 7f7946945640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f79401121e0 con 0x7f79401027a0 2024-09-12T01:54:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.995+0000 7f793ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940101df0 0x7f79400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.995+0000 7f793ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940101df0 0x7f79400744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53732/0 (socket says 172.21.15.70:53732) 2024-09-12T01:54:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.995+0000 7f793ffff640 1 -- 172.21.15.70:0/4204376050 learned_addr learned my addr 172.21.15.70:0/4204376050 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:36.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.995+0000 7f793f7fe640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79401027a0 0x7f7940074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.996+0000 7f7944ee2640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7940106f20 0x7f7940074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.996+0000 7f793ffff640 1 -- 172.21.15.70:0/4204376050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79401027a0 msgr2=0x7f7940074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.996+0000 7f793ffff640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79401027a0 0x7f7940074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.996+0000 7f793ffff640 1 -- 172.21.15.70:0/4204376050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7940106f20 msgr2=0x7f7940074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.996+0000 7f793ffff640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7940106f20 0x7f7940074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:36.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.996+0000 7f793ffff640 1 -- 172.21.15.70:0/4204376050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79401a69c0 con 0x7f7940101df0 2024-09-12T01:54:36.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.996+0000 7f793ffff640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940101df0 0x7f79400744f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7930006010 tx=0x7f79300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:36.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.996+0000 7f793d7fa640 1 -- 172.21.15.70:0/4204376050 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793003f030 con 0x7f7940101df0 2024-09-12T01:54:36.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.996+0000 7f7946945640 1 -- 172.21.15.70:0/4204376050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79401a6c50 con 0x7f7940101df0 2024-09-12T01:54:36.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.996+0000 7f793d7fa640 1 -- 172.21.15.70:0/4204376050 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7930003d00 con 0x7f7940101df0 2024-09-12T01:54:36.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.996+0000 7f793d7fa640 1 -- 172.21.15.70:0/4204376050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930035070 con 0x7f7940101df0 2024-09-12T01:54:36.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.996+0000 7f7946945640 1 -- 172.21.15.70:0/4204376050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79401a7130 con 0x7f7940101df0 2024-09-12T01:54:36.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.998+0000 7f793d7fa640 1 -- 172.21.15.70:0/4204376050 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7930042030 con 0x7f7940101df0 2024-09-12T01:54:36.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f7948d1e740 1 Processor -- start 2024-09-12T01:54:36.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f7948d1e740 1 -- start start 2024-09-12T01:54:37.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f7948d1e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c705d760 0x5622c705db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f7948d1e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 0x5622c7068400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f7948d1e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c7068940 0x5622c706ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f7948d1e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5622c6fc32a0 con 0x5622c705e080 2024-09-12T01:54:37.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f7948d1e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5622c6f6ab10 con 0x5622c705d760 2024-09-12T01:54:37.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f7948d1e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5622c6fbf260 con 0x5622c7068940 2024-09-12T01:54:37.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f793d7fa640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79280a2b80 0x7f79280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f793ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 0x5622c7068400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f793ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 0x5622c7068400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53734/0 (socket says 172.21.15.70:53734) 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f793ffff640 1 -- 172.21.15.70:0/2062702298 learned_addr learned my addr 172.21.15.70:0/2062702298 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f7944ee2640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79280a2b80 0x7f79280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f793f7fe640 1 --2- 172.21.15.70:0/2062702298 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c7068940 0x5622c706ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f7944ee2640 1 --2- 172.21.15.70:0/2062702298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c705d760 0x5622c705db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:36.999+0000 7f793d7fa640 1 -- 172.21.15.70:0/4204376050 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f79300ef360 con 0x7f7940101df0 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.000+0000 7f7944ee2640 1 -- 172.21.15.70:0/2062702298 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c7068940 msgr2=0x5622c706ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.000+0000 7f7944ee2640 1 --2- 172.21.15.70:0/2062702298 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c7068940 0x5622c706ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.000+0000 7f7944ee2640 1 -- 172.21.15.70:0/2062702298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 msgr2=0x5622c7068400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.000+0000 7f7944ee2640 1 --2- 172.21.15.70:0/2062702298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 0x5622c7068400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.000+0000 7f7944ee2640 1 -- 172.21.15.70:0/2062702298 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622c6d34b90 con 0x5622c705d760 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.000+0000 7f7944ee2640 1 --2- 172.21.15.70:0/2062702298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c705d760 0x5622c705db40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7938012bc0 tx=0x7f793800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=381a78314328cfa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.000+0000 7f7944ee2640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79280a2b80 0x7f79280a5040 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f793800fc30 tx=0x7f7938019000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.000+0000 7f79267fc640 1 -- 172.21.15.70:0/2062702298 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793800ebf0 con 0x5622c705d760 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.000+0000 7f79267fc640 1 -- 172.21.15.70:0/2062702298 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f793800ed90 con 0x5622c705d760 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.001+0000 7f7948d1e740 1 -- 172.21.15.70:0/2062702298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c705d760 msgr2=0x5622c705db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.001+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2062702298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c705d760 0x5622c705db40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7938012bc0 tx=0x7f793800f730 comp rx=0 tx=0).stop 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.001+0000 7f7948d1e740 1 -- 172.21.15.70:0/2062702298 shutdown_connections 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.001+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2062702298 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c7068940 0x5622c706ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.001+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2062702298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 0x5622c7068400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.001+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2062702298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c705d760 0x5622c705db40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.001+0000 7f7948d1e740 1 -- 172.21.15.70:0/2062702298 >> 172.21.15.70:0/2062702298 conn(0x5622c7059cf0 msgr2=0x5622c705a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.001+0000 7f7948d1e740 1 -- 172.21.15.70:0/2062702298 shutdown_connections 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.001+0000 7f7948d1e740 1 -- 172.21.15.70:0/2062702298 wait complete. 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.001+0000 7f7948d1e740 1 -- start start 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.001+0000 7f7948d1e740 1 Processor -- start 2024-09-12T01:54:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f7948d1e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705d760 0x5622c70656e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f7948d1e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 0x5622c7065c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f7948d1e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c7068940 0x5622c7066160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f7948d1e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5622c706b560 con 0x5622c705e080 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f7948d1e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5622c6f4b6e0 con 0x5622c7068940 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f7948d1e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5622c706b6e0 con 0x5622c705d760 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f7948d1e740 10 client.0 _ll_register_callbacks cb 0x5622c6f6fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f793f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 0x5622c7065c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f793f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 0x5622c7065c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53748/0 (socket says 172.21.15.70:53748) 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f793f7fe640 1 -- 172.21.15.70:0/442187240 learned_addr learned my addr 172.21.15.70:0/442187240 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f7944ee2640 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c7068940 0x5622c7066160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f793ffff640 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705d760 0x5622c70656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f793f7fe640 1 -- 172.21.15.70:0/442187240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705d760 msgr2=0x5622c70656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f793f7fe640 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705d760 0x5622c70656e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f793f7fe640 1 -- 172.21.15.70:0/442187240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c7068940 msgr2=0x5622c7066160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f793f7fe640 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c7068940 0x5622c7066160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f793f7fe640 1 -- 172.21.15.70:0/442187240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622c7074a20 con 0x5622c705e080 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f793f7fe640 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 0x5622c7065c20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7934012700 tx=0x7f7934012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f842ccbbf49788 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f791f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f791f7fe640 1 -- 172.21.15.70:0/442187240 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934004050 con 0x5622c705e080 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f791f7fe640 1 -- 172.21.15.70:0/442187240 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f79340041f0 con 0x5622c705e080 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.002+0000 7f7948d1e740 1 -- 172.21.15.70:0/442187240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f793800ed90 con 0x5622c705e080 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.003+0000 7f791f7fe640 1 -- 172.21.15.70:0/442187240 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f79340043f0 con 0x5622c705e080 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.003+0000 7f7948d1e740 10 client.16347 fetch_fsmap learned FSMap version 36 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.003+0000 7f7948d1e740 1 -- 172.21.15.70:0/442187240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5622c70773a0 con 0x5622c705e080 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.003+0000 7f791f7fe640 1 -- 172.21.15.70:0/442187240 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f793800ed90 con 0x5622c705e080 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.003+0000 7f791f7fe640 1 -- 172.21.15.70:0/442187240 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8398+0+0 (secure 0 0 0) 0x7f7934010430 con 0x5622c705e080 2024-09-12T01:54:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.003+0000 7f7948d1e740 10 client.16347 fetch_fsmap finished waiting for FSMap version 36 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.003+0000 7f7948d1e740 10 client.16347 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.003+0000 7f7948d1e740 20 client.16347 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.003+0000 7f7948d1e740 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622c7078900 0x5622c707ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.003+0000 7f7948d1e740 4 client.16347 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.003+0000 7f7948d1e740 1 -- 172.21.15.70:0/442187240 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622c6fd09d0 con 0x5622c7078900 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.003+0000 7f793ffff640 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622c7078900 0x5622c707ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.004+0000 7f793ffff640 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622c7078900 0x5622c707ad10 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc45508e64460998 server_cookie=99bbd7330f6db6fa in_seq=0 out_seq=0 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.004+0000 7f791f7fe640 10 client.16347 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f791f7fe640 1 -- 172.21.15.70:0/442187240 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5622c6fd09d0 con 0x5622c7078900 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f791f7fe640 10 client.16347 handle_command_reply: tid=0 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f7948d1e740 1 client.16347 shutdown 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f7948d1e740 1 -- 172.21.15.70:0/442187240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 msgr2=0x5622c7065c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f7948d1e740 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 0x5622c7065c20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7934012700 tx=0x7f7934012bc0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f7948d1e740 1 -- 172.21.15.70:0/442187240 shutdown_connections 2024-09-12T01:54:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f7948d1e740 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622c7078900 0x5622c707ad10 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f7948d1e740 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c7068940 0x5622c7066160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f7948d1e740 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705e080 0x5622c7065c20 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f7948d1e740 1 --2- 172.21.15.70:0/442187240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705d760 0x5622c70656e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f7948d1e740 1 -- 172.21.15.70:0/442187240 >> 172.21.15.70:0/442187240 conn(0x5622c7059cf0 msgr2=0x5622c705f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f791f7fe640 0 client.16347 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f7948d1e740 1 -- 172.21.15.70:0/442187240 shutdown_connections 2024-09-12T01:54:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f7948d1e740 1 -- 172.21.15.70:0/442187240 wait complete. 2024-09-12T01:54:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.005+0000 7f7948d1e740 20 client.16347 trim_cache size 0 max 16384 2024-09-12T01:54:37.015 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:36 smithi152 ceph-mon[35055]: pgmap v410: 97 pgs: 97 active+clean; 95 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 1.14k op/s 2024-09-12T01:54:37.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f7948d1e740 1 Processor -- start 2024-09-12T01:54:37.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f7948d1e740 1 -- start start 2024-09-12T01:54:37.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f7948d1e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c7059cf0 0x5622c7065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f7948d1e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705d760 0x5622c70805e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f7948d1e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705e080 0x5622c7080b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f7948d1e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79401af830 con 0x5622c705d760 2024-09-12T01:54:37.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f7948d1e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f79401b14f0 con 0x5622c7059cf0 2024-09-12T01:54:37.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f7948d1e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f79401aff30 con 0x5622c705e080 2024-09-12T01:54:37.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f793f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705d760 0x5622c70805e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f793f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705d760 0x5622c70805e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53754/0 (socket says 172.21.15.70:53754) 2024-09-12T01:54:37.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f793f7fe640 1 -- 172.21.15.70:0/2470217345 learned_addr learned my addr 172.21.15.70:0/2470217345 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:37.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f793ffff640 1 --2- 172.21.15.70:0/2470217345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c7059cf0 0x5622c7065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f7944ee2640 1 --2- 172.21.15.70:0/2470217345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705e080 0x5622c7080b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f793f7fe640 1 -- 172.21.15.70:0/2470217345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705e080 msgr2=0x5622c7080b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:37.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f793f7fe640 1 --2- 172.21.15.70:0/2470217345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705e080 0x5622c7080b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f793f7fe640 1 -- 172.21.15.70:0/2470217345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c7059cf0 msgr2=0x5622c7065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:37.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f793f7fe640 1 --2- 172.21.15.70:0/2470217345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c7059cf0 0x5622c7065fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.022+0000 7f793f7fe640 1 -- 172.21.15.70:0/2470217345 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622c705deb0 con 0x5622c705d760 2024-09-12T01:54:37.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f793f7fe640 1 --2- 172.21.15.70:0/2470217345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705d760 0x5622c70805e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f79340109c0 tx=0x7f7934005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b2dfa0662582c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:37.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f7925ffb640 1 -- 172.21.15.70:0/2470217345 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934010430 con 0x5622c705d760 2024-09-12T01:54:37.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f7925ffb640 1 -- 172.21.15.70:0/2470217345 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f79340105d0 con 0x5622c705d760 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f7925ffb640 1 -- 172.21.15.70:0/2470217345 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79340052a0 con 0x5622c705d760 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f7948d1e740 1 -- 172.21.15.70:0/2470217345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705d760 msgr2=0x5622c70805e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2470217345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705d760 0x5622c70805e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f79340109c0 tx=0x7f7934005d30 comp rx=0 tx=0).stop 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f7948d1e740 1 -- 172.21.15.70:0/2470217345 shutdown_connections 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2470217345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705e080 0x5622c7080b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2470217345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c705d760 0x5622c70805e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2470217345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c7059cf0 0x5622c7065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f7948d1e740 1 -- 172.21.15.70:0/2470217345 >> 172.21.15.70:0/2470217345 conn(0x5622c7067850 msgr2=0x5622c705f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f7948d1e740 1 -- 172.21.15.70:0/2470217345 shutdown_connections 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.023+0000 7f7948d1e740 1 -- 172.21.15.70:0/2470217345 wait complete. 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f7948d1e740 1 -- start start 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f7948d1e740 1 Processor -- start 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f7948d1e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c7059cf0 0x5622c7071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f7948d1e740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c705d760 0x5622c706b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f7948d1e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705e080 0x5622c706bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f7948d1e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79401b0d60 con 0x5622c7059cf0 2024-09-12T01:54:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f7948d1e740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f79401b0630 con 0x5622c705d760 2024-09-12T01:54:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f7948d1e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f79401ad7f0 con 0x5622c705e080 2024-09-12T01:54:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f7948d1e740 10 client.0 _ll_register_callbacks cb 0x7f7934009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f793ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c7059cf0 0x5622c7071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f793ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c7059cf0 0x5622c7071120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53766/0 (socket says 172.21.15.70:53766) 2024-09-12T01:54:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f793ffff640 1 -- 172.21.15.70:0/2954080553 learned_addr learned my addr 172.21.15.70:0/2954080553 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f7944ee2640 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705e080 0x5622c706bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.024+0000 7f793f7fe640 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c705d760 0x5622c706b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f793ffff640 1 -- 172.21.15.70:0/2954080553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705e080 msgr2=0x5622c706bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f793ffff640 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705e080 0x5622c706bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f793ffff640 1 -- 172.21.15.70:0/2954080553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c705d760 msgr2=0x5622c706b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f793ffff640 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c705d760 0x5622c706b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f793ffff640 1 -- 172.21.15.70:0/2954080553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622c706c730 con 0x5622c7059cf0 2024-09-12T01:54:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f793ffff640 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c7059cf0 0x5622c7071120 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f79300096c0 tx=0x7f793002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1276c9609f62ebfc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f791f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:37.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f791f7fe640 1 -- 172.21.15.70:0/2954080553 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79300d9060 con 0x5622c7059cf0 2024-09-12T01:54:37.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f791f7fe640 1 -- 172.21.15.70:0/2954080553 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f793003b460 con 0x5622c7059cf0 2024-09-12T01:54:37.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f7948d1e740 1 -- 172.21.15.70:0/2954080553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79340105d0 con 0x5622c7059cf0 2024-09-12T01:54:37.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f791f7fe640 1 -- 172.21.15.70:0/2954080553 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7930049040 con 0x5622c7059cf0 2024-09-12T01:54:37.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f7948d1e740 10 client.16353 fetch_fsmap learned FSMap version 36 2024-09-12T01:54:37.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f7948d1e740 1 -- 172.21.15.70:0/2954080553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5622c70e46d0 con 0x5622c7059cf0 2024-09-12T01:54:37.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.025+0000 7f791f7fe640 1 -- 172.21.15.70:0/2954080553 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f79340105d0 con 0x5622c7059cf0 2024-09-12T01:54:37.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.026+0000 7f791f7fe640 1 -- 172.21.15.70:0/2954080553 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8398+0+0 (secure 0 0 0) 0x7f793003bcb0 con 0x5622c7059cf0 2024-09-12T01:54:37.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.026+0000 7f7948d1e740 10 client.16353 fetch_fsmap finished waiting for FSMap version 36 2024-09-12T01:54:37.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.026+0000 7f7948d1e740 10 client.16353 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:54:37.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.026+0000 7f7948d1e740 20 client.16353 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:37.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.026+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622c7068940 0x5622c70e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:37.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.026+0000 7f7948d1e740 4 client.16353 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}] 2024-09-12T01:54:37.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.026+0000 7f7948d1e740 1 -- 172.21.15.70:0/2954080553 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}) -- 0x5622c705a9a0 con 0x5622c7068940 2024-09-12T01:54:37.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.026+0000 7f793f7fe640 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622c7068940 0x5622c70e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:37.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.026+0000 7f793f7fe640 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622c7068940 0x5622c70e6ec0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0e6bcf5f567e7e1 server_cookie=c0f106bc9c21be63 in_seq=0 out_seq=0 2024-09-12T01:54:37.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.026+0000 7f791f7fe640 10 client.16353 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:37.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f791f7fe640 1 -- 172.21.15.70:0/2954080553 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5622c705a9a0 con 0x5622c7068940 2024-09-12T01:54:37.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f791f7fe640 10 client.16353 handle_command_reply: tid=0 2024-09-12T01:54:37.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f7948d1e740 1 client.16353 shutdown 2024-09-12T01:54:37.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f7948d1e740 1 -- 172.21.15.70:0/2954080553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c7059cf0 msgr2=0x5622c7071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:37.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c7059cf0 0x5622c7071120 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f79300096c0 tx=0x7f793002a410 comp rx=0 tx=0).stop 2024-09-12T01:54:37.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f7948d1e740 1 -- 172.21.15.70:0/2954080553 shutdown_connections 2024-09-12T01:54:37.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622c7068940 0x5622c70e6ec0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622c705e080 0x5622c706bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f791f7fe640 0 client.16353 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:37.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622c705d760 0x5622c706b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f7948d1e740 1 --2- 172.21.15.70:0/2954080553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622c7059cf0 0x5622c7071120 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f7948d1e740 1 -- 172.21.15.70:0/2954080553 >> 172.21.15.70:0/2954080553 conn(0x5622c7067850 msgr2=0x5622c7058650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:37.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f7948d1e740 1 -- 172.21.15.70:0/2954080553 shutdown_connections 2024-09-12T01:54:37.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f7948d1e740 1 -- 172.21.15.70:0/2954080553 wait complete. 2024-09-12T01:54:37.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.744+0000 7f7948d1e740 20 client.16353 trim_cache size 0 max 16384 2024-09-12T01:54:37.746 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:54:37.746 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 37, 2024-09-12T01:54:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24452, 2024-09-12T01:54:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 10, 2024-09-12T01:54:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-12T01:54:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "e681cdf1": { 2024-09-12T01:54:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 10, 2024-09-12T01:54:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-12T01:54:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-12T01:54:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-12T01:54:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-12T01:54:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:54:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-12T01:54:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 144.7, 2024-09-12T01:54:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-12T01:54:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-12T01:54:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-12T01:54:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-12T01:54:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-09-12T01:54:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-12T01:54:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:37.749 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:54:37.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.745+0000 7f7946945640 1 -- 172.21.15.70:0/4204376050 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79280a2b80 msgr2=0x7f79280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:37.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.745+0000 7f7946945640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79280a2b80 0x7f79280a5040 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f793800fc30 tx=0x7f7938019000 comp rx=0 tx=0).stop 2024-09-12T01:54:37.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.745+0000 7f7946945640 1 -- 172.21.15.70:0/4204376050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940101df0 msgr2=0x7f79400744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:37.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.745+0000 7f7946945640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940101df0 0x7f79400744f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7930006010 tx=0x7f79300042f0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.745+0000 7f7946945640 1 -- 172.21.15.70:0/4204376050 shutdown_connections 2024-09-12T01:54:37.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.745+0000 7f7946945640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f79280a2b80 0x7f79280a5040 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.745+0000 7f7946945640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7940106f20 0x7f7940074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.745+0000 7f7946945640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79401027a0 0x7f7940074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.745+0000 7f7946945640 1 --2- 172.21.15.70:0/4204376050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7940101df0 0x7f79400744f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:37.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.745+0000 7f7946945640 1 -- 172.21.15.70:0/4204376050 >> 172.21.15.70:0/4204376050 conn(0x7f79400fd8f0 msgr2=0x7f79400fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:37.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.745+0000 7f7946945640 1 -- 172.21.15.70:0/4204376050 shutdown_connections 2024-09-12T01:54:37.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:37.745+0000 7f7946945640 1 -- 172.21.15.70:0/4204376050 wait complete. 2024-09-12T01:54:38.452 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e681cdf1', quiesce took 4.0 seconds. Will release after: 20.7 2024-09-12T01:54:38.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:38 smithi070 ceph-mon[31177]: pgmap v411: 97 pgs: 97 active+clean; 57 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 1.04k op/s 2024-09-12T01:54:38.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:38 smithi070 ceph-mon[31177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.819+0000 7f228c84c640 1 -- 172.21.15.70:0/2890116538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2288100a50 msgr2=0x7f2288100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.819+0000 7f228c84c640 1 --2- 172.21.15.70:0/2890116538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2288100a50 0x7f2288100e50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2278009900 tx=0x7f227802a410 comp rx=0 tx=0).stop 2024-09-12T01:54:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.819+0000 7f228c84c640 1 -- 172.21.15.70:0/2890116538 shutdown_connections 2024-09-12T01:54:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.819+0000 7f228c84c640 1 --2- 172.21.15.70:0/2890116538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2288102600 0x7f2288108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.819+0000 7f228c84c640 1 --2- 172.21.15.70:0/2890116538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2288101c40 0x7f22881020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.819+0000 7f228c84c640 1 --2- 172.21.15.70:0/2890116538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2288100a50 0x7f2288100e50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.819+0000 7f228c84c640 1 -- 172.21.15.70:0/2890116538 >> 172.21.15.70:0/2890116538 conn(0x7f22880fc1b0 msgr2=0x7f22880fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.819+0000 7f228c84c640 1 -- 172.21.15.70:0/2890116538 shutdown_connections 2024-09-12T01:54:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.819+0000 7f228c84c640 1 -- 172.21.15.70:0/2890116538 wait complete. 2024-09-12T01:54:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.820+0000 7f228c84c640 1 Processor -- start 2024-09-12T01:54:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.820+0000 7f228c84c640 1 -- start start 2024-09-12T01:54:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.820+0000 7f228c84c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2288100a50 0x7f228806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.820+0000 7f228c84c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2288101c40 0x7f228819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.820+0000 7f228c84c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2288102600 0x7f228819f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.820+0000 7f228c84c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f228810c830 con 0x7f2288102600 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.820+0000 7f228c84c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f228810c6b0 con 0x7f2288101c40 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.820+0000 7f228c84c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f228810c9b0 con 0x7f2288100a50 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.820+0000 7f2286d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2288102600 0x7f228819f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f2286d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2288102600 0x7f228819f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53780/0 (socket says 172.21.15.70:53780) 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f2286d9d640 1 -- 172.21.15.70:0/3521186136 learned_addr learned my addr 172.21.15.70:0/3521186136 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f227ffff640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2288101c40 0x7f228819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f228659c640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2288100a50 0x7f228806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f2286d9d640 1 -- 172.21.15.70:0/3521186136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2288100a50 msgr2=0x7f228806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f2286d9d640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2288100a50 0x7f228806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f2286d9d640 1 -- 172.21.15.70:0/3521186136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2288101c40 msgr2=0x7f228819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f2286d9d640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2288101c40 0x7f228819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f2286d9d640 1 -- 172.21.15.70:0/3521186136 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228819fac0 con 0x7f2288102600 2024-09-12T01:54:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f227ffff640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2288101c40 0x7f228819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f228659c640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2288100a50 0x7f228806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f2286d9d640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2288102600 0x7f228819f200 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f228000eb10 tx=0x7f228000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f227f7fe640 1 -- 172.21.15.70:0/3521186136 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280004b20 con 0x7f2288102600 2024-09-12T01:54:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f227f7fe640 1 -- 172.21.15.70:0/3521186136 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2280004cc0 con 0x7f2288102600 2024-09-12T01:54:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f228c84c640 1 -- 172.21.15.70:0/3521186136 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228819fdb0 con 0x7f2288102600 2024-09-12T01:54:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f227f7fe640 1 -- 172.21.15.70:0/3521186136 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22800107f0 con 0x7f2288102600 2024-09-12T01:54:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.821+0000 7f228c84c640 1 -- 172.21.15.70:0/3521186136 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22881a0220 con 0x7f2288102600 2024-09-12T01:54:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.823+0000 7f227f7fe640 1 -- 172.21.15.70:0/3521186136 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2280005020 con 0x7f2288102600 2024-09-12T01:54:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.824+0000 7f228f5e6740 1 Processor -- start 2024-09-12T01:54:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.824+0000 7f228f5e6740 1 -- start start 2024-09-12T01:54:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.824+0000 7f228f5e6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 0x560078a33da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.824+0000 7f228f5e6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a342e0 0x560078a38da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.824+0000 7f228f5e6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a39370 0x560078a3b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.824+0000 7f228f5e6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5600789972f0 con 0x560078a339a0 2024-09-12T01:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.824+0000 7f228f5e6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x56007893f270 con 0x560078a342e0 2024-09-12T01:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.824+0000 7f228f5e6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5600789932b0 con 0x560078a39370 2024-09-12T01:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.824+0000 7f227f7fe640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f22740a2c30 0x7f22740a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.824+0000 7f227ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 0x560078a33da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 0x560078a33da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53790/0 (socket says 172.21.15.70:53790) 2024-09-12T01:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227ffff640 1 -- 172.21.15.70:0/2216502845 learned_addr learned my addr 172.21.15.70:0/2216502845 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f228659c640 1 --2- 172.21.15.70:0/2216502845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a342e0 0x560078a38da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f2286d9d640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f22740a2c30 0x7f22740a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227ffff640 1 --2- 172.21.15.70:0/2216502845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a39370 0x560078a3b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227f7fe640 1 -- 172.21.15.70:0/3521186136 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f22800cf750 con 0x7f2288102600 2024-09-12T01:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227ffff640 1 -- 172.21.15.70:0/2216502845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a39370 msgr2=0x560078a3b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227ffff640 1 --2- 172.21.15.70:0/2216502845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a39370 0x560078a3b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227ffff640 1 -- 172.21.15.70:0/2216502845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a342e0 msgr2=0x560078a38da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227ffff640 1 --2- 172.21.15.70:0/2216502845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a342e0 0x560078a38da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227ffff640 1 -- 172.21.15.70:0/2216502845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56007893e340 con 0x560078a339a0 2024-09-12T01:54:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227ffff640 1 --2- 172.21.15.70:0/2216502845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 0x560078a33da0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2270013590 tx=0x7f22700097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138b89440d93cf5b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f2286d9d640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f22740a2c30 0x7f22740a50f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2280011fd0 tx=0x7f2280067020 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227cff9640 1 -- 172.21.15.70:0/2216502845 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227000f520 con 0x560078a339a0 2024-09-12T01:54:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227cff9640 1 -- 172.21.15.70:0/2216502845 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f227000fbc0 con 0x560078a339a0 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.825+0000 7f227cff9640 1 -- 172.21.15.70:0/2216502845 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2270010a00 con 0x560078a339a0 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.826+0000 7f228f5e6740 1 -- 172.21.15.70:0/2216502845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 msgr2=0x560078a33da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.826+0000 7f228f5e6740 1 --2- 172.21.15.70:0/2216502845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 0x560078a33da0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2270013590 tx=0x7f22700097d0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.826+0000 7f228f5e6740 1 -- 172.21.15.70:0/2216502845 shutdown_connections 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.826+0000 7f228f5e6740 1 --2- 172.21.15.70:0/2216502845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a39370 0x560078a3b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.826+0000 7f228f5e6740 1 --2- 172.21.15.70:0/2216502845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a342e0 0x560078a38da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.826+0000 7f228f5e6740 1 --2- 172.21.15.70:0/2216502845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 0x560078a33da0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.826+0000 7f228f5e6740 1 -- 172.21.15.70:0/2216502845 >> 172.21.15.70:0/2216502845 conn(0x560078a2f010 msgr2=0x560078a2f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.826+0000 7f228f5e6740 1 -- 172.21.15.70:0/2216502845 shutdown_connections 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.826+0000 7f228f5e6740 1 -- 172.21.15.70:0/2216502845 wait complete. 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.826+0000 7f228f5e6740 1 -- start start 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f228f5e6740 1 Processor -- start 2024-09-12T01:54:38.834 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f228f5e6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 0x560078a3dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f228f5e6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a342e0 0x560078a3e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f228f5e6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a39370 0x560078a45120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f228f5e6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560078a3c340 con 0x560078a339a0 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f228f5e6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x560078920290 con 0x560078a39370 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f228f5e6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x560078a3c4c0 con 0x560078a342e0 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f228f5e6740 10 client.0 _ll_register_callbacks cb 0x560078951140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f227ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 0x560078a3dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f227ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 0x560078a3dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53804/0 (socket says 172.21.15.70:53804) 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f227ffff640 1 -- 172.21.15.70:0/162385912 learned_addr learned my addr 172.21.15.70:0/162385912 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f228659c640 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a342e0 0x560078a3e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f227ffff640 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a39370 0x560078a45120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f227ffff640 1 -- 172.21.15.70:0/162385912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a342e0 msgr2=0x560078a3e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:38.835 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f227ffff640 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a342e0 0x560078a3e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f227ffff640 1 -- 172.21.15.70:0/162385912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a39370 msgr2=0x560078a45120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f227ffff640 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a39370 0x560078a45120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f227ffff640 1 -- 172.21.15.70:0/162385912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600786aa210 con 0x560078a339a0 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f227ffff640 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 0x560078a3dba0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2270013350 tx=0x7f2270005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ca2477151ad714 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f226dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f226dffb640 1 -- 172.21.15.70:0/162385912 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22700130d0 con 0x560078a339a0 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f226dffb640 1 -- 172.21.15.70:0/162385912 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2270010990 con 0x560078a339a0 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.827+0000 7f228f5e6740 1 -- 172.21.15.70:0/162385912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f227000fbc0 con 0x560078a339a0 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.828+0000 7f226dffb640 1 -- 172.21.15.70:0/162385912 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2270034050 con 0x560078a339a0 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.828+0000 7f228f5e6740 10 client.16365 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.828+0000 7f228f5e6740 1 -- 172.21.15.70:0/162385912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x560078776620 con 0x560078a339a0 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.828+0000 7f226dffb640 1 -- 172.21.15.70:0/162385912 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f227000fbc0 con 0x560078a339a0 2024-09-12T01:54:38.836 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.828+0000 7f226dffb640 1 -- 172.21.15.70:0/162385912 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f227002c020 con 0x560078a339a0 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.828+0000 7f228f5e6740 10 client.16365 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.828+0000 7f228f5e6740 10 client.16365 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.828+0000 7f228f5e6740 20 client.16365 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.828+0000 7f228f5e6740 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560078a49670 0x560078a4ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.828+0000 7f228f5e6740 4 client.16365 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.828+0000 7f228f5e6740 1 -- 172.21.15.70:0/162385912 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600789a4a20 con 0x560078a49670 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.828+0000 7f228659c640 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560078a49670 0x560078a4ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.829+0000 7f228659c640 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560078a49670 0x560078a4ba90 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=902508ca9e36896f server_cookie=72f4de3708801f0f in_seq=0 out_seq=0 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.829+0000 7f226dffb640 10 client.16365 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.829+0000 7f226dffb640 1 -- 172.21.15.70:0/162385912 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600789a4a20 con 0x560078a49670 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.829+0000 7f226dffb640 10 client.16365 handle_command_reply: tid=0 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f228f5e6740 1 client.16365 shutdown 2024-09-12T01:54:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f228f5e6740 1 -- 172.21.15.70:0/162385912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 msgr2=0x560078a3dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:38.838 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f228f5e6740 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 0x560078a3dba0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2270013350 tx=0x7f2270005f90 comp rx=0 tx=0).stop 2024-09-12T01:54:38.838 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f228f5e6740 1 -- 172.21.15.70:0/162385912 shutdown_connections 2024-09-12T01:54:38.838 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f228f5e6740 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560078a49670 0x560078a4ba90 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.838 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f228f5e6740 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a39370 0x560078a45120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.838 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f228f5e6740 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a342e0 0x560078a3e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.838 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f228f5e6740 1 --2- 172.21.15.70:0/162385912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a339a0 0x560078a3dba0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.838 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f226dffb640 0 client.16365 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:38.838 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f228f5e6740 1 -- 172.21.15.70:0/162385912 >> 172.21.15.70:0/162385912 conn(0x560078a2f010 msgr2=0x560078a30820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:38.838 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f228f5e6740 1 -- 172.21.15.70:0/162385912 shutdown_connections 2024-09-12T01:54:38.839 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f228f5e6740 1 -- 172.21.15.70:0/162385912 wait complete. 2024-09-12T01:54:38.839 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.830+0000 7f228f5e6740 20 client.16365 trim_cache size 0 max 16384 2024-09-12T01:54:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.844+0000 7f228f5e6740 1 Processor -- start 2024-09-12T01:54:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.844+0000 7f228f5e6740 1 -- start start 2024-09-12T01:54:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.844+0000 7f228f5e6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a339a0 0x560078a3e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.844+0000 7f228f5e6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 0x560078a2e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.844+0000 7f228f5e6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a39370 0x560078a30630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.844+0000 7f228f5e6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22881a90e0 con 0x560078a342e0 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.844+0000 7f228f5e6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f22881aadd0 con 0x560078a339a0 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.844+0000 7f228f5e6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f22881a9810 con 0x560078a39370 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.844+0000 7f228659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 0x560078a2e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.844+0000 7f228659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 0x560078a2e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53808/0 (socket says 172.21.15.70:53808) 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.844+0000 7f228659c640 1 -- 172.21.15.70:0/2731930561 learned_addr learned my addr 172.21.15.70:0/2731930561 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.845+0000 7f227ffff640 1 --2- 172.21.15.70:0/2731930561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a339a0 0x560078a3e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.845+0000 7f228659c640 1 -- 172.21.15.70:0/2731930561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a39370 msgr2=0x560078a30630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.845+0000 7f228659c640 1 --2- 172.21.15.70:0/2731930561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a39370 0x560078a30630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.845+0000 7f228659c640 1 -- 172.21.15.70:0/2731930561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a339a0 msgr2=0x560078a3e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.845+0000 7f228659c640 1 --2- 172.21.15.70:0/2731930561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a339a0 0x560078a3e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.845+0000 7f228659c640 1 -- 172.21.15.70:0/2731930561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560078a3d6e0 con 0x560078a342e0 2024-09-12T01:54:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.845+0000 7f227ffff640 1 --2- 172.21.15.70:0/2731930561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a339a0 0x560078a3e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.845+0000 7f228659c640 1 --2- 172.21.15.70:0/2731930561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 0x560078a2e9b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2278000c00 tx=0x7f22780058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d21ef5d696e532 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.845+0000 7f226ffff640 1 -- 172.21.15.70:0/2731930561 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278035040 con 0x560078a342e0 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.845+0000 7f226ffff640 1 -- 172.21.15.70:0/2731930561 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2278049070 con 0x560078a342e0 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.845+0000 7f226ffff640 1 -- 172.21.15.70:0/2731930561 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278004920 con 0x560078a342e0 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 -- 172.21.15.70:0/2731930561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 msgr2=0x560078a2e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 --2- 172.21.15.70:0/2731930561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 0x560078a2e9b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2278000c00 tx=0x7f22780058b0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 -- 172.21.15.70:0/2731930561 shutdown_connections 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 --2- 172.21.15.70:0/2731930561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a39370 0x560078a30630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 --2- 172.21.15.70:0/2731930561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 0x560078a2e9b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 --2- 172.21.15.70:0/2731930561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a339a0 0x560078a3e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 -- 172.21.15.70:0/2731930561 >> 172.21.15.70:0/2731930561 conn(0x560078a2f010 msgr2=0x560078a2ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 -- 172.21.15.70:0/2731930561 shutdown_connections 2024-09-12T01:54:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 -- 172.21.15.70:0/2731930561 wait complete. 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 -- start start 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 Processor -- start 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a339a0 0x560078aaf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 0x560078aaf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a39370 0x560078ab6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22881aa640 con 0x560078a342e0 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f22881a9f10 con 0x560078a39370 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f22881a70a0 con 0x560078a339a0 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228f5e6740 10 client.0 _ll_register_callbacks cb 0x7f22800093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 0x560078aaf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 0x560078aaf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53820/0 (socket says 172.21.15.70:53820) 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.846+0000 7f228659c640 1 -- 172.21.15.70:0/3584531874 learned_addr learned my addr 172.21.15.70:0/3584531874 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f227ffff640 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a339a0 0x560078aaf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f227ffff640 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a39370 0x560078ab6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f228659c640 1 -- 172.21.15.70:0/3584531874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a339a0 msgr2=0x560078aaf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f228659c640 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a339a0 0x560078aaf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f228659c640 1 -- 172.21.15.70:0/3584531874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a39370 msgr2=0x560078ab6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f228659c640 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a39370 0x560078ab6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f228659c640 1 -- 172.21.15.70:0/3584531874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560078ab6e30 con 0x560078a342e0 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f228659c640 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 0x560078aaf7e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2278009230 tx=0x7f2278032960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31dbefadf56186a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f226dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f226dffb640 1 -- 172.21.15.70:0/3584531874 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278051070 con 0x560078a342e0 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f226dffb640 1 -- 172.21.15.70:0/3584531874 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2278004450 con 0x560078a342e0 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f228f5e6740 1 -- 172.21.15.70:0/3584531874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2278049070 con 0x560078a342e0 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f226dffb640 1 -- 172.21.15.70:0/3584531874 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f227805d050 con 0x560078a342e0 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f228f5e6740 10 client.16371 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f228f5e6740 1 -- 172.21.15.70:0/3584531874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x560078ab8140 con 0x560078a342e0 2024-09-12T01:54:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f226dffb640 1 -- 172.21.15.70:0/3584531874 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2278049070 con 0x560078a342e0 2024-09-12T01:54:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f226dffb640 1 -- 172.21.15.70:0/3584531874 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f2278056740 con 0x560078a342e0 2024-09-12T01:54:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f228f5e6740 10 client.16371 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f228f5e6740 10 client.16371 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.847+0000 7f228f5e6740 20 client.16371 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.848+0000 7f228f5e6740 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560078ab8b80 0x560078abafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.848+0000 7f228f5e6740 4 client.16371 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:54:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.848+0000 7f228f5e6740 1 -- 172.21.15.70:0/3584531874 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56007899ed70 con 0x560078ab8b80 2024-09-12T01:54:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.848+0000 7f227ffff640 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560078ab8b80 0x560078abafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.848+0000 7f226dffb640 10 client.16371 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.848+0000 7f227ffff640 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560078ab8b80 0x560078abafa0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d804e2bef174b648 server_cookie=b8d61cb57e97f7c0 in_seq=0 out_seq=0 2024-09-12T01:54:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f226dffb640 1 -- 172.21.15.70:0/3584531874 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56007899ed70 con 0x560078ab8b80 2024-09-12T01:54:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f226dffb640 10 client.16371 handle_command_reply: tid=0 2024-09-12T01:54:38.906 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f228f5e6740 1 client.16371 shutdown 2024-09-12T01:54:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f228f5e6740 1 -- 172.21.15.70:0/3584531874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 msgr2=0x560078aaf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f228f5e6740 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 0x560078aaf7e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2278009230 tx=0x7f2278032960 comp rx=0 tx=0).stop 2024-09-12T01:54:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f228f5e6740 1 -- 172.21.15.70:0/3584531874 shutdown_connections 2024-09-12T01:54:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f228f5e6740 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x560078ab8b80 0x560078abafa0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f228f5e6740 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x560078a39370 0x560078ab6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f228f5e6740 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560078a342e0 0x560078aaf7e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f228f5e6740 1 --2- 172.21.15.70:0/3584531874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560078a339a0 0x560078aaf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f226dffb640 0 client.16371 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f228f5e6740 1 -- 172.21.15.70:0/3584531874 >> 172.21.15.70:0/3584531874 conn(0x560078a2f010 msgr2=0x560078a30740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.905+0000 7f228f5e6740 1 -- 172.21.15.70:0/3584531874 shutdown_connections 2024-09-12T01:54:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228f5e6740 1 -- 172.21.15.70:0/3584531874 wait complete. 2024-09-12T01:54:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228f5e6740 20 client.16371 trim_cache size 0 max 16384 2024-09-12T01:54:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:54:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:54:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:54:38.909 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:54:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228c84c640 1 -- 172.21.15.70:0/3521186136 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f22740a2c30 msgr2=0x7f22740a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228c84c640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f22740a2c30 0x7f22740a50f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2280011fd0 tx=0x7f2280067020 comp rx=0 tx=0).stop 2024-09-12T01:54:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228c84c640 1 -- 172.21.15.70:0/3521186136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2288102600 msgr2=0x7f228819f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:38.910 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228c84c640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2288102600 0x7f228819f200 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f228000eb10 tx=0x7f228000c2d0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228c84c640 1 -- 172.21.15.70:0/3521186136 shutdown_connections 2024-09-12T01:54:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228c84c640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f22740a2c30 0x7f22740a50f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228c84c640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2288102600 0x7f228819f200 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228c84c640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2288101c40 0x7f228819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228c84c640 1 --2- 172.21.15.70:0/3521186136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2288100a50 0x7f228806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228c84c640 1 -- 172.21.15.70:0/3521186136 >> 172.21.15.70:0/3521186136 conn(0x7f22880fc1b0 msgr2=0x7f2288104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228c84c640 1 -- 172.21.15.70:0/3521186136 shutdown_connections 2024-09-12T01:54:38.911 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:38.906+0000 7f228c84c640 1 -- 172.21.15.70:0/3521186136 wait complete. 2024-09-12T01:54:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:38 smithi191 ceph-mon[35770]: pgmap v411: 97 pgs: 97 active+clean; 57 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 1.04k op/s 2024-09-12T01:54:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:38 smithi191 ceph-mon[35770]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:39.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:38 smithi152 ceph-mon[35055]: pgmap v411: 97 pgs: 97 active+clean; 57 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 1.04k op/s 2024-09-12T01:54:39.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:38 smithi152 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T01:54:39.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:54:40.194 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:40.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:40 smithi070 ceph-mon[31177]: pgmap v412: 97 pgs: 97 active+clean; 51 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 785 op/s 2024-09-12T01:54:40.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.684+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/2972342013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8106a80 msgr2=0x7fbcb8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.684+0000 7fbcbc9cf640 1 --2- 172.21.15.70:0/2972342013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8106a80 0x7fbcb8106e60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009930 tx=0x7fbcb002a420 comp rx=0 tx=0).stop 2024-09-12T01:54:40.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.684+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/2972342013 shutdown_connections 2024-09-12T01:54:40.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.684+0000 7fbcbc9cf640 1 --2- 172.21.15.70:0/2972342013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcb8101420 0x7fbcb810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.684+0000 7fbcbc9cf640 1 --2- 172.21.15.70:0/2972342013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb8100a80 0x7fbcb8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.684+0000 7fbcbc9cf640 1 --2- 172.21.15.70:0/2972342013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8106a80 0x7fbcb8106e60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.684+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/2972342013 >> 172.21.15.70:0/2972342013 conn(0x7fbcb80fc7a0 msgr2=0x7fbcb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:40.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.684+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/2972342013 shutdown_connections 2024-09-12T01:54:40.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.684+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/2972342013 wait complete. 2024-09-12T01:54:40.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.685+0000 7fbcbc9cf640 1 Processor -- start 2024-09-12T01:54:40.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.685+0000 7fbcbc9cf640 1 -- start start 2024-09-12T01:54:40.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.685+0000 7fbcbc9cf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcb8100a80 0x7fbcb8199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.685+0000 7fbcbc9cf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb8101420 0x7fbcb8199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.685+0000 7fbcbc9cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8106a80 0x7fbcb81a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.685+0000 7fbcbc9cf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb8110fe0 con 0x7fbcb8106a80 2024-09-12T01:54:40.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.685+0000 7fbcbc9cf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb8110e60 con 0x7fbcb8100a80 2024-09-12T01:54:40.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.685+0000 7fbcbc9cf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb8111160 con 0x7fbcb8101420 2024-09-12T01:54:40.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.685+0000 7fbcb6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8106a80 0x7fbcb81a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.685+0000 7fbcb6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8106a80 0x7fbcb81a44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58084/0 (socket says 172.21.15.70:58084) 2024-09-12T01:54:40.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.685+0000 7fbcb6d9d640 1 -- 172.21.15.70:0/1874896493 learned_addr learned my addr 172.21.15.70:0/1874896493 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbcb659c640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcb8100a80 0x7fbcb8199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbcb5d9b640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb8101420 0x7fbcb8199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbcb6d9d640 1 -- 172.21.15.70:0/1874896493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb8101420 msgr2=0x7fbcb8199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbcb6d9d640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb8101420 0x7fbcb8199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbcb6d9d640 1 -- 172.21.15.70:0/1874896493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcb8100a80 msgr2=0x7fbcb8199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbcb6d9d640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcb8100a80 0x7fbcb8199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbcb6d9d640 1 -- 172.21.15.70:0/1874896493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb81a49e0 con 0x7fbcb8106a80 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbcb659c640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcb8100a80 0x7fbcb8199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbcb6d9d640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8106a80 0x7fbcb81a44a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbca800d750 tx=0x7fbca800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbca77fe640 1 -- 172.21.15.70:0/1874896493 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8017070 con 0x7fbcb8106a80 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbca77fe640 1 -- 172.21.15.70:0/1874896493 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbca8005520 con 0x7fbcb8106a80 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/1874896493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb81a4bb0 con 0x7fbcb8106a80 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbca77fe640 1 -- 172.21.15.70:0/1874896493 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8004e00 con 0x7fbcb8106a80 2024-09-12T01:54:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.686+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/1874896493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb81a5070 con 0x7fbcb8106a80 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.689+0000 7fbca77fe640 1 -- 172.21.15.70:0/1874896493 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbca8004fa0 con 0x7fbcb8106a80 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.689+0000 7fbcbeda8740 1 Processor -- start 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.689+0000 7fbcbeda8740 1 -- start start 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.689+0000 7fbcbeda8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5380 0x563ff17d5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.689+0000 7fbcbeda8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 0x563ff17e4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.689+0000 7fbca77fe640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbca00a2b80 0x7fbca00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.689+0000 7fbcbeda8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17e4a90 0x563ff17e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.689+0000 7fbcbeda8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563ff173b2e0 con 0x563ff17d5ca0 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.689+0000 7fbcbeda8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563ff16e2ce0 con 0x563ff17e4a90 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.689+0000 7fbcbeda8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563ff17372a0 con 0x563ff17d5380 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb5d9b640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbca00a2b80 0x7fbca00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbca77fe640 1 -- 172.21.15.70:0/1874896493 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbca80ceb00 con 0x7fbcb8106a80 2024-09-12T01:54:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 0x563ff17e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 0x563ff17e4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58086/0 (socket says 172.21.15.70:58086) 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb659c640 1 -- 172.21.15.70:0/766156860 learned_addr learned my addr 172.21.15.70:0/766156860 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb5d9b640 1 --2- 172.21.15.70:0/766156860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5380 0x563ff17d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb6d9d640 1 --2- 172.21.15.70:0/766156860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17e4a90 0x563ff17e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb659c640 1 -- 172.21.15.70:0/766156860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5380 msgr2=0x563ff17d5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb659c640 1 --2- 172.21.15.70:0/766156860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5380 0x563ff17d5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb659c640 1 -- 172.21.15.70:0/766156860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17e4a90 msgr2=0x563ff17e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb659c640 1 --2- 172.21.15.70:0/766156860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17e4a90 0x563ff17e6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb659c640 1 -- 172.21.15.70:0/766156860 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff16c7440 con 0x563ff17d5ca0 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb5d9b640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbca00a2b80 0x7fbca00a5040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbcb806b2e0 tx=0x7fbcac009e00 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbcb659c640 1 --2- 172.21.15.70:0/766156860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 0x563ff17e4550 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009930 tx=0x7fbcb0032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbbd6638d03a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbca4ff9640 1 -- 172.21.15.70:0/766156860 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb003f070 con 0x563ff17d5ca0 2024-09-12T01:54:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbca4ff9640 1 -- 172.21.15.70:0/766156860 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcb0031840 con 0x563ff17d5ca0 2024-09-12T01:54:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.690+0000 7fbca4ff9640 1 -- 172.21.15.70:0/766156860 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0035070 con 0x563ff17d5ca0 2024-09-12T01:54:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.691+0000 7fbcbeda8740 1 -- 172.21.15.70:0/766156860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 msgr2=0x563ff17e4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.691+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/766156860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 0x563ff17e4550 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009930 tx=0x7fbcb0032d30 comp rx=0 tx=0).stop 2024-09-12T01:54:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.691+0000 7fbcbeda8740 1 -- 172.21.15.70:0/766156860 shutdown_connections 2024-09-12T01:54:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.691+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/766156860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17e4a90 0x563ff17e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.691+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/766156860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 0x563ff17e4550 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.691+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/766156860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5380 0x563ff17d5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.691+0000 7fbcbeda8740 1 -- 172.21.15.70:0/766156860 >> 172.21.15.70:0/766156860 conn(0x563ff17d1a30 msgr2=0x563ff17d1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.691+0000 7fbcbeda8740 1 -- 172.21.15.70:0/766156860 shutdown_connections 2024-09-12T01:54:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.691+0000 7fbcbeda8740 1 -- 172.21.15.70:0/766156860 wait complete. 2024-09-12T01:54:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcbeda8740 1 -- start start 2024-09-12T01:54:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcbeda8740 1 Processor -- start 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcbeda8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5380 0x563ff17e4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcbeda8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 0x563ff17e16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcbeda8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17e4a90 0x563ff17e1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcbeda8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563ff17e7660 con 0x563ff17d5ca0 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcbeda8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x563ff16f6050 con 0x563ff17e4a90 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcbeda8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563ff17e77e0 con 0x563ff17d5380 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcbeda8740 10 client.0 _ll_register_callbacks cb 0x563ff1736160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcb5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 0x563ff17e16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcb5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 0x563ff17e16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58098/0 (socket says 172.21.15.70:58098) 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcb5d9b640 1 -- 172.21.15.70:0/1161840883 learned_addr learned my addr 172.21.15.70:0/1161840883 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcb6d9d640 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17e4a90 0x563ff17e1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcb659c640 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5380 0x563ff17e4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcb5d9b640 1 -- 172.21.15.70:0/1161840883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5380 msgr2=0x563ff17e4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcb5d9b640 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5380 0x563ff17e4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcb5d9b640 1 -- 172.21.15.70:0/1161840883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17e4a90 msgr2=0x563ff17e1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcb5d9b640 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17e4a90 0x563ff17e1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcb5d9b640 1 -- 172.21.15.70:0/1161840883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff14ac3c0 con 0x563ff17d5ca0 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.692+0000 7fbcb6d9d640 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17e4a90 0x563ff17e1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbcb5d9b640 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 0x563ff17e16d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00ae80 tx=0x7fbcac0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdca2b4150ce81a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbc9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbc9dffb640 1 -- 172.21.15.70:0/1161840883 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac028060 con 0x563ff17d5ca0 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbc9dffb640 1 -- 172.21.15.70:0/1161840883 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbcac009810 con 0x563ff17d5ca0 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbcbeda8740 1 -- 172.21.15.70:0/1161840883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcb0031840 con 0x563ff17d5ca0 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbc9dffb640 1 -- 172.21.15.70:0/1161840883 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fbcac013040 con 0x563ff17d5ca0 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbcbeda8740 10 client.16383 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbcbeda8740 1 -- 172.21.15.70:0/1161840883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x563ff17f3090 con 0x563ff17d5ca0 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbc9dffb640 1 -- 172.21.15.70:0/1161840883 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcb0031840 con 0x563ff17d5ca0 2024-09-12T01:54:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbc9dffb640 1 -- 172.21.15.70:0/1161840883 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fbcac02d070 con 0x563ff17d5ca0 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbcbeda8740 10 client.16383 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbcbeda8740 10 client.16383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbcbeda8740 20 client.16383 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x563ff17f45c0 0x563ff17f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbcbeda8740 4 client.16383 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.693+0000 7fbcbeda8740 1 -- 172.21.15.70:0/1161840883 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ff1748850 con 0x563ff17f45c0 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.694+0000 7fbcb659c640 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x563ff17f45c0 0x563ff17f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.694+0000 7fbc9dffb640 10 client.16383 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.694+0000 7fbcb659c640 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x563ff17f45c0 0x563ff17f6a00 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f5c7863a256bd33 server_cookie=133e3aea68235cad in_seq=0 out_seq=0 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbc9dffb640 1 -- 172.21.15.70:0/1161840883 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ff1748850 con 0x563ff17f45c0 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbc9dffb640 10 client.16383 handle_command_reply: tid=0 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbcbeda8740 1 client.16383 shutdown 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbcbeda8740 1 -- 172.21.15.70:0/1161840883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 msgr2=0x563ff17e16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 0x563ff17e16d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00ae80 tx=0x7fbcac0093d0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbcbeda8740 1 -- 172.21.15.70:0/1161840883 shutdown_connections 2024-09-12T01:54:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x563ff17f45c0 0x563ff17f6a00 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17e4a90 0x563ff17e1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5ca0 0x563ff17e16d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/1161840883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5380 0x563ff17e4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbcbeda8740 1 -- 172.21.15.70:0/1161840883 >> 172.21.15.70:0/1161840883 conn(0x563ff17d1a30 msgr2=0x563ff17d7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbc9dffb640 0 client.16383 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbcbeda8740 1 -- 172.21.15.70:0/1161840883 shutdown_connections 2024-09-12T01:54:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbcbeda8740 1 -- 172.21.15.70:0/1161840883 wait complete. 2024-09-12T01:54:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.695+0000 7fbcbeda8740 20 client.16383 trim_cache size 0 max 16384 2024-09-12T01:54:40.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcbeda8740 1 Processor -- start 2024-09-12T01:54:40.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcbeda8740 1 -- start start 2024-09-12T01:54:40.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcbeda8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5380 0x563ff17f0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcbeda8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17d5ca0 0x563ff17fc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcbeda8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17e4a90 0x563ff17fc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcbeda8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81ab490 con 0x563ff17d5380 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcbeda8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81ad180 con 0x563ff17d5ca0 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcbeda8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81abbc0 con 0x563ff17e4a90 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcb659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5380 0x563ff17f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcb659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5380 0x563ff17f0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58110/0 (socket says 172.21.15.70:58110) 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcb659c640 1 -- 172.21.15.70:0/2635748980 learned_addr learned my addr 172.21.15.70:0/2635748980 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcb6d9d640 1 --2- 172.21.15.70:0/2635748980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17e4a90 0x563ff17fc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcb659c640 1 -- 172.21.15.70:0/2635748980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17e4a90 msgr2=0x563ff17fc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcb659c640 1 --2- 172.21.15.70:0/2635748980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17e4a90 0x563ff17fc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcb659c640 1 -- 172.21.15.70:0/2635748980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17d5ca0 msgr2=0x563ff17fc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcb659c640 1 --2- 172.21.15.70:0/2635748980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17d5ca0 0x563ff17fc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcb659c640 1 -- 172.21.15.70:0/2635748980 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff17d1860 con 0x563ff17d5380 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.712+0000 7fbcb6d9d640 1 --2- 172.21.15.70:0/2635748980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17e4a90 0x563ff17fc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbcb659c640 1 --2- 172.21.15.70:0/2635748980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5380 0x563ff17f0900 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0033000 tx=0x7fbcb0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b01afdf4b7ca2df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbc9ffff640 1 -- 172.21.15.70:0/2635748980 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb003f050 con 0x563ff17d5380 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbc9ffff640 1 -- 172.21.15.70:0/2635748980 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcb0050070 con 0x563ff17d5380 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbc9ffff640 1 -- 172.21.15.70:0/2635748980 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0035040 con 0x563ff17d5380 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbcbeda8740 1 -- 172.21.15.70:0/2635748980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5380 msgr2=0x563ff17f0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/2635748980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5380 0x563ff17f0900 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0033000 tx=0x7fbcb0000bc0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbcbeda8740 1 -- 172.21.15.70:0/2635748980 shutdown_connections 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/2635748980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17e4a90 0x563ff17fc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/2635748980 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17d5ca0 0x563ff17fc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/2635748980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17d5380 0x563ff17f0900 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbcbeda8740 1 -- 172.21.15.70:0/2635748980 >> 172.21.15.70:0/2635748980 conn(0x563ff17d1a30 msgr2=0x563ff17dcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbcbeda8740 1 -- 172.21.15.70:0/2635748980 shutdown_connections 2024-09-12T01:54:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.713+0000 7fbcbeda8740 1 -- 172.21.15.70:0/2635748980 wait complete. 2024-09-12T01:54:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcbeda8740 1 -- start start 2024-09-12T01:54:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcbeda8740 1 Processor -- start 2024-09-12T01:54:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcbeda8740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17d5380 0x563ff17ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcbeda8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5ca0 0x563ff17ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcbeda8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17e4a90 0x563ff17e8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcbeda8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81ac9f0 con 0x563ff17e4a90 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcbeda8740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81ac2c0 con 0x563ff17d5380 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcbeda8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81a9450 con 0x563ff17d5ca0 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcbeda8740 10 client.0 _ll_register_callbacks cb 0x7fbcac009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcb6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17e4a90 0x563ff17e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcb6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17e4a90 0x563ff17e8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58114/0 (socket says 172.21.15.70:58114) 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcb6d9d640 1 -- 172.21.15.70:0/3706778513 learned_addr learned my addr 172.21.15.70:0/3706778513 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcb659c640 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17d5380 0x563ff17ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcb5d9b640 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5ca0 0x563ff17ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcb6d9d640 1 -- 172.21.15.70:0/3706778513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5ca0 msgr2=0x563ff17ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcb6d9d640 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5ca0 0x563ff17ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcb6d9d640 1 -- 172.21.15.70:0/3706778513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17d5380 msgr2=0x563ff17ecd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcb6d9d640 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17d5380 0x563ff17ecd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.714+0000 7fbcb6d9d640 1 -- 172.21.15.70:0/3706778513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff17e8970 con 0x563ff17e4a90 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbcb6d9d640 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17e4a90 0x563ff17e8140 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fbca809b010 tx=0x7fbca80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c6731e58494e16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbc9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbc9dffb640 1 -- 172.21.15.70:0/3706778513 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8020040 con 0x563ff17e4a90 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbc9dffb640 1 -- 172.21.15.70:0/3706778513 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbca8009cf0 con 0x563ff17e4a90 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbcbeda8740 1 -- 172.21.15.70:0/3706778513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcb0050070 con 0x563ff17e4a90 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbc9dffb640 1 -- 172.21.15.70:0/3706778513 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fbca809ba60 con 0x563ff17e4a90 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbcbeda8740 10 client.16389 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbcbeda8740 1 -- 172.21.15.70:0/3706778513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x563ff185eed0 con 0x563ff17e4a90 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbc9dffb640 1 -- 172.21.15.70:0/3706778513 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcb0050070 con 0x563ff17e4a90 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbc9dffb640 1 -- 172.21.15.70:0/3706778513 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fbca80b4920 con 0x563ff17e4a90 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbcbeda8740 10 client.16389 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbcbeda8740 10 client.16389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbcbeda8740 20 client.16389 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x563ff185f6b0 0x563ff1861ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbcbeda8740 4 client.16389 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.715+0000 7fbcbeda8740 1 -- 172.21.15.70:0/3706778513 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563ff1742d60 con 0x563ff185f6b0 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbcb659c640 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x563ff185f6b0 0x563ff1861ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbcb659c640 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x563ff185f6b0 0x563ff1861ad0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31c0d30e0dbde261 server_cookie=ebdd1e505471b8d8 in_seq=0 out_seq=0 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbc9dffb640 10 client.16389 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbc9dffb640 1 -- 172.21.15.70:0/3706778513 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563ff1742d60 con 0x563ff185f6b0 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbc9dffb640 10 client.16389 handle_command_reply: tid=0 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbcbeda8740 1 client.16389 shutdown 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbcbeda8740 1 -- 172.21.15.70:0/3706778513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17e4a90 msgr2=0x563ff17e8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17e4a90 0x563ff17e8140 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fbca809b010 tx=0x7fbca80046c0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbcbeda8740 1 -- 172.21.15.70:0/3706778513 shutdown_connections 2024-09-12T01:54:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x563ff185f6b0 0x563ff1861ad0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ff17e4a90 0x563ff17e8140 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563ff17d5ca0 0x563ff17ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbcbeda8740 1 --2- 172.21.15.70:0/3706778513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563ff17d5380 0x563ff17ecd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbcbeda8740 1 -- 172.21.15.70:0/3706778513 >> 172.21.15.70:0/3706778513 conn(0x563ff17d1a30 msgr2=0x563ff17dffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:40.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.716+0000 7fbc9dffb640 0 client.16389 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:40.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbeda8740 1 -- 172.21.15.70:0/3706778513 shutdown_connections 2024-09-12T01:54:40.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbeda8740 1 -- 172.21.15.70:0/3706778513 wait complete. 2024-09-12T01:54:40.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbeda8740 20 client.16389 trim_cache size 0 max 16384 2024-09-12T01:54:40.722 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:54:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-12T01:54:40.723 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-12T01:54:40.723 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:54:40.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/1874896493 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbca00a2b80 msgr2=0x7fbca00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbc9cf640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbca00a2b80 0x7fbca00a5040 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbcb806b2e0 tx=0x7fbcac009e00 comp rx=0 tx=0).stop 2024-09-12T01:54:40.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/1874896493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8106a80 msgr2=0x7fbcb81a44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:40.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbc9cf640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8106a80 0x7fbcb81a44a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbca800d750 tx=0x7fbca800dc10 comp rx=0 tx=0).stop 2024-09-12T01:54:40.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/1874896493 shutdown_connections 2024-09-12T01:54:40.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbc9cf640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbca00a2b80 0x7fbca00a5040 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbc9cf640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbcb8106a80 0x7fbcb81a44a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbc9cf640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb8101420 0x7fbcb8199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbc9cf640 1 --2- 172.21.15.70:0/1874896493 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbcb8100a80 0x7fbcb8199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:40.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/1874896493 >> 172.21.15.70:0/1874896493 conn(0x7fbcb80fc7a0 msgr2=0x7fbcb80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:40.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/1874896493 shutdown_connections 2024-09-12T01:54:40.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:40.717+0000 7fbcbc9cf640 1 -- 172.21.15.70:0/1874896493 wait complete. 2024-09-12T01:54:40.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:40 smithi191 ceph-mon[35770]: pgmap v412: 97 pgs: 97 active+clean; 51 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 785 op/s 2024-09-12T01:54:41.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:40 smithi152 ceph-mon[35055]: pgmap v412: 97 pgs: 97 active+clean; 51 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 785 op/s 2024-09-12T01:54:41.522 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:54:41.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:41.770 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:42.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.208+0000 7ff2b0d01640 1 -- 172.21.15.70:0/2827899610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ac102ef0 msgr2=0x7ff2ac10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:42.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.208+0000 7ff2b0d01640 1 --2- 172.21.15.70:0/2827899610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ac102ef0 0x7ff2ac10da40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009ca0 tx=0x7ff2a402a950 comp rx=0 tx=0).stop 2024-09-12T01:54:42.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.208+0000 7ff2b0d01640 1 -- 172.21.15.70:0/2827899610 shutdown_connections 2024-09-12T01:54:42.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.208+0000 7ff2b0d01640 1 --2- 172.21.15.70:0/2827899610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ac102ef0 0x7ff2ac10da40 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.208+0000 7ff2b0d01640 1 --2- 172.21.15.70:0/2827899610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2ac102570 0x7ff2ac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.208+0000 7ff2b0d01640 1 --2- 172.21.15.70:0/2827899610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2ac100e20 0x7ff2ac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.208+0000 7ff2b0d01640 1 -- 172.21.15.70:0/2827899610 >> 172.21.15.70:0/2827899610 conn(0x7ff2ac0fc7d0 msgr2=0x7ff2ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:42.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.208+0000 7ff2b0d01640 1 -- 172.21.15.70:0/2827899610 shutdown_connections 2024-09-12T01:54:42.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.208+0000 7ff2b0d01640 1 -- 172.21.15.70:0/2827899610 wait complete. 2024-09-12T01:54:42.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.209+0000 7ff2b0d01640 1 Processor -- start 2024-09-12T01:54:42.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.209+0000 7ff2b0d01640 1 -- start start 2024-09-12T01:54:42.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.209+0000 7ff2b0d01640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2ac100e20 0x7ff2ac199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:42.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.209+0000 7ff2b0d01640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2ac102570 0x7ff2ac1999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:42.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.209+0000 7ff2b0d01640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ac102ef0 0x7ff2ac1a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:42.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.209+0000 7ff2b0d01640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac1110a0 con 0x7ff2ac102ef0 2024-09-12T01:54:42.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.209+0000 7ff2b0d01640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac110f20 con 0x7ff2ac100e20 2024-09-12T01:54:42.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.209+0000 7ff2b0d01640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac111220 con 0x7ff2ac102570 2024-09-12T01:54:42.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.209+0000 7ff2aad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ac102ef0 0x7ff2ac1a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:42.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.209+0000 7ff2aad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ac102ef0 0x7ff2ac1a44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58140/0 (socket says 172.21.15.70:58140) 2024-09-12T01:54:42.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.209+0000 7ff2aad9d640 1 -- 172.21.15.70:0/940701269 learned_addr learned my addr 172.21.15.70:0/940701269 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.209+0000 7ff2aa59c640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2ac100e20 0x7ff2ac199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.210+0000 7ff2aad9d640 1 -- 172.21.15.70:0/940701269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2ac102570 msgr2=0x7ff2ac1999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.210+0000 7ff2aad9d640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2ac102570 0x7ff2ac1999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.210+0000 7ff2aad9d640 1 -- 172.21.15.70:0/940701269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2ac100e20 msgr2=0x7ff2ac199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.210+0000 7ff2aad9d640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2ac100e20 0x7ff2ac199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.210+0000 7ff2aad9d640 1 -- 172.21.15.70:0/940701269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ac1a4a30 con 0x7ff2ac102ef0 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.210+0000 7ff2aa59c640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2ac100e20 0x7ff2ac199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.210+0000 7ff2aad9d640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ac102ef0 0x7ff2ac1a44f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4005cc0 tx=0x7ff2a402f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.210+0000 7ff2a37fe640 1 -- 172.21.15.70:0/940701269 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4034040 con 0x7ff2ac102ef0 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.210+0000 7ff2a37fe640 1 -- 172.21.15.70:0/940701269 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2a4030940 con 0x7ff2ac102ef0 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.210+0000 7ff2b0d01640 1 -- 172.21.15.70:0/940701269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ac1a4c00 con 0x7ff2ac102ef0 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.210+0000 7ff2a37fe640 1 -- 172.21.15.70:0/940701269 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40456e0 con 0x7ff2ac102ef0 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.210+0000 7ff2b0d01640 1 -- 172.21.15.70:0/940701269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ac1a5050 con 0x7ff2ac102ef0 2024-09-12T01:54:42.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.211+0000 7ff2b0d01640 1 -- 172.21.15.70:0/940701269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2ac101200 con 0x7ff2ac102ef0 2024-09-12T01:54:42.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.212+0000 7ff2a37fe640 1 -- 172.21.15.70:0/940701269 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff2a4037020 con 0x7ff2ac102ef0 2024-09-12T01:54:42.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.213+0000 7ff2a37fe640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff2980a2b80 0x7ff2980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:42.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.213+0000 7ff2aa59c640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff2980a2b80 0x7ff2980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:42.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.213+0000 7ff2a37fe640 1 -- 172.21.15.70:0/940701269 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff2a40f00f0 con 0x7ff2ac102ef0 2024-09-12T01:54:42.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.213+0000 7ff2aa59c640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff2980a2b80 0x7ff2980a5040 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff29c005fd0 tx=0x7ff29c00b5f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:42.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.217+0000 7ff2a37fe640 1 -- 172.21.15.70:0/940701269 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2a40bd050 con 0x7ff2ac102ef0 2024-09-12T01:54:42.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.420+0000 7ff2b0d01640 1 -- 172.21.15.70:0/940701269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2ac1a5280 con 0x7ff2ac102ef0 2024-09-12T01:54:42.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.420+0000 7ff2a37fe640 1 -- 172.21.15.70:0/940701269 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11994 (secure 0 0 0) 0x7ff2a40bc950 con 0x7ff2ac102ef0 2024-09-12T01:54:42.421 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:54:42.421 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"btime":"2024-09-12T01:54:37:622268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:54:36.766931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:54:42.421 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 37 2024-09-12T01:54:42.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.423+0000 7ff2b0d01640 1 -- 172.21.15.70:0/940701269 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff2980a2b80 msgr2=0x7ff2980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:42.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.423+0000 7ff2b0d01640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff2980a2b80 0x7ff2980a5040 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff29c005fd0 tx=0x7ff29c00b5f0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.423+0000 7ff2b0d01640 1 -- 172.21.15.70:0/940701269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ac102ef0 msgr2=0x7ff2ac1a44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:42.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.423+0000 7ff2b0d01640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ac102ef0 0x7ff2ac1a44f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4005cc0 tx=0x7ff2a402f790 comp rx=0 tx=0).stop 2024-09-12T01:54:42.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.423+0000 7ff2b0d01640 1 -- 172.21.15.70:0/940701269 shutdown_connections 2024-09-12T01:54:42.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.423+0000 7ff2b0d01640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff2980a2b80 0x7ff2980a5040 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.423+0000 7ff2b0d01640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ac102ef0 0x7ff2ac1a44f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.423+0000 7ff2b0d01640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2ac102570 0x7ff2ac1999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.423+0000 7ff2b0d01640 1 --2- 172.21.15.70:0/940701269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2ac100e20 0x7ff2ac199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.423+0000 7ff2b0d01640 1 -- 172.21.15.70:0/940701269 >> 172.21.15.70:0/940701269 conn(0x7ff2ac0fc7d0 msgr2=0x7ff2ac106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:42.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.423+0000 7ff2b0d01640 1 -- 172.21.15.70:0/940701269 shutdown_connections 2024-09-12T01:54:42.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:42.423+0000 7ff2b0d01640 1 -- 172.21.15.70:0/940701269 wait complete. 2024-09-12T01:54:42.934 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:42 smithi070 ceph-mon[31177]: pgmap v413: 97 pgs: 97 active+clean; 45 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 587 op/s 2024-09-12T01:54:42.934 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:42 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/940701269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:42.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:42 smithi191 ceph-mon[35770]: pgmap v413: 97 pgs: 97 active+clean; 45 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 587 op/s 2024-09-12T01:54:42.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:42 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/940701269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:43.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:42 smithi152 ceph-mon[35055]: pgmap v413: 97 pgs: 97 active+clean; 45 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 587 op/s 2024-09-12T01:54:43.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:42 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/940701269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:43.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:54:43.581 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.036+0000 7f250a2de640 1 -- 172.21.15.70:0/3645870091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504106f10 msgr2=0x7f250410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.036+0000 7f250a2de640 1 --2- 172.21.15.70:0/3645870091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504106f10 0x7f250410ea90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009ca0 tx=0x7f24fc02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.036+0000 7f250a2de640 1 -- 172.21.15.70:0/3645870091 shutdown_connections 2024-09-12T01:54:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.036+0000 7f250a2de640 1 --2- 172.21.15.70:0/3645870091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504106f10 0x7f250410ea90 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.036+0000 7f250a2de640 1 --2- 172.21.15.70:0/3645870091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2504102790 0x7f25041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.036+0000 7f250a2de640 1 --2- 172.21.15.70:0/3645870091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2504101de0 0x7f25041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.036+0000 7f250a2de640 1 -- 172.21.15.70:0/3645870091 >> 172.21.15.70:0/3645870091 conn(0x7f25040fd8c0 msgr2=0x7f25040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.036+0000 7f250a2de640 1 -- 172.21.15.70:0/3645870091 shutdown_connections 2024-09-12T01:54:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.036+0000 7f250a2de640 1 -- 172.21.15.70:0/3645870091 wait complete. 2024-09-12T01:54:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.036+0000 7f250a2de640 1 Processor -- start 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f250a2de640 1 -- start start 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f250a2de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2504101de0 0x7f25040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f250a2de640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102790 0x7f2504074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f250a2de640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2504106f10 0x7f2504074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f250a2de640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2504112150 con 0x7f2504102790 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f250a2de640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2504111fd0 con 0x7f2504101de0 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f250a2de640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f25041122d0 con 0x7f2504106f10 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f25037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102790 0x7f2504074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f25037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102790 0x7f2504074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58152/0 (socket says 172.21.15.70:58152) 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f25037fe640 1 -- 172.21.15.70:0/1030000950 learned_addr learned my addr 172.21.15.70:0/1030000950 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f2503fff640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2504101de0 0x7f25040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f250887b640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2504106f10 0x7f2504074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f25037fe640 1 -- 172.21.15.70:0/1030000950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2504106f10 msgr2=0x7f2504074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f25037fe640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2504106f10 0x7f2504074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f25037fe640 1 -- 172.21.15.70:0/1030000950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2504101de0 msgr2=0x7f25040744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f25037fe640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2504101de0 0x7f25040744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f25037fe640 1 -- 172.21.15.70:0/1030000950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25041a6ad0 con 0x7f2504102790 2024-09-12T01:54:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.037+0000 7f2503fff640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2504101de0 0x7f25040744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.038+0000 7f25037fe640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102790 0x7f2504074a30 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f24f800b4a0 tx=0x7f24f800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.038+0000 7f25017fa640 1 -- 172.21.15.70:0/1030000950 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8014070 con 0x7f2504102790 2024-09-12T01:54:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.038+0000 7f25017fa640 1 -- 172.21.15.70:0/1030000950 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24f8010b10 con 0x7f2504102790 2024-09-12T01:54:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.038+0000 7f250a2de640 1 -- 172.21.15.70:0/1030000950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25041a6dc0 con 0x7f2504102790 2024-09-12T01:54:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.038+0000 7f25017fa640 1 -- 172.21.15.70:0/1030000950 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8017d60 con 0x7f2504102790 2024-09-12T01:54:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.038+0000 7f250a2de640 1 -- 172.21.15.70:0/1030000950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25041a7220 con 0x7f2504102790 2024-09-12T01:54:44.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.040+0000 7f25017fa640 1 -- 172.21.15.70:0/1030000950 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f24f8017070 con 0x7f2504102790 2024-09-12T01:54:44.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.040+0000 7f250c6b7740 1 Processor -- start 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.040+0000 7f250c6b7740 1 -- start start 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f25017fa640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24ec0a2b80 0x7f24ec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f250c6b7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200ee7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f250c6b7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200ee7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f250c6b7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 0x55e200ef4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f250c6b7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e200e4d2f0 con 0x55e200ee8b40 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f250c6b7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e200df4cf0 con 0x55e200ee75d0 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f250c6b7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e200e492b0 con 0x55e200ef2370 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f250887b640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24ec0a2b80 0x7f24ec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f25017fa640 1 -- 172.21.15.70:0/1030000950 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f24f80ce4f0 con 0x7f2504102790 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f2503fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200ee7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f2503fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200ee7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58166/0 (socket says 172.21.15.70:58166) 2024-09-12T01:54:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f2503fff640 1 -- 172.21.15.70:0/2381775466 learned_addr learned my addr 172.21.15.70:0/2381775466 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f250887b640 1 --2- 172.21.15.70:0/2381775466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 0x55e200ef4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f2503fff640 1 -- 172.21.15.70:0/2381775466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 msgr2=0x55e200ef4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f2503fff640 1 --2- 172.21.15.70:0/2381775466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 0x55e200ef4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f25037fe640 1 --2- 172.21.15.70:0/2381775466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200ee7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f2503fff640 1 -- 172.21.15.70:0/2381775466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 msgr2=0x55e200ee7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f2503fff640 1 --2- 172.21.15.70:0/2381775466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200ee7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f2503fff640 1 -- 172.21.15.70:0/2381775466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e200dd93a0 con 0x55e200ee8b40 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f25037fe640 1 --2- 172.21.15.70:0/2381775466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200ee7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f250887b640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24ec0a2b80 0x7f24ec0a5040 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f24fc006010 tx=0x7f24fc031c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.041+0000 7f2503fff640 1 --2- 172.21.15.70:0/2381775466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200ee7090 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f24f4007850 tx=0x7f24f4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704b96e7a413d0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.042+0000 7f24ea7fc640 1 -- 172.21.15.70:0/2381775466 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f400d950 con 0x55e200ee8b40 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.042+0000 7f24ea7fc640 1 -- 172.21.15.70:0/2381775466 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24f4018070 con 0x55e200ee8b40 2024-09-12T01:54:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.042+0000 7f24ea7fc640 1 -- 172.21.15.70:0/2381775466 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f40123e0 con 0x55e200ee8b40 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.042+0000 7f250c6b7740 1 -- 172.21.15.70:0/2381775466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 msgr2=0x55e200ee7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.042+0000 7f250c6b7740 1 --2- 172.21.15.70:0/2381775466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200ee7090 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f24f4007850 tx=0x7f24f4007d10 comp rx=0 tx=0).stop 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.042+0000 7f250c6b7740 1 -- 172.21.15.70:0/2381775466 shutdown_connections 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.042+0000 7f250c6b7740 1 --2- 172.21.15.70:0/2381775466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 0x55e200ef4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.042+0000 7f250c6b7740 1 --2- 172.21.15.70:0/2381775466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200ee7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.042+0000 7f250c6b7740 1 --2- 172.21.15.70:0/2381775466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200ee7090 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.042+0000 7f250c6b7740 1 -- 172.21.15.70:0/2381775466 >> 172.21.15.70:0/2381775466 conn(0x55e200eb0310 msgr2=0x55e200ee3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.042+0000 7f250c6b7740 1 -- 172.21.15.70:0/2381775466 shutdown_connections 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.042+0000 7f250c6b7740 1 -- 172.21.15.70:0/2381775466 wait complete. 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f250c6b7740 1 -- start start 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f250c6b7740 1 Processor -- start 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f250c6b7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200ef1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f250c6b7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200eeef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f250c6b7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 0x55e200eef490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f250c6b7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e200ef5070 con 0x55e200ee8b40 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f250c6b7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55e200e08060 con 0x55e200ee75d0 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f250c6b7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55e200ef51f0 con 0x55e200ef2370 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f250c6b7740 10 client.0 _ll_register_callbacks cb 0x55e200b5b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f25037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200eeef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f25037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200eeef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58180/0 (socket says 172.21.15.70:58180) 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f25037fe640 1 -- 172.21.15.70:0/1824337771 learned_addr learned my addr 172.21.15.70:0/1824337771 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f2503fff640 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200ef1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.043+0000 7f250887b640 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 0x55e200eef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f25037fe640 1 -- 172.21.15.70:0/1824337771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 msgr2=0x55e200eef490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f25037fe640 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 0x55e200eef490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f25037fe640 1 -- 172.21.15.70:0/1824337771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 msgr2=0x55e200ef1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f25037fe640 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200ef1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f25037fe640 1 -- 172.21.15.70:0/1824337771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e200bbe3c0 con 0x55e200ee8b40 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f25037fe640 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200eeef50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f24f80a3450 tx=0x7f24f809b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7287cbe09b60ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f24e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f24e37fe640 1 -- 172.21.15.70:0/1824337771 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f801e070 con 0x55e200ee8b40 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f24e37fe640 1 -- 172.21.15.70:0/1824337771 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f24f8010cc0 con 0x55e200ee8b40 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f250c6b7740 1 -- 172.21.15.70:0/1824337771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24f4018070 con 0x55e200ee8b40 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f24e37fe640 1 -- 172.21.15.70:0/1824337771 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f24f80a3980 con 0x55e200ee8b40 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f250c6b7740 10 client.16407 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f250c6b7740 1 -- 172.21.15.70:0/1824337771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e200f00a60 con 0x55e200ee8b40 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f24e37fe640 1 -- 172.21.15.70:0/1824337771 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24f4018070 con 0x55e200ee8b40 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f24e37fe640 1 -- 172.21.15.70:0/1824337771 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f24f809a160 con 0x55e200ee8b40 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f250c6b7740 10 client.16407 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.044+0000 7f250c6b7740 10 client.16407 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T01:54:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.045+0000 7f250c6b7740 20 client.16407 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.045+0000 7f250c6b7740 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55e200f01f60 0x55e200f04400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.045+0000 7f250c6b7740 4 client.16407 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.045+0000 7f250c6b7740 1 -- 172.21.15.70:0/1824337771 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e200e5a860 con 0x55e200f01f60 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.045+0000 7f2503fff640 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55e200f01f60 0x55e200f04400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.045+0000 7f24e37fe640 10 client.16407 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.045+0000 7f2503fff640 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55e200f01f60 0x55e200f04400 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ef97f9388679bbbb server_cookie=8e25c16be8e68a92 in_seq=0 out_seq=0 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.046+0000 7f24e37fe640 1 -- 172.21.15.70:0/1824337771 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e200e5a860 con 0x55e200f01f60 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.046+0000 7f24e37fe640 10 client.16407 handle_command_reply: tid=0 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.046+0000 7f250c6b7740 1 client.16407 shutdown 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.046+0000 7f250c6b7740 1 -- 172.21.15.70:0/1824337771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 msgr2=0x55e200eeef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.046+0000 7f250c6b7740 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200eeef50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f24f80a3450 tx=0x7f24f809b4d0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.046+0000 7f250c6b7740 1 -- 172.21.15.70:0/1824337771 shutdown_connections 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.046+0000 7f250c6b7740 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55e200f01f60 0x55e200f04400 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.046+0000 7f250c6b7740 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 0x55e200eef490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.046+0000 7f250c6b7740 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200eeef50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.046+0000 7f24e37fe640 0 client.16407 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:54:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.046+0000 7f250c6b7740 1 --2- 172.21.15.70:0/1824337771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200ef1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.046+0000 7f250c6b7740 1 -- 172.21.15.70:0/1824337771 >> 172.21.15.70:0/1824337771 conn(0x55e200eb0310 msgr2=0x55e200ee9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.047+0000 7f250c6b7740 1 -- 172.21.15.70:0/1824337771 shutdown_connections 2024-09-12T01:54:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.047+0000 7f250c6b7740 1 -- 172.21.15.70:0/1824337771 wait complete. 2024-09-12T01:54:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.047+0000 7f250c6b7740 20 client.16407 trim_cache size 0 max 16384 2024-09-12T01:54:44.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.059+0000 7f250c6b7740 1 Processor -- start 2024-09-12T01:54:44.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.059+0000 7f250c6b7740 1 -- start start 2024-09-12T01:54:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f250c6b7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200efe340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f250c6b7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200eea120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f250c6b7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 0x55e200eea660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f250c6b7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f25041af950 con 0x55e200ee8b40 2024-09-12T01:54:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f250c6b7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f25041b1640 con 0x55e200ee75d0 2024-09-12T01:54:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f250c6b7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f25041b0080 con 0x55e200ef2370 2024-09-12T01:54:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f25037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200eea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f25037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200eea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58188/0 (socket says 172.21.15.70:58188) 2024-09-12T01:54:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f25037fe640 1 -- 172.21.15.70:0/2784878557 learned_addr learned my addr 172.21.15.70:0/2784878557 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f2503fff640 1 --2- 172.21.15.70:0/2784878557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200efe340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f250887b640 1 --2- 172.21.15.70:0/2784878557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 0x55e200eea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f25037fe640 1 -- 172.21.15.70:0/2784878557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 msgr2=0x55e200eea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f25037fe640 1 --2- 172.21.15.70:0/2784878557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 0x55e200eea660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f25037fe640 1 -- 172.21.15.70:0/2784878557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 msgr2=0x55e200efe340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f25037fe640 1 --2- 172.21.15.70:0/2784878557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200efe340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f25037fe640 1 -- 172.21.15.70:0/2784878557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e200eef7c0 con 0x55e200ee8b40 2024-09-12T01:54:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f25037fe640 1 --2- 172.21.15.70:0/2784878557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200eea120 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f24f80976e0 tx=0x7f24f8099220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55368e938cbd577 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f24e9ffb640 1 -- 172.21.15.70:0/2784878557 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f801e050 con 0x55e200ee8b40 2024-09-12T01:54:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f24e9ffb640 1 -- 172.21.15.70:0/2784878557 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24f80173f0 con 0x55e200ee8b40 2024-09-12T01:54:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.060+0000 7f24e9ffb640 1 -- 172.21.15.70:0/2784878557 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f80ce0d0 con 0x55e200ee8b40 2024-09-12T01:54:44.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.061+0000 7f250c6b7740 1 -- 172.21.15.70:0/2784878557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 msgr2=0x55e200eea120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:44.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.061+0000 7f250c6b7740 1 --2- 172.21.15.70:0/2784878557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200eea120 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f24f80976e0 tx=0x7f24f8099220 comp rx=0 tx=0).stop 2024-09-12T01:54:44.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.061+0000 7f250c6b7740 1 -- 172.21.15.70:0/2784878557 shutdown_connections 2024-09-12T01:54:44.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.061+0000 7f250c6b7740 1 --2- 172.21.15.70:0/2784878557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ef2370 0x55e200eea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.061+0000 7f250c6b7740 1 --2- 172.21.15.70:0/2784878557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ee8b40 0x55e200eea120 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.061+0000 7f250c6b7740 1 --2- 172.21.15.70:0/2784878557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee75d0 0x55e200efe340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.061+0000 7f250c6b7740 1 -- 172.21.15.70:0/2784878557 >> 172.21.15.70:0/2784878557 conn(0x55e200eb0310 msgr2=0x55e200eee040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.061+0000 7f250c6b7740 1 -- 172.21.15.70:0/2784878557 shutdown_connections 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.061+0000 7f250c6b7740 1 -- 172.21.15.70:0/2784878557 wait complete. 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.061+0000 7f250c6b7740 1 -- start start 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250c6b7740 1 Processor -- start 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250c6b7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ee75d0 0x55e200eebe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250c6b7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee8b40 0x55e200eec390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250c6b7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ef2370 0x55e200eec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250c6b7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f25041b0eb0 con 0x55e200ef2370 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250c6b7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f25041b0780 con 0x55e200ee8b40 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250c6b7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f25041ad910 con 0x55e200ee75d0 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250c6b7740 10 client.0 _ll_register_callbacks cb 0x7f24f809aae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250887b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ef2370 0x55e200eec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f2503fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ee75d0 0x55e200eebe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250887b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ef2370 0x55e200eec8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58192/0 (socket says 172.21.15.70:58192) 2024-09-12T01:54:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f2503fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ee75d0 0x55e200eebe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:59050/0 (socket says 172.21.15.70:59050) 2024-09-12T01:54:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250887b640 1 -- 172.21.15.70:0/52324870 learned_addr learned my addr 172.21.15.70:0/52324870 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f25037fe640 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee8b40 0x55e200eec390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250887b640 1 -- 172.21.15.70:0/52324870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ee75d0 msgr2=0x55e200eebe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250887b640 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ee75d0 0x55e200eebe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250887b640 1 -- 172.21.15.70:0/52324870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee8b40 msgr2=0x55e200eec390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250887b640 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee8b40 0x55e200eec390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f250887b640 1 -- 172.21.15.70:0/52324870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e200f6bca0 con 0x55e200ef2370 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.062+0000 7f25037fe640 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee8b40 0x55e200eec390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f250887b640 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ef2370 0x55e200eec8d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009ca0 tx=0x7f24fc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ac4d006f36e21f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f24e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f24e37fe640 1 -- 172.21.15.70:0/52324870 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc04f070 con 0x55e200ef2370 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f24e37fe640 1 -- 172.21.15.70:0/52324870 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f24fc004790 con 0x55e200ef2370 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f250c6b7740 1 -- 172.21.15.70:0/52324870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24f80173f0 con 0x55e200ef2370 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f24e37fe640 1 -- 172.21.15.70:0/52324870 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f24fc05b050 con 0x55e200ef2370 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f250c6b7740 10 client.16413 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f250c6b7740 1 -- 172.21.15.70:0/52324870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e200f6ce80 con 0x55e200ef2370 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f24e37fe640 1 -- 172.21.15.70:0/52324870 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24f80173f0 con 0x55e200ef2370 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f24e37fe640 1 -- 172.21.15.70:0/52324870 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f24fc0306e0 con 0x55e200ef2370 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f250c6b7740 10 client.16413 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f250c6b7740 10 client.16413 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f250c6b7740 20 client.16413 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f250c6b7740 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55e200f01f60 0x55e200f6f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f250c6b7740 4 client.16413 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.063+0000 7f250c6b7740 1 -- 172.21.15.70:0/52324870 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e200e54d70 con 0x55e200f01f60 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f2503fff640 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55e200f01f60 0x55e200f6f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f2503fff640 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55e200f01f60 0x55e200f6f6a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7ba94d8f61a2a112 server_cookie=9e14ac8146428fa1 in_seq=0 out_seq=0 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f24e37fe640 10 client.16413 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f24e37fe640 1 -- 172.21.15.70:0/52324870 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e200e54d70 con 0x55e200f01f60 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f24e37fe640 10 client.16413 handle_command_reply: tid=0 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f250c6b7740 1 client.16413 shutdown 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f250c6b7740 1 -- 172.21.15.70:0/52324870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ef2370 msgr2=0x55e200eec8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f250c6b7740 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ef2370 0x55e200eec8d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009ca0 tx=0x7f24fc02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f250c6b7740 1 -- 172.21.15.70:0/52324870 shutdown_connections 2024-09-12T01:54:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f250c6b7740 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55e200f01f60 0x55e200f6f6a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f250c6b7740 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e200ef2370 0x55e200eec8d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f250c6b7740 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55e200ee8b40 0x55e200eec390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f24e37fe640 0 client.16413 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:54:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f250c6b7740 1 --2- 172.21.15.70:0/52324870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e200ee75d0 0x55e200eebe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f250c6b7740 1 -- 172.21.15.70:0/52324870 >> 172.21.15.70:0/52324870 conn(0x55e200eb0310 msgr2=0x55e200ef07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f250c6b7740 1 -- 172.21.15.70:0/52324870 shutdown_connections 2024-09-12T01:54:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.064+0000 7f250c6b7740 1 -- 172.21.15.70:0/52324870 wait complete. 2024-09-12T01:54:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250c6b7740 20 client.16413 trim_cache size 0 max 16384 2024-09-12T01:54:44.072 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:54:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250a2de640 1 -- 172.21.15.70:0/1030000950 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24ec0a2b80 msgr2=0x7f24ec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250a2de640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24ec0a2b80 0x7f24ec0a5040 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f24fc006010 tx=0x7f24fc031c90 comp rx=0 tx=0).stop 2024-09-12T01:54:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250a2de640 1 -- 172.21.15.70:0/1030000950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102790 msgr2=0x7f2504074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250a2de640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102790 0x7f2504074a30 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f24f800b4a0 tx=0x7f24f800b960 comp rx=0 tx=0).stop 2024-09-12T01:54:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250a2de640 1 -- 172.21.15.70:0/1030000950 shutdown_connections 2024-09-12T01:54:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250a2de640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24ec0a2b80 0x7f24ec0a5040 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250a2de640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2504106f10 0x7f2504074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250a2de640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2504102790 0x7f2504074a30 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250a2de640 1 --2- 172.21.15.70:0/1030000950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2504101de0 0x7f25040744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250a2de640 1 -- 172.21.15.70:0/1030000950 >> 172.21.15.70:0/1030000950 conn(0x7f25040fd8c0 msgr2=0x7f25040fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250a2de640 1 -- 172.21.15.70:0/1030000950 shutdown_connections 2024-09-12T01:54:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:44.065+0000 7f250a2de640 1 -- 172.21.15.70:0/1030000950 wait complete. 2024-09-12T01:54:44.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:44 smithi070 ceph-mon[31177]: pgmap v414: 97 pgs: 97 active+clean; 44 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 398 op/s 2024-09-12T01:54:44.713 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:54:44.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:44 smithi191 ceph-mon[35770]: pgmap v414: 97 pgs: 97 active+clean; 44 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 398 op/s 2024-09-12T01:54:44.956 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:45.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:44 smithi152 ceph-mon[35055]: pgmap v414: 97 pgs: 97 active+clean; 44 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 398 op/s 2024-09-12T01:54:45.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.461+0000 7fd889b36640 1 -- 172.21.15.70:0/3616509725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd884101de0 msgr2=0x7fd8841021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.461+0000 7fd889b36640 1 --2- 172.21.15.70:0/3616509725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd884101de0 0x7fd8841021c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd874009900 tx=0x7fd87402a410 comp rx=0 tx=0).stop 2024-09-12T01:54:45.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.461+0000 7fd889b36640 1 -- 172.21.15.70:0/3616509725 shutdown_connections 2024-09-12T01:54:45.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.461+0000 7fd889b36640 1 --2- 172.21.15.70:0/3616509725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd884106f10 0x7fd88410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.461+0000 7fd889b36640 1 --2- 172.21.15.70:0/3616509725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd884102790 0x7fd8841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.461+0000 7fd889b36640 1 --2- 172.21.15.70:0/3616509725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd884101de0 0x7fd8841021c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.461+0000 7fd889b36640 1 -- 172.21.15.70:0/3616509725 >> 172.21.15.70:0/3616509725 conn(0x7fd8840fd8c0 msgr2=0x7fd8840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:45.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd889b36640 1 -- 172.21.15.70:0/3616509725 shutdown_connections 2024-09-12T01:54:45.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd889b36640 1 -- 172.21.15.70:0/3616509725 wait complete. 2024-09-12T01:54:45.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd889b36640 1 Processor -- start 2024-09-12T01:54:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd889b36640 1 -- start start 2024-09-12T01:54:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd889b36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd884101de0 0x7fd8840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd889b36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd884102790 0x7fd884074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd889b36640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd884106f10 0x7fd884074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd889b36640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd884112050 con 0x7fd884101de0 2024-09-12T01:54:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd889b36640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd884111ed0 con 0x7fd884102790 2024-09-12T01:54:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd889b36640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841121d0 con 0x7fd884106f10 2024-09-12T01:54:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd8837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd884101de0 0x7fd8840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd8837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd884101de0 0x7fd8840744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58206/0 (socket says 172.21.15.70:58206) 2024-09-12T01:54:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.462+0000 7fd8837fe640 1 -- 172.21.15.70:0/1531757238 learned_addr learned my addr 172.21.15.70:0/1531757238 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd87bfff640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd884102790 0x7fd884074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd8837fe640 1 -- 172.21.15.70:0/1531757238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd884106f10 msgr2=0x7fd884074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd8837fe640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd884106f10 0x7fd884074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd8837fe640 1 -- 172.21.15.70:0/1531757238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd884102790 msgr2=0x7fd884074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd8837fe640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd884102790 0x7fd884074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd8837fe640 1 -- 172.21.15.70:0/1531757238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8841a6a30 con 0x7fd884101de0 2024-09-12T01:54:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd87bfff640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd884102790 0x7fd884074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd8837fe640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd884101de0 0x7fd8840744f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd874006010 tx=0x7fd8740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd8817fa640 1 -- 172.21.15.70:0/1531757238 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87403f030 con 0x7fd884101de0 2024-09-12T01:54:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd889b36640 1 -- 172.21.15.70:0/1531757238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8841a6cc0 con 0x7fd884101de0 2024-09-12T01:54:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd8817fa640 1 -- 172.21.15.70:0/1531757238 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd874003d00 con 0x7fd884101de0 2024-09-12T01:54:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd8817fa640 1 -- 172.21.15.70:0/1531757238 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874035070 con 0x7fd884101de0 2024-09-12T01:54:45.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.463+0000 7fd889b36640 1 -- 172.21.15.70:0/1531757238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8841a71a0 con 0x7fd884101de0 2024-09-12T01:54:45.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.465+0000 7fd8817fa640 1 -- 172.21.15.70:0/1531757238 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd874042030 con 0x7fd884101de0 2024-09-12T01:54:45.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.465+0000 7fd88bf0f740 1 Processor -- start 2024-09-12T01:54:45.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd88bf0f740 1 -- start start 2024-09-12T01:54:45.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd88bf0f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a051504b40 0x55a051503090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd88bf0f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a0515035d0 0x55a051503a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd88bf0f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051510760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd88bf0f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a0514692f0 con 0x55a05150e370 2024-09-12T01:54:45.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd88bf0f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a051410cf0 con 0x55a051504b40 2024-09-12T01:54:45.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd88bf0f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a0514652b0 con 0x55a0515035d0 2024-09-12T01:54:45.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd8817fa640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fd8700a2b80 0x7fd8700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd87bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051510760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd87bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051510760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58214/0 (socket says 172.21.15.70:58214) 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd87bfff640 1 -- 172.21.15.70:0/3860102523 learned_addr learned my addr 172.21.15.70:0/3860102523 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd883fff640 1 --2- 172.21.15.70:0/3860102523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a051504b40 0x55a051503090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd8817fa640 1 -- 172.21.15.70:0/1531757238 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd8740ef620 con 0x7fd884101de0 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd883fff640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fd8700a2b80 0x7fd8700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd8837fe640 1 --2- 172.21.15.70:0/3860102523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a0515035d0 0x55a051503a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd87bfff640 1 -- 172.21.15.70:0/3860102523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a0515035d0 msgr2=0x55a051503a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd87bfff640 1 --2- 172.21.15.70:0/3860102523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a0515035d0 0x55a051503a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd87bfff640 1 -- 172.21.15.70:0/3860102523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a051504b40 msgr2=0x55a051503090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd87bfff640 1 --2- 172.21.15.70:0/3860102523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a051504b40 0x55a051503090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd87bfff640 1 -- 172.21.15.70:0/3860102523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0513f53a0 con 0x55a05150e370 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd87bfff640 1 --2- 172.21.15.70:0/3860102523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051510760 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00bb40 tx=0x7fd86c00d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90e29379d3311bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:45.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.466+0000 7fd883fff640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fd8700a2b80 0x7fd8700a5040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd87c005c40 tx=0x7fd87c009200 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.467+0000 7fd879ffb640 1 -- 172.21.15.70:0/3860102523 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c017420 con 0x55a05150e370 2024-09-12T01:54:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.467+0000 7fd879ffb640 1 -- 172.21.15.70:0/3860102523 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd86c017ac0 con 0x55a05150e370 2024-09-12T01:54:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.467+0000 7fd879ffb640 1 -- 172.21.15.70:0/3860102523 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c00fbf0 con 0x55a05150e370 2024-09-12T01:54:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.467+0000 7fd88bf0f740 1 -- 172.21.15.70:0/3860102523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 msgr2=0x55a051510760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.467+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/3860102523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051510760 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00bb40 tx=0x7fd86c00d340 comp rx=0 tx=0).stop 2024-09-12T01:54:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.467+0000 7fd88bf0f740 1 -- 172.21.15.70:0/3860102523 shutdown_connections 2024-09-12T01:54:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.467+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/3860102523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051510760 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.467+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/3860102523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a0515035d0 0x55a051503a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.467+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/3860102523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a051504b40 0x55a051503090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.467+0000 7fd88bf0f740 1 -- 172.21.15.70:0/3860102523 >> 172.21.15.70:0/3860102523 conn(0x55a0514cc310 msgr2=0x55a0514ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.467+0000 7fd88bf0f740 1 -- 172.21.15.70:0/3860102523 shutdown_connections 2024-09-12T01:54:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.467+0000 7fd88bf0f740 1 -- 172.21.15.70:0/3860102523 wait complete. 2024-09-12T01:54:45.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd88bf0f740 1 -- start start 2024-09-12T01:54:45.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd88bf0f740 1 Processor -- start 2024-09-12T01:54:45.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd88bf0f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0515035d0 0x55a05150dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd88bf0f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a051504b40 0x55a05150af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd88bf0f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a05150e370 0x55a05150b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd88bf0f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a051511070 con 0x55a0515035d0 2024-09-12T01:54:45.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd88bf0f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55a051424060 con 0x55a051504b40 2024-09-12T01:54:45.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd88bf0f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55a0515111f0 con 0x55a05150e370 2024-09-12T01:54:45.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd88bf0f740 10 client.0 _ll_register_callbacks cb 0x55a0511778c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:45.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd8837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0515035d0 0x55a05150dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd8837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0515035d0 0x55a05150dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58230/0 (socket says 172.21.15.70:58230) 2024-09-12T01:54:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd8837fe640 1 -- 172.21.15.70:0/1239277891 learned_addr learned my addr 172.21.15.70:0/1239277891 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.468+0000 7fd87bfff640 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a051504b40 0x55a05150af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd883fff640 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a05150e370 0x55a05150b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd8837fe640 1 -- 172.21.15.70:0/1239277891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a05150e370 msgr2=0x55a05150b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd8837fe640 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a05150e370 0x55a05150b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd8837fe640 1 -- 172.21.15.70:0/1239277891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a051504b40 msgr2=0x55a05150af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd8837fe640 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a051504b40 0x55a05150af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd8837fe640 1 -- 172.21.15.70:0/1239277891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0511da3c0 con 0x55a0515035d0 2024-09-12T01:54:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd8837fe640 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0515035d0 0x55a05150dcb0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd8740c4680 tx=0x7fd8740bbdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfea0b1c3d595c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd862ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd862ffd640 1 -- 172.21.15.70:0/1239277891 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874049030 con 0x55a0515035d0 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd862ffd640 1 -- 172.21.15.70:0/1239277891 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd8740ed230 con 0x55a0515035d0 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1239277891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd86c017ac0 con 0x55a0515035d0 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd862ffd640 1 -- 172.21.15.70:0/1239277891 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd8740bbf40 con 0x55a0515035d0 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd88bf0f740 10 client.16425 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1239277891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a05151ca60 con 0x55a0515035d0 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd862ffd640 1 -- 172.21.15.70:0/1239277891 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd86c017ac0 con 0x55a0515035d0 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd862ffd640 1 -- 172.21.15.70:0/1239277891 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fd87403b460 con 0x55a0515035d0 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd88bf0f740 10 client.16425 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.469+0000 7fd88bf0f740 10 client.16425 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.470+0000 7fd88bf0f740 20 client.16425 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.470+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a05151df10 0x55a0515203a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.470+0000 7fd88bf0f740 4 client.16425 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.470+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1239277891 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a051476860 con 0x55a05151df10 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.470+0000 7fd87bfff640 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a05151df10 0x55a0515203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.470+0000 7fd87bfff640 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a05151df10 0x55a0515203a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=78a3bdac2965dd5b server_cookie=976741ed9a977ac in_seq=0 out_seq=0 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.470+0000 7fd862ffd640 10 client.16425 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd862ffd640 1 -- 172.21.15.70:0/1239277891 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a051476860 con 0x55a05151df10 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd862ffd640 10 client.16425 handle_command_reply: tid=0 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd88bf0f740 1 client.16425 shutdown 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1239277891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0515035d0 msgr2=0x55a05150dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0515035d0 0x55a05150dcb0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd8740c4680 tx=0x7fd8740bbdd0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1239277891 shutdown_connections 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a05151df10 0x55a0515203a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a05150e370 0x55a05150b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a051504b40 0x55a05150af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/1239277891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0515035d0 0x55a05150dcb0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd862ffd640 0 client.16425 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:54:45.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1239277891 >> 172.21.15.70:0/1239277891 conn(0x55a0514cc310 msgr2=0x55a051505960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:45.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1239277891 shutdown_connections 2024-09-12T01:54:45.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1239277891 wait complete. 2024-09-12T01:54:45.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.471+0000 7fd88bf0f740 20 client.16425 trim_cache size 0 max 16384 2024-09-12T01:54:45.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.484+0000 7fd88bf0f740 1 Processor -- start 2024-09-12T01:54:45.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.484+0000 7fd88bf0f740 1 -- start start 2024-09-12T01:54:45.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.484+0000 7fd88bf0f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0515035d0 0x55a05151a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.484+0000 7fd88bf0f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a051504b40 0x55a051525c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.484+0000 7fd88bf0f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051526190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.484+0000 7fd88bf0f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841af8d0 con 0x55a05150e370 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.484+0000 7fd88bf0f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841b15c0 con 0x55a0515035d0 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.484+0000 7fd88bf0f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841b0000 con 0x55a051504b40 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.484+0000 7fd883fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051526190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.484+0000 7fd883fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051526190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58232/0 (socket says 172.21.15.70:58232) 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.484+0000 7fd883fff640 1 -- 172.21.15.70:0/1303577608 learned_addr learned my addr 172.21.15.70:0/1303577608 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.485+0000 7fd87bfff640 1 --2- 172.21.15.70:0/1303577608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a051504b40 0x55a051525c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.485+0000 7fd8837fe640 1 --2- 172.21.15.70:0/1303577608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0515035d0 0x55a05151a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.485+0000 7fd883fff640 1 -- 172.21.15.70:0/1303577608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a051504b40 msgr2=0x55a051525c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.485+0000 7fd883fff640 1 --2- 172.21.15.70:0/1303577608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a051504b40 0x55a051525c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.485+0000 7fd883fff640 1 -- 172.21.15.70:0/1303577608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0515035d0 msgr2=0x55a05151a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.485+0000 7fd883fff640 1 --2- 172.21.15.70:0/1303577608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0515035d0 0x55a05151a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.485+0000 7fd883fff640 1 -- 172.21.15.70:0/1303577608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a051500960 con 0x55a05150e370 2024-09-12T01:54:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.485+0000 7fd8837fe640 1 --2- 172.21.15.70:0/1303577608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0515035d0 0x55a05151a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.485+0000 7fd883fff640 1 --2- 172.21.15.70:0/1303577608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051526190 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd87c012870 tx=0x7fd87c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b76b5d54f5e450b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.485+0000 7fd8797fa640 1 -- 172.21.15.70:0/1303577608 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c004d20 con 0x55a05150e370 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.485+0000 7fd8797fa640 1 -- 172.21.15.70:0/1303577608 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd87c01da90 con 0x55a05150e370 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.485+0000 7fd8797fa640 1 -- 172.21.15.70:0/1303577608 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c005720 con 0x55a05150e370 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.486+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1303577608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 msgr2=0x55a051526190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.486+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/1303577608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051526190 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd87c012870 tx=0x7fd87c014040 comp rx=0 tx=0).stop 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.486+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1303577608 shutdown_connections 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.486+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/1303577608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051526190 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.486+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/1303577608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a051504b40 0x55a051525c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.486+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/1303577608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0515035d0 0x55a05151a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.486+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1303577608 >> 172.21.15.70:0/1303577608 conn(0x55a0514cc310 msgr2=0x55a05150af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.486+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1303577608 shutdown_connections 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.486+0000 7fd88bf0f740 1 -- 172.21.15.70:0/1303577608 wait complete. 2024-09-12T01:54:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.486+0000 7fd88bf0f740 1 -- start start 2024-09-12T01:54:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.486+0000 7fd88bf0f740 1 Processor -- start 2024-09-12T01:54:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.486+0000 7fd88bf0f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0515035d0 0x55a0515125a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd88bf0f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a051504b40 0x55a051512ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd88bf0f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051587c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd88bf0f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841b0e30 con 0x55a05150e370 2024-09-12T01:54:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd88bf0f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841b0700 con 0x55a0515035d0 2024-09-12T01:54:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd88bf0f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd8841ad890 con 0x55a051504b40 2024-09-12T01:54:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd88bf0f740 10 client.0 _ll_register_callbacks cb 0x7fd874005e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd883fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051587c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd883fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051587c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58240/0 (socket says 172.21.15.70:58240) 2024-09-12T01:54:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd883fff640 1 -- 172.21.15.70:0/450613956 learned_addr learned my addr 172.21.15.70:0/450613956 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd87bfff640 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a051504b40 0x55a051512ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd8837fe640 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0515035d0 0x55a0515125a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd883fff640 1 -- 172.21.15.70:0/450613956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a051504b40 msgr2=0x55a051512ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd883fff640 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a051504b40 0x55a051512ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd883fff640 1 -- 172.21.15.70:0/450613956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0515035d0 msgr2=0x55a0515125a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd883fff640 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0515035d0 0x55a0515125a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd883fff640 1 -- 172.21.15.70:0/450613956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0515133c0 con 0x55a05150e370 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd8837fe640 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0515035d0 0x55a0515125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd87bfff640 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a051504b40 0x55a051512ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd883fff640 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051587c20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd87c005ff0 tx=0x7fd87c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e68c3e5a6af93b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd862ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd862ffd640 1 -- 172.21.15.70:0/450613956 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c033020 con 0x55a05150e370 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd862ffd640 1 -- 172.21.15.70:0/450613956 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd87c01d590 con 0x55a05150e370 2024-09-12T01:54:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd88bf0f740 1 -- 172.21.15.70:0/450613956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd87c01da90 con 0x55a05150e370 2024-09-12T01:54:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.487+0000 7fd862ffd640 1 -- 172.21.15.70:0/450613956 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd87c01d790 con 0x55a05150e370 2024-09-12T01:54:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.488+0000 7fd88bf0f740 10 client.16431 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.488+0000 7fd88bf0f740 1 -- 172.21.15.70:0/450613956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a0515891e0 con 0x55a05150e370 2024-09-12T01:54:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.488+0000 7fd862ffd640 1 -- 172.21.15.70:0/450613956 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd87c01da90 con 0x55a05150e370 2024-09-12T01:54:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:54:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.488+0000 7fd862ffd640 1 -- 172.21.15.70:0/450613956 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fd87c0054a0 con 0x55a05150e370 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.488+0000 7fd88bf0f740 10 client.16431 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.488+0000 7fd88bf0f740 10 client.16431 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.488+0000 7fd88bf0f740 20 client.16431 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.488+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a0515898f0 0x55a05158bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.488+0000 7fd88bf0f740 4 client.16431 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.488+0000 7fd88bf0f740 1 -- 172.21.15.70:0/450613956 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a051470d70 con 0x55a0515898f0 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.488+0000 7fd8837fe640 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a0515898f0 0x55a05158bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd8837fe640 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a0515898f0 0x55a05158bd10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e71bfd9ca0e223ef server_cookie=4bcad7f6b526a38 in_seq=0 out_seq=0 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd862ffd640 10 client.16431 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd862ffd640 1 -- 172.21.15.70:0/450613956 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a051470d70 con 0x55a0515898f0 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd862ffd640 10 client.16431 handle_command_reply: tid=0 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd88bf0f740 1 client.16431 shutdown 2024-09-12T01:54:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd88bf0f740 1 -- 172.21.15.70:0/450613956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 msgr2=0x55a051587c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051587c20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd87c005ff0 tx=0x7fd87c009800 comp rx=0 tx=0).stop 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd88bf0f740 1 -- 172.21.15.70:0/450613956 shutdown_connections 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x55a0515898f0 0x55a05158bd10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a05150e370 0x55a051587c20 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a051504b40 0x55a051512ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd862ffd640 0 client.16431 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd88bf0f740 1 --2- 172.21.15.70:0/450613956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55a0515035d0 0x55a0515125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd88bf0f740 1 -- 172.21.15.70:0/450613956 >> 172.21.15.70:0/450613956 conn(0x55a0514cc310 msgr2=0x55a05150c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd88bf0f740 1 -- 172.21.15.70:0/450613956 shutdown_connections 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd88bf0f740 1 -- 172.21.15.70:0/450613956 wait complete. 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.489+0000 7fd88bf0f740 20 client.16431 trim_cache size 0 max 16384 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.490+0000 7fd889b36640 1 -- 172.21.15.70:0/1531757238 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fd8700a2b80 msgr2=0x7fd8700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.490+0000 7fd889b36640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fd8700a2b80 0x7fd8700a5040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd87c005c40 tx=0x7fd87c009200 comp rx=0 tx=0).stop 2024-09-12T01:54:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.490+0000 7fd889b36640 1 -- 172.21.15.70:0/1531757238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd884101de0 msgr2=0x7fd8840744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.490+0000 7fd889b36640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd884101de0 0x7fd8840744f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd874006010 tx=0x7fd8740042f0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.490+0000 7fd889b36640 1 -- 172.21.15.70:0/1531757238 shutdown_connections 2024-09-12T01:54:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.490+0000 7fd889b36640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fd8700a2b80 0x7fd8700a5040 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.490+0000 7fd889b36640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd884106f10 0x7fd884074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.490+0000 7fd889b36640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd884102790 0x7fd884074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.490+0000 7fd889b36640 1 --2- 172.21.15.70:0/1531757238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd884101de0 0x7fd8840744f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.490+0000 7fd889b36640 1 -- 172.21.15.70:0/1531757238 >> 172.21.15.70:0/1531757238 conn(0x7fd8840fd8c0 msgr2=0x7fd8840fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.490+0000 7fd889b36640 1 -- 172.21.15.70:0/1531757238 shutdown_connections 2024-09-12T01:54:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:45.490+0000 7fd889b36640 1 -- 172.21.15.70:0/1531757238 wait complete. 2024-09-12T01:54:46.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:54:46.578 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:46.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:46 smithi070 ceph-mon[31177]: pgmap v415: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 978 KiB/s wr, 354 op/s 2024-09-12T01:54:46.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:46 smithi191 ceph-mon[35770]: pgmap v415: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 978 KiB/s wr, 354 op/s 2024-09-12T01:54:47.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:46 smithi152 ceph-mon[35055]: pgmap v415: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 978 KiB/s wr, 354 op/s 2024-09-12T01:54:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.073+0000 7f1751d42640 1 -- 172.21.15.70:0/2891552911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c102570 msgr2=0x7f174c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.073+0000 7f1751d42640 1 --2- 172.21.15.70:0/2891552911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c102570 0x7f174c1029b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1734009900 tx=0x7f173402a480 comp rx=0 tx=0).stop 2024-09-12T01:54:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.073+0000 7f1751d42640 1 -- 172.21.15.70:0/2891552911 shutdown_connections 2024-09-12T01:54:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.073+0000 7f1751d42640 1 --2- 172.21.15.70:0/2891552911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f174c102ef0 0x7f174c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.073+0000 7f1751d42640 1 --2- 172.21.15.70:0/2891552911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c102570 0x7f174c1029b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.073+0000 7f1751d42640 1 --2- 172.21.15.70:0/2891552911 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f174c100e20 0x7f174c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.073+0000 7f1751d42640 1 -- 172.21.15.70:0/2891552911 >> 172.21.15.70:0/2891552911 conn(0x7f174c0fc7d0 msgr2=0x7f174c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:47.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.073+0000 7f1751d42640 1 -- 172.21.15.70:0/2891552911 shutdown_connections 2024-09-12T01:54:47.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.073+0000 7f1751d42640 1 -- 172.21.15.70:0/2891552911 wait complete. 2024-09-12T01:54:47.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.073+0000 7f1751d42640 1 Processor -- start 2024-09-12T01:54:47.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f1751d42640 1 -- start start 2024-09-12T01:54:47.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f1751d42640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f174c100e20 0x7f174c1a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f1751d42640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f174c102570 0x7f174c1a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f1751d42640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c102ef0 0x7f174c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f1751d42640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1110e0 con 0x7f174c102ef0 2024-09-12T01:54:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f1751d42640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f174c110f60 con 0x7f174c100e20 2024-09-12T01:54:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f1751d42640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f174c111260 con 0x7f174c102570 2024-09-12T01:54:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f174bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c102ef0 0x7f174c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f174bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c102ef0 0x7f174c19a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58260/0 (socket says 172.21.15.70:58260) 2024-09-12T01:54:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f174bfff640 1 -- 172.21.15.70:0/3015256065 learned_addr learned my addr 172.21.15.70:0/3015256065 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f174b7fe640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f174c100e20 0x7f174c1a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f1742ffd640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f174c102570 0x7f174c1a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f174bfff640 1 -- 172.21.15.70:0/3015256065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f174c102570 msgr2=0x7f174c1a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f174bfff640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f174c102570 0x7f174c1a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f174bfff640 1 -- 172.21.15.70:0/3015256065 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f174c100e20 msgr2=0x7f174c1a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f174bfff640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f174c100e20 0x7f174c1a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f174bfff640 1 -- 172.21.15.70:0/3015256065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c19af40 con 0x7f174c102ef0 2024-09-12T01:54:47.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f1742ffd640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f174c102570 0x7f174c1a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:47.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.074+0000 7f174bfff640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c102ef0 0x7f174c19a6d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f174400eaa0 tx=0x7f174400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:47.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.075+0000 7f17497fa640 1 -- 172.21.15.70:0/3015256065 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174400cdb0 con 0x7f174c102ef0 2024-09-12T01:54:47.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.075+0000 7f17497fa640 1 -- 172.21.15.70:0/3015256065 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1744004b20 con 0x7f174c102ef0 2024-09-12T01:54:47.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.075+0000 7f1751d42640 1 -- 172.21.15.70:0/3015256065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c19b230 con 0x7f174c102ef0 2024-09-12T01:54:47.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.075+0000 7f17497fa640 1 -- 172.21.15.70:0/3015256065 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744011760 con 0x7f174c102ef0 2024-09-12T01:54:47.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.075+0000 7f1751d42640 1 -- 172.21.15.70:0/3015256065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c1a73b0 con 0x7f174c102ef0 2024-09-12T01:54:47.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.077+0000 7f17497fa640 1 -- 172.21.15.70:0/3015256065 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1744004cd0 con 0x7f174c102ef0 2024-09-12T01:54:47.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.077+0000 7f175411b740 1 Processor -- start 2024-09-12T01:54:47.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.077+0000 7f175411b740 1 -- start start 2024-09-12T01:54:47.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f175411b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e7a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f175411b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e7aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f175411b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e85370 0x55b7c0e87760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f175411b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b7c0de02f0 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f175411b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b7c0d87cf0 con 0x55b7c0e7bb40 2024-09-12T01:54:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f175411b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b7c0ddc2b0 con 0x55b7c0e85370 2024-09-12T01:54:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f174b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e7aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f174b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e7aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58264/0 (socket says 172.21.15.70:58264) 2024-09-12T01:54:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f174b7fe640 1 -- 172.21.15.70:0/2164952821 learned_addr learned my addr 172.21.15.70:0/2164952821 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f1742ffd640 1 --2- 172.21.15.70:0/2164952821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e7a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f17497fa640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f17380a2b80 0x7f17380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f1742ffd640 1 --2- 172.21.15.70:0/2164952821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e85370 0x55b7c0e87760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f174b7fe640 1 -- 172.21.15.70:0/2164952821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e85370 msgr2=0x55b7c0e87760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f174b7fe640 1 --2- 172.21.15.70:0/2164952821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e85370 0x55b7c0e87760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f174b7fe640 1 -- 172.21.15.70:0/2164952821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 msgr2=0x55b7c0e7a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f174b7fe640 1 --2- 172.21.15.70:0/2164952821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e7a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f174b7fe640 1 -- 172.21.15.70:0/2164952821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c0d6c3a0 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f174bfff640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f17380a2b80 0x7f17380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f1742ffd640 1 --2- 172.21.15.70:0/2164952821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e85370 0x55b7c0e87760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f174b7fe640 1 --2- 172.21.15.70:0/2164952821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e7aa10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f173c00b820 tx=0x7f173c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd2f0a23c1f8453 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f17497fa640 1 -- 172.21.15.70:0/3015256065 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f17440cf3a0 con 0x7f174c102ef0 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.078+0000 7f1741ffb640 1 -- 172.21.15.70:0/2164952821 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c00d950 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.079+0000 7f1741ffb640 1 -- 172.21.15.70:0/2164952821 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f173c019070 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.079+0000 7f1741ffb640 1 -- 172.21.15.70:0/2164952821 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c0123e0 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.079+0000 7f175411b740 1 -- 172.21.15.70:0/2164952821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 msgr2=0x55b7c0e7aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.079+0000 7f175411b740 1 --2- 172.21.15.70:0/2164952821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e7aa10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f173c00b820 tx=0x7f173c00bce0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.079+0000 7f174bfff640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f17380a2b80 0x7f17380a5040 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f174409b8c0 tx=0x7f1744066c30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.079+0000 7f175411b740 1 -- 172.21.15.70:0/2164952821 shutdown_connections 2024-09-12T01:54:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.079+0000 7f175411b740 1 --2- 172.21.15.70:0/2164952821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e85370 0x55b7c0e87760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.079+0000 7f175411b740 1 --2- 172.21.15.70:0/2164952821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e7aa10 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.079+0000 7f175411b740 1 --2- 172.21.15.70:0/2164952821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e7a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.079+0000 7f175411b740 1 -- 172.21.15.70:0/2164952821 >> 172.21.15.70:0/2164952821 conn(0x55b7c0e43310 msgr2=0x55b7c0e76c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.079+0000 7f175411b740 1 -- 172.21.15.70:0/2164952821 shutdown_connections 2024-09-12T01:54:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.079+0000 7f175411b740 1 -- 172.21.15.70:0/2164952821 wait complete. 2024-09-12T01:54:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f175411b740 1 -- start start 2024-09-12T01:54:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f175411b740 1 Processor -- start 2024-09-12T01:54:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f175411b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e84cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f175411b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e81f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f175411b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 0x55b7c0e824a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f175411b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b7c0e88070 con 0x55b7c0e85370 2024-09-12T01:54:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f175411b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55b7c0d9b060 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f175411b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b7c0e881f0 con 0x55b7c0e7bb40 2024-09-12T01:54:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f175411b740 10 client.0 _ll_register_callbacks cb 0x55b7c0aee8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 0x55b7c0e824a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 0x55b7c0e824a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58276/0 (socket says 172.21.15.70:58276) 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f1742ffd640 1 -- 172.21.15.70:0/2776047551 learned_addr learned my addr 172.21.15.70:0/2776047551 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f174b7fe640 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e81f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f1742ffd640 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e84cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f1742ffd640 1 -- 172.21.15.70:0/2776047551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e7bb40 msgr2=0x55b7c0e81f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f1742ffd640 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e81f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f1742ffd640 1 -- 172.21.15.70:0/2776047551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7a5d0 msgr2=0x55b7c0e84cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f1742ffd640 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e84cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.080+0000 7f1742ffd640 1 -- 172.21.15.70:0/2776047551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c0b513c0 con 0x55b7c0e85370 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f1742ffd640 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 0x55b7c0e824a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1734033000 tx=0x7f1734009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3593f99c35b99cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f172affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f172affd640 1 -- 172.21.15.70:0/2776047551 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734044030 con 0x55b7c0e85370 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f172affd640 1 -- 172.21.15.70:0/2776047551 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1734004260 con 0x55b7c0e85370 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f175411b740 1 -- 172.21.15.70:0/2776047551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f173c019070 con 0x55b7c0e85370 2024-09-12T01:54:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f172affd640 1 -- 172.21.15.70:0/2776047551 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f1734035040 con 0x55b7c0e85370 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f175411b740 10 client.16443 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f175411b740 1 -- 172.21.15.70:0/2776047551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b7c0e93a30 con 0x55b7c0e85370 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f172affd640 1 -- 172.21.15.70:0/2776047551 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f173c019070 con 0x55b7c0e85370 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f172affd640 1 -- 172.21.15.70:0/2776047551 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f173403a030 con 0x55b7c0e85370 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f175411b740 10 client.16443 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f175411b740 10 client.16443 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f175411b740 20 client.16443 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f175411b740 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55b7c0e94de0 0x55b7c0e97240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f175411b740 4 client.16443 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.081+0000 7f175411b740 1 -- 172.21.15.70:0/2776047551 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7c0ded860 con 0x55b7c0e94de0 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.082+0000 7f174b7fe640 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55b7c0e94de0 0x55b7c0e97240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.082+0000 7f172affd640 10 client.16443 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:54:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.082+0000 7f174b7fe640 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55b7c0e94de0 0x55b7c0e97240 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=60c0fea1ba17eaac server_cookie=773d7181e8da1822 in_seq=0 out_seq=0 2024-09-12T01:54:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f172affd640 1 -- 172.21.15.70:0/2776047551 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7c0ded860 con 0x55b7c0e94de0 2024-09-12T01:54:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f172affd640 10 client.16443 handle_command_reply: tid=0 2024-09-12T01:54:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f175411b740 1 client.16443 shutdown 2024-09-12T01:54:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f175411b740 1 -- 172.21.15.70:0/2776047551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 msgr2=0x55b7c0e824a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f175411b740 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 0x55b7c0e824a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1734033000 tx=0x7f1734009260 comp rx=0 tx=0).stop 2024-09-12T01:54:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f175411b740 1 -- 172.21.15.70:0/2776047551 shutdown_connections 2024-09-12T01:54:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f175411b740 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55b7c0e94de0 0x55b7c0e97240 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f175411b740 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 0x55b7c0e824a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f175411b740 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e81f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f175411b740 1 --2- 172.21.15.70:0/2776047551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e84cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f175411b740 1 -- 172.21.15.70:0/2776047551 >> 172.21.15.70:0/2776047551 conn(0x55b7c0e43310 msgr2=0x55b7c0e7c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f172affd640 0 client.16443 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:54:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f175411b740 1 -- 172.21.15.70:0/2776047551 shutdown_connections 2024-09-12T01:54:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f175411b740 1 -- 172.21.15.70:0/2776047551 wait complete. 2024-09-12T01:54:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.083+0000 7f175411b740 20 client.16443 trim_cache size 0 max 16384 2024-09-12T01:54:47.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.096+0000 7f175411b740 1 Processor -- start 2024-09-12T01:54:47.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f175411b740 1 -- start start 2024-09-12T01:54:47.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f175411b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e91370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f175411b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e86760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f175411b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 0x55b7c0e86ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f175411b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1af960 con 0x55b7c0e85370 2024-09-12T01:54:47.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f175411b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b1650 con 0x55b7c0e7bb40 2024-09-12T01:54:47.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f175411b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b0090 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 0x55b7c0e86ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 0x55b7c0e86ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58284/0 (socket says 172.21.15.70:58284) 2024-09-12T01:54:47.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f1742ffd640 1 -- 172.21.15.70:0/4155964919 learned_addr learned my addr 172.21.15.70:0/4155964919 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:47.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f174b7fe640 1 --2- 172.21.15.70:0/4155964919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e86760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f1742ffd640 1 --2- 172.21.15.70:0/4155964919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e91370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f1742ffd640 1 -- 172.21.15.70:0/4155964919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e7a5d0 msgr2=0x55b7c0e91370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f1742ffd640 1 --2- 172.21.15.70:0/4155964919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e91370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f1742ffd640 1 -- 172.21.15.70:0/4155964919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 msgr2=0x55b7c0e86760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f1742ffd640 1 --2- 172.21.15.70:0/4155964919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e86760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f1742ffd640 1 -- 172.21.15.70:0/4155964919 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c0e75310 con 0x55b7c0e85370 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f174b7fe640 1 --2- 172.21.15.70:0/4155964919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e86760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.097+0000 7f1742ffd640 1 --2- 172.21.15.70:0/4155964919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 0x55b7c0e86ca0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1734009850 tx=0x7f1734005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787edba9bf1540fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.098+0000 7f17417fa640 1 -- 172.21.15.70:0/4155964919 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734044070 con 0x55b7c0e85370 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.098+0000 7f17417fa640 1 -- 172.21.15.70:0/4155964919 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1734045040 con 0x55b7c0e85370 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.098+0000 7f17417fa640 1 -- 172.21.15.70:0/4155964919 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734054bc0 con 0x55b7c0e85370 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.098+0000 7f175411b740 1 -- 172.21.15.70:0/4155964919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 msgr2=0x55b7c0e86ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.098+0000 7f175411b740 1 --2- 172.21.15.70:0/4155964919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 0x55b7c0e86ca0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1734009850 tx=0x7f1734005a20 comp rx=0 tx=0).stop 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.098+0000 7f175411b740 1 -- 172.21.15.70:0/4155964919 shutdown_connections 2024-09-12T01:54:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.098+0000 7f175411b740 1 --2- 172.21.15.70:0/4155964919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e85370 0x55b7c0e86ca0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.098+0000 7f175411b740 1 --2- 172.21.15.70:0/4155964919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e86760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.098+0000 7f175411b740 1 --2- 172.21.15.70:0/4155964919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e91370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.098+0000 7f175411b740 1 -- 172.21.15.70:0/4155964919 >> 172.21.15.70:0/4155964919 conn(0x55b7c0e43310 msgr2=0x55b7c0e81f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:47.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.098+0000 7f175411b740 1 -- 172.21.15.70:0/4155964919 shutdown_connections 2024-09-12T01:54:47.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.098+0000 7f175411b740 1 -- 172.21.15.70:0/4155964919 wait complete. 2024-09-12T01:54:47.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.099+0000 7f175411b740 1 -- start start 2024-09-12T01:54:47.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.099+0000 7f175411b740 1 Processor -- start 2024-09-12T01:54:47.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.099+0000 7f175411b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e9c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.099+0000 7f175411b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e9c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.099+0000 7f175411b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e85370 0x55b7c0e8c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.099+0000 7f175411b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b0ec0 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.099+0000 7f175411b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b0790 con 0x55b7c0e7bb40 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.099+0000 7f175411b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1ad920 con 0x55b7c0e85370 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.099+0000 7f175411b740 10 client.0 _ll_register_callbacks cb 0x7f1734009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.099+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e9c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.099+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e9c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58292/0 (socket says 172.21.15.70:58292) 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.099+0000 7f1742ffd640 1 -- 172.21.15.70:0/1473197553 learned_addr learned my addr 172.21.15.70:0/1473197553 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f1742ffd640 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e85370 0x55b7c0e8c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f174b7fe640 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e9c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f1742ffd640 1 -- 172.21.15.70:0/1473197553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e85370 msgr2=0x55b7c0e8c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f1742ffd640 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e85370 0x55b7c0e8c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f1742ffd640 1 -- 172.21.15.70:0/1473197553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 msgr2=0x55b7c0e9c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f1742ffd640 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e9c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f1742ffd640 1 -- 172.21.15.70:0/1473197553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c0e76510 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f174b7fe640 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e9c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f1742ffd640 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e9c060 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1734005ab0 tx=0x7f173402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b25d9813762eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f172affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f172affd640 1 -- 172.21.15.70:0/1473197553 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734044040 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f172affd640 1 -- 172.21.15.70:0/1473197553 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f173403e8a0 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f175411b740 1 -- 172.21.15.70:0/1473197553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1734045040 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f172affd640 1 -- 172.21.15.70:0/1473197553 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f173403eaa0 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f175411b740 10 client.16449 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f175411b740 1 -- 172.21.15.70:0/1473197553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b7c0e8dbd0 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.100+0000 7f172affd640 1 -- 172.21.15.70:0/1473197553 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1734045040 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f172affd640 1 -- 172.21.15.70:0/1473197553 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f173403a070 con 0x55b7c0e7a5d0 2024-09-12T01:54:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f175411b740 10 client.16449 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f175411b740 10 client.16449 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f175411b740 20 client.16449 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f175411b740 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55b7c0effae0 0x55b7c0f01ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f175411b740 4 client.16449 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f175411b740 1 -- 172.21.15.70:0/1473197553 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7c0de7d70 con 0x55b7c0effae0 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f174b7fe640 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55b7c0effae0 0x55b7c0f01ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f174b7fe640 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55b7c0effae0 0x55b7c0f01ed0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2ad336a27603a1b3 server_cookie=cb2aef4b32dfed91 in_seq=0 out_seq=0 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f172affd640 10 client.16449 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f172affd640 1 -- 172.21.15.70:0/1473197553 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7c0de7d70 con 0x55b7c0effae0 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f172affd640 10 client.16449 handle_command_reply: tid=0 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.101+0000 7f175411b740 1 client.16449 shutdown 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f175411b740 1 -- 172.21.15.70:0/1473197553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 msgr2=0x55b7c0e9c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f175411b740 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e9c060 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1734005ab0 tx=0x7f173402a480 comp rx=0 tx=0).stop 2024-09-12T01:54:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f175411b740 1 -- 172.21.15.70:0/1473197553 shutdown_connections 2024-09-12T01:54:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f175411b740 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x55b7c0effae0 0x55b7c0f01ed0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f175411b740 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b7c0e85370 0x55b7c0e8c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f175411b740 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b7c0e7bb40 0x55b7c0e9c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f175411b740 1 --2- 172.21.15.70:0/1473197553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7c0e7a5d0 0x55b7c0e9c060 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f175411b740 1 -- 172.21.15.70:0/1473197553 >> 172.21.15.70:0/1473197553 conn(0x55b7c0e43310 msgr2=0x55b7c0e754e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f172affd640 0 client.16449 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:54:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f175411b740 1 -- 172.21.15.70:0/1473197553 shutdown_connections 2024-09-12T01:54:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f175411b740 1 -- 172.21.15.70:0/1473197553 wait complete. 2024-09-12T01:54:47.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f175411b740 20 client.16449 trim_cache size 0 max 16384 2024-09-12T01:54:47.119 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:54:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f1751d42640 1 -- 172.21.15.70:0/3015256065 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f17380a2b80 msgr2=0x7f17380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f1751d42640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f17380a2b80 0x7f17380a5040 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f174409b8c0 tx=0x7f1744066c30 comp rx=0 tx=0).stop 2024-09-12T01:54:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f1751d42640 1 -- 172.21.15.70:0/3015256065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c102ef0 msgr2=0x7f174c19a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.102+0000 7f1751d42640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c102ef0 0x7f174c19a6d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f174400eaa0 tx=0x7f174400ef60 comp rx=0 tx=0).stop 2024-09-12T01:54:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.103+0000 7f1751d42640 1 -- 172.21.15.70:0/3015256065 shutdown_connections 2024-09-12T01:54:47.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.103+0000 7f1751d42640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f17380a2b80 0x7f17380a5040 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.103+0000 7f1751d42640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c102ef0 0x7f174c19a6d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.103+0000 7f1751d42640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f174c102570 0x7f174c1a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.103+0000 7f1751d42640 1 --2- 172.21.15.70:0/3015256065 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f174c100e20 0x7f174c1a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:47.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.103+0000 7f1751d42640 1 -- 172.21.15.70:0/3015256065 >> 172.21.15.70:0/3015256065 conn(0x7f174c0fc7d0 msgr2=0x7f174c0ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:47.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.103+0000 7f1751d42640 1 -- 172.21.15.70:0/3015256065 shutdown_connections 2024-09-12T01:54:47.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:47.103+0000 7f1751d42640 1 -- 172.21.15.70:0/3015256065 wait complete. 2024-09-12T01:54:47.749 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:54:47.993 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:48.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.482+0000 7f85ad2dc640 1 -- 172.21.15.70:0/3913942303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85a8102ef0 msgr2=0x7f85a810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.482+0000 7f85ad2dc640 1 --2- 172.21.15.70:0/3913942303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85a8102ef0 0x7f85a810da40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009900 tx=0x7f85a002a480 comp rx=0 tx=0).stop 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.482+0000 7f85ad2dc640 1 -- 172.21.15.70:0/3913942303 shutdown_connections 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.482+0000 7f85ad2dc640 1 --2- 172.21.15.70:0/3913942303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85a8102ef0 0x7f85a810da40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.482+0000 7f85ad2dc640 1 --2- 172.21.15.70:0/3913942303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a8102570 0x7f85a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.482+0000 7f85ad2dc640 1 --2- 172.21.15.70:0/3913942303 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85a8100e20 0x7f85a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.482+0000 7f85ad2dc640 1 -- 172.21.15.70:0/3913942303 >> 172.21.15.70:0/3913942303 conn(0x7f85a80fc7d0 msgr2=0x7f85a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.482+0000 7f85ad2dc640 1 -- 172.21.15.70:0/3913942303 shutdown_connections 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.482+0000 7f85ad2dc640 1 -- 172.21.15.70:0/3913942303 wait complete. 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.483+0000 7f85ad2dc640 1 Processor -- start 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.483+0000 7f85ad2dc640 1 -- start start 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.483+0000 7f85ad2dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85a8100e20 0x7f85a81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.483+0000 7f85ad2dc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85a8102570 0x7f85a8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.483+0000 7f85ad2dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a8102ef0 0x7f85a819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.483+0000 7f85ad2dc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85a81121e0 con 0x7f85a8100e20 2024-09-12T01:54:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.483+0000 7f85ad2dc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f85a8112060 con 0x7f85a8102ef0 2024-09-12T01:54:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.483+0000 7f85ad2dc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f85a8112360 con 0x7f85a8102570 2024-09-12T01:54:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.483+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85a8100e20 0x7f85a81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.483+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85a8100e20 0x7f85a81985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58314/0 (socket says 172.21.15.70:58314) 2024-09-12T01:54:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.483+0000 7f85a6ffd640 1 -- 172.21.15.70:0/1860242226 learned_addr learned my addr 172.21.15.70:0/1860242226 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.483+0000 7f85a67fc640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85a8102570 0x7f85a8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f85a77fe640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a8102ef0 0x7f85a819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f85a6ffd640 1 -- 172.21.15.70:0/1860242226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85a8102570 msgr2=0x7f85a8198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85a8102570 0x7f85a8198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f85a6ffd640 1 -- 172.21.15.70:0/1860242226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a8102ef0 msgr2=0x7f85a819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a8102ef0 0x7f85a819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f85a6ffd640 1 -- 172.21.15.70:0/1860242226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a819d550 con 0x7f85a8100e20 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f85a77fe640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a8102ef0 0x7f85a819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85a8100e20 0x7f85a81985a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f859800ba50 tx=0x7f859800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f859ffff640 1 -- 172.21.15.70:0/1860242226 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8598019070 con 0x7f85a8100e20 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f859ffff640 1 -- 172.21.15.70:0/1860242226 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f859800cbe0 con 0x7f85a8100e20 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f85ad2dc640 1 -- 172.21.15.70:0/1860242226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a819d840 con 0x7f85a8100e20 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f859ffff640 1 -- 172.21.15.70:0/1860242226 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8598007770 con 0x7f85a8100e20 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.484+0000 7f85ad2dc640 1 -- 172.21.15.70:0/1860242226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a81a5120 con 0x7f85a8100e20 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.486+0000 7f859ffff640 1 -- 172.21.15.70:0/1860242226 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f859801c070 con 0x7f85a8100e20 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.487+0000 7f85af6b5740 1 Processor -- start 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.487+0000 7f85af6b5740 1 -- start start 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.487+0000 7f85af6b5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38e6b40 0x55d0f38e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.487+0000 7f85af6b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.487+0000 7f85af6b5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38f0370 0x55d0f38f2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.487+0000 7f85af6b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d0f384b2f0 con 0x55d0f38e55d0 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.487+0000 7f85af6b5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d0f37f2cf0 con 0x55d0f38e6b40 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.487+0000 7f85af6b5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d0f38472b0 con 0x55d0f38f0370 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.487+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f859ffff640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f85940a2c00 0x7f85940a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38e5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58322/0 (socket says 172.21.15.70:58322) 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f85a6ffd640 1 -- 172.21.15.70:0/1891016204 learned_addr learned my addr 172.21.15.70:0/1891016204 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f85a67fc640 1 --2- 172.21.15.70:0/1891016204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38f0370 0x55d0f38f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f85a77fe640 1 --2- 172.21.15.70:0/1891016204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38e6b40 0x55d0f38e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f859ffff640 1 -- 172.21.15.70:0/1860242226 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f85980ce690 con 0x7f85a8100e20 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f85a6ffd640 1 -- 172.21.15.70:0/1891016204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38f0370 msgr2=0x55d0f38f2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f85a77fe640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f85940a2c00 0x7f85940a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/1891016204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38f0370 0x55d0f38f2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f85a6ffd640 1 -- 172.21.15.70:0/1891016204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38e6b40 msgr2=0x55d0f38e5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/1891016204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38e6b40 0x55d0f38e5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f85a6ffd640 1 -- 172.21.15.70:0/1891016204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f37d73a0 con 0x55d0f38e55d0 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/1891016204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38e5a10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f85980cc150 tx=0x7f8598014e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3497c3b55d052c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f859d7fa640 1 -- 172.21.15.70:0/1891016204 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85980a3b20 con 0x55d0f38e55d0 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f85a77fe640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f85940a2c00 0x7f85940a50c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f85a00096c0 tx=0x7f85a0005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f859d7fa640 1 -- 172.21.15.70:0/1891016204 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f859809af60 con 0x55d0f38e55d0 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.488+0000 7f859d7fa640 1 -- 172.21.15.70:0/1891016204 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85980a38f0 con 0x55d0f38e55d0 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.489+0000 7f85af6b5740 1 -- 172.21.15.70:0/1891016204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 msgr2=0x55d0f38e5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.489+0000 7f85af6b5740 1 --2- 172.21.15.70:0/1891016204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38e5a10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f85980cc150 tx=0x7f8598014e10 comp rx=0 tx=0).stop 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.489+0000 7f85af6b5740 1 -- 172.21.15.70:0/1891016204 shutdown_connections 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.489+0000 7f85af6b5740 1 --2- 172.21.15.70:0/1891016204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38f0370 0x55d0f38f2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.489+0000 7f85af6b5740 1 --2- 172.21.15.70:0/1891016204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38e5a10 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.489+0000 7f85af6b5740 1 --2- 172.21.15.70:0/1891016204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38e6b40 0x55d0f38e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.489+0000 7f85af6b5740 1 -- 172.21.15.70:0/1891016204 >> 172.21.15.70:0/1891016204 conn(0x55d0f38ae310 msgr2=0x55d0f38e1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.489+0000 7f85af6b5740 1 -- 172.21.15.70:0/1891016204 shutdown_connections 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.489+0000 7f85af6b5740 1 -- 172.21.15.70:0/1891016204 wait complete. 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85af6b5740 1 -- start start 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85af6b5740 1 Processor -- start 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85af6b5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e55d0 0x55d0f38efd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85af6b5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38e6b40 0x55d0f38ed030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85af6b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38f0370 0x55d0f38ed640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85af6b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d0f38f2fb0 con 0x55d0f38f0370 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85af6b5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55d0f3806060 con 0x55d0f38e6b40 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85af6b5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d0f38f3130 con 0x55d0f38e55d0 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85af6b5740 10 client.0 _ll_register_callbacks cb 0x55d0f35598c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:48.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85a77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38f0370 0x55d0f38ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85a77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38f0370 0x55d0f38ed640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58332/0 (socket says 172.21.15.70:58332) 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85a77fe640 1 -- 172.21.15.70:0/1215082222 learned_addr learned my addr 172.21.15.70:0/1215082222 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85a67fc640 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38e6b40 0x55d0f38ed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85a77fe640 1 -- 172.21.15.70:0/1215082222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e55d0 msgr2=0x55d0f38efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e55d0 0x55d0f38efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85a77fe640 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e55d0 0x55d0f38efd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85a77fe640 1 -- 172.21.15.70:0/1215082222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38e6b40 msgr2=0x55d0f38ed030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85a77fe640 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38e6b40 0x55d0f38ed030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85a77fe640 1 -- 172.21.15.70:0/1215082222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f35bc3c0 con 0x55d0f38f0370 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85a67fc640 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38e6b40 0x55d0f38ed030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f85a77fe640 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38f0370 0x55d0f38ed640 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f85a0005400 tx=0x7f85a0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b6051a433b6393 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.490+0000 7f858e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:48.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f858e7fc640 1 -- 172.21.15.70:0/1215082222 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0045050 con 0x55d0f38f0370 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f858e7fc640 1 -- 172.21.15.70:0/1215082222 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f85a004a440 con 0x55d0f38f0370 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f85af6b5740 1 -- 172.21.15.70:0/1215082222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f859809af60 con 0x55d0f38f0370 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f858e7fc640 1 -- 172.21.15.70:0/1215082222 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f85a0035040 con 0x55d0f38f0370 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f85af6b5740 10 client.16461 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f85af6b5740 1 -- 172.21.15.70:0/1215082222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d0f38fea80 con 0x55d0f38f0370 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f858e7fc640 1 -- 172.21.15.70:0/1215082222 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f859809af60 con 0x55d0f38f0370 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f858e7fc640 1 -- 172.21.15.70:0/1215082222 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f85a003a040 con 0x55d0f38f0370 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f85af6b5740 10 client.16461 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f85af6b5740 10 client.16461 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f85af6b5740 20 client.16461 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f85af6b5740 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55d0f3900000 0x55d0f39024a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f85af6b5740 4 client.16461 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.491+0000 7f85af6b5740 1 -- 172.21.15.70:0/1215082222 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0f3858860 con 0x55d0f3900000 2024-09-12T01:54:48.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.492+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55d0f3900000 0x55d0f39024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.492+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55d0f3900000 0x55d0f39024a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb564e73f11b6a98 server_cookie=2b1a0b49494e4d9c in_seq=0 out_seq=0 2024-09-12T01:54:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.492+0000 7f858e7fc640 10 client.16461 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:54:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f858e7fc640 1 -- 172.21.15.70:0/1215082222 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0f3858860 con 0x55d0f3900000 2024-09-12T01:54:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f858e7fc640 10 client.16461 handle_command_reply: tid=0 2024-09-12T01:54:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f85af6b5740 1 client.16461 shutdown 2024-09-12T01:54:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f85af6b5740 1 -- 172.21.15.70:0/1215082222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38f0370 msgr2=0x55d0f38ed640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f85af6b5740 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38f0370 0x55d0f38ed640 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f85a0005400 tx=0x7f85a0009260 comp rx=0 tx=0).stop 2024-09-12T01:54:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f85af6b5740 1 -- 172.21.15.70:0/1215082222 shutdown_connections 2024-09-12T01:54:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f85af6b5740 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55d0f3900000 0x55d0f39024a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f85af6b5740 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38f0370 0x55d0f38ed640 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f85af6b5740 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38e6b40 0x55d0f38ed030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f85af6b5740 1 --2- 172.21.15.70:0/1215082222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e55d0 0x55d0f38efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f858e7fc640 0 client.16461 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:54:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f85af6b5740 1 -- 172.21.15.70:0/1215082222 >> 172.21.15.70:0/1215082222 conn(0x55d0f38ae310 msgr2=0x55d0f38e7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f85af6b5740 1 -- 172.21.15.70:0/1215082222 shutdown_connections 2024-09-12T01:54:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f85af6b5740 1 -- 172.21.15.70:0/1215082222 wait complete. 2024-09-12T01:54:48.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.493+0000 7f85af6b5740 20 client.16461 trim_cache size 0 max 16384 2024-09-12T01:54:48.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.506+0000 7f85af6b5740 1 Processor -- start 2024-09-12T01:54:48.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.506+0000 7f85af6b5740 1 -- start start 2024-09-12T01:54:48.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.506+0000 7f85af6b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38fc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.506+0000 7f85af6b5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e6b40 0x55d0f38ec010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.506+0000 7f85af6b5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38f0370 0x55d0f38e8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.506+0000 7f85af6b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85a81ad5e0 con 0x55d0f38e55d0 2024-09-12T01:54:48.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.506+0000 7f85af6b5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f85a81af2d0 con 0x55d0f38f0370 2024-09-12T01:54:48.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.506+0000 7f85af6b5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f85a81add10 con 0x55d0f38e6b40 2024-09-12T01:54:48.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.506+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38fc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38fc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58348/0 (socket says 172.21.15.70:58348) 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f85a6ffd640 1 -- 172.21.15.70:0/2249100409 learned_addr learned my addr 172.21.15.70:0/2249100409 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f85a67fc640 1 --2- 172.21.15.70:0/2249100409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e6b40 0x55d0f38ec010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f85a77fe640 1 --2- 172.21.15.70:0/2249100409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38f0370 0x55d0f38e8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f85a6ffd640 1 -- 172.21.15.70:0/2249100409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e6b40 msgr2=0x55d0f38ec010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/2249100409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e6b40 0x55d0f38ec010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f85a6ffd640 1 -- 172.21.15.70:0/2249100409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38f0370 msgr2=0x55d0f38e8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/2249100409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38f0370 0x55d0f38e8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f85a6ffd640 1 -- 172.21.15.70:0/2249100409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f38e1de0 con 0x55d0f38e55d0 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f85a77fe640 1 --2- 172.21.15.70:0/2249100409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38f0370 0x55d0f38e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f85a67fc640 1 --2- 172.21.15.70:0/2249100409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e6b40 0x55d0f38ec010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/2249100409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38fc250 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f85980973c0 tx=0x7f85980bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aaaf20d4f48546a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f859cff9640 1 -- 172.21.15.70:0/2249100409 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859800ce10 con 0x55d0f38e55d0 2024-09-12T01:54:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f859cff9640 1 -- 172.21.15.70:0/2249100409 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f859809af60 con 0x55d0f38e55d0 2024-09-12T01:54:48.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.507+0000 7f859cff9640 1 -- 172.21.15.70:0/2249100409 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859809a3b0 con 0x55d0f38e55d0 2024-09-12T01:54:48.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.508+0000 7f85af6b5740 1 -- 172.21.15.70:0/2249100409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 msgr2=0x55d0f38fc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.508+0000 7f85af6b5740 1 --2- 172.21.15.70:0/2249100409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38fc250 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f85980973c0 tx=0x7f85980bb040 comp rx=0 tx=0).stop 2024-09-12T01:54:48.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.508+0000 7f85af6b5740 1 -- 172.21.15.70:0/2249100409 shutdown_connections 2024-09-12T01:54:48.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.508+0000 7f85af6b5740 1 --2- 172.21.15.70:0/2249100409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38f0370 0x55d0f38e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.508+0000 7f85af6b5740 1 --2- 172.21.15.70:0/2249100409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e6b40 0x55d0f38ec010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.508+0000 7f85af6b5740 1 --2- 172.21.15.70:0/2249100409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38fc250 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.508+0000 7f85af6b5740 1 -- 172.21.15.70:0/2249100409 >> 172.21.15.70:0/2249100409 conn(0x55d0f38ae310 msgr2=0x55d0f38eb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:48.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.508+0000 7f85af6b5740 1 -- 172.21.15.70:0/2249100409 shutdown_connections 2024-09-12T01:54:48.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.508+0000 7f85af6b5740 1 -- 172.21.15.70:0/2249100409 wait complete. 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.508+0000 7f85af6b5740 1 -- start start 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.508+0000 7f85af6b5740 1 Processor -- start 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85af6b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38f3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85af6b5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e6b40 0x55d0f38f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85af6b5740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38f0370 0x55d0f3968d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85af6b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85a81aeb40 con 0x55d0f38e55d0 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85af6b5740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f85a81ae410 con 0x55d0f38f0370 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85af6b5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f85a81ab5a0 con 0x55d0f38e6b40 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85af6b5740 10 client.0 _ll_register_callbacks cb 0x7f85a0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38f3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58350/0 (socket says 172.21.15.70:58350) 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85a6ffd640 1 -- 172.21.15.70:0/3608235031 learned_addr learned my addr 172.21.15.70:0/3608235031 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85a67fc640 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e6b40 0x55d0f38f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85a77fe640 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38f0370 0x55d0f3968d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85a6ffd640 1 -- 172.21.15.70:0/3608235031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e6b40 msgr2=0x55d0f38f3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e6b40 0x55d0f38f3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85a6ffd640 1 -- 172.21.15.70:0/3608235031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38f0370 msgr2=0x55d0f3968d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38f0370 0x55d0f3968d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85a6ffd640 1 -- 172.21.15.70:0/3608235031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f39692b0 con 0x55d0f38e55d0 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85a67fc640 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e6b40 0x55d0f38f3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85a6ffd640 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38f3740 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8598014e50 tx=0x7f85980bb0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d666a63e80c4cb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f858e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f858e7fc640 1 -- 172.21.15.70:0/3608235031 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8598099260 con 0x55d0f38e55d0 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f858e7fc640 1 -- 172.21.15.70:0/3608235031 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8598014a40 con 0x55d0f38e55d0 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85af6b5740 1 -- 172.21.15.70:0/3608235031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f859809af60 con 0x55d0f38e55d0 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f858e7fc640 1 -- 172.21.15.70:0/3608235031 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f85980a3700 con 0x55d0f38e55d0 2024-09-12T01:54:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85af6b5740 10 client.16467 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.509+0000 7f85af6b5740 1 -- 172.21.15.70:0/3608235031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d0f396a480 con 0x55d0f38e55d0 2024-09-12T01:54:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.510+0000 7f858e7fc640 1 -- 172.21.15.70:0/3608235031 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f859809af60 con 0x55d0f38e55d0 2024-09-12T01:54:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.510+0000 7f858e7fc640 1 -- 172.21.15.70:0/3608235031 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f8598096d40 con 0x55d0f38e55d0 2024-09-12T01:54:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.510+0000 7f85af6b5740 10 client.16467 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.510+0000 7f85af6b5740 10 client.16467 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:54:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.510+0000 7f85af6b5740 20 client.16467 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.510+0000 7f85af6b5740 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55d0f396a700 0x55d0f396caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.510+0000 7f85af6b5740 4 client.16467 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:54:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.510+0000 7f85af6b5740 1 -- 172.21.15.70:0/3608235031 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0f3852d70 con 0x55d0f396a700 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.510+0000 7f85a67fc640 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55d0f396a700 0x55d0f396caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f858e7fc640 10 client.16467 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85a67fc640 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55d0f396a700 0x55d0f396caf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fcde4534d5adf5d6 server_cookie=7b20ab9e4f457ddc in_seq=0 out_seq=0 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f858e7fc640 1 -- 172.21.15.70:0/3608235031 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0f3852d70 con 0x55d0f396a700 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f858e7fc640 10 client.16467 handle_command_reply: tid=0 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85af6b5740 1 client.16467 shutdown 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85af6b5740 1 -- 172.21.15.70:0/3608235031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 msgr2=0x55d0f38f3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85af6b5740 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38f3740 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8598014e50 tx=0x7f85980bb0b0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85af6b5740 1 -- 172.21.15.70:0/3608235031 shutdown_connections 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85af6b5740 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55d0f396a700 0x55d0f396caf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85af6b5740 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d0f38f0370 0x55d0f3968d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85af6b5740 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0f38e6b40 0x55d0f38f3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85af6b5740 1 --2- 172.21.15.70:0/3608235031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f38e55d0 0x55d0f38f3740 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85af6b5740 1 -- 172.21.15.70:0/3608235031 >> 172.21.15.70:0/3608235031 conn(0x55d0f38ae310 msgr2=0x55d0f38ec120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f858e7fc640 0 client.16467 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:54:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85af6b5740 1 -- 172.21.15.70:0/3608235031 shutdown_connections 2024-09-12T01:54:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85af6b5740 1 -- 172.21.15.70:0/3608235031 wait complete. 2024-09-12T01:54:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.511+0000 7f85af6b5740 20 client.16467 trim_cache size 0 max 16384 2024-09-12T01:54:48.523 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:54:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.512+0000 7f85ad2dc640 1 -- 172.21.15.70:0/1860242226 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f85940a2c00 msgr2=0x7f85940a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.512+0000 7f85ad2dc640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f85940a2c00 0x7f85940a50c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f85a00096c0 tx=0x7f85a0005fd0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.512+0000 7f85ad2dc640 1 -- 172.21.15.70:0/1860242226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85a8100e20 msgr2=0x7f85a81985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.512+0000 7f85ad2dc640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85a8100e20 0x7f85a81985a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f859800ba50 tx=0x7f859800bf10 comp rx=0 tx=0).stop 2024-09-12T01:54:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.512+0000 7f85ad2dc640 1 -- 172.21.15.70:0/1860242226 shutdown_connections 2024-09-12T01:54:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.512+0000 7f85ad2dc640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f85940a2c00 0x7f85940a50c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.512+0000 7f85ad2dc640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f85a8102ef0 0x7f85a819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.512+0000 7f85ad2dc640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85a8102570 0x7f85a8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.512+0000 7f85ad2dc640 1 --2- 172.21.15.70:0/1860242226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85a8100e20 0x7f85a81985a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.512+0000 7f85ad2dc640 1 -- 172.21.15.70:0/1860242226 >> 172.21.15.70:0/1860242226 conn(0x7f85a80fc7d0 msgr2=0x7f85a81067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.512+0000 7f85ad2dc640 1 -- 172.21.15.70:0/1860242226 shutdown_connections 2024-09-12T01:54:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:48.512+0000 7f85ad2dc640 1 -- 172.21.15.70:0/1860242226 wait complete. 2024-09-12T01:54:48.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:48 smithi070 ceph-mon[31177]: pgmap v416: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 464 KiB/s wr, 258 op/s 2024-09-12T01:54:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:48 smithi191 ceph-mon[35770]: pgmap v416: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 464 KiB/s wr, 258 op/s 2024-09-12T01:54:49.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:48 smithi152 ceph-mon[35055]: pgmap v416: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 464 KiB/s wr, 258 op/s 2024-09-12T01:54:49.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:54:49.481 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:49.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.933+0000 7f3c256c9640 1 -- 172.21.15.70:0/418366328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c20100a90 msgr2=0x7f3c20100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:49.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.933+0000 7f3c256c9640 1 --2- 172.21.15.70:0/418366328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c20100a90 0x7f3c20100ef0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009930 tx=0x7f3c1402a420 comp rx=0 tx=0).stop 2024-09-12T01:54:49.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.933+0000 7f3c256c9640 1 -- 172.21.15.70:0/418366328 shutdown_connections 2024-09-12T01:54:49.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.933+0000 7f3c256c9640 1 --2- 172.21.15.70:0/418366328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c20101430 0x7f3c2010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.933+0000 7f3c256c9640 1 --2- 172.21.15.70:0/418366328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c20100a90 0x7f3c20100ef0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.933+0000 7f3c256c9640 1 --2- 172.21.15.70:0/418366328 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c20106a90 0x7f3c20106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.933+0000 7f3c256c9640 1 -- 172.21.15.70:0/418366328 >> 172.21.15.70:0/418366328 conn(0x7f3c200fc7d0 msgr2=0x7f3c200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:49.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.933+0000 7f3c256c9640 1 -- 172.21.15.70:0/418366328 shutdown_connections 2024-09-12T01:54:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.933+0000 7f3c256c9640 1 -- 172.21.15.70:0/418366328 wait complete. 2024-09-12T01:54:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.934+0000 7f3c256c9640 1 Processor -- start 2024-09-12T01:54:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.934+0000 7f3c256c9640 1 -- start start 2024-09-12T01:54:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c256c9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c20100a90 0x7f3c20197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c256c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c20101430 0x7f3c201979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c256c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c20106a90 0x7f3c2019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c256c9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3c20110fb0 con 0x7f3c20106a90 2024-09-12T01:54:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c256c9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3c20110e30 con 0x7f3c20101430 2024-09-12T01:54:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c256c9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3c20111130 con 0x7f3c20100a90 2024-09-12T01:54:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c1f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c20106a90 0x7f3c2019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c1f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c20106a90 0x7f3c2019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58376/0 (socket says 172.21.15.70:58376) 2024-09-12T01:54:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c1f7fe640 1 -- 172.21.15.70:0/1042642921 learned_addr learned my addr 172.21.15.70:0/1042642921 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c1effd640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c20100a90 0x7f3c20197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c1e7fc640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c20101430 0x7f3c201979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c1f7fe640 1 -- 172.21.15.70:0/1042642921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c20100a90 msgr2=0x7f3c20197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:49.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c1f7fe640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c20100a90 0x7f3c20197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c1f7fe640 1 -- 172.21.15.70:0/1042642921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c20101430 msgr2=0x7f3c201979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:49.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c1f7fe640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c20101430 0x7f3c201979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c1f7fe640 1 -- 172.21.15.70:0/1042642921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2019c440 con 0x7f3c20106a90 2024-09-12T01:54:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c1e7fc640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c20101430 0x7f3c201979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:49.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c1f7fe640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c20106a90 0x7f3c2019bd60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800eaa0 tx=0x7f3c1800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:49.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c07fff640 1 -- 172.21.15.70:0/1042642921 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800cdb0 con 0x7f3c20106a90 2024-09-12T01:54:49.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c256c9640 1 -- 172.21.15.70:0/1042642921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2019c730 con 0x7f3c20106a90 2024-09-12T01:54:49.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c07fff640 1 -- 172.21.15.70:0/1042642921 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c18004b20 con 0x7f3c20106a90 2024-09-12T01:54:49.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c07fff640 1 -- 172.21.15.70:0/1042642921 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18011760 con 0x7f3c20106a90 2024-09-12T01:54:49.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.935+0000 7f3c256c9640 1 -- 172.21.15.70:0/1042642921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c201a4010 con 0x7f3c20106a90 2024-09-12T01:54:49.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.937+0000 7f3c07fff640 1 -- 172.21.15.70:0/1042642921 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3c18004cd0 con 0x7f3c20106a90 2024-09-12T01:54:49.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c27aa2740 1 Processor -- start 2024-09-12T01:54:49.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c27aa2740 1 -- start start 2024-09-12T01:54:49.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c07fff640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3c080a2b80 0x7f3c080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c27aa2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadac0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c27aa2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadac05d0 0x55dfadac0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c27aa2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 0x55dfadacf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c27aa2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dfada262f0 con 0x55dfadacd580 2024-09-12T01:54:49.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c27aa2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dfad9cdcf0 con 0x55dfadac1b40 2024-09-12T01:54:49.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c27aa2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dfada222b0 con 0x55dfadac05d0 2024-09-12T01:54:49.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c1e7fc640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3c080a2b80 0x7f3c080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c1f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 0x55dfadacf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c07fff640 1 -- 172.21.15.70:0/1042642921 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3c180cf360 con 0x7f3c20106a90 2024-09-12T01:54:49.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c1effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadac0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c1e7fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadac05d0 0x55dfadac0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c1effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadac0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.70:36122/0 (socket says 172.21.15.70:36122) 2024-09-12T01:54:49.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.938+0000 7f3c1effd640 1 -- 172.21.15.70:0/3729894852 learned_addr learned my addr 172.21.15.70:0/3729894852 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:49.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.939+0000 7f3c1effd640 1 -- 172.21.15.70:0/3729894852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadac05d0 msgr2=0x55dfadac0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:49.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.939+0000 7f3c1effd640 1 --2- 172.21.15.70:0/3729894852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadac05d0 0x55dfadac0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.939+0000 7f3c1effd640 1 -- 172.21.15.70:0/3729894852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 msgr2=0x55dfadacf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:49.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.939+0000 7f3c1effd640 1 --2- 172.21.15.70:0/3729894852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 0x55dfadacf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.939+0000 7f3c1effd640 1 -- 172.21.15.70:0/3729894852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfad9b23a0 con 0x55dfadac1b40 2024-09-12T01:54:49.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.939+0000 7f3c1f7fe640 1 --2- 172.21.15.70:0/3729894852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 0x55dfadacf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:54:49.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.939+0000 7f3c1e7fc640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3c080a2b80 0x7f3c080a5040 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3c14005ec0 tx=0x7f3c140316e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:49.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.939+0000 7f3c1effd640 1 --2- 172.21.15.70:0/3729894852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadac0090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000bc20 tx=0x7f3c1000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9824d464d3577bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:49.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.939+0000 7f3c057fa640 1 -- 172.21.15.70:0/3729894852 <== mon.2 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10015070 con 0x55dfadac1b40 2024-09-12T01:54:49.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.939+0000 7f3c057fa640 1 -- 172.21.15.70:0/3729894852 <== mon.2 v2:172.21.15.152:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c10005520 con 0x55dfadac1b40 2024-09-12T01:54:49.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.939+0000 7f3c057fa640 1 -- 172.21.15.70:0/3729894852 <== mon.2 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c100116a0 con 0x55dfadac1b40 2024-09-12T01:54:49.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 -- 172.21.15.70:0/3729894852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 msgr2=0x55dfadac0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:49.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/3729894852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadac0090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000bc20 tx=0x7f3c1000f730 comp rx=0 tx=0).stop 2024-09-12T01:54:49.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 -- 172.21.15.70:0/3729894852 shutdown_connections 2024-09-12T01:54:49.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/3729894852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 0x55dfadacf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/3729894852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadac05d0 0x55dfadac0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/3729894852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadac0090 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 -- 172.21.15.70:0/3729894852 >> 172.21.15.70:0/3729894852 conn(0x55dfada89310 msgr2=0x55dfadabcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 -- 172.21.15.70:0/3729894852 shutdown_connections 2024-09-12T01:54:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 -- 172.21.15.70:0/3729894852 wait complete. 2024-09-12T01:54:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 -- start start 2024-09-12T01:54:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 Processor -- start 2024-09-12T01:54:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 0x55dfadaccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.940+0000 7f3c27aa2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadaca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c27aa2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadacd580 0x55dfadaca780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c27aa2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dfadad0280 con 0x55dfadac05d0 2024-09-12T01:54:49.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c27aa2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dfad9e1060 con 0x55dfadac1b40 2024-09-12T01:54:49.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c27aa2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dfadad0400 con 0x55dfadacd580 2024-09-12T01:54:49.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c27aa2740 10 client.0 _ll_register_callbacks cb 0x55dfad7348c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:49.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c1effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 0x55dfadaccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c1effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 0x55dfadaccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58400/0 (socket says 172.21.15.70:58400) 2024-09-12T01:54:49.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c1effd640 1 -- 172.21.15.70:0/760667053 learned_addr learned my addr 172.21.15.70:0/760667053 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:49.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c1e7fc640 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadaca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c1f7fe640 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadacd580 0x55dfadaca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c1effd640 1 -- 172.21.15.70:0/760667053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadacd580 msgr2=0x55dfadaca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c1effd640 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadacd580 0x55dfadaca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c1effd640 1 -- 172.21.15.70:0/760667053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 msgr2=0x55dfadaca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c1effd640 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadaca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c1effd640 1 -- 172.21.15.70:0/760667053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfad7973c0 con 0x55dfadac05d0 2024-09-12T01:54:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c1effd640 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 0x55dfadaccf30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3c10004e70 tx=0x7f3c10005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c5e8a45d4484b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:49.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c02ff5640 1 -- 172.21.15.70:0/760667053 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10028060 con 0x55dfadac05d0 2024-09-12T01:54:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c02ff5640 1 -- 172.21.15.70:0/760667053 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3c100046c0 con 0x55dfadac05d0 2024-09-12T01:54:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c27aa2740 1 -- 172.21.15.70:0/760667053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c10005520 con 0x55dfadac05d0 2024-09-12T01:54:49.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c02ff5640 1 -- 172.21.15.70:0/760667053 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3c10015070 con 0x55dfadac05d0 2024-09-12T01:54:49.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c27aa2740 10 client.16479 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:49.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.941+0000 7f3c27aa2740 1 -- 172.21.15.70:0/760667053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55dfadadbcd0 con 0x55dfadac05d0 2024-09-12T01:54:49.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.942+0000 7f3c02ff5640 1 -- 172.21.15.70:0/760667053 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c10005520 con 0x55dfadac05d0 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.942+0000 7f3c02ff5640 1 -- 172.21.15.70:0/760667053 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f3c1002d070 con 0x55dfadac05d0 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.942+0000 7f3c27aa2740 10 client.16479 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.942+0000 7f3c27aa2740 10 client.16479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.942+0000 7f3c27aa2740 20 client.16479 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.942+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dfadadd0d0 0x55dfadadf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.942+0000 7f3c27aa2740 4 client.16479 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.942+0000 7f3c27aa2740 1 -- 172.21.15.70:0/760667053 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfada33860 con 0x55dfadadd0d0 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.942+0000 7f3c1e7fc640 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dfadadd0d0 0x55dfadadf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c02ff5640 10 client.16479 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c1e7fc640 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dfadadd0d0 0x55dfadadf4c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81989c348e0e5527 server_cookie=fb17f68e581c0463 in_seq=0 out_seq=0 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c02ff5640 1 -- 172.21.15.70:0/760667053 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfada33860 con 0x55dfadadd0d0 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c02ff5640 10 client.16479 handle_command_reply: tid=0 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c27aa2740 1 client.16479 shutdown 2024-09-12T01:54:49.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c27aa2740 1 -- 172.21.15.70:0/760667053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 msgr2=0x55dfadaccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:49.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 0x55dfadaccf30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3c10004e70 tx=0x7f3c10005740 comp rx=0 tx=0).stop 2024-09-12T01:54:49.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c27aa2740 1 -- 172.21.15.70:0/760667053 shutdown_connections 2024-09-12T01:54:49.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dfadadd0d0 0x55dfadadf4c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadacd580 0x55dfadaca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadaca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/760667053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 0x55dfadaccf30 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c02ff5640 0 client.16479 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:49.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.943+0000 7f3c27aa2740 1 -- 172.21.15.70:0/760667053 >> 172.21.15.70:0/760667053 conn(0x55dfada89310 msgr2=0x55dfadac2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:49.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.944+0000 7f3c27aa2740 1 -- 172.21.15.70:0/760667053 shutdown_connections 2024-09-12T01:54:49.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.944+0000 7f3c27aa2740 1 -- 172.21.15.70:0/760667053 wait complete. 2024-09-12T01:54:49.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.944+0000 7f3c27aa2740 20 client.16479 trim_cache size 0 max 16384 2024-09-12T01:54:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.956+0000 7f3c27aa2740 1 Processor -- start 2024-09-12T01:54:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.956+0000 7f3c27aa2740 1 -- start start 2024-09-12T01:54:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.956+0000 7f3c27aa2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac05d0 0x55dfadabce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.956+0000 7f3c27aa2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadac1b40 0x55dfadad9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c27aa2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 0x55dfadae4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c27aa2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3c201ab550 con 0x55dfadacd580 2024-09-12T01:54:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c27aa2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3c201ad240 con 0x55dfadac05d0 2024-09-12T01:54:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c27aa2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3c201abc80 con 0x55dfadac1b40 2024-09-12T01:54:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 0x55dfadae4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 0x55dfadae4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58404/0 (socket says 172.21.15.70:58404) 2024-09-12T01:54:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1f7fe640 1 -- 172.21.15.70:0/282564801 learned_addr learned my addr 172.21.15.70:0/282564801 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1e7fc640 1 --2- 172.21.15.70:0/282564801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadac1b40 0x55dfadad9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1effd640 1 --2- 172.21.15.70:0/282564801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac05d0 0x55dfadabce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1f7fe640 1 -- 172.21.15.70:0/282564801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadac1b40 msgr2=0x55dfadad9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1f7fe640 1 --2- 172.21.15.70:0/282564801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadac1b40 0x55dfadad9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1f7fe640 1 -- 172.21.15.70:0/282564801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac05d0 msgr2=0x55dfadabce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1f7fe640 1 --2- 172.21.15.70:0/282564801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac05d0 0x55dfadabce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1f7fe640 1 -- 172.21.15.70:0/282564801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfadac1760 con 0x55dfadacd580 2024-09-12T01:54:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1effd640 1 --2- 172.21.15.70:0/282564801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac05d0 0x55dfadabce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:49.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1e7fc640 1 --2- 172.21.15.70:0/282564801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadac1b40 0x55dfadad9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c1f7fe640 1 --2- 172.21.15.70:0/282564801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 0x55dfadae4af0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800efd0 tx=0x7f3c1809c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f825e29b1dec60e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c04ff9640 1 -- 172.21.15.70:0/282564801 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1801f040 con 0x55dfadacd580 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c04ff9640 1 -- 172.21.15.70:0/282564801 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c180b2020 con 0x55dfadacd580 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.957+0000 7f3c04ff9640 1 -- 172.21.15.70:0/282564801 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1801ac60 con 0x55dfadacd580 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.958+0000 7f3c27aa2740 1 -- 172.21.15.70:0/282564801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 msgr2=0x55dfadae4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.958+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/282564801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 0x55dfadae4af0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800efd0 tx=0x7f3c1809c340 comp rx=0 tx=0).stop 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.958+0000 7f3c27aa2740 1 -- 172.21.15.70:0/282564801 shutdown_connections 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.958+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/282564801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadacd580 0x55dfadae4af0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.958+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/282564801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadac1b40 0x55dfadad9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.958+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/282564801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac05d0 0x55dfadabce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.958+0000 7f3c27aa2740 1 -- 172.21.15.70:0/282564801 >> 172.21.15.70:0/282564801 conn(0x55dfada89310 msgr2=0x55dfadabc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.958+0000 7f3c27aa2740 1 -- 172.21.15.70:0/282564801 shutdown_connections 2024-09-12T01:54:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.958+0000 7f3c27aa2740 1 -- 172.21.15.70:0/282564801 wait complete. 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.958+0000 7f3c27aa2740 1 -- start start 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.958+0000 7f3c27aa2740 1 Processor -- start 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c27aa2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 0x55dfadad1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c27aa2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadad1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c27aa2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadacd580 0x55dfadad20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c27aa2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3c201acab0 con 0x55dfadac05d0 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c27aa2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3c201ac380 con 0x55dfadac1b40 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c27aa2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f3c201a9510 con 0x55dfadacd580 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c27aa2740 10 client.0 _ll_register_callbacks cb 0x7f3c18005820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c1effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 0x55dfadad1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c1effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 0x55dfadad1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58418/0 (socket says 172.21.15.70:58418) 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c1effd640 1 -- 172.21.15.70:0/1455373852 learned_addr learned my addr 172.21.15.70:0/1455373852 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c1f7fe640 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadacd580 0x55dfadad20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c1e7fc640 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadad1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c1effd640 1 -- 172.21.15.70:0/1455373852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadacd580 msgr2=0x55dfadad20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c1effd640 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadacd580 0x55dfadad20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c1effd640 1 -- 172.21.15.70:0/1455373852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 msgr2=0x55dfadad1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c1effd640 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadad1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c1effd640 1 -- 172.21.15.70:0/1455373852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfadb46d10 con 0x55dfadac05d0 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c1f7fe640 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadacd580 0x55dfadad20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c1effd640 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 0x55dfadad1660 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000baf0 tx=0x7f3c1000bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9f105a755969b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c02ff5640 1 -- 172.21.15.70:0/1455373852 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10033030 con 0x55dfadac05d0 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c02ff5640 1 -- 172.21.15.70:0/1455373852 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3c10020030 con 0x55dfadac05d0 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.959+0000 7f3c27aa2740 1 -- 172.21.15.70:0/1455373852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c180b2020 con 0x55dfadac05d0 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.960+0000 7f3c02ff5640 1 -- 172.21.15.70:0/1455373852 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3c1001d020 con 0x55dfadac05d0 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.960+0000 7f3c27aa2740 10 client.16485 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:49.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.960+0000 7f3c27aa2740 1 -- 172.21.15.70:0/1455373852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55dfadb47f40 con 0x55dfadac05d0 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.960+0000 7f3c02ff5640 1 -- 172.21.15.70:0/1455373852 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c180b2020 con 0x55dfadac05d0 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.960+0000 7f3c02ff5640 1 -- 172.21.15.70:0/1455373852 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f3c1002d070 con 0x55dfadac05d0 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.960+0000 7f3c27aa2740 10 client.16485 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.960+0000 7f3c27aa2740 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.960+0000 7f3c27aa2740 20 client.16485 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.960+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dfadb486b0 0x55dfadb4aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.960+0000 7f3c27aa2740 4 client.16485 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.960+0000 7f3c27aa2740 1 -- 172.21.15.70:0/1455373852 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dfada2dd70 con 0x55dfadb486b0 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.960+0000 7f3c1e7fc640 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dfadb486b0 0x55dfadb4aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c1e7fc640 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dfadb486b0 0x55dfadb4aad0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32eec5a468290698 server_cookie=7281bbb57c8fe0aa in_seq=0 out_seq=0 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c02ff5640 10 client.16485 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c02ff5640 1 -- 172.21.15.70:0/1455373852 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dfada2dd70 con 0x55dfadb486b0 2024-09-12T01:54:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c02ff5640 10 client.16485 handle_command_reply: tid=0 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c27aa2740 1 client.16485 shutdown 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c27aa2740 1 -- 172.21.15.70:0/1455373852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 msgr2=0x55dfadad1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 0x55dfadad1660 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000baf0 tx=0x7f3c1000bb20 comp rx=0 tx=0).stop 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c27aa2740 1 -- 172.21.15.70:0/1455373852 shutdown_connections 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55dfadb486b0 0x55dfadb4aad0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dfadacd580 0x55dfadad20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dfadac1b40 0x55dfadad1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c27aa2740 1 --2- 172.21.15.70:0/1455373852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dfadac05d0 0x55dfadad1660 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c27aa2740 1 -- 172.21.15.70:0/1455373852 >> 172.21.15.70:0/1455373852 conn(0x55dfada89310 msgr2=0x55dfadabb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c02ff5640 0 client.16485 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c27aa2740 1 -- 172.21.15.70:0/1455373852 shutdown_connections 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c27aa2740 1 -- 172.21.15.70:0/1455373852 wait complete. 2024-09-12T01:54:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.961+0000 7f3c27aa2740 20 client.16485 trim_cache size 0 max 16384 2024-09-12T01:54:49.985 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:54:49.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.962+0000 7f3c256c9640 1 -- 172.21.15.70:0/1042642921 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3c080a2b80 msgr2=0x7f3c080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:49.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.962+0000 7f3c256c9640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3c080a2b80 0x7f3c080a5040 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3c14005ec0 tx=0x7f3c140316e0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.962+0000 7f3c256c9640 1 -- 172.21.15.70:0/1042642921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c20106a90 msgr2=0x7f3c2019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:49.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.962+0000 7f3c256c9640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c20106a90 0x7f3c2019bd60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800eaa0 tx=0x7f3c1800ef60 comp rx=0 tx=0).stop 2024-09-12T01:54:49.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.962+0000 7f3c256c9640 1 -- 172.21.15.70:0/1042642921 shutdown_connections 2024-09-12T01:54:49.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.962+0000 7f3c256c9640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f3c080a2b80 0x7f3c080a5040 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.962+0000 7f3c256c9640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c20106a90 0x7f3c2019bd60 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.962+0000 7f3c256c9640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c20101430 0x7f3c201979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.962+0000 7f3c256c9640 1 --2- 172.21.15.70:0/1042642921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3c20100a90 0x7f3c20197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.962+0000 7f3c256c9640 1 -- 172.21.15.70:0/1042642921 >> 172.21.15.70:0/1042642921 conn(0x7f3c200fc7d0 msgr2=0x7f3c200fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.962+0000 7f3c256c9640 1 -- 172.21.15.70:0/1042642921 shutdown_connections 2024-09-12T01:54:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:49.962+0000 7f3c256c9640 1 -- 172.21.15.70:0/1042642921 wait complete. 2024-09-12T01:54:50.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:50 smithi191 ceph-mon[35770]: pgmap v417: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 441 KiB/s wr, 195 op/s 2024-09-12T01:54:51.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:50 smithi152 ceph-mon[35055]: pgmap v417: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 441 KiB/s wr, 195 op/s 2024-09-12T01:54:51.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:50 smithi070 ceph-mon[31177]: pgmap v417: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 441 KiB/s wr, 195 op/s 2024-09-12T01:54:51.815 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T01:54:51.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T01:54:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.995+0000 7f916dd31640 1 -- 172.21.15.70:0/114917525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91681025c0 msgr2=0x7f91681049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.995+0000 7f916dd31640 1 --2- 172.21.15.70:0/114917525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91681025c0 0x7f91681049b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f915c009900 tx=0x7f915c02a410 comp rx=0 tx=0).stop 2024-09-12T01:54:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.995+0000 7f916dd31640 1 -- 172.21.15.70:0/114917525 shutdown_connections 2024-09-12T01:54:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.995+0000 7f916dd31640 1 --2- 172.21.15.70:0/114917525 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9168107820 0x7f9168109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.995+0000 7f916dd31640 1 --2- 172.21.15.70:0/114917525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9168104ef0 0x7f91681072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.995+0000 7f916dd31640 1 --2- 172.21.15.70:0/114917525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91681025c0 0x7f91681049b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.995+0000 7f916dd31640 1 -- 172.21.15.70:0/114917525 >> 172.21.15.70:0/114917525 conn(0x7f91680fc1e0 msgr2=0x7f91680fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.995+0000 7f916dd31640 1 -- 172.21.15.70:0/114917525 shutdown_connections 2024-09-12T01:54:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.995+0000 7f916dd31640 1 -- 172.21.15.70:0/114917525 wait complete. 2024-09-12T01:54:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.996+0000 7f916dd31640 1 Processor -- start 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.996+0000 7f916dd31640 1 -- start start 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.996+0000 7f916dd31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91681025c0 0x7f9168197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.996+0000 7f916dd31640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9168104ef0 0x7f91681984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.996+0000 7f916dd31640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9168107820 0x7f916819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.996+0000 7f916dd31640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f916810d9d0 con 0x7f91681025c0 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.996+0000 7f916dd31640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f916810d850 con 0x7f9168107820 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.996+0000 7f916dd31640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f916810db50 con 0x7f9168104ef0 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.996+0000 7f91677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91681025c0 0x7f9168197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.996+0000 7f91677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91681025c0 0x7f9168197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58046/0 (socket says 172.21.15.70:58046) 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.996+0000 7f91677fe640 1 -- 172.21.15.70:0/2034585211 learned_addr learned my addr 172.21.15.70:0/2034585211 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f9166ffd640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9168104ef0 0x7f91681984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f9167fff640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9168107820 0x7f916819f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f91677fe640 1 -- 172.21.15.70:0/2034585211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9168104ef0 msgr2=0x7f91681984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f91677fe640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9168104ef0 0x7f91681984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f91677fe640 1 -- 172.21.15.70:0/2034585211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9168107820 msgr2=0x7f916819f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f91677fe640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9168107820 0x7f916819f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f91677fe640 1 -- 172.21.15.70:0/2034585211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916819fbd0 con 0x7f91681025c0 2024-09-12T01:54:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f9166ffd640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9168104ef0 0x7f91681984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f9167fff640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9168107820 0x7f916819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f91677fe640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91681025c0 0x7f9168197fb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f915c009a20 tx=0x7f915c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f9164ff9640 1 -- 172.21.15.70:0/2034585211 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c03f030 con 0x7f91681025c0 2024-09-12T01:54:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f9164ff9640 1 -- 172.21.15.70:0/2034585211 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f915c003dc0 con 0x7f91681025c0 2024-09-12T01:54:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f916dd31640 1 -- 172.21.15.70:0/2034585211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916819fe60 con 0x7f91681025c0 2024-09-12T01:54:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f9164ff9640 1 -- 172.21.15.70:0/2034585211 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c035070 con 0x7f91681025c0 2024-09-12T01:54:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:51.997+0000 7f916dd31640 1 -- 172.21.15.70:0/2034585211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91681a02f0 con 0x7f91681025c0 2024-09-12T01:54:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9164ff9640 1 -- 172.21.15.70:0/2034585211 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f915c042030 con 0x7f91681025c0 2024-09-12T01:54:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9170acb740 1 Processor -- start 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9170acb740 1 -- start start 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9170acb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af358a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9170acb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af358f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9170acb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af3591c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9170acb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555af34e92f0 con 0x555af3589db0 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9170acb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555af3491270 con 0x555af358a6f0 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9170acb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555af34e52b0 con 0x555af358f780 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9167fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af358a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9167fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af358a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58052/0 (socket says 172.21.15.70:58052) 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9167fff640 1 -- 172.21.15.70:0/1565906182 learned_addr learned my addr 172.21.15.70:0/1565906182 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f91677fe640 1 --2- 172.21.15.70:0/1565906182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af358f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9166ffd640 1 --2- 172.21.15.70:0/1565906182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af3591c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9164ff9640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f91500a2c30 0x7f91500a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9167fff640 1 -- 172.21.15.70:0/1565906182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 msgr2=0x555af3591c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9167fff640 1 --2- 172.21.15.70:0/1565906182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af3591c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9167fff640 1 -- 172.21.15.70:0/1565906182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 msgr2=0x555af358f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9167fff640 1 --2- 172.21.15.70:0/1565906182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af358f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9167fff640 1 -- 172.21.15.70:0/1565906182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af3490340 con 0x555af3589db0 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.000+0000 7f9166ffd640 1 --2- 172.21.15.70:0/1565906182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af3591c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.001+0000 7f9164ff9640 1 -- 172.21.15.70:0/2034585211 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f915c0ef880 con 0x7f91681025c0 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.001+0000 7f9167fff640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f91500a2c30 0x7f91500a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.001+0000 7f9167fff640 1 --2- 172.21.15.70:0/1565906182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af358a1b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9160008da0 tx=0x7f916000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f00f43cf3443f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.001+0000 7f914dffb640 1 -- 172.21.15.70:0/1565906182 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916001f070 con 0x555af3589db0 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.001+0000 7f914dffb640 1 -- 172.21.15.70:0/1565906182 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f916000f690 con 0x555af3589db0 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.001+0000 7f914dffb640 1 -- 172.21.15.70:0/1565906182 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916000ec80 con 0x555af3589db0 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.002+0000 7f9170acb740 1 -- 172.21.15.70:0/1565906182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 msgr2=0x555af358a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.002+0000 7f9167fff640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f91500a2c30 0x7f91500a50f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f916001c000 tx=0x7f916001f000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.002+0000 7f9170acb740 1 --2- 172.21.15.70:0/1565906182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af358a1b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9160008da0 tx=0x7f916000d710 comp rx=0 tx=0).stop 2024-09-12T01:54:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.002+0000 7f9170acb740 1 -- 172.21.15.70:0/1565906182 shutdown_connections 2024-09-12T01:54:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.002+0000 7f9170acb740 1 --2- 172.21.15.70:0/1565906182 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af3591c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.002+0000 7f9170acb740 1 --2- 172.21.15.70:0/1565906182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af358f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.002+0000 7f9170acb740 1 --2- 172.21.15.70:0/1565906182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af358a1b0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.002+0000 7f9170acb740 1 -- 172.21.15.70:0/1565906182 >> 172.21.15.70:0/1565906182 conn(0x555af3581010 msgr2=0x555af3581410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.002+0000 7f9170acb740 1 -- 172.21.15.70:0/1565906182 shutdown_connections 2024-09-12T01:54:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.002+0000 7f9170acb740 1 -- 172.21.15.70:0/1565906182 wait complete. 2024-09-12T01:54:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.002+0000 7f9170acb740 1 -- start start 2024-09-12T01:54:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f9170acb740 1 Processor -- start 2024-09-12T01:54:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f9170acb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af3594000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f9170acb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af3594540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.009 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f9170acb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af359b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f9170acb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555af3592750 con 0x555af3589db0 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f9170acb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x555af3472290 con 0x555af358a6f0 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f9170acb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x555af35928d0 con 0x555af358f780 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f9170acb740 10 client.0 _ll_register_callbacks cb 0x555af34a3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f91677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af3594000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f91677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af3594000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58054/0 (socket says 172.21.15.70:58054) 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f91677fe640 1 -- 172.21.15.70:0/4102742551 learned_addr learned my addr 172.21.15.70:0/4102742551 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f9167fff640 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af359b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f9166ffd640 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af3594540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f91677fe640 1 -- 172.21.15.70:0/4102742551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 msgr2=0x555af359b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f91677fe640 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af359b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f91677fe640 1 -- 172.21.15.70:0/4102742551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 msgr2=0x555af3594540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f91677fe640 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af3594540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f91677fe640 1 -- 172.21.15.70:0/4102742551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555af31fc210 con 0x555af3589db0 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f9166ffd640 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af3594540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f91677fe640 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af3594000 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f915c0314d0 tx=0x7f915c0b8440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1336ac58882b08b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.003+0000 7f9146ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9146ffd640 1 -- 172.21.15.70:0/4102742551 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c049050 con 0x555af3589db0 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9146ffd640 1 -- 172.21.15.70:0/4102742551 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f915c0b8750 con 0x555af3589db0 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9170acb740 1 -- 172.21.15.70:0/4102742551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f916000f690 con 0x555af3589db0 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9146ffd640 1 -- 172.21.15.70:0/4102742551 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f915c03b460 con 0x555af3589db0 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9170acb740 10 client.16497 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9170acb740 1 -- 172.21.15.70:0/4102742551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x555af32c8620 con 0x555af3589db0 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9146ffd640 1 -- 172.21.15.70:0/4102742551 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f916000f690 con 0x555af3589db0 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9146ffd640 1 -- 172.21.15.70:0/4102742551 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f915c0c00c0 con 0x555af3589db0 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9170acb740 10 client.16497 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9170acb740 10 client.16497 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9170acb740 20 client.16497 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9170acb740 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x555af359fac0 0x555af35a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9170acb740 4 client.16497 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.004+0000 7f9170acb740 1 -- 172.21.15.70:0/4102742551 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555af34f6a20 con 0x555af359fac0 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.005+0000 7f9166ffd640 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x555af359fac0 0x555af35a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.005+0000 7f9166ffd640 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x555af359fac0 0x555af35a1f60 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a38afd21e5b80520 server_cookie=c1255bd772cee7c1 in_seq=0 out_seq=0 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.005+0000 7f9146ffd640 10 client.16497 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9146ffd640 1 -- 172.21.15.70:0/4102742551 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555af34f6a20 con 0x555af359fac0 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9146ffd640 10 client.16497 handle_command_reply: tid=0 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9170acb740 1 client.16497 shutdown 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9170acb740 1 -- 172.21.15.70:0/4102742551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 msgr2=0x555af3594000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9170acb740 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af3594000 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f915c0314d0 tx=0x7f915c0b8440 comp rx=0 tx=0).stop 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9170acb740 1 -- 172.21.15.70:0/4102742551 shutdown_connections 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9170acb740 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x555af359fac0 0x555af35a1f60 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9170acb740 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af359b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9170acb740 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af3594540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9146ffd640 0 client.16497 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9170acb740 1 --2- 172.21.15.70:0/4102742551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af3594000 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9170acb740 1 -- 172.21.15.70:0/4102742551 >> 172.21.15.70:0/4102742551 conn(0x555af3581010 msgr2=0x555af3582820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9170acb740 1 -- 172.21.15.70:0/4102742551 shutdown_connections 2024-09-12T01:54:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9170acb740 1 -- 172.21.15.70:0/4102742551 wait complete. 2024-09-12T01:54:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.006+0000 7f9170acb740 20 client.16497 trim_cache size 0 max 16384 2024-09-12T01:54:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.025+0000 7f9170acb740 1 Processor -- start 2024-09-12T01:54:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.025+0000 7f9170acb740 1 -- start start 2024-09-12T01:54:52.026 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.025+0000 7f9170acb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af3589db0 0x555af3594420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.025+0000 7f9170acb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af359b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.025+0000 7f9170acb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af358f780 0x555af35a6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.025+0000 7f9170acb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91681a6fc0 con 0x555af358f780 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.025+0000 7f9170acb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f91681a8cb0 con 0x555af358a6f0 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.025+0000 7f9170acb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f91681a76f0 con 0x555af3589db0 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.025+0000 7f9167fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af358f780 0x555af35a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.025+0000 7f9167fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af358f780 0x555af35a6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58062/0 (socket says 172.21.15.70:58062) 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.025+0000 7f9167fff640 1 -- 172.21.15.70:0/1760870028 learned_addr learned my addr 172.21.15.70:0/1760870028 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.026+0000 7f9166ffd640 1 --2- 172.21.15.70:0/1760870028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af359b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.026+0000 7f91677fe640 1 --2- 172.21.15.70:0/1760870028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af3589db0 0x555af3594420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.026+0000 7f9167fff640 1 -- 172.21.15.70:0/1760870028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af3589db0 msgr2=0x555af3594420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.026+0000 7f9167fff640 1 --2- 172.21.15.70:0/1760870028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af3589db0 0x555af3594420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.026+0000 7f9167fff640 1 -- 172.21.15.70:0/1760870028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 msgr2=0x555af359b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.026+0000 7f9167fff640 1 --2- 172.21.15.70:0/1760870028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af359b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.026+0000 7f9167fff640 1 -- 172.21.15.70:0/1760870028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af35a25e0 con 0x555af358f780 2024-09-12T01:54:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.026+0000 7f91677fe640 1 --2- 172.21.15.70:0/1760870028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af3589db0 0x555af3594420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.026+0000 7f9167fff640 1 --2- 172.21.15.70:0/1760870028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af358f780 0x555af35a6860 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f916000f820 tx=0x7f9160022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba53fefd57c63a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.026+0000 7f914d7fa640 1 -- 172.21.15.70:0/1760870028 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160008990 con 0x555af358f780 2024-09-12T01:54:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.026+0000 7f914d7fa640 1 -- 172.21.15.70:0/1760870028 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9160033070 con 0x555af358f780 2024-09-12T01:54:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.026+0000 7f914d7fa640 1 -- 172.21.15.70:0/1760870028 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160019e30 con 0x555af358f780 2024-09-12T01:54:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.027+0000 7f9170acb740 1 -- 172.21.15.70:0/1760870028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af358f780 msgr2=0x555af35a6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.027+0000 7f9170acb740 1 --2- 172.21.15.70:0/1760870028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af358f780 0x555af35a6860 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f916000f820 tx=0x7f9160022000 comp rx=0 tx=0).stop 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.027+0000 7f9170acb740 1 -- 172.21.15.70:0/1760870028 shutdown_connections 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.027+0000 7f9170acb740 1 --2- 172.21.15.70:0/1760870028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af358f780 0x555af35a6860 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.027+0000 7f9170acb740 1 --2- 172.21.15.70:0/1760870028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af359b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.027+0000 7f9170acb740 1 --2- 172.21.15.70:0/1760870028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af3589db0 0x555af3594420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.027+0000 7f9170acb740 1 -- 172.21.15.70:0/1760870028 >> 172.21.15.70:0/1760870028 conn(0x555af3581010 msgr2=0x555af35801c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.027+0000 7f9170acb740 1 -- 172.21.15.70:0/1760870028 shutdown_connections 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.027+0000 7f9170acb740 1 -- 172.21.15.70:0/1760870028 wait complete. 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.027+0000 7f9170acb740 1 -- start start 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9170acb740 1 Processor -- start 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9170acb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af3598b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9170acb740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af35990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9170acb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af359a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9170acb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91681a8520 con 0x555af3589db0 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9170acb740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f91681a7df0 con 0x555af358a6f0 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9170acb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f91681a4f80 con 0x555af358f780 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9170acb740 10 client.0 _ll_register_callbacks cb 0x7f915c009290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f91677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af3598b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f91677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af3598b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58074/0 (socket says 172.21.15.70:58074) 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f91677fe640 1 -- 172.21.15.70:0/2731690845 learned_addr learned my addr 172.21.15.70:0/2731690845 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9166ffd640 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af35990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9167fff640 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af359a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f91677fe640 1 -- 172.21.15.70:0/2731690845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 msgr2=0x555af359a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f91677fe640 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af359a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f91677fe640 1 -- 172.21.15.70:0/2731690845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 msgr2=0x555af35990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f91677fe640 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af35990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f91677fe640 1 -- 172.21.15.70:0/2731690845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555af359a670 con 0x555af3589db0 2024-09-12T01:54:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9167fff640 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af359a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9166ffd640 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af35990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f91677fe640 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af3598b60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f915c031570 tx=0x7f915c009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa0c10e9543ef4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.028+0000 7f9146ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9146ffd640 1 -- 172.21.15.70:0/2731690845 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c049070 con 0x555af3589db0 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9146ffd640 1 -- 172.21.15.70:0/2731690845 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f915c0c48c0 con 0x555af3589db0 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9170acb740 1 -- 172.21.15.70:0/2731690845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9160033070 con 0x555af3589db0 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9146ffd640 1 -- 172.21.15.70:0/2731690845 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f915c0bc7e0 con 0x555af3589db0 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9170acb740 10 client.16503 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9170acb740 1 -- 172.21.15.70:0/2731690845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x555af359a670 con 0x555af3589db0 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9146ffd640 1 -- 172.21.15.70:0/2731690845 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9160033070 con 0x555af3589db0 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9146ffd640 1 -- 172.21.15.70:0/2731690845 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f915c0bc340 con 0x555af3589db0 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9170acb740 10 client.16503 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9170acb740 10 client.16503 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9170acb740 20 client.16503 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9170acb740 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x555af360adc0 0x555af360d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9170acb740 4 client.16503 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:54:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9170acb740 1 -- 172.21.15.70:0/2731690845 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555af34f0d70 con 0x555af360adc0 2024-09-12T01:54:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.029+0000 7f9166ffd640 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x555af360adc0 0x555af360d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.030+0000 7f9146ffd640 10 client.16503 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.030+0000 7f9166ffd640 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x555af360adc0 0x555af360d1e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e15f023143996e79 server_cookie=ce97da966cc39768 in_seq=0 out_seq=0 2024-09-12T01:54:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9146ffd640 1 -- 172.21.15.70:0/2731690845 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555af34f0d70 con 0x555af360adc0 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9146ffd640 10 client.16503 handle_command_reply: tid=0 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9170acb740 1 client.16503 shutdown 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9170acb740 1 -- 172.21.15.70:0/2731690845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 msgr2=0x555af3598b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9170acb740 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af3598b60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f915c031570 tx=0x7f915c009560 comp rx=0 tx=0).stop 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9170acb740 1 -- 172.21.15.70:0/2731690845 shutdown_connections 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9170acb740 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x555af360adc0 0x555af360d1e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9170acb740 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555af358f780 0x555af359a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9170acb740 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555af358a6f0 0x555af35990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9170acb740 1 --2- 172.21.15.70:0/2731690845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555af3589db0 0x555af3598b60 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9146ffd640 0 client.16503 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9170acb740 1 -- 172.21.15.70:0/2731690845 >> 172.21.15.70:0/2731690845 conn(0x555af3581010 msgr2=0x555af35826e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9170acb740 1 -- 172.21.15.70:0/2731690845 shutdown_connections 2024-09-12T01:54:52.053 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9170acb740 1 -- 172.21.15.70:0/2731690845 wait complete. 2024-09-12T01:54:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.052+0000 7f9170acb740 20 client.16503 trim_cache size 0 max 16384 2024-09-12T01:54:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:54:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:54:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:54:52.054 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:54:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.053+0000 7f916dd31640 1 -- 172.21.15.70:0/2034585211 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f91500a2c30 msgr2=0x7f91500a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.053+0000 7f916dd31640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f91500a2c30 0x7f91500a50f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f916001c000 tx=0x7f916001f000 comp rx=0 tx=0).stop 2024-09-12T01:54:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.053+0000 7f916dd31640 1 -- 172.21.15.70:0/2034585211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91681025c0 msgr2=0x7f9168197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.053+0000 7f916dd31640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91681025c0 0x7f9168197fb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f915c009a20 tx=0x7f915c004430 comp rx=0 tx=0).stop 2024-09-12T01:54:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.053+0000 7f916dd31640 1 -- 172.21.15.70:0/2034585211 shutdown_connections 2024-09-12T01:54:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.053+0000 7f916dd31640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f91500a2c30 0x7f91500a50f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.053+0000 7f916dd31640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9168107820 0x7f916819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.053+0000 7f916dd31640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9168104ef0 0x7f91681984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.053+0000 7f916dd31640 1 --2- 172.21.15.70:0/2034585211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91681025c0 0x7f9168197fb0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.053+0000 7f916dd31640 1 -- 172.21.15.70:0/2034585211 >> 172.21.15.70:0/2034585211 conn(0x7f91680fc1e0 msgr2=0x7f9168102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.053+0000 7f916dd31640 1 -- 172.21.15.70:0/2034585211 shutdown_connections 2024-09-12T01:54:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:54:52.053+0000 7f916dd31640 1 -- 172.21.15.70:0/2034585211 wait complete. 2024-09-12T01:54:52.085 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.521+0000 7ff28364f640 1 -- 172.21.15.70:0/1589019809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff27c0ffc00 msgr2=0x7ff27c100060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.521+0000 7ff28364f640 1 --2- 172.21.15.70:0/1589019809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff27c0ffc00 0x7ff27c100060 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff278009900 tx=0x7ff27802a410 comp rx=0 tx=0).stop 2024-09-12T01:54:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.522+0000 7ff28364f640 1 -- 172.21.15.70:0/1589019809 shutdown_connections 2024-09-12T01:54:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.522+0000 7ff28364f640 1 --2- 172.21.15.70:0/1589019809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff27c1005a0 0x7ff27c10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.522+0000 7ff28364f640 1 --2- 172.21.15.70:0/1589019809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff27c0ffc00 0x7ff27c100060 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.522+0000 7ff28364f640 1 --2- 172.21.15.70:0/1589019809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff27c106b80 0x7ff27c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.522+0000 7ff28364f640 1 -- 172.21.15.70:0/1589019809 >> 172.21.15.70:0/1589019809 conn(0x7ff27c0fba90 msgr2=0x7ff27c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.522+0000 7ff28364f640 1 -- 172.21.15.70:0/1589019809 shutdown_connections 2024-09-12T01:54:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.522+0000 7ff28364f640 1 -- 172.21.15.70:0/1589019809 wait complete. 2024-09-12T01:54:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.522+0000 7ff28364f640 1 Processor -- start 2024-09-12T01:54:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.522+0000 7ff28364f640 1 -- start start 2024-09-12T01:54:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff28364f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff27c0ffc00 0x7ff27c101670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff28364f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff27c1005a0 0x7ff27c101bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff28364f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff27c106b80 0x7ff27c1020f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff28364f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1120e0 con 0x7ff27c1005a0 2024-09-12T01:54:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff28364f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c111f60 con 0x7ff27c0ffc00 2024-09-12T01:54:52.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff28364f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c112260 con 0x7ff27c106b80 2024-09-12T01:54:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff280bea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff27c1005a0 0x7ff27c101bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff280bea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff27c1005a0 0x7ff27c101bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58092/0 (socket says 172.21.15.70:58092) 2024-09-12T01:54:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff280bea640 1 -- 172.21.15.70:0/901202952 learned_addr learned my addr 172.21.15.70:0/901202952 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff2813eb640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff27c0ffc00 0x7ff27c101670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff281bec640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff27c106b80 0x7ff27c1020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff280bea640 1 -- 172.21.15.70:0/901202952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff27c106b80 msgr2=0x7ff27c1020f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff280bea640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff27c106b80 0x7ff27c1020f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff280bea640 1 -- 172.21.15.70:0/901202952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff27c0ffc00 msgr2=0x7ff27c101670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff280bea640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff27c0ffc00 0x7ff27c101670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff280bea640 1 -- 172.21.15.70:0/901202952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c1a6a30 con 0x7ff27c1005a0 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff280bea640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff27c1005a0 0x7ff27c101bb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff278006010 tx=0x7ff278004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff26e7fc640 1 -- 172.21.15.70:0/901202952 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27803f030 con 0x7ff27c1005a0 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff26e7fc640 1 -- 172.21.15.70:0/901202952 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff278005500 con 0x7ff27c1005a0 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff28364f640 1 -- 172.21.15.70:0/901202952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27c1a6cc0 con 0x7ff27c1005a0 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.523+0000 7ff26e7fc640 1 -- 172.21.15.70:0/901202952 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278035070 con 0x7ff27c1005a0 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.524+0000 7ff28364f640 1 -- 172.21.15.70:0/901202952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27c1a71a0 con 0x7ff27c1005a0 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.526+0000 7ff285a28740 1 Processor -- start 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.526+0000 7ff285a28740 1 -- start start 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.526+0000 7ff26e7fc640 1 -- 172.21.15.70:0/901202952 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff278042030 con 0x7ff27c1005a0 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff285a28740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c8b60 0x5622ce8c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff285a28740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 0x5622ce8d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff285a28740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8d3d40 0x5622ce8d6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff285a28740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5622ce82e280 con 0x5622ce8c9480 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff285a28740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5622ce7d5b10 con 0x5622ce8c8b60 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff285a28740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5622ce82a240 con 0x5622ce8d3d40 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff2813eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 0x5622ce8d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff2813eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 0x5622ce8d3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58108/0 (socket says 172.21.15.70:58108) 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff2813eb640 1 -- 172.21.15.70:0/256259290 learned_addr learned my addr 172.21.15.70:0/256259290 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff281bec640 1 --2- 172.21.15.70:0/256259290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c8b60 0x5622ce8c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff280bea640 1 --2- 172.21.15.70:0/256259290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8d3d40 0x5622ce8d6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff2813eb640 1 -- 172.21.15.70:0/256259290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8d3d40 msgr2=0x5622ce8d6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff2813eb640 1 --2- 172.21.15.70:0/256259290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8d3d40 0x5622ce8d6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff2813eb640 1 -- 172.21.15.70:0/256259290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c8b60 msgr2=0x5622ce8c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff2813eb640 1 --2- 172.21.15.70:0/256259290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c8b60 0x5622ce8c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff2813eb640 1 -- 172.21.15.70:0/256259290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622ce7e21f0 con 0x5622ce8c9480 2024-09-12T01:54:52.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff281bec640 1 --2- 172.21.15.70:0/256259290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c8b60 0x5622ce8c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:54:52.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff26e7fc640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff2680a2b80 0x7ff2680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff281bec640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff2680a2b80 0x7ff2680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff2813eb640 1 --2- 172.21.15.70:0/256259290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 0x5622ce8d3800 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff27000b820 tx=0x7ff27000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbeaf64fadf94323 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:52.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.527+0000 7ff26e7fc640 1 -- 172.21.15.70:0/901202952 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff2780ef590 con 0x7ff27c1005a0 2024-09-12T01:54:52.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff2677fe640 1 -- 172.21.15.70:0/256259290 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27000d950 con 0x5622ce8c9480 2024-09-12T01:54:52.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff2677fe640 1 -- 172.21.15.70:0/256259290 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff270019070 con 0x5622ce8c9480 2024-09-12T01:54:52.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff2677fe640 1 -- 172.21.15.70:0/256259290 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2700123e0 con 0x5622ce8c9480 2024-09-12T01:54:52.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff285a28740 1 -- 172.21.15.70:0/256259290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 msgr2=0x5622ce8d3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff281bec640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff2680a2b80 0x7ff2680a5040 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff27c1077c0 tx=0x7ff274009620 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:52.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff285a28740 1 --2- 172.21.15.70:0/256259290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 0x5622ce8d3800 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff27000b820 tx=0x7ff27000bce0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff285a28740 1 -- 172.21.15.70:0/256259290 shutdown_connections 2024-09-12T01:54:52.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff285a28740 1 --2- 172.21.15.70:0/256259290 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8d3d40 0x5622ce8d6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff285a28740 1 --2- 172.21.15.70:0/256259290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 0x5622ce8d3800 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff285a28740 1 --2- 172.21.15.70:0/256259290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c8b60 0x5622ce8c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff285a28740 1 -- 172.21.15.70:0/256259290 >> 172.21.15.70:0/256259290 conn(0x5622ce8c50f0 msgr2=0x5622ce8c54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:52.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff285a28740 1 -- 172.21.15.70:0/256259290 shutdown_connections 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.528+0000 7ff285a28740 1 -- 172.21.15.70:0/256259290 wait complete. 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff285a28740 1 -- start start 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff285a28740 1 Processor -- start 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff285a28740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 0x5622ce8d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff285a28740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c9480 0x5622ce8d1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff285a28740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 0x5622ce8d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff285a28740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5622ce8d6910 con 0x5622ce8d3d40 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff285a28740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5622ce7e8f10 con 0x5622ce8c9480 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff285a28740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5622ce8d6a90 con 0x5622ce8c8b60 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff285a28740 10 client.0 _ll_register_callbacks cb 0x5622ce7b1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff281bec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 0x5622ce8d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff281bec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 0x5622ce8d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58116/0 (socket says 172.21.15.70:58116) 2024-09-12T01:54:52.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff281bec640 1 -- 172.21.15.70:0/3929609972 learned_addr learned my addr 172.21.15.70:0/3929609972 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.529+0000 7ff280bea640 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c9480 0x5622ce8d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff2813eb640 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 0x5622ce8d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff281bec640 1 -- 172.21.15.70:0/3929609972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 msgr2=0x5622ce8d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff281bec640 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 0x5622ce8d0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff281bec640 1 -- 172.21.15.70:0/3929609972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c9480 msgr2=0x5622ce8d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff281bec640 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c9480 0x5622ce8d1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff281bec640 1 -- 172.21.15.70:0/3929609972 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622ce59f6a0 con 0x5622ce8d3d40 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff281bec640 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 0x5622ce8d1670 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff274003d90 tx=0x7ff274004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d506be10075ae89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff264ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff264ff9640 1 -- 172.21.15.70:0/3929609972 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274010960 con 0x5622ce8d3d40 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff264ff9640 1 -- 172.21.15.70:0/3929609972 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff274010b00 con 0x5622ce8d3d40 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff285a28740 1 -- 172.21.15.70:0/3929609972 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff270019070 con 0x5622ce8d3d40 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff264ff9640 1 -- 172.21.15.70:0/3929609972 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff274010d00 con 0x5622ce8d3d40 2024-09-12T01:54:52.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff285a28740 10 client.16515 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff285a28740 1 -- 172.21.15.70:0/3929609972 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5622ce8e25a0 con 0x5622ce8d3d40 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff264ff9640 1 -- 172.21.15.70:0/3929609972 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff270019070 con 0x5622ce8d3d40 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff264ff9640 1 -- 172.21.15.70:0/3929609972 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7ff274027400 con 0x5622ce8d3d40 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff285a28740 10 client.16515 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.530+0000 7ff285a28740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.531+0000 7ff285a28740 20 client.16515 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.531+0000 7ff285a28740 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622ce8e3b00 0x5622ce8e5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.531+0000 7ff285a28740 4 client.16515 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.531+0000 7ff285a28740 1 -- 172.21.15.70:0/3929609972 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622ce83b7f0 con 0x5622ce8e3b00 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.531+0000 7ff2813eb640 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622ce8e3b00 0x5622ce8e5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.531+0000 7ff2813eb640 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622ce8e3b00 0x5622ce8e5f60 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1827e9a9e81be392 server_cookie=ca3695e4627ea176 in_seq=0 out_seq=0 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.531+0000 7ff264ff9640 10 client.16515 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:52.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.532+0000 7ff264ff9640 1 -- 172.21.15.70:0/3929609972 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5622ce83b7f0 con 0x5622ce8e3b00 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.532+0000 7ff264ff9640 10 client.16515 handle_command_reply: tid=0 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.532+0000 7ff285a28740 1 client.16515 shutdown 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.532+0000 7ff285a28740 1 -- 172.21.15.70:0/3929609972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 msgr2=0x5622ce8d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.532+0000 7ff285a28740 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 0x5622ce8d1670 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff274003d90 tx=0x7ff274004a40 comp rx=0 tx=0).stop 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.532+0000 7ff285a28740 1 -- 172.21.15.70:0/3929609972 shutdown_connections 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.532+0000 7ff285a28740 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622ce8e3b00 0x5622ce8e5f60 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.532+0000 7ff285a28740 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 0x5622ce8d1670 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.532+0000 7ff285a28740 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c9480 0x5622ce8d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.532+0000 7ff264ff9640 0 client.16515 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.532+0000 7ff285a28740 1 --2- 172.21.15.70:0/3929609972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 0x5622ce8d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.532+0000 7ff285a28740 1 -- 172.21.15.70:0/3929609972 >> 172.21.15.70:0/3929609972 conn(0x5622ce8c50f0 msgr2=0x5622ce8cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.533+0000 7ff285a28740 1 -- 172.21.15.70:0/3929609972 shutdown_connections 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.533+0000 7ff285a28740 1 -- 172.21.15.70:0/3929609972 wait complete. 2024-09-12T01:54:52.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.533+0000 7ff285a28740 20 client.16515 trim_cache size 0 max 16384 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff285a28740 1 Processor -- start 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff285a28740 1 -- start start 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff285a28740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 0x5622ce8eb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff285a28740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c9480 0x5622ce8ebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff285a28740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 0x5622ce8d2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff285a28740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1af8e0 con 0x5622ce8d3d40 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff285a28740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1b15d0 con 0x5622ce8c9480 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff285a28740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1b0010 con 0x5622ce8c8b60 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff281bec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 0x5622ce8d2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff281bec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 0x5622ce8d2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58120/0 (socket says 172.21.15.70:58120) 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff281bec640 1 -- 172.21.15.70:0/3087699837 learned_addr learned my addr 172.21.15.70:0/3087699837 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff2813eb640 1 --2- 172.21.15.70:0/3087699837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 0x5622ce8eb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff280bea640 1 --2- 172.21.15.70:0/3087699837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c9480 0x5622ce8ebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff281bec640 1 -- 172.21.15.70:0/3087699837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 msgr2=0x5622ce8eb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff281bec640 1 --2- 172.21.15.70:0/3087699837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 0x5622ce8eb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff281bec640 1 -- 172.21.15.70:0/3087699837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c9480 msgr2=0x5622ce8ebdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff281bec640 1 --2- 172.21.15.70:0/3087699837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c9480 0x5622ce8ebdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.550+0000 7ff281bec640 1 -- 172.21.15.70:0/3087699837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622ce8c4f20 con 0x5622ce8d3d40 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.551+0000 7ff281bec640 1 --2- 172.21.15.70:0/3087699837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 0x5622ce8d2340 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff274028ef0 tx=0x7ff274003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870108688d9c3dbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.551+0000 7ff266ffd640 1 -- 172.21.15.70:0/3087699837 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274037040 con 0x5622ce8d3d40 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.551+0000 7ff266ffd640 1 -- 172.21.15.70:0/3087699837 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff274004890 con 0x5622ce8d3d40 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.551+0000 7ff266ffd640 1 -- 172.21.15.70:0/3087699837 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740109c0 con 0x5622ce8d3d40 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.551+0000 7ff285a28740 1 -- 172.21.15.70:0/3087699837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 msgr2=0x5622ce8d2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.551+0000 7ff285a28740 1 --2- 172.21.15.70:0/3087699837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 0x5622ce8d2340 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff274028ef0 tx=0x7ff274003f90 comp rx=0 tx=0).stop 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.551+0000 7ff285a28740 1 -- 172.21.15.70:0/3087699837 shutdown_connections 2024-09-12T01:54:52.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.551+0000 7ff285a28740 1 --2- 172.21.15.70:0/3087699837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8d3d40 0x5622ce8d2340 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.551+0000 7ff285a28740 1 --2- 172.21.15.70:0/3087699837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8c9480 0x5622ce8ebdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.551+0000 7ff285a28740 1 --2- 172.21.15.70:0/3087699837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 0x5622ce8eb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff285a28740 1 -- 172.21.15.70:0/3087699837 >> 172.21.15.70:0/3087699837 conn(0x5622ce8c50f0 msgr2=0x5622ce8cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff285a28740 1 -- 172.21.15.70:0/3087699837 shutdown_connections 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff285a28740 1 -- 172.21.15.70:0/3087699837 wait complete. 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff285a28740 1 -- start start 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff285a28740 1 Processor -- start 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff285a28740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 0x5622ce8cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff285a28740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 0x5622ce8ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff285a28740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8d3d40 0x5622ce8ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff285a28740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1b0e40 con 0x5622ce8c9480 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff285a28740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1b0710 con 0x5622ce8d3d40 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff285a28740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1ad8a0 con 0x5622ce8c8b60 2024-09-12T01:54:52.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff285a28740 10 client.0 _ll_register_callbacks cb 0x7ff274009980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff280bea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 0x5622ce8ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff280bea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 0x5622ce8ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58132/0 (socket says 172.21.15.70:58132) 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.552+0000 7ff280bea640 1 -- 172.21.15.70:0/1860317921 learned_addr learned my addr 172.21.15.70:0/1860317921 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff2813eb640 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 0x5622ce8cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff281bec640 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8d3d40 0x5622ce8ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff280bea640 1 -- 172.21.15.70:0/1860317921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 msgr2=0x5622ce8cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff280bea640 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 0x5622ce8cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff280bea640 1 -- 172.21.15.70:0/1860317921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8d3d40 msgr2=0x5622ce8ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff280bea640 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8d3d40 0x5622ce8ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff280bea640 1 -- 172.21.15.70:0/1860317921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622ce94d8f0 con 0x5622ce8c9480 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff280bea640 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 0x5622ce8ce240 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff2780b87c0 tx=0x7ff2780b8150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a4308f04508772 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff264ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:52.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff264ff9640 1 -- 172.21.15.70:0/1860317921 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278049040 con 0x5622ce8c9480 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff264ff9640 1 -- 172.21.15.70:0/1860317921 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff2780f2d20 con 0x5622ce8c9480 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff285a28740 1 -- 172.21.15.70:0/1860317921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff274004890 con 0x5622ce8c9480 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff264ff9640 1 -- 172.21.15.70:0/1860317921 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff2780056b0 con 0x5622ce8c9480 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff285a28740 10 client.16521 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff285a28740 1 -- 172.21.15.70:0/1860317921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5622ce94ec70 con 0x5622ce8c9480 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff264ff9640 1 -- 172.21.15.70:0/1860317921 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff274004890 con 0x5622ce8c9480 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff264ff9640 1 -- 172.21.15.70:0/1860317921 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7ff2780b8460 con 0x5622ce8c9480 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff285a28740 10 client.16521 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff285a28740 10 client.16521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.553+0000 7ff285a28740 20 client.16521 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.554+0000 7ff285a28740 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622ce8e3b00 0x5622ce951520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.554+0000 7ff285a28740 4 client.16521 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.554+0000 7ff285a28740 1 -- 172.21.15.70:0/1860317921 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5622ce835d00 con 0x5622ce8e3b00 2024-09-12T01:54:52.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.554+0000 7ff2813eb640 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622ce8e3b00 0x5622ce951520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:52.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.554+0000 7ff2813eb640 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622ce8e3b00 0x5622ce951520 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15f5b874966b475a server_cookie=d548d8cfee048764 in_seq=0 out_seq=0 2024-09-12T01:54:52.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.554+0000 7ff264ff9640 10 client.16521 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:52.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.555+0000 7ff264ff9640 1 -- 172.21.15.70:0/1860317921 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5622ce835d00 con 0x5622ce8e3b00 2024-09-12T01:54:52.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff264ff9640 10 client.16521 handle_command_reply: tid=0 2024-09-12T01:54:52.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff285a28740 1 client.16521 shutdown 2024-09-12T01:54:52.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff285a28740 1 -- 172.21.15.70:0/1860317921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 msgr2=0x5622ce8ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff285a28740 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 0x5622ce8ce240 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff2780b87c0 tx=0x7ff2780b8150 comp rx=0 tx=0).stop 2024-09-12T01:54:52.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff285a28740 1 -- 172.21.15.70:0/1860317921 shutdown_connections 2024-09-12T01:54:52.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff285a28740 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5622ce8e3b00 0x5622ce951520 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff264ff9640 0 client.16521 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:52.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff285a28740 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5622ce8d3d40 0x5622ce8ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff285a28740 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622ce8c9480 0x5622ce8ce240 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff285a28740 1 --2- 172.21.15.70:0/1860317921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5622ce8c8b60 0x5622ce8cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff285a28740 1 -- 172.21.15.70:0/1860317921 >> 172.21.15.70:0/1860317921 conn(0x5622ce8c50f0 msgr2=0x5622ce8c3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:52.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff285a28740 1 -- 172.21.15.70:0/1860317921 shutdown_connections 2024-09-12T01:54:52.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff285a28740 1 -- 172.21.15.70:0/1860317921 wait complete. 2024-09-12T01:54:52.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.556+0000 7ff285a28740 20 client.16521 trim_cache size 0 max 16384 2024-09-12T01:54:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:54:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-12T01:54:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "6ad46b0b-b579-4311-ab57-0e5fb635178c", 2024-09-12T01:54:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-12T01:54:52.574 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:54:52.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.557+0000 7ff28364f640 1 -- 172.21.15.70:0/901202952 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff2680a2b80 msgr2=0x7ff2680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.557+0000 7ff28364f640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff2680a2b80 0x7ff2680a5040 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff27c1077c0 tx=0x7ff274009620 comp rx=0 tx=0).stop 2024-09-12T01:54:52.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.557+0000 7ff28364f640 1 -- 172.21.15.70:0/901202952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff27c1005a0 msgr2=0x7ff27c101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:52.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.557+0000 7ff28364f640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff27c1005a0 0x7ff27c101bb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff278006010 tx=0x7ff278004c00 comp rx=0 tx=0).stop 2024-09-12T01:54:52.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.557+0000 7ff28364f640 1 -- 172.21.15.70:0/901202952 shutdown_connections 2024-09-12T01:54:52.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.557+0000 7ff28364f640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7ff2680a2b80 0x7ff2680a5040 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.557+0000 7ff28364f640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff27c106b80 0x7ff27c1020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.557+0000 7ff28364f640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff27c1005a0 0x7ff27c101bb0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.557+0000 7ff28364f640 1 --2- 172.21.15.70:0/901202952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff27c0ffc00 0x7ff27c101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:52.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.557+0000 7ff28364f640 1 -- 172.21.15.70:0/901202952 >> 172.21.15.70:0/901202952 conn(0x7ff27c0fba90 msgr2=0x7ff27c0fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:52.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.557+0000 7ff28364f640 1 -- 172.21.15.70:0/901202952 shutdown_connections 2024-09-12T01:54:52.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:52.557+0000 7ff28364f640 1 -- 172.21.15.70:0/901202952 wait complete. 2024-09-12T01:54:52.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:52 smithi191 ceph-mon[35770]: pgmap v418: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 242 KiB/s wr, 127 op/s 2024-09-12T01:54:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:52 smithi152 ceph-mon[35055]: pgmap v418: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 242 KiB/s wr, 127 op/s 2024-09-12T01:54:53.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:52 smithi070 ceph-mon[31177]: pgmap v418: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 242 KiB/s wr, 127 op/s 2024-09-12T01:54:53.805 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:54:53.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:53 smithi191 ceph-mon[35770]: scrub queued for path: / 2024-09-12T01:54:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:53 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:53 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:54:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:53 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:54:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:53 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:54:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:53 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:54:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:53 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:53 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:53 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:53 smithi191 ceph-mon[35770]: scrub summary: active paths [/] 2024-09-12T01:54:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:53 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:53.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:53 smithi191 ceph-mon[35770]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:53 smithi152 ceph-mon[35055]: scrub queued for path: / 2024-09-12T01:54:54.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:53 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:53 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:54:54.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:53 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:54:54.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:53 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:54:54.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:53 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:54:54.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:53 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:53 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:53 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:53 smithi152 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-12T01:54:54.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:53 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:53 smithi152 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:53 smithi070 ceph-mon[31177]: scrub queued for path: / 2024-09-12T01:54:54.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:53 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:53 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:54:54.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:53 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:54:54.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:53 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:54:54.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:53 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:54:54.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:53 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:53 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:53 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:53 smithi070 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-12T01:54:54.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:53 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:53 smithi070 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-12T01:54:54.055 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:54.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.564+0000 7fa607927640 1 -- 172.21.15.70:0/4238946229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa600106a80 msgr2=0x7fa600106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:54.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.564+0000 7fa607927640 1 --2- 172.21.15.70:0/4238946229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa600106a80 0x7fa600106e60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009930 tx=0x7fa5fc02a420 comp rx=0 tx=0).stop 2024-09-12T01:54:54.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.564+0000 7fa607927640 1 -- 172.21.15.70:0/4238946229 shutdown_connections 2024-09-12T01:54:54.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.564+0000 7fa607927640 1 --2- 172.21.15.70:0/4238946229 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa600101420 0x7fa60010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.564+0000 7fa607927640 1 --2- 172.21.15.70:0/4238946229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa600100a80 0x7fa600100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.564+0000 7fa607927640 1 --2- 172.21.15.70:0/4238946229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa600106a80 0x7fa600106e60 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.564+0000 7fa607927640 1 -- 172.21.15.70:0/4238946229 >> 172.21.15.70:0/4238946229 conn(0x7fa6000fc7a0 msgr2=0x7fa6000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:54.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.564+0000 7fa607927640 1 -- 172.21.15.70:0/4238946229 shutdown_connections 2024-09-12T01:54:54.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.564+0000 7fa607927640 1 -- 172.21.15.70:0/4238946229 wait complete. 2024-09-12T01:54:54.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa607927640 1 Processor -- start 2024-09-12T01:54:54.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa607927640 1 -- start start 2024-09-12T01:54:54.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa607927640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa600100a80 0x7fa6001993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa607927640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa600101420 0x7fa600199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa607927640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa600106a80 0x7fa6001a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa607927640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa600110fe0 con 0x7fa600106a80 2024-09-12T01:54:54.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa607927640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa600110e60 con 0x7fa600101420 2024-09-12T01:54:54.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa607927640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa600111160 con 0x7fa600100a80 2024-09-12T01:54:54.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa605ec4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa600106a80 0x7fa6001a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa605ec4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa600106a80 0x7fa6001a4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58158/0 (socket says 172.21.15.70:58158) 2024-09-12T01:54:54.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa605ec4640 1 -- 172.21.15.70:0/1759449586 learned_addr learned my addr 172.21.15.70:0/1759449586 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:54.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa604ec2640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa600101420 0x7fa600199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa6056c3640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa600100a80 0x7fa6001993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa605ec4640 1 -- 172.21.15.70:0/1759449586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa600100a80 msgr2=0x7fa6001993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:54.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa605ec4640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa600100a80 0x7fa6001993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa605ec4640 1 -- 172.21.15.70:0/1759449586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa600101420 msgr2=0x7fa600199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:54.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa605ec4640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa600101420 0x7fa600199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa605ec4640 1 -- 172.21.15.70:0/1759449586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6001a49b0 con 0x7fa600106a80 2024-09-12T01:54:54.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa6056c3640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa600100a80 0x7fa6001993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:54.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa604ec2640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa600101420 0x7fa600199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:54.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.565+0000 7fa605ec4640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa600106a80 0x7fa6001a4470 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800b970 tx=0x7fa5f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:54.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.566+0000 7fa5f67fc640 1 -- 172.21.15.70:0/1759449586 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8019070 con 0x7fa600106a80 2024-09-12T01:54:54.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.566+0000 7fa5f67fc640 1 -- 172.21.15.70:0/1759449586 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5f800cb40 con 0x7fa600106a80 2024-09-12T01:54:54.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.566+0000 7fa607927640 1 -- 172.21.15.70:0/1759449586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6001a4b80 con 0x7fa600106a80 2024-09-12T01:54:54.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.566+0000 7fa5f67fc640 1 -- 172.21.15.70:0/1759449586 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8007700 con 0x7fa600106a80 2024-09-12T01:54:54.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.566+0000 7fa607927640 1 -- 172.21.15.70:0/1759449586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6001a50c0 con 0x7fa600106a80 2024-09-12T01:54:54.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.568+0000 7fa5f67fc640 1 -- 172.21.15.70:0/1759449586 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa5f801c070 con 0x7fa600106a80 2024-09-12T01:54:54.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.568+0000 7fa609d00740 1 Processor -- start 2024-09-12T01:54:54.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.568+0000 7fa609d00740 1 -- start start 2024-09-12T01:54:54.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa609d00740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480360 0x562e2f480740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa609d00740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480c80 0x562e2f48f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa609d00740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f491e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa609d00740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e2f3e62e0 con 0x562e2f480c80 2024-09-12T01:54:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa609d00740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562e2f38dce0 con 0x562e2f48fa90 2024-09-12T01:54:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa609d00740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562e2f3e22a0 con 0x562e2f480360 2024-09-12T01:54:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa5f67fc640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa5ec0a2c00 0x7fa5ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa6056c3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480c80 0x562e2f48f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa6056c3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480c80 0x562e2f48f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58170/0 (socket says 172.21.15.70:58170) 2024-09-12T01:54:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa6056c3640 1 -- 172.21.15.70:0/384495305 learned_addr learned my addr 172.21.15.70:0/384495305 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa604ec2640 1 --2- 172.21.15.70:0/384495305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480360 0x562e2f480740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa5f67fc640 1 -- 172.21.15.70:0/1759449586 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa5f80ce630 con 0x7fa600106a80 2024-09-12T01:54:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa604ec2640 1 --2- 172.21.15.70:0/384495305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f491e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa605ec4640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa5ec0a2c00 0x7fa5ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa6056c3640 1 -- 172.21.15.70:0/384495305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480360 msgr2=0x562e2f480740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa6056c3640 1 --2- 172.21.15.70:0/384495305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480360 0x562e2f480740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa6056c3640 1 -- 172.21.15.70:0/384495305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 msgr2=0x562e2f491e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa6056c3640 1 --2- 172.21.15.70:0/384495305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f491e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa6056c3640 1 -- 172.21.15.70:0/384495305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2f372440 con 0x562e2f480c80 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa605ec4640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa5ec0a2c00 0x7fa5ec0a50c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8004b90 tx=0x7fa5f8014db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.569+0000 7fa6056c3640 1 --2- 172.21.15.70:0/384495305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480c80 0x562e2f48f550 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc000c00 tx=0x7fa5fc032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788a5c59a5444f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.570+0000 7fa5eb7fe640 1 -- 172.21.15.70:0/384495305 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc03f070 con 0x562e2f480c80 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.570+0000 7fa5eb7fe640 1 -- 172.21.15.70:0/384495305 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5fc031840 con 0x562e2f480c80 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.570+0000 7fa5eb7fe640 1 -- 172.21.15.70:0/384495305 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc035070 con 0x562e2f480c80 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.570+0000 7fa609d00740 1 -- 172.21.15.70:0/384495305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480c80 msgr2=0x562e2f48f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.570+0000 7fa609d00740 1 --2- 172.21.15.70:0/384495305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480c80 0x562e2f48f550 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc000c00 tx=0x7fa5fc032d30 comp rx=0 tx=0).stop 2024-09-12T01:54:54.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.570+0000 7fa609d00740 1 -- 172.21.15.70:0/384495305 shutdown_connections 2024-09-12T01:54:54.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.570+0000 7fa609d00740 1 --2- 172.21.15.70:0/384495305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f491e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.570+0000 7fa609d00740 1 --2- 172.21.15.70:0/384495305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480c80 0x562e2f48f550 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.570+0000 7fa609d00740 1 --2- 172.21.15.70:0/384495305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480360 0x562e2f480740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.570+0000 7fa609d00740 1 -- 172.21.15.70:0/384495305 >> 172.21.15.70:0/384495305 conn(0x562e2f47ca30 msgr2=0x562e2f47ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:54.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.570+0000 7fa609d00740 1 -- 172.21.15.70:0/384495305 shutdown_connections 2024-09-12T01:54:54.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa609d00740 1 -- 172.21.15.70:0/384495305 wait complete. 2024-09-12T01:54:54.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa609d00740 1 -- start start 2024-09-12T01:54:54.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa609d00740 1 Processor -- start 2024-09-12T01:54:54.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa609d00740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f48f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa609d00740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 0x562e2f48c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa609d00740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f48cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa609d00740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e2f492600 con 0x562e2f480360 2024-09-12T01:54:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa609d00740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x562e2f3a1050 con 0x562e2f48fa90 2024-09-12T01:54:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa609d00740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x562e2f492780 con 0x562e2f480c80 2024-09-12T01:54:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa609d00740 10 client.0 _ll_register_callbacks cb 0x562e2f3e1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa604ec2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f48f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa604ec2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f48f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58172/0 (socket says 172.21.15.70:58172) 2024-09-12T01:54:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.571+0000 7fa604ec2640 1 -- 172.21.15.70:0/131849595 learned_addr learned my addr 172.21.15.70:0/131849595 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa6056c3640 1 --2- 172.21.15.70:0/131849595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 0x562e2f48c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa604ec2640 1 -- 172.21.15.70:0/131849595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 msgr2=0x562e2f48c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa604ec2640 1 --2- 172.21.15.70:0/131849595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 0x562e2f48c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa604ec2640 1 -- 172.21.15.70:0/131849595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 msgr2=0x562e2f48cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:54.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa604ec2640 1 --2- 172.21.15.70:0/131849595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f48cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa604ec2640 1 -- 172.21.15.70:0/131849595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e2f1573c0 con 0x562e2f480360 2024-09-12T01:54:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa604ec2640 1 --2- 172.21.15.70:0/131849595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f48f370 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00058c0 tx=0x7fa5f0010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72f8b0367e45651 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa5e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa5e8ff9640 1 -- 172.21.15.70:0/131849595 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0005020 con 0x562e2f480360 2024-09-12T01:54:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa5e8ff9640 1 -- 172.21.15.70:0/131849595 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa5f00051c0 con 0x562e2f480360 2024-09-12T01:54:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa609d00740 1 -- 172.21.15.70:0/131849595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5fc031840 con 0x562e2f480360 2024-09-12T01:54:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa5e8ff9640 1 -- 172.21.15.70:0/131849595 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa5f0024050 con 0x562e2f480360 2024-09-12T01:54:54.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa609d00740 10 client.16533 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:54.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.572+0000 7fa609d00740 1 -- 172.21.15.70:0/131849595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562e2f49e010 con 0x562e2f480360 2024-09-12T01:54:54.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.573+0000 7fa5e8ff9640 1 -- 172.21.15.70:0/131849595 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5fc031840 con 0x562e2f480360 2024-09-12T01:54:54.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.573+0000 7fa5e8ff9640 1 -- 172.21.15.70:0/131849595 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fa5f000f5d0 con 0x562e2f480360 2024-09-12T01:54:54.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.573+0000 7fa609d00740 10 client.16533 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:54.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.573+0000 7fa609d00740 10 client.16533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:54.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.573+0000 7fa609d00740 20 client.16533 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:54.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.573+0000 7fa609d00740 1 --2- 172.21.15.70:0/131849595 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e2f49f570 0x562e2f4a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.573+0000 7fa609d00740 4 client.16533 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.573+0000 7fa609d00740 1 -- 172.21.15.70:0/131849595 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e2f3f3850 con 0x562e2f49f570 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.573+0000 7fa6056c3640 1 --2- 172.21.15.70:0/131849595 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e2f49f570 0x562e2f4a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.573+0000 7fa5e8ff9640 10 client.16533 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.573+0000 7fa6056c3640 1 --2- 172.21.15.70:0/131849595 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e2f49f570 0x562e2f4a1a10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c366a38e0173440 server_cookie=a864ea00d0ec9f90 in_seq=0 out_seq=0 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.574+0000 7fa5e8ff9640 1 -- 172.21.15.70:0/131849595 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e2f3f3850 con 0x562e2f49f570 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.574+0000 7fa5e8ff9640 10 client.16533 handle_command_reply: tid=0 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.574+0000 7fa609d00740 1 client.16533 shutdown 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.574+0000 7fa609d00740 1 -- 172.21.15.70:0/131849595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 msgr2=0x562e2f48f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.574+0000 7fa609d00740 1 --2- 172.21.15.70:0/131849595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f48f370 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00058c0 tx=0x7fa5f0010800 comp rx=0 tx=0).stop 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.574+0000 7fa609d00740 1 -- 172.21.15.70:0/131849595 shutdown_connections 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.574+0000 7fa609d00740 1 --2- 172.21.15.70:0/131849595 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e2f49f570 0x562e2f4a1a10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.574+0000 7fa5e8ff9640 0 client.16533 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:54.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.574+0000 7fa609d00740 1 --2- 172.21.15.70:0/131849595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f48cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.574+0000 7fa609d00740 1 --2- 172.21.15.70:0/131849595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 0x562e2f48c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.574+0000 7fa609d00740 1 --2- 172.21.15.70:0/131849595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f48f370 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.574+0000 7fa609d00740 1 -- 172.21.15.70:0/131849595 >> 172.21.15.70:0/131849595 conn(0x562e2f47ca30 msgr2=0x562e2f482790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.575+0000 7fa609d00740 1 -- 172.21.15.70:0/131849595 shutdown_connections 2024-09-12T01:54:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.575+0000 7fa609d00740 1 -- 172.21.15.70:0/131849595 wait complete. 2024-09-12T01:54:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.575+0000 7fa609d00740 20 client.16533 trim_cache size 0 max 16384 2024-09-12T01:54:54.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.591+0000 7fa609d00740 1 Processor -- start 2024-09-12T01:54:54.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.591+0000 7fa609d00740 1 -- start start 2024-09-12T01:54:54.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.591+0000 7fa609d00740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f49b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.591+0000 7fa609d00740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 0x562e2f487d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa609d00740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f48b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa609d00740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6001ab590 con 0x562e2f480360 2024-09-12T01:54:54.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa609d00740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa6001ad280 con 0x562e2f48fa90 2024-09-12T01:54:54.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa609d00740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa6001abcc0 con 0x562e2f480c80 2024-09-12T01:54:54.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa604ec2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f49b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa604ec2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f49b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58176/0 (socket says 172.21.15.70:58176) 2024-09-12T01:54:54.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa604ec2640 1 -- 172.21.15.70:0/4103436973 learned_addr learned my addr 172.21.15.70:0/4103436973 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:54.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa604ec2640 1 -- 172.21.15.70:0/4103436973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 msgr2=0x562e2f487d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:54.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa604ec2640 1 --2- 172.21.15.70:0/4103436973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 0x562e2f487d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa604ec2640 1 -- 172.21.15.70:0/4103436973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 msgr2=0x562e2f48b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:54.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa604ec2640 1 --2- 172.21.15.70:0/4103436973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f48b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa604ec2640 1 -- 172.21.15.70:0/4103436973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2f48f6e0 con 0x562e2f480360 2024-09-12T01:54:54.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa604ec2640 1 --2- 172.21.15.70:0/4103436973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f49b900 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0010010 tx=0x7fa5f000b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f559ecb570231ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:54.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa5eaffd640 1 -- 172.21.15.70:0/4103436973 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f000f5d0 con 0x562e2f480360 2024-09-12T01:54:54.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa5eaffd640 1 -- 172.21.15.70:0/4103436973 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5f000f770 con 0x562e2f480360 2024-09-12T01:54:54.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.592+0000 7fa5eaffd640 1 -- 172.21.15.70:0/4103436973 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0013330 con 0x562e2f480360 2024-09-12T01:54:54.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.593+0000 7fa609d00740 1 -- 172.21.15.70:0/4103436973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 msgr2=0x562e2f49b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:54.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.593+0000 7fa609d00740 1 --2- 172.21.15.70:0/4103436973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f49b900 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0010010 tx=0x7fa5f000b980 comp rx=0 tx=0).stop 2024-09-12T01:54:54.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.593+0000 7fa609d00740 1 -- 172.21.15.70:0/4103436973 shutdown_connections 2024-09-12T01:54:54.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.593+0000 7fa609d00740 1 --2- 172.21.15.70:0/4103436973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f48b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.593+0000 7fa609d00740 1 --2- 172.21.15.70:0/4103436973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 0x562e2f487d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.593+0000 7fa609d00740 1 --2- 172.21.15.70:0/4103436973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f49b900 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.593+0000 7fa609d00740 1 -- 172.21.15.70:0/4103436973 >> 172.21.15.70:0/4103436973 conn(0x562e2f47ca30 msgr2=0x562e2f48aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.593+0000 7fa609d00740 1 -- 172.21.15.70:0/4103436973 shutdown_connections 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.593+0000 7fa609d00740 1 -- 172.21.15.70:0/4103436973 wait complete. 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.593+0000 7fa609d00740 1 -- start start 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.593+0000 7fa609d00740 1 Processor -- start 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa609d00740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f493170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa609d00740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 0x562e2f4936b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa609d00740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f497730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa609d00740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6001acaf0 con 0x562e2f480360 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa609d00740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa6001ac3c0 con 0x562e2f48fa90 2024-09-12T01:54:54.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa609d00740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa6001a9570 con 0x562e2f480c80 2024-09-12T01:54:54.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa609d00740 10 client.0 _ll_register_callbacks cb 0x7fa5f0013be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:54:54.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa604ec2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f493170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa604ec2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f493170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58178/0 (socket says 172.21.15.70:58178) 2024-09-12T01:54:54.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa604ec2640 1 -- 172.21.15.70:0/1866367465 learned_addr learned my addr 172.21.15.70:0/1866367465 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:54.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa604ec2640 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f497730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa6056c3640 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 0x562e2f4936b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa604ec2640 1 -- 172.21.15.70:0/1866367465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 msgr2=0x562e2f4936b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:54.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa604ec2640 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 0x562e2f4936b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa604ec2640 1 -- 172.21.15.70:0/1866367465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 msgr2=0x562e2f497730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:54:54.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa604ec2640 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f497730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa604ec2640 1 -- 172.21.15.70:0/1866367465 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e2f497dd0 con 0x562e2f480360 2024-09-12T01:54:54.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa604ec2640 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f493170 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0013fd0 tx=0x7fa5f000fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f2ff6f84f6ae9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:54.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.594+0000 7fa5e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:54:54.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa5e8ff9640 1 -- 172.21.15.70:0/1866367465 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f003d060 con 0x562e2f480360 2024-09-12T01:54:54.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa5e8ff9640 1 -- 172.21.15.70:0/1866367465 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa5f00132d0 con 0x562e2f480360 2024-09-12T01:54:54.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa609d00740 1 -- 172.21.15.70:0/1866367465 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5f000f770 con 0x562e2f480360 2024-09-12T01:54:54.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa5e8ff9640 1 -- 172.21.15.70:0/1866367465 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa5f0005000 con 0x562e2f480360 2024-09-12T01:54:54.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa609d00740 10 client.16539 fetch_fsmap learned FSMap version 37 2024-09-12T01:54:54.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa609d00740 1 -- 172.21.15.70:0/1866367465 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562e2f509d10 con 0x562e2f480360 2024-09-12T01:54:54.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa5e8ff9640 1 -- 172.21.15.70:0/1866367465 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5f000f770 con 0x562e2f480360 2024-09-12T01:54:54.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa5e8ff9640 1 -- 172.21.15.70:0/1866367465 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fa5f0027070 con 0x562e2f480360 2024-09-12T01:54:54.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa609d00740 10 client.16539 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:54:54.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa609d00740 10 client.16539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:54:54.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa609d00740 20 client.16539 populate_metadata read hostname 'smithi070' 2024-09-12T01:54:54.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa609d00740 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e2f49f570 0x562e2f50c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:54.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa609d00740 4 client.16539 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:54:54.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa609d00740 1 -- 172.21.15.70:0/1866367465 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562e2f3edd60 con 0x562e2f49f570 2024-09-12T01:54:54.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.595+0000 7fa6056c3640 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e2f49f570 0x562e2f50c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:54.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa6056c3640 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e2f49f570 0x562e2f50c370 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b342dc60881bda76 server_cookie=833a36fc38f92afe in_seq=0 out_seq=0 2024-09-12T01:54:54.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa5e8ff9640 10 client.16539 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:54.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa5e8ff9640 1 -- 172.21.15.70:0/1866367465 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562e2f3edd60 con 0x562e2f49f570 2024-09-12T01:54:54.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa5e8ff9640 10 client.16539 handle_command_reply: tid=0 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa609d00740 1 client.16539 shutdown 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa609d00740 1 -- 172.21.15.70:0/1866367465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 msgr2=0x562e2f493170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa609d00740 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f493170 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0013fd0 tx=0x7fa5f000fcd0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa609d00740 1 -- 172.21.15.70:0/1866367465 shutdown_connections 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa609d00740 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x562e2f49f570 0x562e2f50c370 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa609d00740 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x562e2f48fa90 0x562e2f497730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa5e8ff9640 0 client.16539 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa609d00740 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562e2f480c80 0x562e2f4936b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa609d00740 1 --2- 172.21.15.70:0/1866367465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e2f480360 0x562e2f493170 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa609d00740 1 -- 172.21.15.70:0/1866367465 >> 172.21.15.70:0/1866367465 conn(0x562e2f47ca30 msgr2=0x562e2f48b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa609d00740 1 -- 172.21.15.70:0/1866367465 shutdown_connections 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa609d00740 1 -- 172.21.15.70:0/1866367465 wait complete. 2024-09-12T01:54:54.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.596+0000 7fa609d00740 20 client.16539 trim_cache size 0 max 16384 2024-09-12T01:54:54.605 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:54:54.605 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T01:54:54.606 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-12T01:54:54.606 INFO:teuthology.orchestra.run.smithi070.stdout: "6ad46b0b-b579-4311-ab57-0e5fb635178c": { 2024-09-12T01:54:54.606 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-12T01:54:54.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "6ad46b0b-b579-4311-ab57-0e5fb635178c", 2024-09-12T01:54:54.606 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-12T01:54:54.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:54.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:54:54.607 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:54:54.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.597+0000 7fa607927640 1 -- 172.21.15.70:0/1759449586 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa5ec0a2c00 msgr2=0x7fa5ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:54.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.597+0000 7fa607927640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa5ec0a2c00 0x7fa5ec0a50c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8004b90 tx=0x7fa5f8014db0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.597+0000 7fa607927640 1 -- 172.21.15.70:0/1759449586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa600106a80 msgr2=0x7fa6001a4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:54.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.597+0000 7fa607927640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa600106a80 0x7fa6001a4470 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800b970 tx=0x7fa5f800be30 comp rx=0 tx=0).stop 2024-09-12T01:54:54.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.597+0000 7fa607927640 1 -- 172.21.15.70:0/1759449586 shutdown_connections 2024-09-12T01:54:54.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.597+0000 7fa607927640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fa5ec0a2c00 0x7fa5ec0a50c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.597+0000 7fa607927640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa600106a80 0x7fa6001a4470 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.597+0000 7fa607927640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa600101420 0x7fa600199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.597+0000 7fa607927640 1 --2- 172.21.15.70:0/1759449586 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa600100a80 0x7fa6001993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:54.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.597+0000 7fa607927640 1 -- 172.21.15.70:0/1759449586 >> 172.21.15.70:0/1759449586 conn(0x7fa6000fc7a0 msgr2=0x7fa6000fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:54.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.597+0000 7fa607927640 1 -- 172.21.15.70:0/1759449586 shutdown_connections 2024-09-12T01:54:54.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:54.597+0000 7fa607927640 1 -- 172.21.15.70:0/1759449586 wait complete. 2024-09-12T01:54:54.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:54 smithi070 ceph-mon[31177]: pgmap v419: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 KiB/s wr, 49 op/s 2024-09-12T01:54:54.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:54 smithi191 ceph-mon[35770]: pgmap v419: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 KiB/s wr, 49 op/s 2024-09-12T01:54:55.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:54 smithi152 ceph-mon[35055]: pgmap v419: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 KiB/s wr, 49 op/s 2024-09-12T01:54:55.291 INFO:tasks.cephfs.filesystem:scrub status for tag:6ad46b0b-b579-4311-ab57-0e5fb635178c - {'path': '/', 'tag': '6ad46b0b-b579-4311-ab57-0e5fb635178c', 'options': 'recursive,force'} 2024-09-12T01:54:56.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:56 smithi191 ceph-mon[35770]: pgmap v420: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 32 op/s 2024-09-12T01:54:57.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:56 smithi152 ceph-mon[35055]: pgmap v420: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 32 op/s 2024-09-12T01:54:57.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:56 smithi070 ceph-mon[31177]: pgmap v420: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 32 op/s 2024-09-12T01:54:58.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:58 smithi191 ceph-mon[35770]: pgmap v421: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.2 KiB/s wr, 29 op/s 2024-09-12T01:54:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:58 smithi191 ceph-mon[35770]: scrub summary: idle 2024-09-12T01:54:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:58 smithi191 ceph-mon[35770]: scrub summary: idle 2024-09-12T01:54:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:58 smithi191 ceph-mon[35770]: scrub summary: idle 2024-09-12T01:54:58.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:54:58 smithi191 ceph-mon[35770]: scrub summary: idle 2024-09-12T01:54:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:58 smithi152 ceph-mon[35055]: pgmap v421: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.2 KiB/s wr, 29 op/s 2024-09-12T01:54:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:58 smithi152 ceph-mon[35055]: scrub summary: idle 2024-09-12T01:54:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:58 smithi152 ceph-mon[35055]: scrub summary: idle 2024-09-12T01:54:59.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:58 smithi152 ceph-mon[35055]: scrub summary: idle 2024-09-12T01:54:59.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:54:58 smithi152 ceph-mon[35055]: scrub summary: idle 2024-09-12T01:54:59.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:58 smithi070 ceph-mon[31177]: pgmap v421: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.2 KiB/s wr, 29 op/s 2024-09-12T01:54:59.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:58 smithi070 ceph-mon[31177]: scrub summary: idle 2024-09-12T01:54:59.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:58 smithi070 ceph-mon[31177]: scrub summary: idle 2024-09-12T01:54:59.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:58 smithi070 ceph-mon[31177]: scrub summary: idle 2024-09-12T01:54:59.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:54:58 smithi070 ceph-mon[31177]: scrub summary: idle 2024-09-12T01:54:59.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:59.412 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:54:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.879+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/696388005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b04106a80 msgr2=0x7f2b04106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.879+0000 7f2b0b6a0640 1 --2- 172.21.15.70:0/696388005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b04106a80 0x7f2b04106e60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009930 tx=0x7f2b0002a420 comp rx=0 tx=0).stop 2024-09-12T01:54:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.879+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/696388005 shutdown_connections 2024-09-12T01:54:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.879+0000 7f2b0b6a0640 1 --2- 172.21.15.70:0/696388005 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b04101420 0x7f2b0410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.879+0000 7f2b0b6a0640 1 --2- 172.21.15.70:0/696388005 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b04100a80 0x7f2b04100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.879+0000 7f2b0b6a0640 1 --2- 172.21.15.70:0/696388005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b04106a80 0x7f2b04106e60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.879+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/696388005 >> 172.21.15.70:0/696388005 conn(0x7f2b040fc7a0 msgr2=0x7f2b040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.879+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/696388005 shutdown_connections 2024-09-12T01:54:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.879+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/696388005 wait complete. 2024-09-12T01:54:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.879+0000 7f2b0b6a0640 1 Processor -- start 2024-09-12T01:54:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.879+0000 7f2b0b6a0640 1 -- start start 2024-09-12T01:54:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b0b6a0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b04100a80 0x7f2b04198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b0b6a0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b04101420 0x7f2b04198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b0b6a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b04106a80 0x7f2b0419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b0b6a0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04110fe0 con 0x7f2b04106a80 2024-09-12T01:54:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b0b6a0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04110e60 con 0x7f2b04101420 2024-09-12T01:54:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b0b6a0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04111160 con 0x7f2b04100a80 2024-09-12T01:54:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b09c3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b04106a80 0x7f2b0419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b09c3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b04106a80 0x7f2b0419ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58204/0 (socket says 172.21.15.70:58204) 2024-09-12T01:54:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b09c3d640 1 -- 172.21.15.70:0/718823320 learned_addr learned my addr 172.21.15.70:0/718823320 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:54:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b08c3b640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b04101420 0x7f2b04198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:59.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b0943c640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b04100a80 0x7f2b04198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b09c3d640 1 -- 172.21.15.70:0/718823320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b04100a80 msgr2=0x7f2b04198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b09c3d640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b04100a80 0x7f2b04198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b09c3d640 1 -- 172.21.15.70:0/718823320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b04101420 msgr2=0x7f2b04198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b09c3d640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b04101420 0x7f2b04198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b09c3d640 1 -- 172.21.15.70:0/718823320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0419d5b0 con 0x7f2b04106a80 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b0943c640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b04100a80 0x7f2b04198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b09c3d640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b04106a80 0x7f2b0419ced0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00cad0 tx=0x7f2afc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2afa7fc640 1 -- 172.21.15.70:0/718823320 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00ad60 con 0x7f2b04106a80 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2afa7fc640 1 -- 172.21.15.70:0/718823320 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2afc004b20 con 0x7f2b04106a80 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/718823320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0419d8a0 con 0x7f2b04106a80 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.880+0000 7f2afa7fc640 1 -- 172.21.15.70:0/718823320 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00f6f0 con 0x7f2b04106a80 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.881+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/718823320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b041a5180 con 0x7f2b04106a80 2024-09-12T01:54:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.882+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/718823320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b04100ee0 con 0x7f2b04106a80 2024-09-12T01:54:59.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.884+0000 7f2afa7fc640 1 -- 172.21.15.70:0/718823320 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2afc00f8d0 con 0x7f2b04106a80 2024-09-12T01:54:59.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.884+0000 7f2afa7fc640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2af00a2b80 0x7f2af00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:59.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.884+0000 7f2b0943c640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2af00a2b80 0x7f2af00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:59.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.884+0000 7f2afa7fc640 1 -- 172.21.15.70:0/718823320 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2afc0cf460 con 0x7f2b04106a80 2024-09-12T01:54:59.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.885+0000 7f2b0943c640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2af00a2b80 0x7f2af00a5040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2b00000c00 tx=0x7f2b00005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:54:59.888+0000 7f2afa7fc640 1 -- 172.21.15.70:0/718823320 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2afc014030 con 0x7f2b04106a80 2024-09-12T01:55:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.085+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/718823320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b04199960 con 0x7f2b04106a80 2024-09-12T01:55:00.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.086+0000 7f2afa7fc640 1 -- 172.21.15.70:0/718823320 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11994 (secure 0 0 0) 0x7f2b04199960 con 0x7f2b04106a80 2024-09-12T01:55:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:55:00.087 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"btime":"2024-09-12T01:54:37:622268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:54:36.766931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:55:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 37 2024-09-12T01:55:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.088+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/718823320 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2af00a2b80 msgr2=0x7f2af00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.088+0000 7f2b0b6a0640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2af00a2b80 0x7f2af00a5040 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2b00000c00 tx=0x7f2b00005a20 comp rx=0 tx=0).stop 2024-09-12T01:55:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.088+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/718823320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b04106a80 msgr2=0x7f2b0419ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:00.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.088+0000 7f2b0b6a0640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b04106a80 0x7f2b0419ced0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00cad0 tx=0x7f2afc00ced0 comp rx=0 tx=0).stop 2024-09-12T01:55:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.088+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/718823320 shutdown_connections 2024-09-12T01:55:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.088+0000 7f2b0b6a0640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2af00a2b80 0x7f2af00a5040 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.088+0000 7f2b0b6a0640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b04106a80 0x7f2b0419ced0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.088+0000 7f2b0b6a0640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2b04101420 0x7f2b04198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:00.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.088+0000 7f2b0b6a0640 1 --2- 172.21.15.70:0/718823320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b04100a80 0x7f2b04198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.088+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/718823320 >> 172.21.15.70:0/718823320 conn(0x7f2b040fc7a0 msgr2=0x7f2b0406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.088+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/718823320 shutdown_connections 2024-09-12T01:55:00.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:00.088+0000 7f2b0b6a0640 1 -- 172.21.15.70:0/718823320 wait complete. 2024-09-12T01:55:00.774 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24452 quiesce db --set-id e681cdf1 --release --await' 2024-09-12T01:55:00.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24452 quiesce db --set-id e681cdf1 --release --await 2024-09-12T01:55:00.797 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:00 smithi070 ceph-mon[31177]: pgmap v422: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.2 KiB/s wr, 30 op/s 2024-09-12T01:55:00.797 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:00 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/718823320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:00.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:00 smithi191 ceph-mon[35770]: pgmap v422: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.2 KiB/s wr, 30 op/s 2024-09-12T01:55:00.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:00 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/718823320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:01.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:00 smithi152 ceph-mon[35055]: pgmap v422: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.2 KiB/s wr, 30 op/s 2024-09-12T01:55:01.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:00 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/718823320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.486+0000 7fbe552f9640 1 -- 172.21.15.70:0/3043308285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe50106f20 msgr2=0x7fbe5010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.486+0000 7fbe552f9640 1 --2- 172.21.15.70:0/3043308285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe50106f20 0x7fbe5010eaa0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009ca0 tx=0x7fbe4802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.486+0000 7fbe552f9640 1 -- 172.21.15.70:0/3043308285 shutdown_connections 2024-09-12T01:55:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.486+0000 7fbe552f9640 1 --2- 172.21.15.70:0/3043308285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe50106f20 0x7fbe5010eaa0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.486+0000 7fbe552f9640 1 --2- 172.21.15.70:0/3043308285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe501027a0 0x7fbe501067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.486+0000 7fbe552f9640 1 --2- 172.21.15.70:0/3043308285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe50101df0 0x7fbe501021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.486+0000 7fbe552f9640 1 -- 172.21.15.70:0/3043308285 >> 172.21.15.70:0/3043308285 conn(0x7fbe500fd8f0 msgr2=0x7fbe500ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.486+0000 7fbe552f9640 1 -- 172.21.15.70:0/3043308285 shutdown_connections 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.486+0000 7fbe552f9640 1 -- 172.21.15.70:0/3043308285 wait complete. 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe552f9640 1 Processor -- start 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe552f9640 1 -- start start 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe552f9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe50101df0 0x7fbe501984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe552f9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe501027a0 0x7fbe50198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe552f9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe50106f20 0x7fbe5019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe552f9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe501120e0 con 0x7fbe50101df0 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe552f9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbe50111f60 con 0x7fbe501027a0 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe552f9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbe50112260 con 0x7fbe50106f20 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe4effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe50101df0 0x7fbe501984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe4effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe50101df0 0x7fbe501984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54362/0 (socket says 172.21.15.70:54362) 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe4effd640 1 -- 172.21.15.70:0/3682995364 learned_addr learned my addr 172.21.15.70:0/3682995364 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe47fff640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe501027a0 0x7fbe50198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe50106f20 0x7fbe5019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe4effd640 1 -- 172.21.15.70:0/3682995364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe50106f20 msgr2=0x7fbe5019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe4effd640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe50106f20 0x7fbe5019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe4effd640 1 -- 172.21.15.70:0/3682995364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe501027a0 msgr2=0x7fbe50198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe4effd640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe501027a0 0x7fbe50198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.487+0000 7fbe4effd640 1 -- 172.21.15.70:0/3682995364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5019d490 con 0x7fbe50101df0 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.488+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe50106f20 0x7fbe5019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.488+0000 7fbe4effd640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe50101df0 0x7fbe501984e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000c920 tx=0x7fbe4000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.488+0000 7fbe4cff9640 1 -- 172.21.15.70:0/3682995364 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40007c70 con 0x7fbe50101df0 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.488+0000 7fbe4cff9640 1 -- 172.21.15.70:0/3682995364 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe40007e10 con 0x7fbe50101df0 2024-09-12T01:55:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.488+0000 7fbe552f9640 1 -- 172.21.15.70:0/3682995364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5019d780 con 0x7fbe50101df0 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.488+0000 7fbe4cff9640 1 -- 172.21.15.70:0/3682995364 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40018940 con 0x7fbe50101df0 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.488+0000 7fbe552f9640 1 -- 172.21.15.70:0/3682995364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe501a5060 con 0x7fbe50101df0 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.490+0000 7fbe4cff9640 1 -- 172.21.15.70:0/3682995364 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbe40018b20 con 0x7fbe50101df0 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe576d2740 1 Processor -- start 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe576d2740 1 -- start start 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe576d2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162060 0x55aedc162440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe4cff9640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbe3c0a2b80 0x7fbe3c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe576d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162980 0x55aedc16cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe576d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc16f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe576d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aedc0c7620 con 0x55aedc16d240 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe576d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55aedc06ee50 con 0x55aedc162980 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe576d2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55aedc0c35e0 con 0x55aedc162060 2024-09-12T01:55:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc16f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe4effd640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbe3c0a2b80 0x7fbe3c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc16f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54368/0 (socket says 172.21.15.70:54368) 2024-09-12T01:55:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe4f7fe640 1 -- 172.21.15.70:0/2419731336 learned_addr learned my addr 172.21.15.70:0/2419731336 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe4cff9640 1 -- 172.21.15.70:0/3682995364 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbe400cf2d0 con 0x7fbe50101df0 2024-09-12T01:55:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.491+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/2419731336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162060 0x55aedc162440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.492+0000 7fbe47fff640 1 --2- 172.21.15.70:0/2419731336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162980 0x55aedc16cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.492+0000 7fbe4f7fe640 1 -- 172.21.15.70:0/2419731336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162060 msgr2=0x55aedc162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.492+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/2419731336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162060 0x55aedc162440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.492+0000 7fbe4f7fe640 1 -- 172.21.15.70:0/2419731336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162980 msgr2=0x55aedc16cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.492+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/2419731336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162980 0x55aedc16cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.492+0000 7fbe4f7fe640 1 -- 172.21.15.70:0/2419731336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aedc05fd40 con 0x55aedc16d240 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.492+0000 7fbe4effd640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbe3c0a2b80 0x7fbe3c0a5040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbe40007590 tx=0x7fbe40090fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.492+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/2419731336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc16f630 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbe48006010 tx=0x7fbe48005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bbd98808a03081 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.492+0000 7fbe457fa640 1 -- 172.21.15.70:0/2419731336 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48031790 con 0x55aedc16d240 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.492+0000 7fbe457fa640 1 -- 172.21.15.70:0/2419731336 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe48036040 con 0x55aedc16d240 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.492+0000 7fbe457fa640 1 -- 172.21.15.70:0/2419731336 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48004820 con 0x55aedc16d240 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.493+0000 7fbe576d2740 1 -- 172.21.15.70:0/2419731336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 msgr2=0x55aedc16f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.493+0000 7fbe576d2740 1 --2- 172.21.15.70:0/2419731336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc16f630 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbe48006010 tx=0x7fbe48005ef0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.493+0000 7fbe576d2740 1 -- 172.21.15.70:0/2419731336 shutdown_connections 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.493+0000 7fbe576d2740 1 --2- 172.21.15.70:0/2419731336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc16f630 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.493+0000 7fbe576d2740 1 --2- 172.21.15.70:0/2419731336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162980 0x55aedc16cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.493+0000 7fbe576d2740 1 --2- 172.21.15.70:0/2419731336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162060 0x55aedc162440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.493+0000 7fbe576d2740 1 -- 172.21.15.70:0/2419731336 >> 172.21.15.70:0/2419731336 conn(0x55aedc15e5f0 msgr2=0x55aedc15e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.493+0000 7fbe576d2740 1 -- 172.21.15.70:0/2419731336 shutdown_connections 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.493+0000 7fbe576d2740 1 -- 172.21.15.70:0/2419731336 wait complete. 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.493+0000 7fbe576d2740 1 -- start start 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.493+0000 7fbe576d2740 1 Processor -- start 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe576d2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162060 0x55aedc16a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe576d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162980 0x55aedc16a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe576d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc16abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe576d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aedc16fe10 con 0x55aedc16d240 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe576d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55aedc04ff10 con 0x55aedc162980 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe576d2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55aedc16ff90 con 0x55aedc162060 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe576d2740 10 client.0 _ll_register_callbacks cb 0x55aedc073db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc16abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc16abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54370/0 (socket says 172.21.15.70:54370) 2024-09-12T01:55:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe4f7fe640 1 -- 172.21.15.70:0/3070082083 learned_addr learned my addr 172.21.15.70:0/3070082083 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe47fff640 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162980 0x55aedc16a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162060 0x55aedc16a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe4f7fe640 1 -- 172.21.15.70:0/3070082083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162060 msgr2=0x55aedc16a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162060 0x55aedc16a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe4f7fe640 1 -- 172.21.15.70:0/3070082083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162980 msgr2=0x55aedc16a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162980 0x55aedc16a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe4f7fe640 1 -- 172.21.15.70:0/3070082083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aedbdd6580 con 0x55aedc16d240 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc16abb0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009590 tx=0x7fbe48041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9525063311d916 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe367fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.494+0000 7fbe367fc640 1 -- 172.21.15.70:0/3070082083 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48031db0 con 0x55aedc16d240 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe367fc640 1 -- 172.21.15.70:0/3070082083 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbe48031590 con 0x55aedc16d240 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe576d2740 1 -- 172.21.15.70:0/3070082083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe48036040 con 0x55aedc16d240 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe367fc640 1 -- 172.21.15.70:0/3070082083 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fbe48031790 con 0x55aedc16d240 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe576d2740 10 client.16557 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe576d2740 1 -- 172.21.15.70:0/3070082083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55aedbea0960 con 0x55aedc16d240 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe367fc640 1 -- 172.21.15.70:0/3070082083 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe48036040 con 0x55aedc16d240 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe367fc640 1 -- 172.21.15.70:0/3070082083 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fbe4802fb40 con 0x55aedc16d240 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe576d2740 10 client.16557 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe576d2740 10 client.16557 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe576d2740 20 client.16557 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe576d2740 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aedc17cc40 0x55aedc17f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe576d2740 4 client.16557 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe576d2740 1 -- 172.21.15.70:0/3070082083 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aedc0d4b90 con 0x55aedc17cc40 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.495+0000 7fbe47fff640 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aedc17cc40 0x55aedc17f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.496+0000 7fbe47fff640 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aedc17cc40 0x55aedc17f030 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8137b395db01b9cd server_cookie=2bb1f7e1b34abbcd in_seq=0 out_seq=0 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.496+0000 7fbe367fc640 10 client.16557 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe367fc640 1 -- 172.21.15.70:0/3070082083 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aedc0d4b90 con 0x55aedc17cc40 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe367fc640 10 client.16557 handle_command_reply: tid=0 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe576d2740 1 client.16557 shutdown 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe576d2740 1 -- 172.21.15.70:0/3070082083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 msgr2=0x55aedc16abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe576d2740 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc16abb0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009590 tx=0x7fbe48041040 comp rx=0 tx=0).stop 2024-09-12T01:55:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe576d2740 1 -- 172.21.15.70:0/3070082083 shutdown_connections 2024-09-12T01:55:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe576d2740 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aedc17cc40 0x55aedc17f030 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe576d2740 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc16abb0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe576d2740 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162980 0x55aedc16a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe367fc640 0 client.16557 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe576d2740 1 --2- 172.21.15.70:0/3070082083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162060 0x55aedc16a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe576d2740 1 -- 172.21.15.70:0/3070082083 >> 172.21.15.70:0/3070082083 conn(0x55aedc15e5f0 msgr2=0x55aedc1642d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe576d2740 1 -- 172.21.15.70:0/3070082083 shutdown_connections 2024-09-12T01:55:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe576d2740 1 -- 172.21.15.70:0/3070082083 wait complete. 2024-09-12T01:55:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.497+0000 7fbe576d2740 20 client.16557 trim_cache size 0 max 16384 2024-09-12T01:55:01.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.513+0000 7fbe576d2740 1 Processor -- start 2024-09-12T01:55:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe576d2740 1 -- start start 2024-09-12T01:55:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe576d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162060 0x55aedc16c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe576d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc162980 0x55aedc184600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe576d2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc16d240 0x55aedc184b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe576d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe501ad640 con 0x55aedc162980 2024-09-12T01:55:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe576d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbe501af330 con 0x55aedc162060 2024-09-12T01:55:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe576d2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbe501add70 con 0x55aedc16d240 2024-09-12T01:55:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe47fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc162980 0x55aedc184600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe47fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc162980 0x55aedc184600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54382/0 (socket says 172.21.15.70:54382) 2024-09-12T01:55:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe47fff640 1 -- 172.21.15.70:0/2531357522 learned_addr learned my addr 172.21.15.70:0/2531357522 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:01.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/2531357522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162060 0x55aedc16c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/2531357522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc16d240 0x55aedc184b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe47fff640 1 -- 172.21.15.70:0/2531357522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc16d240 msgr2=0x55aedc184b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:01.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe47fff640 1 --2- 172.21.15.70:0/2531357522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc16d240 0x55aedc184b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe47fff640 1 -- 172.21.15.70:0/2531357522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162060 msgr2=0x55aedc16c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:01.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe47fff640 1 --2- 172.21.15.70:0/2531357522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162060 0x55aedc16c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe47fff640 1 -- 172.21.15.70:0/2531357522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aedc1627b0 con 0x55aedc162980 2024-09-12T01:55:01.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.514+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/2531357522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162060 0x55aedc16c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:01.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.515+0000 7fbe47fff640 1 --2- 172.21.15.70:0/2531357522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc162980 0x55aedc184600 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006fd0 tx=0x7fbe38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102a373646752b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:01.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.515+0000 7fbe44ff9640 1 -- 172.21.15.70:0/2531357522 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3800bd50 con 0x55aedc162980 2024-09-12T01:55:01.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.515+0000 7fbe44ff9640 1 -- 172.21.15.70:0/2531357522 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe3801c750 con 0x55aedc162980 2024-09-12T01:55:01.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.515+0000 7fbe44ff9640 1 -- 172.21.15.70:0/2531357522 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe38013700 con 0x55aedc162980 2024-09-12T01:55:01.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.515+0000 7fbe576d2740 1 -- 172.21.15.70:0/2531357522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc162980 msgr2=0x55aedc184600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.515+0000 7fbe576d2740 1 --2- 172.21.15.70:0/2531357522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc162980 0x55aedc184600 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006fd0 tx=0x7fbe38008040 comp rx=0 tx=0).stop 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 -- 172.21.15.70:0/2531357522 shutdown_connections 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 --2- 172.21.15.70:0/2531357522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc16d240 0x55aedc184b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 --2- 172.21.15.70:0/2531357522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc162980 0x55aedc184600 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 --2- 172.21.15.70:0/2531357522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162060 0x55aedc16c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 -- 172.21.15.70:0/2531357522 >> 172.21.15.70:0/2531357522 conn(0x55aedc15e5f0 msgr2=0x55aedc15d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 -- 172.21.15.70:0/2531357522 shutdown_connections 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 -- 172.21.15.70:0/2531357522 wait complete. 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 -- start start 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 Processor -- start 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162060 0x55aedc1755e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162980 0x55aedc1721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc1726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe501aeba0 con 0x55aedc16d240 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbe501ae470 con 0x55aedc162060 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbe501ab600 con 0x55aedc162980 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe576d2740 10 client.0 _ll_register_callbacks cb 0x7fbe480314e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc1726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc1726f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54390/0 (socket says 172.21.15.70:54390) 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.516+0000 7fbe4f7fe640 1 -- 172.21.15.70:0/956870802 learned_addr learned my addr 172.21.15.70:0/956870802 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162060 0x55aedc1755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe47fff640 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162980 0x55aedc1721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe4f7fe640 1 -- 172.21.15.70:0/956870802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162980 msgr2=0x55aedc1721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162980 0x55aedc1721b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe4f7fe640 1 -- 172.21.15.70:0/956870802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162060 msgr2=0x55aedc1755e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:01.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162060 0x55aedc1755e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe4f7fe640 1 -- 172.21.15.70:0/956870802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aedc172c30 con 0x55aedc16d240 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe4f7fe640 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc1726f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbe4802ff10 tx=0x7fbe480044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96846d994692674 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe367fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe367fc640 1 -- 172.21.15.70:0/956870802 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48030d70 con 0x55aedc16d240 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe367fc640 1 -- 172.21.15.70:0/956870802 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbe4802f610 con 0x55aedc16d240 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe576d2740 1 -- 172.21.15.70:0/956870802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe3801c750 con 0x55aedc16d240 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe367fc640 1 -- 172.21.15.70:0/956870802 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fbe4802f810 con 0x55aedc16d240 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe576d2740 10 client.16563 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.517+0000 7fbe576d2740 1 -- 172.21.15.70:0/956870802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55aedc1e82a0 con 0x55aedc16d240 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.518+0000 7fbe367fc640 1 -- 172.21.15.70:0/956870802 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe3801c750 con 0x55aedc16d240 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.518+0000 7fbe367fc640 1 -- 172.21.15.70:0/956870802 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fbe48061060 con 0x55aedc16d240 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.518+0000 7fbe576d2740 10 client.16563 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:01.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.518+0000 7fbe576d2740 10 client.16563 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:55:01.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.518+0000 7fbe576d2740 20 client.16563 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:01.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.518+0000 7fbe576d2740 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aedc1e8970 0x55aedc1ead90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.518+0000 7fbe576d2740 4 client.16563 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e681cdf1", "release": true, "await": true}] 2024-09-12T01:55:01.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.518+0000 7fbe576d2740 1 -- 172.21.15.70:0/956870802 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e681cdf1", "release": true, "await": true}) -- 0x55aedc0cf0a0 con 0x55aedc1e8970 2024-09-12T01:55:01.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.518+0000 7fbe47fff640 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aedc1e8970 0x55aedc1ead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.518+0000 7fbe367fc640 10 client.16563 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:01.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.518+0000 7fbe47fff640 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aedc1e8970 0x55aedc1ead90 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66d412a4bed942c5 server_cookie=a054fa5554ac8d38 in_seq=0 out_seq=0 2024-09-12T01:55:01.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe367fc640 1 -- 172.21.15.70:0/956870802 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55aedc0cf0a0 con 0x55aedc1e8970 2024-09-12T01:55:01.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe367fc640 10 client.16563 handle_command_reply: tid=0 2024-09-12T01:55:01.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe576d2740 1 client.16563 shutdown 2024-09-12T01:55:01.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe576d2740 1 -- 172.21.15.70:0/956870802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 msgr2=0x55aedc1726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe576d2740 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc1726f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbe4802ff10 tx=0x7fbe480044e0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe576d2740 1 -- 172.21.15.70:0/956870802 shutdown_connections 2024-09-12T01:55:01.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe576d2740 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aedc1e8970 0x55aedc1ead90 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe576d2740 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aedc16d240 0x55aedc1726f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe576d2740 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aedc162980 0x55aedc1721b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe367fc640 0 client.16563 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:01.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe576d2740 1 --2- 172.21.15.70:0/956870802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aedc162060 0x55aedc1755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe576d2740 1 -- 172.21.15.70:0/956870802 >> 172.21.15.70:0/956870802 conn(0x55aedc15e5f0 msgr2=0x55aedc15cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:01.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe576d2740 1 -- 172.21.15.70:0/956870802 shutdown_connections 2024-09-12T01:55:01.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe576d2740 1 -- 172.21.15.70:0/956870802 wait complete. 2024-09-12T01:55:01.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.530+0000 7fbe576d2740 20 client.16563 trim_cache size 0 max 16384 2024-09-12T01:55:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:55:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 37, 2024-09-12T01:55:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24452, 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 12, 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "e681cdf1": { 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 12, 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 90.0, 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 144.7, 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-09-12T01:55:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-09-12T01:55:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-09-12T01:55:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-09-12T01:55:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-09-12T01:55:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:01.534 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:55:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.531+0000 7fbe552f9640 1 -- 172.21.15.70:0/3682995364 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbe3c0a2b80 msgr2=0x7fbe3c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.531+0000 7fbe552f9640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbe3c0a2b80 0x7fbe3c0a5040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbe40007590 tx=0x7fbe40090fd0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.531+0000 7fbe552f9640 1 -- 172.21.15.70:0/3682995364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe50101df0 msgr2=0x7fbe501984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.531+0000 7fbe552f9640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe50101df0 0x7fbe501984e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000c920 tx=0x7fbe4000cde0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.531+0000 7fbe552f9640 1 -- 172.21.15.70:0/3682995364 shutdown_connections 2024-09-12T01:55:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.531+0000 7fbe552f9640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbe3c0a2b80 0x7fbe3c0a5040 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.531+0000 7fbe552f9640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbe50106f20 0x7fbe5019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.531+0000 7fbe552f9640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbe501027a0 0x7fbe50198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.531+0000 7fbe552f9640 1 --2- 172.21.15.70:0/3682995364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe50101df0 0x7fbe501984e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.531+0000 7fbe552f9640 1 -- 172.21.15.70:0/3682995364 >> 172.21.15.70:0/3682995364 conn(0x7fbe500fd8f0 msgr2=0x7fbe500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:01.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.531+0000 7fbe552f9640 1 -- 172.21.15.70:0/3682995364 shutdown_connections 2024-09-12T01:55:01.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:01.531+0000 7fbe552f9640 1 -- 172.21.15.70:0/3682995364 wait complete. 2024-09-12T01:55:02.127 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-12T01:55:02.128 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:55:02.269 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e681cdf1', total seconds elapsed: 27.8 2024-09-12T01:55:02.464 DEBUG:teuthology.parallel:result is None 2024-09-12T01:55:02.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:55:02.498 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:55:02.498 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-12T01:55:02.509 INFO:tasks.quiescer:joining Quiescers 2024-09-12T01:55:02.510 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-12T01:55:02.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:55:02.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:02 smithi070 ceph-mon[31177]: pgmap v423: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.9 KiB/s wr, 32 op/s 2024-09-12T01:55:02.791 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:02.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:02 smithi191 ceph-mon[35770]: pgmap v423: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.9 KiB/s wr, 32 op/s 2024-09-12T01:55:03.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:02 smithi152 ceph-mon[35055]: pgmap v423: 97 pgs: 97 active+clean; 44 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.9 KiB/s wr, 32 op/s 2024-09-12T01:55:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.262+0000 7fd90e70a640 1 -- 172.21.15.70:0/2901847478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908106f20 msgr2=0x7fd90810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.262+0000 7fd90e70a640 1 --2- 172.21.15.70:0/2901847478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908106f20 0x7fd90810eaa0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd900009ca0 tx=0x7fd90002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.262+0000 7fd90e70a640 1 -- 172.21.15.70:0/2901847478 shutdown_connections 2024-09-12T01:55:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.262+0000 7fd90e70a640 1 --2- 172.21.15.70:0/2901847478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908106f20 0x7fd90810eaa0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.262+0000 7fd90e70a640 1 --2- 172.21.15.70:0/2901847478 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9081027a0 0x7fd9081067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.262+0000 7fd90e70a640 1 --2- 172.21.15.70:0/2901847478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd908101df0 0x7fd9081021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.262+0000 7fd90e70a640 1 -- 172.21.15.70:0/2901847478 >> 172.21.15.70:0/2901847478 conn(0x7fd9080fd8b0 msgr2=0x7fd9080ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.262+0000 7fd90e70a640 1 -- 172.21.15.70:0/2901847478 shutdown_connections 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.262+0000 7fd90e70a640 1 -- 172.21.15.70:0/2901847478 wait complete. 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.263+0000 7fd90e70a640 1 Processor -- start 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.263+0000 7fd90e70a640 1 -- start start 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.263+0000 7fd90e70a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd908101df0 0x7fd908198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.263+0000 7fd90e70a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9081027a0 0x7fd908198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.263+0000 7fd90e70a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908106f20 0x7fd90819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.263+0000 7fd90e70a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd908112160 con 0x7fd908106f20 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.263+0000 7fd90e70a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd908111fe0 con 0x7fd9081027a0 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.263+0000 7fd90e70a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081122e0 con 0x7fd908101df0 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.263+0000 7fd90cca7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908106f20 0x7fd90819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd90cca7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908106f20 0x7fd90819ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54416/0 (socket says 172.21.15.70:54416) 2024-09-12T01:55:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd90cca7640 1 -- 172.21.15.70:0/1186728046 learned_addr learned my addr 172.21.15.70:0/1186728046 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd907fff640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd908101df0 0x7fd908198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd9077fe640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9081027a0 0x7fd908198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd90cca7640 1 -- 172.21.15.70:0/1186728046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd908101df0 msgr2=0x7fd908198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd90cca7640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd908101df0 0x7fd908198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd90cca7640 1 -- 172.21.15.70:0/1186728046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9081027a0 msgr2=0x7fd908198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd90cca7640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9081027a0 0x7fd908198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd90cca7640 1 -- 172.21.15.70:0/1186728046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90819d5b0 con 0x7fd908106f20 2024-09-12T01:55:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd907fff640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd908101df0 0x7fd908198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd90cca7640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908106f20 0x7fd90819ced0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd900009dc0 tx=0x7fd900031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd9057fa640 1 -- 172.21.15.70:0/1186728046 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90002fba0 con 0x7fd908106f20 2024-09-12T01:55:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd90e70a640 1 -- 172.21.15.70:0/1186728046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90819d840 con 0x7fd908106f20 2024-09-12T01:55:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd9057fa640 1 -- 172.21.15.70:0/1186728046 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd90002fd40 con 0x7fd908106f20 2024-09-12T01:55:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd9057fa640 1 -- 172.21.15.70:0/1186728046 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900046a70 con 0x7fd908106f20 2024-09-12T01:55:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.264+0000 7fd90e70a640 1 -- 172.21.15.70:0/1186728046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9081a5180 con 0x7fd908106f20 2024-09-12T01:55:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.265+0000 7fd90e70a640 1 -- 172.21.15.70:0/1186728046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd908102250 con 0x7fd908106f20 2024-09-12T01:55:03.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.266+0000 7fd9057fa640 1 -- 172.21.15.70:0/1186728046 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd9000305c0 con 0x7fd908106f20 2024-09-12T01:55:03.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.267+0000 7fd9057fa640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fd8f00a2b80 0x7fd8f00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:03.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.267+0000 7fd907fff640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fd8f00a2b80 0x7fd8f00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:03.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.267+0000 7fd9057fa640 1 -- 172.21.15.70:0/1186728046 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd9000f0760 con 0x7fd908106f20 2024-09-12T01:55:03.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.268+0000 7fd907fff640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fd8f00a2b80 0x7fd8f00a5040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009930 tx=0x7fd8f8008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:03.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.271+0000 7fd9057fa640 1 -- 172.21.15.70:0/1186728046 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd9000bd6c0 con 0x7fd908106f20 2024-09-12T01:55:03.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.475+0000 7fd90e70a640 1 -- 172.21.15.70:0/1186728046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd90810a100 con 0x7fd908106f20 2024-09-12T01:55:03.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.476+0000 7fd9057fa640 1 -- 172.21.15.70:0/1186728046 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11994 (secure 0 0 0) 0x7fd9000bcfc0 con 0x7fd908106f20 2024-09-12T01:55:03.476 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:55:03.476 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"btime":"2024-09-12T01:54:37:622268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:54:36.766931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:55:03.476 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 37 2024-09-12T01:55:03.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.478+0000 7fd90e70a640 1 -- 172.21.15.70:0/1186728046 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fd8f00a2b80 msgr2=0x7fd8f00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:03.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.478+0000 7fd90e70a640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fd8f00a2b80 0x7fd8f00a5040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009930 tx=0x7fd8f8008040 comp rx=0 tx=0).stop 2024-09-12T01:55:03.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.478+0000 7fd90e70a640 1 -- 172.21.15.70:0/1186728046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908106f20 msgr2=0x7fd90819ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:03.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.478+0000 7fd90e70a640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908106f20 0x7fd90819ced0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd900009dc0 tx=0x7fd900031b10 comp rx=0 tx=0).stop 2024-09-12T01:55:03.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.478+0000 7fd90e70a640 1 -- 172.21.15.70:0/1186728046 shutdown_connections 2024-09-12T01:55:03.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.478+0000 7fd90e70a640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fd8f00a2b80 0x7fd8f00a5040 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.478+0000 7fd90e70a640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd908106f20 0x7fd90819ced0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.478+0000 7fd90e70a640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9081027a0 0x7fd908198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.478+0000 7fd90e70a640 1 --2- 172.21.15.70:0/1186728046 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd908101df0 0x7fd908198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:03.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.478+0000 7fd90e70a640 1 -- 172.21.15.70:0/1186728046 >> 172.21.15.70:0/1186728046 conn(0x7fd9080fd8b0 msgr2=0x7fd9080fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:03.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.478+0000 7fd90e70a640 1 -- 172.21.15.70:0/1186728046 shutdown_connections 2024-09-12T01:55:03.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:03.478+0000 7fd90e70a640 1 -- 172.21.15.70:0/1186728046 wait complete. 2024-09-12T01:55:03.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:03 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1186728046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:03.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:03 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1186728046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:04.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:03 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1186728046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:04.160 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24452 quiesce db --cancel --all' 2024-09-12T01:55:04.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24452 quiesce db --cancel --all 2024-09-12T01:55:04.406 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:04.802 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:04 smithi070 ceph-mon[31177]: pgmap v424: 97 pgs: 97 active+clean; 44 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 KiB/s wr, 34 op/s 2024-09-12T01:55:04.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.887+0000 7fef32a1e640 1 -- 172.21.15.70:0/4066444136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c10c1a0 msgr2=0x7fef2c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.887+0000 7fef32a1e640 1 --2- 172.21.15.70:0/4066444136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c10c1a0 0x7fef2c10e610 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fef24009ca0 tx=0x7fef2402a950 comp rx=0 tx=0).stop 2024-09-12T01:55:04.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.887+0000 7fef32a1e640 1 -- 172.21.15.70:0/4066444136 shutdown_connections 2024-09-12T01:55:04.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.887+0000 7fef32a1e640 1 --2- 172.21.15.70:0/4066444136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c10c1a0 0x7fef2c10e610 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.887+0000 7fef32a1e640 1 --2- 172.21.15.70:0/4066444136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c103720 0x7fef2c10bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.887+0000 7fef32a1e640 1 --2- 172.21.15.70:0/4066444136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef2c102e00 0x7fef2c1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.887+0000 7fef32a1e640 1 -- 172.21.15.70:0/4066444136 >> 172.21.15.70:0/4066444136 conn(0x7fef2c0fc7a0 msgr2=0x7fef2c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:04.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.887+0000 7fef32a1e640 1 -- 172.21.15.70:0/4066444136 shutdown_connections 2024-09-12T01:55:04.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.887+0000 7fef32a1e640 1 -- 172.21.15.70:0/4066444136 wait complete. 2024-09-12T01:55:04.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.887+0000 7fef32a1e640 1 Processor -- start 2024-09-12T01:55:04.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.887+0000 7fef32a1e640 1 -- start start 2024-09-12T01:55:04.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef32a1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c102e00 0x7fef2c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef32a1e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef2c103720 0x7fef2c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef32a1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c10c1a0 0x7fef2c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef32a1e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c112090 con 0x7fef2c102e00 2024-09-12T01:55:04.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef32a1e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c111f10 con 0x7fef2c10c1a0 2024-09-12T01:55:04.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef32a1e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c112210 con 0x7fef2c103720 2024-09-12T01:55:04.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef2bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c102e00 0x7fef2c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef2bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c102e00 0x7fef2c198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54446/0 (socket says 172.21.15.70:54446) 2024-09-12T01:55:04.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef2bfff640 1 -- 172.21.15.70:0/2751240652 learned_addr learned my addr 172.21.15.70:0/2751240652 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:04.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef30fbb640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c10c1a0 0x7fef2c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef23fff640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef2c103720 0x7fef2c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef2bfff640 1 -- 172.21.15.70:0/2751240652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef2c103720 msgr2=0x7fef2c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef2bfff640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef2c103720 0x7fef2c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef2bfff640 1 -- 172.21.15.70:0/2751240652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c10c1a0 msgr2=0x7fef2c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef2bfff640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c10c1a0 0x7fef2c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef2bfff640 1 -- 172.21.15.70:0/2751240652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2c19d3c0 con 0x7fef2c102e00 2024-09-12T01:55:04.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef23fff640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef2c103720 0x7fef2c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:04.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef2bfff640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c102e00 0x7fef2c198410 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00c890 tx=0x7fef1c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:04.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef29ffb640 1 -- 172.21.15.70:0/2751240652 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c004220 con 0x7fef2c102e00 2024-09-12T01:55:04.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef32a1e640 1 -- 172.21.15.70:0/2751240652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef2c19d6b0 con 0x7fef2c102e00 2024-09-12T01:55:04.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef29ffb640 1 -- 172.21.15.70:0/2751240652 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef1c0043c0 con 0x7fef2c102e00 2024-09-12T01:55:04.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef29ffb640 1 -- 172.21.15.70:0/2751240652 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c004b10 con 0x7fef2c102e00 2024-09-12T01:55:04.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.888+0000 7fef32a1e640 1 -- 172.21.15.70:0/2751240652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef2c1a4f90 con 0x7fef2c102e00 2024-09-12T01:55:04.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.891+0000 7fef29ffb640 1 -- 172.21.15.70:0/2751240652 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fef1c0051b0 con 0x7fef2c102e00 2024-09-12T01:55:04.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.891+0000 7fef34df7740 1 Processor -- start 2024-09-12T01:55:04.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef34df7740 1 -- start start 2024-09-12T01:55:04.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef34df7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c6a00 0x5654fa4c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef34df7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4c7320 0x5654fa4d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef34df7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 0x5654fa4d3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef34df7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5654fa42b200 con 0x5654fa4d1be0 2024-09-12T01:55:04.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef34df7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5654fa3d1dc0 con 0x5654fa4c7320 2024-09-12T01:55:04.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef34df7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5654fa4271c0 con 0x5654fa4c6a00 2024-09-12T01:55:04.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef23fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 0x5654fa4d3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef23fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 0x5654fa4d3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54460/0 (socket says 172.21.15.70:54460) 2024-09-12T01:55:04.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef23fff640 1 -- 172.21.15.70:0/3010133123 learned_addr learned my addr 172.21.15.70:0/3010133123 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:04.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef2bfff640 1 --2- 172.21.15.70:0/3010133123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4c7320 0x5654fa4d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef29ffb640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fef180a2b80 0x7fef180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef30fbb640 1 --2- 172.21.15.70:0/3010133123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c6a00 0x5654fa4c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef30fbb640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fef180a2b80 0x7fef180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef29ffb640 1 -- 172.21.15.70:0/2751240652 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fef1c0cf0b0 con 0x7fef2c102e00 2024-09-12T01:55:04.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef23fff640 1 -- 172.21.15.70:0/3010133123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c6a00 msgr2=0x5654fa4c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:04.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef23fff640 1 --2- 172.21.15.70:0/3010133123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c6a00 0x5654fa4c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef23fff640 1 -- 172.21.15.70:0/3010133123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4c7320 msgr2=0x5654fa4d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:04.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef23fff640 1 --2- 172.21.15.70:0/3010133123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4c7320 0x5654fa4d16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.892+0000 7fef23fff640 1 -- 172.21.15.70:0/3010133123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654fa19c620 con 0x5654fa4d1be0 2024-09-12T01:55:04.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.893+0000 7fef23fff640 1 --2- 172.21.15.70:0/3010133123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 0x5654fa4d3fd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fef14008ba0 tx=0x7fef1400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448cde0fe65ec16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:04.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.893+0000 7fef30fbb640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fef180a2b80 0x7fef180a5040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fef24005fe0 tx=0x7fef240095c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:04.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.893+0000 7fef227fc640 1 -- 172.21.15.70:0/3010133123 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14014070 con 0x5654fa4d1be0 2024-09-12T01:55:04.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.893+0000 7fef227fc640 1 -- 172.21.15.70:0/3010133123 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef140047a0 con 0x5654fa4d1be0 2024-09-12T01:55:04.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.893+0000 7fef227fc640 1 -- 172.21.15.70:0/3010133123 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14010710 con 0x5654fa4d1be0 2024-09-12T01:55:04.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.894+0000 7fef34df7740 1 -- 172.21.15.70:0/3010133123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 msgr2=0x5654fa4d3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.894+0000 7fef34df7740 1 --2- 172.21.15.70:0/3010133123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 0x5654fa4d3fd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fef14008ba0 tx=0x7fef1400e720 comp rx=0 tx=0).stop 2024-09-12T01:55:04.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.894+0000 7fef34df7740 1 -- 172.21.15.70:0/3010133123 shutdown_connections 2024-09-12T01:55:04.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.894+0000 7fef34df7740 1 --2- 172.21.15.70:0/3010133123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 0x5654fa4d3fd0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.894+0000 7fef34df7740 1 --2- 172.21.15.70:0/3010133123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4c7320 0x5654fa4d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.894+0000 7fef34df7740 1 --2- 172.21.15.70:0/3010133123 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c6a00 0x5654fa4c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.894+0000 7fef34df7740 1 -- 172.21.15.70:0/3010133123 >> 172.21.15.70:0/3010133123 conn(0x5654fa4c2f90 msgr2=0x5654fa4c3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:04.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.894+0000 7fef34df7740 1 -- 172.21.15.70:0/3010133123 shutdown_connections 2024-09-12T01:55:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.894+0000 7fef34df7740 1 -- 172.21.15.70:0/3010133123 wait complete. 2024-09-12T01:55:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.894+0000 7fef34df7740 1 -- start start 2024-09-12T01:55:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.894+0000 7fef34df7740 1 Processor -- start 2024-09-12T01:55:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.894+0000 7fef34df7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c6a00 0x5654fa4d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef34df7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c7320 0x5654fa4ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef34df7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4d1be0 0x5654fa4cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef34df7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5654fa4d47b0 con 0x5654fa4c6a00 2024-09-12T01:55:04.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef34df7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x5654fa3c5c50 con 0x5654fa4d1be0 2024-09-12T01:55:04.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef34df7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5654fa4d4930 con 0x5654fa4c7320 2024-09-12T01:55:04.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef34df7740 10 client.0 _ll_register_callbacks cb 0x5654fa3d7ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:04.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef2bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c6a00 0x5654fa4d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef2bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c6a00 0x5654fa4d14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54468/0 (socket says 172.21.15.70:54468) 2024-09-12T01:55:04.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef2bfff640 1 -- 172.21.15.70:0/2072577976 learned_addr learned my addr 172.21.15.70:0/2072577976 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:04.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef30fbb640 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4d1be0 0x5654fa4cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef23fff640 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c7320 0x5654fa4ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef2bfff640 1 -- 172.21.15.70:0/2072577976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c7320 msgr2=0x5654fa4ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:04.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef2bfff640 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c7320 0x5654fa4ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef2bfff640 1 -- 172.21.15.70:0/2072577976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4d1be0 msgr2=0x5654fa4cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:04.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef2bfff640 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4d1be0 0x5654fa4cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef2bfff640 1 -- 172.21.15.70:0/2072577976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654fa4cf4c0 con 0x5654fa4c6a00 2024-09-12T01:55:04.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef30fbb640 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4d1be0 0x5654fa4cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:04.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef2bfff640 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c6a00 0x5654fa4d14a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0ccbb0 tx=0x7fef1c09b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332ec897bc3012e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:04.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:04.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef0b7fe640 1 -- 172.21.15.70:0/2072577976 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c01d040 con 0x5654fa4c6a00 2024-09-12T01:55:04.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef0b7fe640 1 -- 172.21.15.70:0/2072577976 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fef1c0d1110 con 0x5654fa4c6a00 2024-09-12T01:55:04.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef34df7740 1 -- 172.21.15.70:0/2072577976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef140047a0 con 0x5654fa4c6a00 2024-09-12T01:55:04.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef0b7fe640 1 -- 172.21.15.70:0/2072577976 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fef1c09c010 con 0x5654fa4c6a00 2024-09-12T01:55:04.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef34df7740 10 client.16581 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:04.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.895+0000 7fef34df7740 1 -- 172.21.15.70:0/2072577976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5654fa4e0320 con 0x5654fa4c6a00 2024-09-12T01:55:04.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.896+0000 7fef0b7fe640 1 -- 172.21.15.70:0/2072577976 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef140047a0 con 0x5654fa4c6a00 2024-09-12T01:55:04.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.896+0000 7fef0b7fe640 1 -- 172.21.15.70:0/2072577976 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fef1c09bb70 con 0x5654fa4c6a00 2024-09-12T01:55:04.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.896+0000 7fef34df7740 10 client.16581 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:04.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.896+0000 7fef34df7740 10 client.16581 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:55:04.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.896+0000 7fef34df7740 20 client.16581 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:04.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.896+0000 7fef34df7740 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5654fa4e1760 0x5654fa4e3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.896+0000 7fef34df7740 4 client.16581 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:55:04.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.896+0000 7fef34df7740 1 -- 172.21.15.70:0/2072577976 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654fa438770 con 0x5654fa4e1760 2024-09-12T01:55:04.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.896+0000 7fef23fff640 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5654fa4e1760 0x5654fa4e3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.897+0000 7fef0b7fe640 10 client.16581 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:04.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.897+0000 7fef23fff640 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5654fa4e1760 0x5654fa4e3c00 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89696658a7db44d server_cookie=8f00cf304043d21a in_seq=0 out_seq=0 2024-09-12T01:55:04.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.897+0000 7fef0b7fe640 1 -- 172.21.15.70:0/2072577976 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654fa438770 con 0x5654fa4e1760 2024-09-12T01:55:04.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.897+0000 7fef0b7fe640 10 client.16581 handle_command_reply: tid=0 2024-09-12T01:55:04.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.897+0000 7fef34df7740 1 client.16581 shutdown 2024-09-12T01:55:04.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.897+0000 7fef34df7740 1 -- 172.21.15.70:0/2072577976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c6a00 msgr2=0x5654fa4d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.897+0000 7fef34df7740 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c6a00 0x5654fa4d14a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0ccbb0 tx=0x7fef1c09b810 comp rx=0 tx=0).stop 2024-09-12T01:55:04.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.897+0000 7fef34df7740 1 -- 172.21.15.70:0/2072577976 shutdown_connections 2024-09-12T01:55:04.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.897+0000 7fef34df7740 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5654fa4e1760 0x5654fa4e3c00 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.897+0000 7fef34df7740 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4d1be0 0x5654fa4cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.898+0000 7fef34df7740 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c7320 0x5654fa4ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.898+0000 7fef34df7740 1 --2- 172.21.15.70:0/2072577976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c6a00 0x5654fa4d14a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.898+0000 7fef34df7740 1 -- 172.21.15.70:0/2072577976 >> 172.21.15.70:0/2072577976 conn(0x5654fa4c2f90 msgr2=0x5654fa4c21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:04.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.898+0000 7fef0b7fe640 0 client.16581 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:04.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.898+0000 7fef34df7740 1 -- 172.21.15.70:0/2072577976 shutdown_connections 2024-09-12T01:55:04.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.898+0000 7fef34df7740 1 -- 172.21.15.70:0/2072577976 wait complete. 2024-09-12T01:55:04.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.898+0000 7fef34df7740 20 client.16581 trim_cache size 0 max 16384 2024-09-12T01:55:04.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.914+0000 7fef34df7740 1 Processor -- start 2024-09-12T01:55:04.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.914+0000 7fef34df7740 1 -- start start 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.914+0000 7fef34df7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4c6a00 0x5654fa4dda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.914+0000 7fef34df7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c7320 0x5654fa4e94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.914+0000 7fef34df7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 0x5654fa4e9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.914+0000 7fef34df7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c1ad630 con 0x5654fa4d1be0 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.914+0000 7fef34df7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c1af320 con 0x5654fa4c6a00 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.914+0000 7fef34df7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c1add60 con 0x5654fa4c7320 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef30fbb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 0x5654fa4e9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef30fbb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 0x5654fa4e9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54482/0 (socket says 172.21.15.70:54482) 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef30fbb640 1 -- 172.21.15.70:0/3905412048 learned_addr learned my addr 172.21.15.70:0/3905412048 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef23fff640 1 --2- 172.21.15.70:0/3905412048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c7320 0x5654fa4e94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef2bfff640 1 --2- 172.21.15.70:0/3905412048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4c6a00 0x5654fa4dda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef30fbb640 1 -- 172.21.15.70:0/3905412048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c7320 msgr2=0x5654fa4e94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:04.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef30fbb640 1 --2- 172.21.15.70:0/3905412048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c7320 0x5654fa4e94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef30fbb640 1 -- 172.21.15.70:0/3905412048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4c6a00 msgr2=0x5654fa4dda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:04.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef30fbb640 1 --2- 172.21.15.70:0/3905412048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4c6a00 0x5654fa4dda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef30fbb640 1 -- 172.21.15.70:0/3905412048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654fa4c3a50 con 0x5654fa4d1be0 2024-09-12T01:55:04.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef23fff640 1 --2- 172.21.15.70:0/3905412048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c7320 0x5654fa4e94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:04.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef2bfff640 1 --2- 172.21.15.70:0/3905412048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4c6a00 0x5654fa4dda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:04.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef30fbb640 1 --2- 172.21.15.70:0/3905412048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 0x5654fa4e9a10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fef24009ca0 tx=0x7fef24043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a978837ba97efa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:04.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef21ffb640 1 -- 172.21.15.70:0/3905412048 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24050070 con 0x5654fa4d1be0 2024-09-12T01:55:04.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef21ffb640 1 -- 172.21.15.70:0/3905412048 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef2402f6d0 con 0x5654fa4d1be0 2024-09-12T01:55:04.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.915+0000 7fef21ffb640 1 -- 172.21.15.70:0/3905412048 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24034040 con 0x5654fa4d1be0 2024-09-12T01:55:04.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.916+0000 7fef34df7740 1 -- 172.21.15.70:0/3905412048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 msgr2=0x5654fa4e9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.916+0000 7fef34df7740 1 --2- 172.21.15.70:0/3905412048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 0x5654fa4e9a10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fef24009ca0 tx=0x7fef24043000 comp rx=0 tx=0).stop 2024-09-12T01:55:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.916+0000 7fef34df7740 1 -- 172.21.15.70:0/3905412048 shutdown_connections 2024-09-12T01:55:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.916+0000 7fef34df7740 1 --2- 172.21.15.70:0/3905412048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4d1be0 0x5654fa4e9a10 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.916+0000 7fef34df7740 1 --2- 172.21.15.70:0/3905412048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c7320 0x5654fa4e94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.916+0000 7fef34df7740 1 --2- 172.21.15.70:0/3905412048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4c6a00 0x5654fa4dda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.916+0000 7fef34df7740 1 -- 172.21.15.70:0/3905412048 >> 172.21.15.70:0/3905412048 conn(0x5654fa4c2f90 msgr2=0x5654fa4ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.916+0000 7fef34df7740 1 -- 172.21.15.70:0/3905412048 shutdown_connections 2024-09-12T01:55:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.916+0000 7fef34df7740 1 -- 172.21.15.70:0/3905412048 wait complete. 2024-09-12T01:55:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.916+0000 7fef34df7740 1 -- start start 2024-09-12T01:55:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef34df7740 1 Processor -- start 2024-09-12T01:55:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef34df7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c6a00 0x5654fa4da1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef34df7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c7320 0x5654fa4d74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef34df7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4d1be0 0x5654fa4d7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef34df7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c1aeb90 con 0x5654fa4c7320 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef34df7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c1ae460 con 0x5654fa4d1be0 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef34df7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c1ab5f0 con 0x5654fa4c6a00 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef34df7740 10 client.0 _ll_register_callbacks cb 0x7fef1c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef23fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c7320 0x5654fa4d74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef23fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c7320 0x5654fa4d74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54496/0 (socket says 172.21.15.70:54496) 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef23fff640 1 -- 172.21.15.70:0/3840907649 learned_addr learned my addr 172.21.15.70:0/3840907649 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef2bfff640 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c6a00 0x5654fa4da1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef30fbb640 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4d1be0 0x5654fa4d7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef23fff640 1 -- 172.21.15.70:0/3840907649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c6a00 msgr2=0x5654fa4da1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef23fff640 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c6a00 0x5654fa4da1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef23fff640 1 -- 172.21.15.70:0/3840907649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4d1be0 msgr2=0x5654fa4d7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef23fff640 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4d1be0 0x5654fa4d7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef23fff640 1 -- 172.21.15.70:0/3840907649 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654fa4c7150 con 0x5654fa4c7320 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef23fff640 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c7320 0x5654fa4d74f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fef14008ba0 tx=0x7fef14010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fdc24c2dcac7ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.917+0000 7fef0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef0b7fe640 1 -- 172.21.15.70:0/3840907649 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14014040 con 0x5654fa4c7320 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef0b7fe640 1 -- 172.21.15.70:0/3840907649 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fef14004450 con 0x5654fa4c7320 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef34df7740 1 -- 172.21.15.70:0/3840907649 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef2402f6d0 con 0x5654fa4c7320 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef0b7fe640 1 -- 172.21.15.70:0/3840907649 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fef14035050 con 0x5654fa4c7320 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef34df7740 10 client.16587 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef34df7740 1 -- 172.21.15.70:0/3840907649 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5654fa54c1c0 con 0x5654fa4c7320 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef0b7fe640 1 -- 172.21.15.70:0/3840907649 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef2402f6d0 con 0x5654fa4c7320 2024-09-12T01:55:04.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef0b7fe640 1 -- 172.21.15.70:0/3840907649 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fef14026420 con 0x5654fa4c7320 2024-09-12T01:55:04.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef34df7740 10 client.16587 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:04.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef34df7740 10 client.16587 resolve_mds: validated gid 24452 aka daemon mds.b 2024-09-12T01:55:04.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef34df7740 20 client.16587 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:04.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef34df7740 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5654fa54c760 0x5654fa54eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef34df7740 4 client.16587 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-12T01:55:04.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.918+0000 7fef34df7740 1 -- 172.21.15.70:0/3840907649 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5654fa432c80 con 0x5654fa54c760 2024-09-12T01:55:04.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.919+0000 7fef2bfff640 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5654fa54c760 0x5654fa54eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.919+0000 7fef0b7fe640 10 client.16587 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:04.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.919+0000 7fef2bfff640 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5654fa54c760 0x5654fa54eb80 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c757b3078012504 server_cookie=5cc48c4fe49ee4e1 in_seq=0 out_seq=0 2024-09-12T01:55:04.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef0b7fe640 1 -- 172.21.15.70:0/3840907649 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5654fa432c80 con 0x5654fa54c760 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef0b7fe640 10 client.16587 handle_command_reply: tid=0 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef34df7740 1 client.16587 shutdown 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef34df7740 1 -- 172.21.15.70:0/3840907649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c7320 msgr2=0x5654fa4d74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef34df7740 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c7320 0x5654fa4d74f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fef14008ba0 tx=0x7fef14010430 comp rx=0 tx=0).stop 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef34df7740 1 -- 172.21.15.70:0/3840907649 shutdown_connections 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef34df7740 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x5654fa54c760 0x5654fa54eb80 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef34df7740 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5654fa4d1be0 0x5654fa4d7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef34df7740 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654fa4c7320 0x5654fa4d74f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef0b7fe640 0 client.16587 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef34df7740 1 --2- 172.21.15.70:0/3840907649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5654fa4c6a00 0x5654fa4da1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef34df7740 1 -- 172.21.15.70:0/3840907649 >> 172.21.15.70:0/3840907649 conn(0x5654fa4c2f90 msgr2=0x5654fa4c19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef34df7740 1 -- 172.21.15.70:0/3840907649 shutdown_connections 2024-09-12T01:55:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef34df7740 1 -- 172.21.15.70:0/3840907649 wait complete. 2024-09-12T01:55:04.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef34df7740 20 client.16587 trim_cache size 0 max 16384 2024-09-12T01:55:04.928 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:55:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 37, 2024-09-12T01:55:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 24452, 2024-09-12T01:55:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 12, 2024-09-12T01:55:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": {} 2024-09-12T01:55:04.928 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:55:04.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef32a1e640 1 -- 172.21.15.70:0/2751240652 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fef180a2b80 msgr2=0x7fef180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef32a1e640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fef180a2b80 0x7fef180a5040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fef24005fe0 tx=0x7fef240095c0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef32a1e640 1 -- 172.21.15.70:0/2751240652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c102e00 msgr2=0x7fef2c198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef32a1e640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c102e00 0x7fef2c198410 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00c890 tx=0x7fef1c00cd50 comp rx=0 tx=0).stop 2024-09-12T01:55:04.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef32a1e640 1 -- 172.21.15.70:0/2751240652 shutdown_connections 2024-09-12T01:55:04.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef32a1e640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fef180a2b80 0x7fef180a5040 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef32a1e640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c10c1a0 0x7fef2c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef32a1e640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef2c103720 0x7fef2c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.920+0000 7fef32a1e640 1 --2- 172.21.15.70:0/2751240652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef2c102e00 0x7fef2c198410 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.921+0000 7fef32a1e640 1 -- 172.21.15.70:0/2751240652 >> 172.21.15.70:0/2751240652 conn(0x7fef2c0fc7a0 msgr2=0x7fef2c0fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:04.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.921+0000 7fef32a1e640 1 -- 172.21.15.70:0/2751240652 shutdown_connections 2024-09-12T01:55:04.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:04.921+0000 7fef32a1e640 1 -- 172.21.15.70:0/2751240652 wait complete. 2024-09-12T01:55:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:04 smithi191 ceph-mon[35770]: pgmap v424: 97 pgs: 97 active+clean; 44 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 KiB/s wr, 34 op/s 2024-09-12T01:55:05.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:04 smithi152 ceph-mon[35055]: pgmap v424: 97 pgs: 97 active+clean; 44 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 KiB/s wr, 34 op/s 2024-09-12T01:55:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 -- 172.21.15.70:0/3624353745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde24102640 msgr2=0x7fde24104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 --2- 172.21.15.70:0/3624353745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde24102640 0x7fde24104a30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fde14009900 tx=0x7fde1402a410 comp rx=0 tx=0).stop 2024-09-12T01:55:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 -- 172.21.15.70:0/3624353745 shutdown_connections 2024-09-12T01:55:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 --2- 172.21.15.70:0/3624353745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde241078a0 0x7fde24109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 --2- 172.21.15.70:0/3624353745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde24104f70 0x7fde24107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 --2- 172.21.15.70:0/3624353745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde24102640 0x7fde24104a30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 -- 172.21.15.70:0/3624353745 >> 172.21.15.70:0/3624353745 conn(0x7fde240fc1e0 msgr2=0x7fde240fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 -- 172.21.15.70:0/3624353745 shutdown_connections 2024-09-12T01:55:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 -- 172.21.15.70:0/3624353745 wait complete. 2024-09-12T01:55:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 Processor -- start 2024-09-12T01:55:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 -- start start 2024-09-12T01:55:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde24102640 0x7fde24197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde24104f70 0x7fde24198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde241078a0 0x7fde2419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde2410d9b0 con 0x7fde24104f70 2024-09-12T01:55:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fde2410d830 con 0x7fde241078a0 2024-09-12T01:55:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.141+0000 7fde2afb9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fde2410db30 con 0x7fde24102640 2024-09-12T01:55:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde1bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde24104f70 0x7fde24198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde1bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde24104f70 0x7fde24198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54508/0 (socket says 172.21.15.70:54508) 2024-09-12T01:55:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde1bfff640 1 -- 172.21.15.70:0/293327081 learned_addr learned my addr 172.21.15.70:0/293327081 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde28d55640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde24102640 0x7fde24197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde29556640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde241078a0 0x7fde2419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde1bfff640 1 -- 172.21.15.70:0/293327081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde24102640 msgr2=0x7fde24197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde1bfff640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde24102640 0x7fde24197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde1bfff640 1 -- 172.21.15.70:0/293327081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde241078a0 msgr2=0x7fde2419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde1bfff640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde241078a0 0x7fde2419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde1bfff640 1 -- 172.21.15.70:0/293327081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2419fb60 con 0x7fde24104f70 2024-09-12T01:55:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde29556640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde241078a0 0x7fde2419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde1bfff640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde24104f70 0x7fde24198480 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fde2000b450 tx=0x7fde2000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde19ffb640 1 -- 172.21.15.70:0/293327081 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde20015020 con 0x7fde24104f70 2024-09-12T01:55:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde19ffb640 1 -- 172.21.15.70:0/293327081 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde20011d90 con 0x7fde24104f70 2024-09-12T01:55:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde2afb9640 1 -- 172.21.15.70:0/293327081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2419fe50 con 0x7fde24104f70 2024-09-12T01:55:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde19ffb640 1 -- 172.21.15.70:0/293327081 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2000f340 con 0x7fde24104f70 2024-09-12T01:55:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.142+0000 7fde2afb9640 1 -- 172.21.15.70:0/293327081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde241a0390 con 0x7fde24104f70 2024-09-12T01:55:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde19ffb640 1 -- 172.21.15.70:0/293327081 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fde20018020 con 0x7fde24104f70 2024-09-12T01:55:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde2de27740 1 Processor -- start 2024-09-12T01:55:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde2de27740 1 -- start start 2024-09-12T01:55:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde2de27740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cc9a0 0x557a840ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde2de27740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cd2e0 0x557a840d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde2de27740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840d2370 0x557a840d4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde19ffb640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fde0c0a2c30 0x7fde0c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde2de27740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557a840302f0 con 0x557a840cc9a0 2024-09-12T01:55:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde2de27740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557a83fd8270 con 0x557a840d2370 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde2de27740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557a8402c2b0 con 0x557a840cd2e0 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde29556640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cc9a0 0x557a840ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde29556640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cc9a0 0x557a840ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54514/0 (socket says 172.21.15.70:54514) 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde29556640 1 -- 172.21.15.70:0/1951634725 learned_addr learned my addr 172.21.15.70:0/1951634725 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.145+0000 7fde29556640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fde0c0a2c30 0x7fde0c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde19ffb640 1 -- 172.21.15.70:0/293327081 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fde200ceac0 con 0x7fde24104f70 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde28d55640 1 --2- 172.21.15.70:0/1951634725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cd2e0 0x557a840d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde1bfff640 1 --2- 172.21.15.70:0/1951634725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840d2370 0x557a840d4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde29556640 1 -- 172.21.15.70:0/1951634725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cd2e0 msgr2=0x557a840d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde29556640 1 --2- 172.21.15.70:0/1951634725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cd2e0 0x557a840d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde29556640 1 -- 172.21.15.70:0/1951634725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840d2370 msgr2=0x557a840d4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde29556640 1 --2- 172.21.15.70:0/1951634725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840d2370 0x557a840d4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde29556640 1 -- 172.21.15.70:0/1951634725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a83fd7340 con 0x557a840cc9a0 2024-09-12T01:55:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde29556640 1 --2- 172.21.15.70:0/1951634725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cc9a0 0x557a840ccda0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fde1c012de0 tx=0x7fde1c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81a32c6ff9242bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde29556640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fde0c0a2c30 0x7fde0c0a50f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00fc30 tx=0x7fde1c01a000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde0affd640 1 -- 172.21.15.70:0/1951634725 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c019ce0 con 0x557a840cc9a0 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde0affd640 1 -- 172.21.15.70:0/1951634725 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde1c01c910 con 0x557a840cc9a0 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.146+0000 7fde0affd640 1 -- 172.21.15.70:0/1951634725 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00d710 con 0x557a840cc9a0 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.147+0000 7fde2de27740 1 -- 172.21.15.70:0/1951634725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cc9a0 msgr2=0x557a840ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.147+0000 7fde2de27740 1 --2- 172.21.15.70:0/1951634725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cc9a0 0x557a840ccda0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fde1c012de0 tx=0x7fde1c00f730 comp rx=0 tx=0).stop 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.147+0000 7fde2de27740 1 -- 172.21.15.70:0/1951634725 shutdown_connections 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.147+0000 7fde2de27740 1 --2- 172.21.15.70:0/1951634725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840d2370 0x557a840d4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.147+0000 7fde2de27740 1 --2- 172.21.15.70:0/1951634725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cd2e0 0x557a840d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.147+0000 7fde2de27740 1 --2- 172.21.15.70:0/1951634725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cc9a0 0x557a840ccda0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.147+0000 7fde2de27740 1 -- 172.21.15.70:0/1951634725 >> 172.21.15.70:0/1951634725 conn(0x557a840c8010 msgr2=0x557a840c8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.147+0000 7fde2de27740 1 -- 172.21.15.70:0/1951634725 shutdown_connections 2024-09-12T01:55:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.147+0000 7fde2de27740 1 -- 172.21.15.70:0/1951634725 wait complete. 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.147+0000 7fde2de27740 1 -- start start 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.147+0000 7fde2de27740 1 Processor -- start 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde2de27740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840cc9a0 0x557a840d6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde2de27740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 0x557a840d70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde2de27740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840d2370 0x557a840de120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde2de27740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557a840d52e0 con 0x557a840cd2e0 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde2de27740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x557a83fb9290 con 0x557a840cc9a0 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde2de27740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x557a840d5460 con 0x557a840d2370 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde2de27740 10 client.0 _ll_register_callbacks cb 0x557a83fea140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde1bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 0x557a840d70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde1bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 0x557a840d70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54524/0 (socket says 172.21.15.70:54524) 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde1bfff640 1 -- 172.21.15.70:0/3558397890 learned_addr learned my addr 172.21.15.70:0/3558397890 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde28d55640 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840cc9a0 0x557a840d6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde29556640 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840d2370 0x557a840de120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde1bfff640 1 -- 172.21.15.70:0/3558397890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840d2370 msgr2=0x557a840de120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde1bfff640 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840d2370 0x557a840de120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde1bfff640 1 -- 172.21.15.70:0/3558397890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840cc9a0 msgr2=0x557a840d6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde1bfff640 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840cc9a0 0x557a840d6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde1bfff640 1 -- 172.21.15.70:0/3558397890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a83d43210 con 0x557a840cd2e0 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde28d55640 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840cc9a0 0x557a840d6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde1bfff640 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 0x557a840d70e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fde200cc5c0 tx=0x7fde20099830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7668b336cdfab49a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde03fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde03fff640 1 -- 172.21.15.70:0/3558397890 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2009b320 con 0x557a840cd2e0 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde03fff640 1 -- 172.21.15.70:0/3558397890 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fde20010690 con 0x557a840cd2e0 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde2de27740 1 -- 172.21.15.70:0/3558397890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde1c01c910 con 0x557a840cd2e0 2024-09-12T01:55:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde03fff640 1 -- 172.21.15.70:0/3558397890 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fde2009f6d0 con 0x557a840cd2e0 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde2de27740 10 client.16599 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.148+0000 7fde2de27740 1 -- 172.21.15.70:0/3558397890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557a83e0f620 con 0x557a840cd2e0 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.149+0000 7fde03fff640 1 -- 172.21.15.70:0/3558397890 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde1c01c910 con 0x557a840cd2e0 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.149+0000 7fde03fff640 1 -- 172.21.15.70:0/3558397890 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fde200bb0b0 con 0x557a840cd2e0 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.149+0000 7fde2de27740 10 client.16599 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.149+0000 7fde2de27740 10 client.16599 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.149+0000 7fde2de27740 20 client.16599 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.149+0000 7fde2de27740 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557a840e2830 0x557a840e4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.149+0000 7fde2de27740 4 client.16599 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.149+0000 7fde2de27740 1 -- 172.21.15.70:0/3558397890 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a8403da20 con 0x557a840e2830 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.149+0000 7fde28d55640 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557a840e2830 0x557a840e4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.150+0000 7fde28d55640 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557a840e2830 0x557a840e4cd0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=764ca7dbec0fdb2f server_cookie=45989103b050037f in_seq=0 out_seq=0 2024-09-12T01:55:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.150+0000 7fde03fff640 10 client.16599 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.150+0000 7fde03fff640 1 -- 172.21.15.70:0/3558397890 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a8403da20 con 0x557a840e2830 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.150+0000 7fde03fff640 10 client.16599 handle_command_reply: tid=0 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.150+0000 7fde2de27740 1 client.16599 shutdown 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.151+0000 7fde2de27740 1 -- 172.21.15.70:0/3558397890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 msgr2=0x557a840d70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.151+0000 7fde2de27740 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 0x557a840d70e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fde200cc5c0 tx=0x7fde20099830 comp rx=0 tx=0).stop 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.151+0000 7fde2de27740 1 -- 172.21.15.70:0/3558397890 shutdown_connections 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.151+0000 7fde2de27740 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557a840e2830 0x557a840e4cd0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.151+0000 7fde2de27740 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840d2370 0x557a840de120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.151+0000 7fde03fff640 0 client.16599 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.151+0000 7fde2de27740 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 0x557a840d70e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.151+0000 7fde2de27740 1 --2- 172.21.15.70:0/3558397890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840cc9a0 0x557a840d6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.151+0000 7fde2de27740 1 -- 172.21.15.70:0/3558397890 >> 172.21.15.70:0/3558397890 conn(0x557a840c8010 msgr2=0x557a840c9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.151+0000 7fde2de27740 1 -- 172.21.15.70:0/3558397890 shutdown_connections 2024-09-12T01:55:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.151+0000 7fde2de27740 1 -- 172.21.15.70:0/3558397890 wait complete. 2024-09-12T01:55:05.160 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.151+0000 7fde2de27740 20 client.16599 trim_cache size 0 max 16384 2024-09-12T01:55:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde2de27740 1 Processor -- start 2024-09-12T01:55:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde2de27740 1 -- start start 2024-09-12T01:55:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde2de27740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840cc9a0 0x557a840d6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde2de27740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cd2e0 0x557a840de0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde2de27740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840d2370 0x557a840d70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde2de27740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde241a9190 con 0x557a840d2370 2024-09-12T01:55:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde2de27740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fde241aae80 con 0x557a840cc9a0 2024-09-12T01:55:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde2de27740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fde241a98c0 con 0x557a840cd2e0 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde29556640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840d2370 0x557a840d70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde29556640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840d2370 0x557a840d70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54538/0 (socket says 172.21.15.70:54538) 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde29556640 1 -- 172.21.15.70:0/175860131 learned_addr learned my addr 172.21.15.70:0/175860131 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde28d55640 1 --2- 172.21.15.70:0/175860131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840cc9a0 0x557a840d6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde29556640 1 -- 172.21.15.70:0/175860131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cd2e0 msgr2=0x557a840de0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde1bfff640 1 --2- 172.21.15.70:0/175860131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cd2e0 0x557a840de0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde29556640 1 --2- 172.21.15.70:0/175860131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cd2e0 0x557a840de0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde29556640 1 -- 172.21.15.70:0/175860131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840cc9a0 msgr2=0x557a840d6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde29556640 1 --2- 172.21.15.70:0/175860131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840cc9a0 0x557a840d6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde29556640 1 -- 172.21.15.70:0/175860131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a840d4b90 con 0x557a840d2370 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde28d55640 1 --2- 172.21.15.70:0/175860131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840cc9a0 0x557a840d6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.165+0000 7fde1bfff640 1 --2- 172.21.15.70:0/175860131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cd2e0 0x557a840de0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde29556640 1 --2- 172.21.15.70:0/175860131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840d2370 0x557a840d70e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00a340 tx=0x7fde1c00a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a556fdcdcf083cb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde0a7fc640 1 -- 172.21.15.70:0/175860131 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c031070 con 0x557a840d2370 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde0a7fc640 1 -- 172.21.15.70:0/175860131 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde1c00ad10 con 0x557a840d2370 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde0a7fc640 1 -- 172.21.15.70:0/175860131 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0057f0 con 0x557a840d2370 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde2de27740 1 -- 172.21.15.70:0/175860131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840d2370 msgr2=0x557a840d70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde2de27740 1 --2- 172.21.15.70:0/175860131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840d2370 0x557a840d70e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00a340 tx=0x7fde1c00a370 comp rx=0 tx=0).stop 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde2de27740 1 -- 172.21.15.70:0/175860131 shutdown_connections 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde2de27740 1 --2- 172.21.15.70:0/175860131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840d2370 0x557a840d70e0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde2de27740 1 --2- 172.21.15.70:0/175860131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cd2e0 0x557a840de0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde2de27740 1 --2- 172.21.15.70:0/175860131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840cc9a0 0x557a840d6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde2de27740 1 -- 172.21.15.70:0/175860131 >> 172.21.15.70:0/175860131 conn(0x557a840c8010 msgr2=0x557a840ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde2de27740 1 -- 172.21.15.70:0/175860131 shutdown_connections 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.166+0000 7fde2de27740 1 -- 172.21.15.70:0/175860131 wait complete. 2024-09-12T01:55:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde2de27740 1 -- start start 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde2de27740 1 Processor -- start 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde2de27740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cc9a0 0x557a840db350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde2de27740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 0x557a840db890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde2de27740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840d2370 0x557a840dc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde2de27740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde241aa6f0 con 0x557a840cd2e0 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde2de27740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fde241a9fc0 con 0x557a840d2370 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde2de27740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fde241a7150 con 0x557a840cc9a0 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde2de27740 10 client.0 _ll_register_callbacks cb 0x7fde20097620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde1bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 0x557a840db890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde1bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 0x557a840db890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54552/0 (socket says 172.21.15.70:54552) 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde1bfff640 1 -- 172.21.15.70:0/2410865148 learned_addr learned my addr 172.21.15.70:0/2410865148 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde28d55640 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cc9a0 0x557a840db350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.173 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde29556640 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840d2370 0x557a840dc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde1bfff640 1 -- 172.21.15.70:0/2410865148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cc9a0 msgr2=0x557a840db350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde1bfff640 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cc9a0 0x557a840db350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde1bfff640 1 -- 172.21.15.70:0/2410865148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840d2370 msgr2=0x557a840dc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde1bfff640 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840d2370 0x557a840dc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.167+0000 7fde1bfff640 1 -- 172.21.15.70:0/2410865148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a840dceb0 con 0x557a840cd2e0 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde1bfff640 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 0x557a840db890 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fde20097cf0 tx=0x7fde2009b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b13a6c2e206a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde03fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde03fff640 1 -- 172.21.15.70:0/2410865148 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde200a3f90 con 0x557a840cd2e0 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde03fff640 1 -- 172.21.15.70:0/2410865148 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fde200bb0b0 con 0x557a840cd2e0 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde2de27740 1 -- 172.21.15.70:0/2410865148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde1c00ad10 con 0x557a840cd2e0 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde03fff640 1 -- 172.21.15.70:0/2410865148 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fde200bb2b0 con 0x557a840cd2e0 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde2de27740 10 client.16605 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:05.174 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde2de27740 1 -- 172.21.15.70:0/2410865148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557a840de130 con 0x557a840cd2e0 2024-09-12T01:55:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde03fff640 1 -- 172.21.15.70:0/2410865148 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde1c00ad10 con 0x557a840cd2e0 2024-09-12T01:55:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde03fff640 1 -- 172.21.15.70:0/2410865148 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fde2009a1e0 con 0x557a840cd2e0 2024-09-12T01:55:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde2de27740 10 client.16605 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde2de27740 10 client.16605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T01:55:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde2de27740 20 client.16605 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde2de27740 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557a8414dac0 0x557a8414fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde2de27740 4 client.16605 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T01:55:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.168+0000 7fde2de27740 1 -- 172.21.15.70:0/2410865148 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a84037d70 con 0x557a8414dac0 2024-09-12T01:55:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.169+0000 7fde28d55640 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557a8414dac0 0x557a8414fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.169+0000 7fde03fff640 10 client.16605 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:05.175 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.169+0000 7fde28d55640 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557a8414dac0 0x557a8414fee0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=113488d8db36ed07 server_cookie=ef476a81362893dd in_seq=0 out_seq=0 2024-09-12T01:55:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.191+0000 7fde03fff640 1 -- 172.21.15.70:0/2410865148 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557a84037d70 con 0x557a8414dac0 2024-09-12T01:55:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.191+0000 7fde03fff640 10 client.16605 handle_command_reply: tid=0 2024-09-12T01:55:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.191+0000 7fde2de27740 1 client.16605 shutdown 2024-09-12T01:55:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.191+0000 7fde2de27740 1 -- 172.21.15.70:0/2410865148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 msgr2=0x557a840db890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.191+0000 7fde2de27740 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 0x557a840db890 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fde20097cf0 tx=0x7fde2009b3f0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2de27740 1 -- 172.21.15.70:0/2410865148 shutdown_connections 2024-09-12T01:55:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2de27740 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x557a8414dac0 0x557a8414fee0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2de27740 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557a840d2370 0x557a840dc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2de27740 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a840cd2e0 0x557a840db890 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2de27740 1 --2- 172.21.15.70:0/2410865148 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557a840cc9a0 0x557a840db350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde03fff640 0 client.16605 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2de27740 1 -- 172.21.15.70:0/2410865148 >> 172.21.15.70:0/2410865148 conn(0x557a840c8010 msgr2=0x557a840d6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2de27740 1 -- 172.21.15.70:0/2410865148 shutdown_connections 2024-09-12T01:55:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2de27740 1 -- 172.21.15.70:0/2410865148 wait complete. 2024-09-12T01:55:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2de27740 20 client.16605 trim_cache size 0 max 16384 2024-09-12T01:55:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:{ 2024-09-12T01:55:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "message": "", 2024-09-12T01:55:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout: "return_code": 0 2024-09-12T01:55:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stdout:} 2024-09-12T01:55:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2afb9640 1 -- 172.21.15.70:0/293327081 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fde0c0a2c30 msgr2=0x7fde0c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2afb9640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fde0c0a2c30 0x7fde0c0a50f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00fc30 tx=0x7fde1c01a000 comp rx=0 tx=0).stop 2024-09-12T01:55:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2afb9640 1 -- 172.21.15.70:0/293327081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde24104f70 msgr2=0x7fde24198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2afb9640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde24104f70 0x7fde24198480 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fde2000b450 tx=0x7fde2000b910 comp rx=0 tx=0).stop 2024-09-12T01:55:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2afb9640 1 -- 172.21.15.70:0/293327081 shutdown_connections 2024-09-12T01:55:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2afb9640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fde0c0a2c30 0x7fde0c0a50f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2afb9640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fde241078a0 0x7fde2419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2afb9640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde24104f70 0x7fde24198480 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2afb9640 1 --2- 172.21.15.70:0/293327081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde24102640 0x7fde24197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.192+0000 7fde2afb9640 1 -- 172.21.15.70:0/293327081 >> 172.21.15.70:0/293327081 conn(0x7fde240fc1e0 msgr2=0x7fde24102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.193+0000 7fde2afb9640 1 -- 172.21.15.70:0/293327081 shutdown_connections 2024-09-12T01:55:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi070.front.sepia.ceph.com.smithi070.stderr:2024-09-12T01:55:05.193+0000 7fde2afb9640 1 -- 172.21.15.70:0/293327081 wait complete. 2024-09-12T01:55:05.769 INFO:tasks.quiescer:done joining Quiescers 2024-09-12T01:55:05.769 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-12T01:55:05.779 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:55:05.788 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-12T01:55:05.799 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-12T01:55:05.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:05 smithi191 ceph-mon[35770]: pgmap v425: 97 pgs: 97 active+clean; 44 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 79 KiB/s wr, 44 op/s 2024-09-12T01:55:06.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:05 smithi152 ceph-mon[35055]: pgmap v425: 97 pgs: 97 active+clean; 44 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 79 KiB/s wr, 44 op/s 2024-09-12T01:55:06.026 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:05 smithi070 ceph-mon[31177]: pgmap v425: 97 pgs: 97 active+clean; 44 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 79 KiB/s wr, 44 op/s 2024-09-12T01:55:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:08 smithi191 ceph-mon[35770]: pgmap v426: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-12T01:55:09.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:08 smithi152 ceph-mon[35055]: pgmap v426: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-12T01:55:09.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:08 smithi070 ceph-mon[31177]: pgmap v426: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-12T01:55:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:10 smithi191 ceph-mon[35770]: pgmap v427: 97 pgs: 97 active+clean; 43 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 81 KiB/s wr, 43 op/s 2024-09-12T01:55:11.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:10 smithi152 ceph-mon[35055]: pgmap v427: 97 pgs: 97 active+clean; 43 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 81 KiB/s wr, 43 op/s 2024-09-12T01:55:11.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:10 smithi070 ceph-mon[31177]: pgmap v427: 97 pgs: 97 active+clean; 43 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 81 KiB/s wr, 43 op/s 2024-09-12T01:55:12.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:12 smithi191 ceph-mon[35770]: pgmap v428: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 82 KiB/s wr, 45 op/s 2024-09-12T01:55:12.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:12 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:12 smithi152 ceph-mon[35055]: pgmap v428: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 82 KiB/s wr, 45 op/s 2024-09-12T01:55:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:12 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:13.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:12 smithi070 ceph-mon[31177]: pgmap v428: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 82 KiB/s wr, 45 op/s 2024-09-12T01:55:13.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:12 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:13.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:13 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:13.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:13 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:13.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:13 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:55:14.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:13 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:14.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:13 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:14.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:13 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:55:14.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:13 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:14.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:13 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:14.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:13 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' 2024-09-12T01:55:14.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:14 smithi191 ceph-mon[35770]: pgmap v429: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 80 KiB/s wr, 42 op/s 2024-09-12T01:55:15.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:14 smithi152 ceph-mon[35055]: pgmap v429: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 80 KiB/s wr, 42 op/s 2024-09-12T01:55:15.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:14 smithi070 ceph-mon[31177]: pgmap v429: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 80 KiB/s wr, 42 op/s 2024-09-12T01:55:16.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:16 smithi191 ceph-mon[35770]: pgmap v430: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 39 op/s 2024-09-12T01:55:17.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:16 smithi152 ceph-mon[35055]: pgmap v430: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 39 op/s 2024-09-12T01:55:17.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:16 smithi070 ceph-mon[31177]: pgmap v430: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 39 op/s 2024-09-12T01:55:18.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:18 smithi191 ceph-mon[35770]: pgmap v431: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 26 op/s 2024-09-12T01:55:19.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:18 smithi152 ceph-mon[35055]: pgmap v431: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 26 op/s 2024-09-12T01:55:19.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:18 smithi070 ceph-mon[31177]: pgmap v431: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 26 op/s 2024-09-12T01:55:20.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:20 smithi191 ceph-mon[35770]: pgmap v432: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-12T01:55:21.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:20 smithi152 ceph-mon[35055]: pgmap v432: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-12T01:55:21.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:20 smithi070 ceph-mon[31177]: pgmap v432: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-12T01:55:22.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:22 smithi191 ceph-mon[35770]: pgmap v433: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-12T01:55:23.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:22 smithi152 ceph-mon[35055]: pgmap v433: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-12T01:55:23.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:22 smithi070 ceph-mon[31177]: pgmap v433: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-09-12T01:55:24.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:24 smithi191 ceph-mon[35770]: pgmap v434: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T01:55:25.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:24 smithi152 ceph-mon[35055]: pgmap v434: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T01:55:25.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:24 smithi070 ceph-mon[31177]: pgmap v434: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T01:55:25.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T01:55:25.553 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:25.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.956+0000 7fbb153fd640 1 -- 172.21.15.70:0/3894469457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb10106a80 msgr2=0x7fbb10106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.956+0000 7fbb153fd640 1 --2- 172.21.15.70:0/3894469457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb10106a80 0x7fbb10106e60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009930 tx=0x7fbb0002a420 comp rx=0 tx=0).stop 2024-09-12T01:55:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.956+0000 7fbb153fd640 1 -- 172.21.15.70:0/3894469457 shutdown_connections 2024-09-12T01:55:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.956+0000 7fbb153fd640 1 --2- 172.21.15.70:0/3894469457 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb10101420 0x7fbb1010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.956+0000 7fbb153fd640 1 --2- 172.21.15.70:0/3894469457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb10100a80 0x7fbb10100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.956+0000 7fbb153fd640 1 --2- 172.21.15.70:0/3894469457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb10106a80 0x7fbb10106e60 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.956+0000 7fbb153fd640 1 -- 172.21.15.70:0/3894469457 >> 172.21.15.70:0/3894469457 conn(0x7fbb100fc7a0 msgr2=0x7fbb100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.956+0000 7fbb153fd640 1 -- 172.21.15.70:0/3894469457 shutdown_connections 2024-09-12T01:55:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.956+0000 7fbb153fd640 1 -- 172.21.15.70:0/3894469457 wait complete. 2024-09-12T01:55:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb153fd640 1 Processor -- start 2024-09-12T01:55:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb153fd640 1 -- start start 2024-09-12T01:55:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb153fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb10100a80 0x7fbb10198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb153fd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb10101420 0x7fbb10198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb153fd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb10106a80 0x7fbb1019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb153fd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb10112160 con 0x7fbb10100a80 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb153fd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb10111fe0 con 0x7fbb10101420 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb153fd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101122e0 con 0x7fbb10106a80 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb10100a80 0x7fbb10198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb10100a80 0x7fbb10198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55740/0 (socket says 172.21.15.70:55740) 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb0effd640 1 -- 172.21.15.70:0/1600983315 learned_addr learned my addr 172.21.15.70:0/1600983315 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb07fff640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb10101420 0x7fbb10198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb0f7fe640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb10106a80 0x7fbb1019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb0effd640 1 -- 172.21.15.70:0/1600983315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb10106a80 msgr2=0x7fbb1019cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb0effd640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb10106a80 0x7fbb1019cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb0effd640 1 -- 172.21.15.70:0/1600983315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb10101420 msgr2=0x7fbb10198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb0effd640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb10101420 0x7fbb10198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb0effd640 1 -- 172.21.15.70:0/1600983315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1019d630 con 0x7fbb10100a80 2024-09-12T01:55:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.957+0000 7fbb0f7fe640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb10106a80 0x7fbb1019cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.958+0000 7fbb0effd640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb10100a80 0x7fbb10198680 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009a50 tx=0x7fbb00004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.958+0000 7fbb0cff9640 1 -- 172.21.15.70:0/1600983315 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0003f030 con 0x7fbb10100a80 2024-09-12T01:55:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.958+0000 7fbb153fd640 1 -- 172.21.15.70:0/1600983315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1019d8c0 con 0x7fbb10100a80 2024-09-12T01:55:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.958+0000 7fbb0cff9640 1 -- 172.21.15.70:0/1600983315 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb00003af0 con 0x7fbb10100a80 2024-09-12T01:55:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.958+0000 7fbb0cff9640 1 -- 172.21.15.70:0/1600983315 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00035070 con 0x7fbb10100a80 2024-09-12T01:55:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.958+0000 7fbb153fd640 1 -- 172.21.15.70:0/1600983315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb101a5200 con 0x7fbb10100a80 2024-09-12T01:55:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.960+0000 7fbb0cff9640 1 -- 172.21.15.70:0/1600983315 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbb00042030 con 0x7fbb10100a80 2024-09-12T01:55:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.960+0000 7fbb177d6740 1 Processor -- start 2024-09-12T01:55:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.960+0000 7fbb177d6740 1 -- start start 2024-09-12T01:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb177d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414360 0x561c5c414740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb177d6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c414c80 0x561c5c423550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb177d6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c423a90 0x561c5c425e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb177d6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561c5c37a2e0 con 0x561c5c423a90 2024-09-12T01:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb177d6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561c5c321ce0 con 0x561c5c414c80 2024-09-12T01:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb177d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561c5c3762a0 con 0x561c5c414360 2024-09-12T01:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb0cff9640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbafc0a2b80 0x7fbafc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb07fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c423a90 0x561c5c425e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c414c80 0x561c5c423550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb07fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c423a90 0x561c5c425e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55754/0 (socket says 172.21.15.70:55754) 2024-09-12T01:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb07fff640 1 -- 172.21.15.70:0/566841071 learned_addr learned my addr 172.21.15.70:0/566841071 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb0f7fe640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbafc0a2b80 0x7fbafc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb0cff9640 1 -- 172.21.15.70:0/1600983315 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbb000ef9c0 con 0x7fbb10100a80 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb0f7fe640 1 --2- 172.21.15.70:0/566841071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414360 0x561c5c414740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb07fff640 1 -- 172.21.15.70:0/566841071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414360 msgr2=0x561c5c414740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb07fff640 1 --2- 172.21.15.70:0/566841071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414360 0x561c5c414740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb07fff640 1 -- 172.21.15.70:0/566841071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c414c80 msgr2=0x561c5c423550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb07fff640 1 --2- 172.21.15.70:0/566841071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c414c80 0x561c5c423550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb07fff640 1 -- 172.21.15.70:0/566841071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c5c306440 con 0x561c5c423a90 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.961+0000 7fbb07fff640 1 --2- 172.21.15.70:0/566841071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c423a90 0x561c5c425e80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800b7f0 tx=0x7fbaf800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234d7c38daf77957 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.962+0000 7fbb0f7fe640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbafc0a2b80 0x7fbafc0a5040 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800afd0 tx=0x7fbb0800a3d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.962+0000 7fbb057fa640 1 -- 172.21.15.70:0/566841071 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf800d950 con 0x561c5c423a90 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.962+0000 7fbb057fa640 1 -- 172.21.15.70:0/566841071 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbaf8018070 con 0x561c5c423a90 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.962+0000 7fbb057fa640 1 -- 172.21.15.70:0/566841071 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf80123e0 con 0x561c5c423a90 2024-09-12T01:55:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.962+0000 7fbb177d6740 1 -- 172.21.15.70:0/566841071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c423a90 msgr2=0x561c5c425e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.962+0000 7fbb177d6740 1 --2- 172.21.15.70:0/566841071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c423a90 0x561c5c425e80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800b7f0 tx=0x7fbaf800bcb0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 -- 172.21.15.70:0/566841071 shutdown_connections 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 --2- 172.21.15.70:0/566841071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c423a90 0x561c5c425e80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 --2- 172.21.15.70:0/566841071 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c414c80 0x561c5c423550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 --2- 172.21.15.70:0/566841071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414360 0x561c5c414740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 -- 172.21.15.70:0/566841071 >> 172.21.15.70:0/566841071 conn(0x561c5c410a30 msgr2=0x561c5c410e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 -- 172.21.15.70:0/566841071 shutdown_connections 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 -- 172.21.15.70:0/566841071 wait complete. 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 -- start start 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 Processor -- start 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c4233d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c414c80 0x561c5c420680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c423a90 0x561c5c420bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561c5c426660 con 0x561c5c414360 2024-09-12T01:55:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x561c5c335050 con 0x561c5c414c80 2024-09-12T01:55:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x561c5c4267e0 con 0x561c5c423a90 2024-09-12T01:55:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c4233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c4233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55760/0 (socket says 172.21.15.70:55760) 2024-09-12T01:55:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb0effd640 1 -- 172.21.15.70:0/2809565945 learned_addr learned my addr 172.21.15.70:0/2809565945 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.963+0000 7fbb177d6740 10 client.0 _ll_register_callbacks cb 0x561c5c375160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb0f7fe640 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c423a90 0x561c5c420bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb07fff640 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c414c80 0x561c5c420680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb0effd640 1 -- 172.21.15.70:0/2809565945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c423a90 msgr2=0x561c5c420bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb0effd640 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c423a90 0x561c5c420bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb0effd640 1 -- 172.21.15.70:0/2809565945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c414c80 msgr2=0x561c5c420680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb0effd640 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c414c80 0x561c5c420680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb0effd640 1 -- 172.21.15.70:0/2809565945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c5c0eb3c0 con 0x561c5c414360 2024-09-12T01:55:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb0effd640 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c4233d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fbb00005ec0 tx=0x7fbb0008b1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc47f852c0e415e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbaf67fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbaf67fc640 1 -- 172.21.15.70:0/2809565945 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00049070 con 0x561c5c414360 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbaf67fc640 1 -- 172.21.15.70:0/2809565945 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbb0003b460 con 0x561c5c414360 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb177d6740 1 -- 172.21.15.70:0/2809565945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaf8018070 con 0x561c5c414360 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbaf67fc640 1 -- 172.21.15.70:0/2809565945 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fbb000dae60 con 0x561c5c414360 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb177d6740 10 client.16617 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb177d6740 1 -- 172.21.15.70:0/2809565945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x561c5c432050 con 0x561c5c414360 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbaf67fc640 1 -- 172.21.15.70:0/2809565945 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbaf8018070 con 0x561c5c414360 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbaf67fc640 1 -- 172.21.15.70:0/2809565945 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fbb000b8890 con 0x561c5c414360 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb177d6740 10 client.16617 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb177d6740 10 client.16617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb177d6740 20 client.16617 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb177d6740 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561c5c4334e0 0x561c5c435980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb177d6740 4 client.16617 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:55:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.964+0000 7fbb177d6740 1 -- 172.21.15.70:0/2809565945 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c5c387850 con 0x561c5c4334e0 2024-09-12T01:55:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.965+0000 7fbb07fff640 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561c5c4334e0 0x561c5c435980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.965+0000 7fbaf67fc640 10 client.16617 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.965+0000 7fbb07fff640 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561c5c4334e0 0x561c5c435980 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70f68ff452f1764b server_cookie=1a0e151fbce1d7a1 in_seq=0 out_seq=0 2024-09-12T01:55:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbaf67fc640 1 -- 172.21.15.70:0/2809565945 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561c5c387850 con 0x561c5c4334e0 2024-09-12T01:55:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbaf67fc640 10 client.16617 handle_command_reply: tid=0 2024-09-12T01:55:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbb177d6740 1 client.16617 shutdown 2024-09-12T01:55:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbb177d6740 1 -- 172.21.15.70:0/2809565945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 msgr2=0x561c5c4233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbb177d6740 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c4233d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fbb00005ec0 tx=0x7fbb0008b1a0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbb177d6740 1 -- 172.21.15.70:0/2809565945 shutdown_connections 2024-09-12T01:55:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbb177d6740 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561c5c4334e0 0x561c5c435980 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbb177d6740 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c423a90 0x561c5c420bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbb177d6740 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c414c80 0x561c5c420680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbaf67fc640 0 client.16617 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbb177d6740 1 --2- 172.21.15.70:0/2809565945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c4233d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbb177d6740 1 -- 172.21.15.70:0/2809565945 >> 172.21.15.70:0/2809565945 conn(0x561c5c410a30 msgr2=0x561c5c416790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbb177d6740 1 -- 172.21.15.70:0/2809565945 shutdown_connections 2024-09-12T01:55:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.966+0000 7fbb177d6740 1 -- 172.21.15.70:0/2809565945 wait complete. 2024-09-12T01:55:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.967+0000 7fbb177d6740 20 client.16617 trim_cache size 0 max 16384 2024-09-12T01:55:25.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.983+0000 7fbb177d6740 1 Processor -- start 2024-09-12T01:55:25.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.983+0000 7fbb177d6740 1 -- start start 2024-09-12T01:55:25.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb177d6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c42f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb177d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414c80 0x561c5c43b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb177d6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c423a90 0x561c5c43b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb177d6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101ab5a0 con 0x561c5c414360 2024-09-12T01:55:25.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb177d6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101ad290 con 0x561c5c423a90 2024-09-12T01:55:25.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb177d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101abcd0 con 0x561c5c414c80 2024-09-12T01:55:25.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c42f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c42f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55766/0 (socket says 172.21.15.70:55766) 2024-09-12T01:55:25.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb0effd640 1 -- 172.21.15.70:0/1264239437 learned_addr learned my addr 172.21.15.70:0/1264239437 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:25.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb0f7fe640 1 --2- 172.21.15.70:0/1264239437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c423a90 0x561c5c43b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb0effd640 1 -- 172.21.15.70:0/1264239437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414c80 msgr2=0x561c5c43b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:25.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb0effd640 1 --2- 172.21.15.70:0/1264239437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414c80 0x561c5c43b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb0effd640 1 -- 172.21.15.70:0/1264239437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c423a90 msgr2=0x561c5c43b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:25.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb0effd640 1 --2- 172.21.15.70:0/1264239437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c423a90 0x561c5c43b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb0effd640 1 -- 172.21.15.70:0/1264239437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c5c420f00 con 0x561c5c414360 2024-09-12T01:55:25.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb0effd640 1 --2- 172.21.15.70:0/1264239437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c42f900 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fbb000bc1b0 tx=0x7fbb00003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9905a3071e105f2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:25.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.984+0000 7fbb04ff9640 1 -- 172.21.15.70:0/1264239437 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00049030 con 0x561c5c414360 2024-09-12T01:55:25.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.985+0000 7fbb04ff9640 1 -- 172.21.15.70:0/1264239437 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb000bc220 con 0x561c5c414360 2024-09-12T01:55:25.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.985+0000 7fbb04ff9640 1 -- 172.21.15.70:0/1264239437 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb000c4a00 con 0x561c5c414360 2024-09-12T01:55:25.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.985+0000 7fbb177d6740 1 -- 172.21.15.70:0/1264239437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 msgr2=0x561c5c42f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:25.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.985+0000 7fbb177d6740 1 --2- 172.21.15.70:0/1264239437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c42f900 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fbb000bc1b0 tx=0x7fbb00003eb0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.985+0000 7fbb177d6740 1 -- 172.21.15.70:0/1264239437 shutdown_connections 2024-09-12T01:55:25.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.985+0000 7fbb177d6740 1 --2- 172.21.15.70:0/1264239437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c423a90 0x561c5c43b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.985+0000 7fbb177d6740 1 --2- 172.21.15.70:0/1264239437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414c80 0x561c5c43b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.985+0000 7fbb177d6740 1 --2- 172.21.15.70:0/1264239437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c42f900 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.985+0000 7fbb177d6740 1 -- 172.21.15.70:0/1264239437 >> 172.21.15.70:0/1264239437 conn(0x561c5c410a30 msgr2=0x561c5c41ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:25.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.985+0000 7fbb177d6740 1 -- 172.21.15.70:0/1264239437 shutdown_connections 2024-09-12T01:55:25.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.985+0000 7fbb177d6740 1 -- 172.21.15.70:0/1264239437 wait complete. 2024-09-12T01:55:25.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb177d6740 1 -- start start 2024-09-12T01:55:25.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb177d6740 1 Processor -- start 2024-09-12T01:55:25.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb177d6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c427800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb177d6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414c80 0x561c5c427d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb177d6740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c423a90 0x561c5c428280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb177d6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101acb00 con 0x561c5c414360 2024-09-12T01:55:25.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb177d6740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101ac3d0 con 0x561c5c423a90 2024-09-12T01:55:25.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb177d6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101a9560 con 0x561c5c414c80 2024-09-12T01:55:25.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb177d6740 10 client.0 _ll_register_callbacks cb 0x7fbb00009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:25.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c427800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c427800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55772/0 (socket says 172.21.15.70:55772) 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb0effd640 1 -- 172.21.15.70:0/1748897515 learned_addr learned my addr 172.21.15.70:0/1748897515 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb0f7fe640 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c423a90 0x561c5c428280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb07fff640 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414c80 0x561c5c427d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb0effd640 1 -- 172.21.15.70:0/1748897515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414c80 msgr2=0x561c5c427d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb0effd640 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414c80 0x561c5c427d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb0effd640 1 -- 172.21.15.70:0/1748897515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c423a90 msgr2=0x561c5c428280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb0effd640 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c423a90 0x561c5c428280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb0effd640 1 -- 172.21.15.70:0/1748897515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c5c49d2b0 con 0x561c5c414360 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb0f7fe640 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c423a90 0x561c5c428280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.986+0000 7fbb07fff640 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414c80 0x561c5c427d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbb0effd640 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c427800 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fbb000c0750 tx=0x7fbb000c4f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1022c0ce72e7794 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:25.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbaf67fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:25.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbaf67fc640 1 -- 172.21.15.70:0/1748897515 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00085020 con 0x561c5c414360 2024-09-12T01:55:25.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbaf67fc640 1 -- 172.21.15.70:0/1748897515 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbb000c4a00 con 0x561c5c414360 2024-09-12T01:55:25.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbb177d6740 1 -- 172.21.15.70:0/1748897515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb000bc220 con 0x561c5c414360 2024-09-12T01:55:25.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbaf67fc640 1 -- 172.21.15.70:0/1748897515 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fbb0009f020 con 0x561c5c414360 2024-09-12T01:55:25.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbb177d6740 10 client.16623 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:25.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbb177d6740 1 -- 172.21.15.70:0/1748897515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x561c5c49d2b0 con 0x561c5c414360 2024-09-12T01:55:25.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbaf67fc640 1 -- 172.21.15.70:0/1748897515 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb000bc220 con 0x561c5c414360 2024-09-12T01:55:25.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbaf67fc640 1 -- 172.21.15.70:0/1748897515 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fbb000bb670 con 0x561c5c414360 2024-09-12T01:55:25.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbb177d6740 10 client.16623 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:25.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbb177d6740 10 client.16623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:55:25.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbb177d6740 20 client.16623 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:25.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbb177d6740 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561c5c49e8e0 0x561c5c4a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbb177d6740 4 client.16623 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T01:55:25.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.987+0000 7fbb177d6740 1 -- 172.21.15.70:0/1748897515 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561c5c381d60 con 0x561c5c49e8e0 2024-09-12T01:55:25.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbb07fff640 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561c5c49e8e0 0x561c5c4a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbaf67fc640 10 client.16623 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:25.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbb07fff640 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561c5c49e8e0 0x561c5c4a0d00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a60164f2b360b8 server_cookie=ea0d31aee840abcd in_seq=0 out_seq=0 2024-09-12T01:55:25.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbaf67fc640 1 -- 172.21.15.70:0/1748897515 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561c5c381d60 con 0x561c5c49e8e0 2024-09-12T01:55:25.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbaf67fc640 10 client.16623 handle_command_reply: tid=0 2024-09-12T01:55:25.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbb177d6740 1 client.16623 shutdown 2024-09-12T01:55:25.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbb177d6740 1 -- 172.21.15.70:0/1748897515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 msgr2=0x561c5c427800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:25.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbb177d6740 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c427800 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fbb000c0750 tx=0x7fbb000c4f80 comp rx=0 tx=0).stop 2024-09-12T01:55:25.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbb177d6740 1 -- 172.21.15.70:0/1748897515 shutdown_connections 2024-09-12T01:55:25.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbb177d6740 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x561c5c49e8e0 0x561c5c4a0d00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbb177d6740 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x561c5c423a90 0x561c5c428280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbb177d6740 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561c5c414c80 0x561c5c427d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.988+0000 7fbb177d6740 1 --2- 172.21.15.70:0/1748897515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c5c414360 0x561c5c427800 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb177d6740 1 -- 172.21.15.70:0/1748897515 >> 172.21.15.70:0/1748897515 conn(0x561c5c410a30 msgr2=0x561c5c41f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:25.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbaf67fc640 0 client.16623 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:25.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb177d6740 1 -- 172.21.15.70:0/1748897515 shutdown_connections 2024-09-12T01:55:25.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb177d6740 1 -- 172.21.15.70:0/1748897515 wait complete. 2024-09-12T01:55:25.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb177d6740 20 client.16623 trim_cache size 0 max 16384 2024-09-12T01:55:25.999 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:55:25.999 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-12T01:55:26.000 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-12T01:55:26.000 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:55:26.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb153fd640 1 -- 172.21.15.70:0/1600983315 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbafc0a2b80 msgr2=0x7fbafc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:26.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb153fd640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbafc0a2b80 0x7fbafc0a5040 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800afd0 tx=0x7fbb0800a3d0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb153fd640 1 -- 172.21.15.70:0/1600983315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb10100a80 msgr2=0x7fbb10198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:26.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb153fd640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb10100a80 0x7fbb10198680 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009a50 tx=0x7fbb00004270 comp rx=0 tx=0).stop 2024-09-12T01:55:26.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb153fd640 1 -- 172.21.15.70:0/1600983315 shutdown_connections 2024-09-12T01:55:26.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb153fd640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbafc0a2b80 0x7fbafc0a5040 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb153fd640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb10106a80 0x7fbb1019cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb153fd640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb10101420 0x7fbb10198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb153fd640 1 --2- 172.21.15.70:0/1600983315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb10100a80 0x7fbb10198680 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb153fd640 1 -- 172.21.15.70:0/1600983315 >> 172.21.15.70:0/1600983315 conn(0x7fbb100fc7a0 msgr2=0x7fbb100fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:26.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb153fd640 1 -- 172.21.15.70:0/1600983315 shutdown_connections 2024-09-12T01:55:26.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:25.989+0000 7fbb153fd640 1 -- 172.21.15.70:0/1600983315 wait complete. 2024-09-12T01:55:26.785 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T01:55:26.785 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:55:26.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:26 smithi191 ceph-mon[35770]: pgmap v435: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T01:55:27.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:26 smithi152 ceph-mon[35055]: pgmap v435: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T01:55:27.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:26 smithi070 ceph-mon[31177]: pgmap v435: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T01:55:27.027 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:27.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.473+0000 7f24f4248640 1 -- 172.21.15.70:0/2298264014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec103ff0 msgr2=0x7f24ec1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:27.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.473+0000 7f24f4248640 1 --2- 172.21.15.70:0/2298264014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec103ff0 0x7f24ec1043d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009900 tx=0x7f24e802a410 comp rx=0 tx=0).stop 2024-09-12T01:55:27.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.473+0000 7f24f4248640 1 -- 172.21.15.70:0/2298264014 shutdown_connections 2024-09-12T01:55:27.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.473+0000 7f24f4248640 1 --2- 172.21.15.70:0/2298264014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24ec109120 0x7f24ec110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:27.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.473+0000 7f24f4248640 1 --2- 172.21.15.70:0/2298264014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24ec1049a0 0x7f24ec1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:27.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.473+0000 7f24f4248640 1 --2- 172.21.15.70:0/2298264014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec103ff0 0x7f24ec1043d0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:27.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.473+0000 7f24f4248640 1 -- 172.21.15.70:0/2298264014 >> 172.21.15.70:0/2298264014 conn(0x7f24ec0ffab0 msgr2=0x7f24ec101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:27.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.474+0000 7f24f4248640 1 -- 172.21.15.70:0/2298264014 shutdown_connections 2024-09-12T01:55:27.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.474+0000 7f24f4248640 1 -- 172.21.15.70:0/2298264014 wait complete. 2024-09-12T01:55:27.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.474+0000 7f24f4248640 1 Processor -- start 2024-09-12T01:55:27.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.474+0000 7f24f4248640 1 -- start start 2024-09-12T01:55:27.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.474+0000 7f24f4248640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24ec103ff0 0x7f24ec19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:27.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.474+0000 7f24f4248640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24ec1049a0 0x7f24ec19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:27.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.474+0000 7f24f4248640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec109120 0x7f24ec19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.474+0000 7f24f4248640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec114260 con 0x7f24ec109120 2024-09-12T01:55:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.474+0000 7f24f4248640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec1140e0 con 0x7f24ec1049a0 2024-09-12T01:55:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.474+0000 7f24f4248640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec1143e0 con 0x7f24ec103ff0 2024-09-12T01:55:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f27e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec109120 0x7f24ec19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f1fe4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24ec103ff0 0x7f24ec19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f27e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec109120 0x7f24ec19efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55782/0 (socket says 172.21.15.70:55782) 2024-09-12T01:55:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f1fe4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24ec103ff0 0x7f24ec19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:49762/0 (socket says 172.21.15.70:49762) 2024-09-12T01:55:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f27e5640 1 -- 172.21.15.70:0/545650734 learned_addr learned my addr 172.21.15.70:0/545650734 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f17e3640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24ec1049a0 0x7f24ec19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f27e5640 1 -- 172.21.15.70:0/545650734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24ec103ff0 msgr2=0x7f24ec19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f27e5640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24ec103ff0 0x7f24ec19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f27e5640 1 -- 172.21.15.70:0/545650734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24ec1049a0 msgr2=0x7f24ec19ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f27e5640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24ec1049a0 0x7f24ec19ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f27e5640 1 -- 172.21.15.70:0/545650734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ec19f690 con 0x7f24ec109120 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f17e3640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24ec1049a0 0x7f24ec19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f27e5640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec109120 0x7f24ec19efb0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f24e400eaa0 tx=0x7f24e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24e2ffd640 1 -- 172.21.15.70:0/545650734 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e400cdb0 con 0x7f24ec109120 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24e2ffd640 1 -- 172.21.15.70:0/545650734 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f24e4004b20 con 0x7f24ec109120 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f4248640 1 -- 172.21.15.70:0/545650734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ec19f980 con 0x7f24ec109120 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24e2ffd640 1 -- 172.21.15.70:0/545650734 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4011760 con 0x7f24ec109120 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.475+0000 7f24f4248640 1 -- 172.21.15.70:0/545650734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ec1a7260 con 0x7f24ec109120 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.476+0000 7f24f4248640 1 -- 172.21.15.70:0/545650734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24ec1043d0 con 0x7f24ec109120 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.477+0000 7f24e2ffd640 1 -- 172.21.15.70:0/545650734 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f24e4004cd0 con 0x7f24ec109120 2024-09-12T01:55:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.478+0000 7f24e2ffd640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24d80a2b80 0x7f24d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:27.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.478+0000 7f24f1fe4640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24d80a2b80 0x7f24d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:27.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.478+0000 7f24e2ffd640 1 -- 172.21.15.70:0/545650734 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f24e40cf240 con 0x7f24ec109120 2024-09-12T01:55:27.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.479+0000 7f24f1fe4640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24d80a2b80 0x7f24d80a5040 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009230 tx=0x7f24e80058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:27.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.482+0000 7f24e2ffd640 1 -- 172.21.15.70:0/545650734 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24e4016030 con 0x7f24ec109120 2024-09-12T01:55:27.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.686+0000 7f24f4248640 1 -- 172.21.15.70:0/545650734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24ec02d7c0 con 0x7f24ec109120 2024-09-12T01:55:27.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.686+0000 7f24e2ffd640 1 -- 172.21.15.70:0/545650734 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11994 (secure 0 0 0) 0x7f24e409c1a0 con 0x7f24ec109120 2024-09-12T01:55:27.688 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:55:27.688 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"btime":"2024-09-12T01:54:37:622268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:54:36.766931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:55:27.688 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 37 2024-09-12T01:55:27.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.689+0000 7f24f4248640 1 -- 172.21.15.70:0/545650734 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24d80a2b80 msgr2=0x7f24d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:27.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.689+0000 7f24f4248640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24d80a2b80 0x7f24d80a5040 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009230 tx=0x7f24e80058d0 comp rx=0 tx=0).stop 2024-09-12T01:55:27.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.689+0000 7f24f4248640 1 -- 172.21.15.70:0/545650734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec109120 msgr2=0x7f24ec19efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:27.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.689+0000 7f24f4248640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec109120 0x7f24ec19efb0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f24e400eaa0 tx=0x7f24e400ef60 comp rx=0 tx=0).stop 2024-09-12T01:55:27.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.689+0000 7f24f4248640 1 -- 172.21.15.70:0/545650734 shutdown_connections 2024-09-12T01:55:27.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.689+0000 7f24f4248640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f24d80a2b80 0x7f24d80a5040 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:27.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.689+0000 7f24f4248640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec109120 0x7f24ec19efb0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:27.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.689+0000 7f24f4248640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24ec1049a0 0x7f24ec19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:27.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.689+0000 7f24f4248640 1 --2- 172.21.15.70:0/545650734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24ec103ff0 0x7f24ec19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:27.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.689+0000 7f24f4248640 1 -- 172.21.15.70:0/545650734 >> 172.21.15.70:0/545650734 conn(0x7f24ec0ffab0 msgr2=0x7f24ec100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:27.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.689+0000 7f24f4248640 1 -- 172.21.15.70:0/545650734 shutdown_connections 2024-09-12T01:55:27.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:27.689+0000 7f24f4248640 1 -- 172.21.15.70:0/545650734 wait complete. 2024-09-12T01:55:28.381 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T01:55:28.631 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:28.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:28 smithi191 ceph-mon[35770]: pgmap v436: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-12T01:55:28.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:28 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/545650734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:28.977 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:28 smithi070 ceph-mon[31177]: pgmap v436: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-12T01:55:28.978 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:28 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/545650734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:29.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:28 smithi152 ceph-mon[35055]: pgmap v436: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-12T01:55:29.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:28 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/545650734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:55:29.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.058+0000 7f0b22666640 1 -- 172.21.15.70:0/3680483471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c102d40 msgr2=0x7f0b1c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:29.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.058+0000 7f0b22666640 1 --2- 172.21.15.70:0/3680483471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c102d40 0x7f0b1c103120 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009900 tx=0x7f0b0c02a480 comp rx=0 tx=0).stop 2024-09-12T01:55:29.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.058+0000 7f0b22666640 1 -- 172.21.15.70:0/3680483471 shutdown_connections 2024-09-12T01:55:29.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.058+0000 7f0b22666640 1 --2- 172.21.15.70:0/3680483471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c10c170 0x7f0b1c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.058+0000 7f0b22666640 1 --2- 172.21.15.70:0/3680483471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b1c103660 0x7f0b1c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.058+0000 7f0b22666640 1 --2- 172.21.15.70:0/3680483471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c102d40 0x7f0b1c103120 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.058+0000 7f0b22666640 1 -- 172.21.15.70:0/3680483471 >> 172.21.15.70:0/3680483471 conn(0x7f0b1c0fc7a0 msgr2=0x7f0b1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:29.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.058+0000 7f0b22666640 1 -- 172.21.15.70:0/3680483471 shutdown_connections 2024-09-12T01:55:29.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.058+0000 7f0b22666640 1 -- 172.21.15.70:0/3680483471 wait complete. 2024-09-12T01:55:29.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.059+0000 7f0b22666640 1 Processor -- start 2024-09-12T01:55:29.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.059+0000 7f0b22666640 1 -- start start 2024-09-12T01:55:29.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.059+0000 7f0b22666640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b1c102d40 0x7f0b1c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.059+0000 7f0b22666640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c103660 0x7f0b1c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.059+0000 7f0b22666640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c10c170 0x7f0b1c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.059+0000 7f0b22666640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c112110 con 0x7f0b1c103660 2024-09-12T01:55:29.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.059+0000 7f0b22666640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c111f90 con 0x7f0b1c102d40 2024-09-12T01:55:29.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.059+0000 7f0b22666640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c112290 con 0x7f0b1c10c170 2024-09-12T01:55:29.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.059+0000 7f0b1b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c103660 0x7f0b1c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.060+0000 7f0b1b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c103660 0x7f0b1c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55790/0 (socket says 172.21.15.70:55790) 2024-09-12T01:55:29.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.060+0000 7f0b1b7fe640 1 -- 172.21.15.70:0/1346022756 learned_addr learned my addr 172.21.15.70:0/1346022756 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:29.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.060+0000 7f0b20c03640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c10c170 0x7f0b1c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.060+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b1c102d40 0x7f0b1c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.060+0000 7f0b1b7fe640 1 -- 172.21.15.70:0/1346022756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c10c170 msgr2=0x7f0b1c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:29.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.060+0000 7f0b1b7fe640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c10c170 0x7f0b1c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.060+0000 7f0b1b7fe640 1 -- 172.21.15.70:0/1346022756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b1c102d40 msgr2=0x7f0b1c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:29.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.060+0000 7f0b1b7fe640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b1c102d40 0x7f0b1c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.060+0000 7f0b1b7fe640 1 -- 172.21.15.70:0/1346022756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1c1a6a50 con 0x7f0b1c103660 2024-09-12T01:55:29.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.060+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b1c102d40 0x7f0b1c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:29.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.060+0000 7f0b1b7fe640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c103660 0x7f0b1c100ee0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000b3f0 tx=0x7f0b1000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:29.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.061+0000 7f0b197fa640 1 -- 172.21.15.70:0/1346022756 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10015020 con 0x7f0b1c103660 2024-09-12T01:55:29.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.061+0000 7f0b197fa640 1 -- 172.21.15.70:0/1346022756 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b10011d30 con 0x7f0b1c103660 2024-09-12T01:55:29.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.061+0000 7f0b22666640 1 -- 172.21.15.70:0/1346022756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1c1a6d40 con 0x7f0b1c103660 2024-09-12T01:55:29.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.061+0000 7f0b197fa640 1 -- 172.21.15.70:0/1346022756 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000f2e0 con 0x7f0b1c103660 2024-09-12T01:55:29.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.061+0000 7f0b22666640 1 -- 172.21.15.70:0/1346022756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b1c1a7220 con 0x7f0b1c103660 2024-09-12T01:55:29.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.063+0000 7f0b197fa640 1 -- 172.21.15.70:0/1346022756 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0b10018020 con 0x7f0b1c103660 2024-09-12T01:55:29.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.063+0000 7f0b24a3f740 1 Processor -- start 2024-09-12T01:55:29.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b24a3f740 1 -- start start 2024-09-12T01:55:29.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b197fa640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0b040a2cd0 0x7f0b040a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b24a3f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc26390b40 0x55dc2638f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b197fa640 1 -- 172.21.15.70:0/1346022756 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f0b100ce750 con 0x7f0b1c103660 2024-09-12T01:55:29.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b24a3f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc2638fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b24a3f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc2639a370 0x55dc2639c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b24a3f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dc262f52f0 con 0x55dc26390b40 2024-09-12T01:55:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b24a3f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dc2629ccf0 con 0x55dc2638f5d0 2024-09-12T01:55:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b24a3f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dc262f12b0 con 0x55dc2639a370 2024-09-12T01:55:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b1bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc26390b40 0x55dc2638f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b1bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc26390b40 0x55dc2638f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55804/0 (socket says 172.21.15.70:55804) 2024-09-12T01:55:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b1bfff640 1 -- 172.21.15.70:0/3249587823 learned_addr learned my addr 172.21.15.70:0/3249587823 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b20c03640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0b040a2cd0 0x7f0b040a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b1b7fe640 1 --2- 172.21.15.70:0/3249587823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc2638fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b20c03640 1 --2- 172.21.15.70:0/3249587823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc2639a370 0x55dc2639c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b1bfff640 1 -- 172.21.15.70:0/3249587823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc2639a370 msgr2=0x55dc2639c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/3249587823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc2639a370 0x55dc2639c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b1bfff640 1 -- 172.21.15.70:0/3249587823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 msgr2=0x55dc2638fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/3249587823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc2638fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.064+0000 7f0b1bfff640 1 -- 172.21.15.70:0/3249587823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc262813a0 con 0x55dc26390b40 2024-09-12T01:55:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.065+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/3249587823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc26390b40 0x55dc2638f090 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009900 tx=0x7f0b0c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f0a328dd10f02f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.065+0000 7f0b20c03640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0b040a2cd0 0x7f0b040a5190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400a780 tx=0x7f0b14013830 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.065+0000 7f0b027fc640 1 -- 172.21.15.70:0/3249587823 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c03f070 con 0x55dc26390b40 2024-09-12T01:55:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.065+0000 7f0b027fc640 1 -- 172.21.15.70:0/3249587823 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b0c0035f0 con 0x55dc26390b40 2024-09-12T01:55:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.065+0000 7f0b027fc640 1 -- 172.21.15.70:0/3249587823 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c035070 con 0x55dc26390b40 2024-09-12T01:55:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.065+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3249587823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc26390b40 msgr2=0x55dc2638f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.065+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/3249587823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc26390b40 0x55dc2638f090 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009900 tx=0x7f0b0c005e80 comp rx=0 tx=0).stop 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.065+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3249587823 shutdown_connections 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.065+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/3249587823 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc2639a370 0x55dc2639c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.065+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/3249587823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc2638fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.065+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/3249587823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc26390b40 0x55dc2638f090 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.065+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3249587823 >> 172.21.15.70:0/3249587823 conn(0x55dc26358310 msgr2=0x55dc2638bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.066+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3249587823 shutdown_connections 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.066+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3249587823 wait complete. 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.066+0000 7f0b24a3f740 1 -- start start 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.066+0000 7f0b24a3f740 1 Processor -- start 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.066+0000 7f0b24a3f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc26399d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.066+0000 7f0b24a3f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc26390b40 0x55dc26396fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.066+0000 7f0b24a3f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc263975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.066+0000 7f0b24a3f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dc2639d010 con 0x55dc2639a370 2024-09-12T01:55:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.066+0000 7f0b24a3f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55dc262b0060 con 0x55dc2638f5d0 2024-09-12T01:55:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.066+0000 7f0b24a3f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55dc2639d190 con 0x55dc26390b40 2024-09-12T01:55:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.066+0000 7f0b24a3f740 10 client.0 _ll_register_callbacks cb 0x55dc260038c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b20c03640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc263975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b20c03640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc263975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55810/0 (socket says 172.21.15.70:55810) 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b20c03640 1 -- 172.21.15.70:0/951160002 learned_addr learned my addr 172.21.15.70:0/951160002 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b1b7fe640 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc26390b40 0x55dc26396fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc26399d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b20c03640 1 -- 172.21.15.70:0/951160002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc26390b40 msgr2=0x55dc26396fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b20c03640 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc26390b40 0x55dc26396fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b20c03640 1 -- 172.21.15.70:0/951160002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 msgr2=0x55dc26399d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b20c03640 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc26399d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b20c03640 1 -- 172.21.15.70:0/951160002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc260663c0 con 0x55dc2639a370 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc26399d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b20c03640 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc263975d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0b14011ca0 tx=0x7f0b14004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8fcf8238c2d6b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0afb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0afb7fe640 1 -- 172.21.15.70:0/951160002 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14023070 con 0x55dc2639a370 2024-09-12T01:55:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0afb7fe640 1 -- 172.21.15.70:0/951160002 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f0b14003b70 con 0x55dc2639a370 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b24a3f740 1 -- 172.21.15.70:0/951160002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b0c0035f0 con 0x55dc2639a370 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0afb7fe640 1 -- 172.21.15.70:0/951160002 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0b1400ee80 con 0x55dc2639a370 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b24a3f740 10 client.16641 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.067+0000 7f0b24a3f740 1 -- 172.21.15.70:0/951160002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55dc263a8ad0 con 0x55dc2639a370 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.068+0000 7f0afb7fe640 1 -- 172.21.15.70:0/951160002 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b0c0035f0 con 0x55dc2639a370 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.068+0000 7f0afb7fe640 1 -- 172.21.15.70:0/951160002 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f0b1401f6d0 con 0x55dc2639a370 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.068+0000 7f0b24a3f740 10 client.16641 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.068+0000 7f0b24a3f740 10 client.16641 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.068+0000 7f0b24a3f740 20 client.16641 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.068+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55dc263a9f90 0x55dc263ac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.068+0000 7f0b24a3f740 4 client.16641 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.068+0000 7f0b24a3f740 1 -- 172.21.15.70:0/951160002 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc26302860 con 0x55dc263a9f90 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.068+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55dc263a9f90 0x55dc263ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.069+0000 7f0afb7fe640 10 client.16641 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.069+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55dc263a9f90 0x55dc263ac430 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e96c26e0512b9e51 server_cookie=8df4f12360353beb in_seq=0 out_seq=0 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.069+0000 7f0afb7fe640 1 -- 172.21.15.70:0/951160002 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc26302860 con 0x55dc263a9f90 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.069+0000 7f0afb7fe640 10 client.16641 handle_command_reply: tid=0 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.069+0000 7f0b24a3f740 1 client.16641 shutdown 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.070+0000 7f0b24a3f740 1 -- 172.21.15.70:0/951160002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 msgr2=0x55dc263975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.070+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc263975d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0b14011ca0 tx=0x7f0b14004ab0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.070+0000 7f0b24a3f740 1 -- 172.21.15.70:0/951160002 shutdown_connections 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.070+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55dc263a9f90 0x55dc263ac430 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.070+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc263975d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.070+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc26390b40 0x55dc26396fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.070+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/951160002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc26399d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.070+0000 7f0b24a3f740 1 -- 172.21.15.70:0/951160002 >> 172.21.15.70:0/951160002 conn(0x55dc26358310 msgr2=0x55dc26391960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.070+0000 7f0afb7fe640 0 client.16641 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:55:29.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.070+0000 7f0b24a3f740 1 -- 172.21.15.70:0/951160002 shutdown_connections 2024-09-12T01:55:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.070+0000 7f0b24a3f740 1 -- 172.21.15.70:0/951160002 wait complete. 2024-09-12T01:55:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.070+0000 7f0b24a3f740 20 client.16641 trim_cache size 0 max 16384 2024-09-12T01:55:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b24a3f740 1 Processor -- start 2024-09-12T01:55:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b24a3f740 1 -- start start 2024-09-12T01:55:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b24a3f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc2638f5d0 0x55dc263a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b24a3f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc26390b40 0x55dc26392120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b24a3f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc26392660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b24a3f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c1af8b0 con 0x55dc2639a370 2024-09-12T01:55:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b24a3f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c1b15a0 con 0x55dc26390b40 2024-09-12T01:55:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b24a3f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c1affe0 con 0x55dc2638f5d0 2024-09-12T01:55:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b20c03640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc26392660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b20c03640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc26392660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55816/0 (socket says 172.21.15.70:55816) 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b20c03640 1 -- 172.21.15.70:0/936643501 learned_addr learned my addr 172.21.15.70:0/936643501 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b1b7fe640 1 --2- 172.21.15.70:0/936643501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc26390b40 0x55dc26392120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/936643501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc2638f5d0 0x55dc263a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b20c03640 1 -- 172.21.15.70:0/936643501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc2638f5d0 msgr2=0x55dc263a62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b20c03640 1 --2- 172.21.15.70:0/936643501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc2638f5d0 0x55dc263a62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b20c03640 1 -- 172.21.15.70:0/936643501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc26390b40 msgr2=0x55dc26392120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b20c03640 1 --2- 172.21.15.70:0/936643501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc26390b40 0x55dc26392120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b20c03640 1 -- 172.21.15.70:0/936643501 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2638c960 con 0x55dc2639a370 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.083+0000 7f0b1b7fe640 1 --2- 172.21.15.70:0/936643501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc26390b40 0x55dc26392120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.084+0000 7f0b20c03640 1 --2- 172.21.15.70:0/936643501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc26392660 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0b14004a80 tx=0x7f0b14011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ec1619fb9067e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.084+0000 7f0b01ffb640 1 -- 172.21.15.70:0/936643501 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14036070 con 0x55dc2639a370 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.084+0000 7f0b01ffb640 1 -- 172.21.15.70:0/936643501 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b1401f8f0 con 0x55dc2639a370 2024-09-12T01:55:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.084+0000 7f0b01ffb640 1 -- 172.21.15.70:0/936643501 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14023050 con 0x55dc2639a370 2024-09-12T01:55:29.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.085+0000 7f0b24a3f740 1 -- 172.21.15.70:0/936643501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 msgr2=0x55dc26392660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:29.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.085+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/936643501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc26392660 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0b14004a80 tx=0x7f0b14011920 comp rx=0 tx=0).stop 2024-09-12T01:55:29.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.085+0000 7f0b24a3f740 1 -- 172.21.15.70:0/936643501 shutdown_connections 2024-09-12T01:55:29.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.085+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/936643501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc26392660 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.085+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/936643501 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc26390b40 0x55dc26392120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.085+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/936643501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc2638f5d0 0x55dc263a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.085+0000 7f0b24a3f740 1 -- 172.21.15.70:0/936643501 >> 172.21.15.70:0/936643501 conn(0x55dc26358310 msgr2=0x55dc26396fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.085+0000 7f0b24a3f740 1 -- 172.21.15.70:0/936643501 shutdown_connections 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.085+0000 7f0b24a3f740 1 -- 172.21.15.70:0/936643501 wait complete. 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.085+0000 7f0b24a3f740 1 -- start start 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.085+0000 7f0b24a3f740 1 Processor -- start 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b24a3f740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc2639e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b24a3f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc26390b40 0x55dc2639e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b24a3f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc2639eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b24a3f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c1b0e10 con 0x55dc2639a370 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b24a3f740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c1b06e0 con 0x55dc2638f5d0 2024-09-12T01:55:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b24a3f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c1ad870 con 0x55dc26390b40 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b24a3f740 10 client.0 _ll_register_callbacks cb 0x7f0b1400a8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b20c03640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc2639eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b20c03640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc2639eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55828/0 (socket says 172.21.15.70:55828) 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b20c03640 1 -- 172.21.15.70:0/3911334363 learned_addr learned my addr 172.21.15.70:0/3911334363 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b1b7fe640 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc26390b40 0x55dc2639e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc2639e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b20c03640 1 -- 172.21.15.70:0/3911334363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc26390b40 msgr2=0x55dc2639e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b20c03640 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc26390b40 0x55dc2639e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b20c03640 1 -- 172.21.15.70:0/3911334363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 msgr2=0x55dc2639e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b20c03640 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc2639e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b20c03640 1 -- 172.21.15.70:0/3911334363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc26413d80 con 0x55dc2639a370 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc2639e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:29.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b20c03640 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc2639eca0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400a610 tx=0x7f0b140040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54174d38bb41da55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0afb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0afb7fe640 1 -- 172.21.15.70:0/3911334363 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1403f070 con 0x55dc2639a370 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0afb7fe640 1 -- 172.21.15.70:0/3911334363 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f0b14004ab0 con 0x55dc2639a370 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.086+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3911334363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b1401f8f0 con 0x55dc2639a370 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.087+0000 7f0afb7fe640 1 -- 172.21.15.70:0/3911334363 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0b1404b050 con 0x55dc2639a370 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.087+0000 7f0b24a3f740 10 client.16647 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.087+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3911334363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55dc26415060 con 0x55dc2639a370 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.087+0000 7f0afb7fe640 1 -- 172.21.15.70:0/3911334363 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b1401f8f0 con 0x55dc2639a370 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.087+0000 7f0afb7fe640 1 -- 172.21.15.70:0/3911334363 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f0b14005330 con 0x55dc2639a370 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.087+0000 7f0b24a3f740 10 client.16647 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.087+0000 7f0b24a3f740 10 client.16647 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.087+0000 7f0b24a3f740 20 client.16647 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.087+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55dc26415610 0x55dc26417a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:29.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.087+0000 7f0b24a3f740 4 client.16647 mds_command: new command op to 24427 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.087+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3911334363 --> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dc262fcd70 con 0x55dc26415610 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.087+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55dc26415610 0x55dc26417a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b1bfff640 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55dc26415610 0x55dc26417a30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3d036dc0e4283eac server_cookie=bedd9a2e11f72dea in_seq=0 out_seq=0 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0afb7fe640 10 client.16647 ms_handle_connect on v2:172.21.15.191:6834/97556731 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0afb7fe640 1 -- 172.21.15.70:0/3911334363 <== mds.4 v2:172.21.15.191:6834/97556731 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dc262fcd70 con 0x55dc26415610 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0afb7fe640 10 client.16647 handle_command_reply: tid=0 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b24a3f740 1 client.16647 shutdown 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3911334363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 msgr2=0x55dc2639eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc2639eca0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400a610 tx=0x7f0b140040e0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3911334363 shutdown_connections 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.191:6834/97556731,v1:172.21.15.191:6835/97556731] conn(0x55dc26415610 0x55dc26417a30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc2639a370 0x55dc2639eca0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55dc26390b40 0x55dc2639e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b24a3f740 1 --2- 172.21.15.70:0/3911334363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55dc2638f5d0 0x55dc2639e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3911334363 >> 172.21.15.70:0/3911334363 conn(0x55dc26358310 msgr2=0x55dc26398840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:29.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0afb7fe640 0 client.16647 ms_handle_reset on v2:172.21.15.191:6834/97556731 2024-09-12T01:55:29.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3911334363 shutdown_connections 2024-09-12T01:55:29.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b24a3f740 1 -- 172.21.15.70:0/3911334363 wait complete. 2024-09-12T01:55:29.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.088+0000 7f0b24a3f740 20 client.16647 trim_cache size 0 max 16384 2024-09-12T01:55:29.095 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:55:29.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.089+0000 7f0b22666640 1 -- 172.21.15.70:0/1346022756 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0b040a2cd0 msgr2=0x7f0b040a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:29.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.089+0000 7f0b22666640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0b040a2cd0 0x7f0b040a5190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400a780 tx=0x7f0b14013830 comp rx=0 tx=0).stop 2024-09-12T01:55:29.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.089+0000 7f0b22666640 1 -- 172.21.15.70:0/1346022756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c103660 msgr2=0x7f0b1c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:29.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.089+0000 7f0b22666640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c103660 0x7f0b1c100ee0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000b3f0 tx=0x7f0b1000b8b0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.089+0000 7f0b22666640 1 -- 172.21.15.70:0/1346022756 shutdown_connections 2024-09-12T01:55:29.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.089+0000 7f0b22666640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f0b040a2cd0 0x7f0b040a5190 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.089+0000 7f0b22666640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c10c170 0x7f0b1c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.089+0000 7f0b22666640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b1c103660 0x7f0b1c100ee0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.089+0000 7f0b22666640 1 --2- 172.21.15.70:0/1346022756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b1c102d40 0x7f0b1c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:29.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.089+0000 7f0b22666640 1 -- 172.21.15.70:0/1346022756 >> 172.21.15.70:0/1346022756 conn(0x7f0b1c0fc7a0 msgr2=0x7f0b1c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:29.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.089+0000 7f0b22666640 1 -- 172.21.15.70:0/1346022756 shutdown_connections 2024-09-12T01:55:29.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:29.089+0000 7f0b22666640 1 -- 172.21.15.70:0/1346022756 wait complete. 2024-09-12T01:55:29.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T01:55:30.004 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:30.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.408+0000 7fbfa03c9640 1 -- 172.21.15.70:0/738610536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf98102d40 msgr2=0x7fbf98103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:30.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.408+0000 7fbfa03c9640 1 --2- 172.21.15.70:0/738610536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf98102d40 0x7fbf98103120 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009900 tx=0x7fbf8802a480 comp rx=0 tx=0).stop 2024-09-12T01:55:30.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.408+0000 7fbfa03c9640 1 -- 172.21.15.70:0/738610536 shutdown_connections 2024-09-12T01:55:30.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.408+0000 7fbfa03c9640 1 --2- 172.21.15.70:0/738610536 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf9810c170 0x7fbf9810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.408+0000 7fbfa03c9640 1 --2- 172.21.15.70:0/738610536 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf98103660 0x7fbf9810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.408+0000 7fbfa03c9640 1 --2- 172.21.15.70:0/738610536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf98102d40 0x7fbf98103120 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.408+0000 7fbfa03c9640 1 -- 172.21.15.70:0/738610536 >> 172.21.15.70:0/738610536 conn(0x7fbf980fc7a0 msgr2=0x7fbf980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:30.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.408+0000 7fbfa03c9640 1 -- 172.21.15.70:0/738610536 shutdown_connections 2024-09-12T01:55:30.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.408+0000 7fbfa03c9640 1 -- 172.21.15.70:0/738610536 wait complete. 2024-09-12T01:55:30.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbfa03c9640 1 Processor -- start 2024-09-12T01:55:30.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbfa03c9640 1 -- start start 2024-09-12T01:55:30.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbfa03c9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf98102d40 0x7fbf98198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbfa03c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf98103660 0x7fbf98198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbfa03c9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9810c170 0x7fbf9819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbfa03c9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981120f0 con 0x7fbf98103660 2024-09-12T01:55:30.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbfa03c9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf98111f70 con 0x7fbf9810c170 2024-09-12T01:55:30.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbfa03c9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbf98112270 con 0x7fbf98102d40 2024-09-12T01:55:30.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbf9d964640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf98103660 0x7fbf98198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbf9e165640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf98102d40 0x7fbf98198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbf9e165640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf98102d40 0x7fbf98198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.70:52218/0 (socket says 172.21.15.70:52218) 2024-09-12T01:55:30.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbf9d964640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf98103660 0x7fbf98198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43606/0 (socket says 172.21.15.70:43606) 2024-09-12T01:55:30.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbf9e165640 1 -- 172.21.15.70:0/591247069 learned_addr learned my addr 172.21.15.70:0/591247069 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:30.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.409+0000 7fbf9e966640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9810c170 0x7fbf9819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.410+0000 7fbf9d964640 1 -- 172.21.15.70:0/591247069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf98102d40 msgr2=0x7fbf98198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.410+0000 7fbf9d964640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf98102d40 0x7fbf98198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.410+0000 7fbf9d964640 1 -- 172.21.15.70:0/591247069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9810c170 msgr2=0x7fbf9819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.410+0000 7fbf9d964640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9810c170 0x7fbf9819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.410+0000 7fbf9d964640 1 -- 172.21.15.70:0/591247069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9819d520 con 0x7fbf98103660 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.410+0000 7fbf9e966640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9810c170 0x7fbf9819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.410+0000 7fbf9d964640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf98103660 0x7fbf98198ab0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400c720 tx=0x7fbf9400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.410+0000 7fbf8f7fe640 1 -- 172.21.15.70:0/591247069 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94007bb0 con 0x7fbf98103660 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.410+0000 7fbf8f7fe640 1 -- 172.21.15.70:0/591247069 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf9400ce30 con 0x7fbf98103660 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.410+0000 7fbfa03c9640 1 -- 172.21.15.70:0/591247069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9819d810 con 0x7fbf98103660 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.410+0000 7fbf8f7fe640 1 -- 172.21.15.70:0/591247069 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400f450 con 0x7fbf98103660 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.410+0000 7fbfa03c9640 1 -- 172.21.15.70:0/591247069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf981a50f0 con 0x7fbf98103660 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.412+0000 7fbf8f7fe640 1 -- 172.21.15.70:0/591247069 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbf94004ef0 con 0x7fbf98103660 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.412+0000 7fbfa27a2740 1 Processor -- start 2024-09-12T01:55:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbfa27a2740 1 -- start start 2024-09-12T01:55:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbfa27a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237db6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbfa27a2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 0x565237db6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbfa27a2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237dc5780 0x565237dc7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbfa27a2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x565237d1c2f0 con 0x565237db65d0 2024-09-12T01:55:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbfa27a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x565237cc3cf0 con 0x565237db7b40 2024-09-12T01:55:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbfa27a2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x565237d182b0 con 0x565237dc5780 2024-09-12T01:55:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf9e165640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 0x565237db6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf9e165640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 0x565237db6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43618/0 (socket says 172.21.15.70:43618) 2024-09-12T01:55:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf8f7fe640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbf840a2b80 0x7fbf840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf9e165640 1 -- 172.21.15.70:0/2456095038 learned_addr learned my addr 172.21.15.70:0/2456095038 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf9e966640 1 --2- 172.21.15.70:0/2456095038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237db6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf9d964640 1 --2- 172.21.15.70:0/2456095038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237dc5780 0x565237dc7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf9e966640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbf840a2b80 0x7fbf840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf9e165640 1 -- 172.21.15.70:0/2456095038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237dc5780 msgr2=0x565237dc7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf9e165640 1 --2- 172.21.15.70:0/2456095038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237dc5780 0x565237dc7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf8f7fe640 1 -- 172.21.15.70:0/591247069 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbf940cec00 con 0x7fbf98103660 2024-09-12T01:55:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf9e165640 1 -- 172.21.15.70:0/2456095038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 msgr2=0x565237db6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf9e165640 1 --2- 172.21.15.70:0/2456095038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237db6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.413+0000 7fbf9e165640 1 -- 172.21.15.70:0/2456095038 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565237ca83a0 con 0x565237db65d0 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.414+0000 7fbf9e165640 1 --2- 172.21.15.70:0/2456095038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 0x565237db6a10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009a20 tx=0x7fbf88031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34186f039008606 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.414+0000 7fbf9e966640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbf840a2b80 0x7fbf840a5040 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009fd0 tx=0x7fbf90004a40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.414+0000 7fbf8cdea640 1 -- 172.21.15.70:0/2456095038 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88040070 con 0x565237db65d0 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.414+0000 7fbf8cdea640 1 -- 172.21.15.70:0/2456095038 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf88005020 con 0x565237db65d0 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.414+0000 7fbf8cdea640 1 -- 172.21.15.70:0/2456095038 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88035040 con 0x565237db65d0 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.414+0000 7fbfa27a2740 1 -- 172.21.15.70:0/2456095038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 msgr2=0x565237db6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.414+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/2456095038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 0x565237db6a10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009a20 tx=0x7fbf88031770 comp rx=0 tx=0).stop 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.414+0000 7fbfa27a2740 1 -- 172.21.15.70:0/2456095038 shutdown_connections 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/2456095038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237dc5780 0x565237dc7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/2456095038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 0x565237db6a10 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/2456095038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237db6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 -- 172.21.15.70:0/2456095038 >> 172.21.15.70:0/2456095038 conn(0x565237d7f310 msgr2=0x565237db2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 -- 172.21.15.70:0/2456095038 shutdown_connections 2024-09-12T01:55:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 -- 172.21.15.70:0/2456095038 wait complete. 2024-09-12T01:55:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 -- start start 2024-09-12T01:55:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 Processor -- start 2024-09-12T01:55:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 0x565237dc50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237dc2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237dc5780 0x565237dc28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x565237dc8420 con 0x565237db65d0 2024-09-12T01:55:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x565237cd7060 con 0x565237db7b40 2024-09-12T01:55:30.455 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:55:30.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x565237dc85a0 con 0x565237dc5780 2024-09-12T01:55:30.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbfa27a2740 10 client.0 _ll_register_callbacks cb 0x565237a2a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:30.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbf9e165640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 0x565237dc50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbf9e165640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 0x565237dc50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43628/0 (socket says 172.21.15.70:43628) 2024-09-12T01:55:30.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbf9e165640 1 -- 172.21.15.70:0/4190036665 learned_addr learned my addr 172.21.15.70:0/4190036665 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:30.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.415+0000 7fbf9d964640 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237dc2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf9e966640 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237dc5780 0x565237dc28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf9e165640 1 -- 172.21.15.70:0/4190036665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237dc5780 msgr2=0x565237dc28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:30.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf9e165640 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237dc5780 0x565237dc28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf9e165640 1 -- 172.21.15.70:0/4190036665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 msgr2=0x565237dc2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:30.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf9e165640 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237dc2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf9e165640 1 -- 172.21.15.70:0/4190036665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565237a8d3c0 con 0x565237db65d0 2024-09-12T01:55:30.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf9d964640 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237dc2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:30.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf9e165640 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 0x565237dc50c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbf88005ec0 tx=0x7fbf88005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b9844c5e53bfa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:30.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:30.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf81ffb640 1 -- 172.21.15.70:0/4190036665 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8804c070 con 0x565237db65d0 2024-09-12T01:55:30.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf81ffb640 1 -- 172.21.15.70:0/4190036665 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbf88004bc0 con 0x565237db65d0 2024-09-12T01:55:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbfa27a2740 1 -- 172.21.15.70:0/4190036665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf88005020 con 0x565237db65d0 2024-09-12T01:55:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf81ffb640 1 -- 172.21.15.70:0/4190036665 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fbf88058050 con 0x565237db65d0 2024-09-12T01:55:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbfa27a2740 10 client.16659 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbfa27a2740 1 -- 172.21.15.70:0/4190036665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x565237dd3e10 con 0x565237db65d0 2024-09-12T01:55:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf81ffb640 1 -- 172.21.15.70:0/4190036665 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf88005020 con 0x565237db65d0 2024-09-12T01:55:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.416+0000 7fbf81ffb640 1 -- 172.21.15.70:0/4190036665 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fbf88044400 con 0x565237db65d0 2024-09-12T01:55:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.417+0000 7fbfa27a2740 10 client.16659 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.417+0000 7fbfa27a2740 10 client.16659 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T01:55:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.417+0000 7fbfa27a2740 20 client.16659 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.417+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x565237dd5160 0x565237dd7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.417+0000 7fbfa27a2740 4 client.16659 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:55:30.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.417+0000 7fbfa27a2740 1 -- 172.21.15.70:0/4190036665 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565237d29860 con 0x565237dd5160 2024-09-12T01:55:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.417+0000 7fbf9d964640 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x565237dd5160 0x565237dd7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.417+0000 7fbf9d964640 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x565237dd5160 0x565237dd7550 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=115cfe111ae47760 server_cookie=ddc3d268cf4a0151 in_seq=0 out_seq=0 2024-09-12T01:55:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.417+0000 7fbf81ffb640 10 client.16659 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:55:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbf81ffb640 1 -- 172.21.15.70:0/4190036665 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565237d29860 con 0x565237dd5160 2024-09-12T01:55:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbf81ffb640 10 client.16659 handle_command_reply: tid=0 2024-09-12T01:55:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbfa27a2740 1 client.16659 shutdown 2024-09-12T01:55:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbfa27a2740 1 -- 172.21.15.70:0/4190036665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 msgr2=0x565237dc50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 0x565237dc50c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbf88005ec0 tx=0x7fbf88005480 comp rx=0 tx=0).stop 2024-09-12T01:55:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbfa27a2740 1 -- 172.21.15.70:0/4190036665 shutdown_connections 2024-09-12T01:55:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x565237dd5160 0x565237dd7550 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237dc5780 0x565237dc28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237dc2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/4190036665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db65d0 0x565237dc50c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbfa27a2740 1 -- 172.21.15.70:0/4190036665 >> 172.21.15.70:0/4190036665 conn(0x565237d7f310 msgr2=0x565237db8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbf81ffb640 0 client.16659 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:55:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbfa27a2740 1 -- 172.21.15.70:0/4190036665 shutdown_connections 2024-09-12T01:55:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbfa27a2740 1 -- 172.21.15.70:0/4190036665 wait complete. 2024-09-12T01:55:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.418+0000 7fbfa27a2740 20 client.16659 trim_cache size 0 max 16384 2024-09-12T01:55:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbfa27a2740 1 Processor -- start 2024-09-12T01:55:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbfa27a2740 1 -- start start 2024-09-12T01:55:30.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbfa27a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237d7f310 0x565237dc1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbfa27a2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237db65d0 0x565237dc42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbfa27a2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db7b40 0x565237dda190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbfa27a2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981ab4f0 con 0x565237db7b40 2024-09-12T01:55:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbfa27a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981ad1e0 con 0x565237d7f310 2024-09-12T01:55:30.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbfa27a2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981abc20 con 0x565237db65d0 2024-09-12T01:55:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbf9e966640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db7b40 0x565237dda190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbf9e966640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db7b40 0x565237dda190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43636/0 (socket says 172.21.15.70:43636) 2024-09-12T01:55:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbf9e966640 1 -- 172.21.15.70:0/149136391 learned_addr learned my addr 172.21.15.70:0/149136391 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbf9d964640 1 --2- 172.21.15.70:0/149136391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237db65d0 0x565237dc42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbf9e966640 1 -- 172.21.15.70:0/149136391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237db65d0 msgr2=0x565237dc42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:30.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbf9e966640 1 --2- 172.21.15.70:0/149136391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237db65d0 0x565237dc42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbf9e966640 1 -- 172.21.15.70:0/149136391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237d7f310 msgr2=0x565237dc1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:30.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.432+0000 7fbf9e966640 1 --2- 172.21.15.70:0/149136391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237d7f310 0x565237dc1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.433+0000 7fbf9e966640 1 -- 172.21.15.70:0/149136391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565237dc36f0 con 0x565237db7b40 2024-09-12T01:55:30.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.433+0000 7fbf9d964640 1 --2- 172.21.15.70:0/149136391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237db65d0 0x565237dc42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:30.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.433+0000 7fbf9e966640 1 --2- 172.21.15.70:0/149136391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db7b40 0x565237dda190 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000c1e0 tx=0x7fbf90009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965f2b902acfef0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:30.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.433+0000 7fbf83fff640 1 -- 172.21.15.70:0/149136391 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90015050 con 0x565237db7b40 2024-09-12T01:55:30.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.433+0000 7fbf83fff640 1 -- 172.21.15.70:0/149136391 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf90022070 con 0x565237db7b40 2024-09-12T01:55:30.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.433+0000 7fbf83fff640 1 -- 172.21.15.70:0/149136391 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90027d00 con 0x565237db7b40 2024-09-12T01:55:30.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.433+0000 7fbfa27a2740 1 -- 172.21.15.70:0/149136391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db7b40 msgr2=0x565237dda190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:30.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.433+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/149136391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db7b40 0x565237dda190 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000c1e0 tx=0x7fbf90009950 comp rx=0 tx=0).stop 2024-09-12T01:55:30.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 -- 172.21.15.70:0/149136391 shutdown_connections 2024-09-12T01:55:30.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/149136391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237db7b40 0x565237dda190 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/149136391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237db65d0 0x565237dc42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/149136391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237d7f310 0x565237dc1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 -- 172.21.15.70:0/149136391 >> 172.21.15.70:0/149136391 conn(0x565237dc2a10 msgr2=0x565237dc3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 -- 172.21.15.70:0/149136391 shutdown_connections 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 -- 172.21.15.70:0/149136391 wait complete. 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 -- start start 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 Processor -- start 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237d7f310 0x565237dda700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237db65d0 0x565237dd7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237dd7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981aca50 con 0x565237d7f310 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981ac320 con 0x565237db7b40 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981a94b0 con 0x565237db65d0 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbfa27a2740 10 client.0 _ll_register_callbacks cb 0x7fbf900097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbf9e165640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237d7f310 0x565237dda700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbf9e165640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237d7f310 0x565237dda700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43648/0 (socket says 172.21.15.70:43648) 2024-09-12T01:55:30.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.434+0000 7fbf9e165640 1 -- 172.21.15.70:0/3657204865 learned_addr learned my addr 172.21.15.70:0/3657204865 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:30.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf9e165640 1 -- 172.21.15.70:0/3657204865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237db65d0 msgr2=0x565237dd7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:30.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf9e165640 1 --2- 172.21.15.70:0/3657204865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237db65d0 0x565237dd7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf9e966640 1 --2- 172.21.15.70:0/3657204865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237dd7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf9e165640 1 -- 172.21.15.70:0/3657204865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 msgr2=0x565237dd7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:30.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf9e165640 1 --2- 172.21.15.70:0/3657204865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237dd7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf9e165640 1 -- 172.21.15.70:0/3657204865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565237dd85d0 con 0x565237d7f310 2024-09-12T01:55:30.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf9e165640 1 --2- 172.21.15.70:0/3657204865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237d7f310 0x565237dda700 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fbf880315e0 tx=0x7fbf88005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f08e3c2051ebf36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:30.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:30.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf81ffb640 1 -- 172.21.15.70:0/3657204865 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8804c040 con 0x565237d7f310 2024-09-12T01:55:30.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf81ffb640 1 -- 172.21.15.70:0/3657204865 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbf880449f0 con 0x565237d7f310 2024-09-12T01:55:30.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbfa27a2740 1 -- 172.21.15.70:0/3657204865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf90022070 con 0x565237d7f310 2024-09-12T01:55:30.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf81ffb640 1 -- 172.21.15.70:0/3657204865 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fbf88064050 con 0x565237d7f310 2024-09-12T01:55:30.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbfa27a2740 10 client.16665 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:30.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbfa27a2740 1 -- 172.21.15.70:0/3657204865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x565237e3f820 con 0x565237d7f310 2024-09-12T01:55:30.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf81ffb640 1 -- 172.21.15.70:0/3657204865 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf90022070 con 0x565237d7f310 2024-09-12T01:55:30.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbf81ffb640 1 -- 172.21.15.70:0/3657204865 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fbf88004150 con 0x565237d7f310 2024-09-12T01:55:30.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbfa27a2740 10 client.16665 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:30.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbfa27a2740 10 client.16665 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-12T01:55:30.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbfa27a2740 20 client.16665 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:30.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/3657204865 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x565237dc5780 0x565237e41f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:30.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbfa27a2740 4 client.16665 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:55:30.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.435+0000 7fbfa27a2740 1 -- 172.21.15.70:0/3657204865 --> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565237d23d70 con 0x565237dc5780 2024-09-12T01:55:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.436+0000 7fbf9d964640 1 --2- 172.21.15.70:0/3657204865 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x565237dc5780 0x565237e41f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.436+0000 7fbf81ffb640 10 client.16665 ms_handle_connect on v2:172.21.15.191:6836/1473295002 2024-09-12T01:55:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.436+0000 7fbf9d964640 1 --2- 172.21.15.70:0/3657204865 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x565237dc5780 0x565237e41f10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ee2847c0f4604737 server_cookie=20925e7ed0aab0c6 in_seq=0 out_seq=0 2024-09-12T01:55:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.436+0000 7fbf81ffb640 1 -- 172.21.15.70:0/3657204865 <== mds.3 v2:172.21.15.191:6836/1473295002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565237d23d70 con 0x565237dc5780 2024-09-12T01:55:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.436+0000 7fbf81ffb640 10 client.16665 handle_command_reply: tid=0 2024-09-12T01:55:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.436+0000 7fbfa27a2740 1 client.16665 shutdown 2024-09-12T01:55:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.436+0000 7fbfa27a2740 1 -- 172.21.15.70:0/3657204865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237d7f310 msgr2=0x565237dda700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.436+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/3657204865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237d7f310 0x565237dda700 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fbf880315e0 tx=0x7fbf88005690 comp rx=0 tx=0).stop 2024-09-12T01:55:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.436+0000 7fbfa27a2740 1 -- 172.21.15.70:0/3657204865 shutdown_connections 2024-09-12T01:55:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.436+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/3657204865 >> [v2:172.21.15.191:6836/1473295002,v1:172.21.15.191:6837/1473295002] conn(0x565237dc5780 0x565237e41f10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.436+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/3657204865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565237db7b40 0x565237dd7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbf81ffb640 0 client.16665 ms_handle_reset on v2:172.21.15.191:6836/1473295002 2024-09-12T01:55:30.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/3657204865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565237db65d0 0x565237dd7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa27a2740 1 --2- 172.21.15.70:0/3657204865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565237d7f310 0x565237dda700 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa27a2740 1 -- 172.21.15.70:0/3657204865 >> 172.21.15.70:0/3657204865 conn(0x565237dc2a10 msgr2=0x565237db1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:30.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa27a2740 1 -- 172.21.15.70:0/3657204865 shutdown_connections 2024-09-12T01:55:30.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa27a2740 1 -- 172.21.15.70:0/3657204865 wait complete. 2024-09-12T01:55:30.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa27a2740 20 client.16665 trim_cache size 0 max 16384 2024-09-12T01:55:30.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa03c9640 1 -- 172.21.15.70:0/591247069 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbf840a2b80 msgr2=0x7fbf840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:30.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa03c9640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbf840a2b80 0x7fbf840a5040 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009fd0 tx=0x7fbf90004a40 comp rx=0 tx=0).stop 2024-09-12T01:55:30.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa03c9640 1 -- 172.21.15.70:0/591247069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf98103660 msgr2=0x7fbf98198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:30.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa03c9640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf98103660 0x7fbf98198ab0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400c720 tx=0x7fbf9400cbe0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa03c9640 1 -- 172.21.15.70:0/591247069 shutdown_connections 2024-09-12T01:55:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa03c9640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fbf840a2b80 0x7fbf840a5040 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa03c9640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf9810c170 0x7fbf9819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa03c9640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf98103660 0x7fbf98198ab0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa03c9640 1 --2- 172.21.15.70:0/591247069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf98102d40 0x7fbf98198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa03c9640 1 -- 172.21.15.70:0/591247069 >> 172.21.15.70:0/591247069 conn(0x7fbf980fc7a0 msgr2=0x7fbf980fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa03c9640 1 -- 172.21.15.70:0/591247069 shutdown_connections 2024-09-12T01:55:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:30.437+0000 7fbfa03c9640 1 -- 172.21.15.70:0/591247069 wait complete. 2024-09-12T01:55:30.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:30 smithi070 ceph-mon[31177]: pgmap v437: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-12T01:55:30.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:30 smithi191 ceph-mon[35770]: pgmap v437: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-12T01:55:31.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:30 smithi152 ceph-mon[35055]: pgmap v437: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-12T01:55:31.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T01:55:31.420 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.858+0000 7f15aef1b640 1 -- 172.21.15.70:0/2927168544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15a81055b0 msgr2=0x7f15a810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.858+0000 7f15aef1b640 1 --2- 172.21.15.70:0/2927168544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15a81055b0 0x7f15a810d130 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009ca0 tx=0x7f15a002a8c0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.858+0000 7f15aef1b640 1 -- 172.21.15.70:0/2927168544 shutdown_connections 2024-09-12T01:55:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.858+0000 7f15aef1b640 1 --2- 172.21.15.70:0/2927168544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15a81055b0 0x7f15a810d130 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.858+0000 7f15aef1b640 1 --2- 172.21.15.70:0/2927168544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15a8100e30 0x7f15a8104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.858+0000 7f15aef1b640 1 --2- 172.21.15.70:0/2927168544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15a8100480 0x7f15a8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.858+0000 7f15aef1b640 1 -- 172.21.15.70:0/2927168544 >> 172.21.15.70:0/2927168544 conn(0x7f15a8077210 msgr2=0x7f15a80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:31.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.858+0000 7f15aef1b640 1 -- 172.21.15.70:0/2927168544 shutdown_connections 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.858+0000 7f15aef1b640 1 -- 172.21.15.70:0/2927168544 wait complete. 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15aef1b640 1 Processor -- start 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15aef1b640 1 -- start start 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15aef1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15a8100480 0x7f15a81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15aef1b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15a8100e30 0x7f15a8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15aef1b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15a81055b0 0x7f15a819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15aef1b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f15a8110770 con 0x7f15a8100480 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15aef1b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f15a81105f0 con 0x7f15a81055b0 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15aef1b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f15a81108f0 con 0x7f15a8100e30 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15accb7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15a8100480 0x7f15a81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15accb7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15a8100480 0x7f15a81984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43658/0 (socket says 172.21.15.70:43658) 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15accb7640 1 -- 172.21.15.70:0/1066499989 learned_addr learned my addr 172.21.15.70:0/1066499989 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15a7fff640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15a8100e30 0x7f15a8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.859+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15a81055b0 0x7f15a819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.860+0000 7f15accb7640 1 -- 172.21.15.70:0/1066499989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15a8100e30 msgr2=0x7f15a8198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.860+0000 7f15accb7640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15a8100e30 0x7f15a8198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.860+0000 7f15accb7640 1 -- 172.21.15.70:0/1066499989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15a81055b0 msgr2=0x7f15a819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.860+0000 7f15accb7640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15a81055b0 0x7f15a819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.860+0000 7f15accb7640 1 -- 172.21.15.70:0/1066499989 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a819d480 con 0x7f15a8100480 2024-09-12T01:55:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.860+0000 7f15accb7640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15a8100480 0x7f15a81984d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f159c00b4a0 tx=0x7f159c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.860+0000 7f15a5ffb640 1 -- 172.21.15.70:0/1066499989 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c015020 con 0x7f15a8100480 2024-09-12T01:55:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.860+0000 7f15aef1b640 1 -- 172.21.15.70:0/1066499989 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a819d770 con 0x7f15a8100480 2024-09-12T01:55:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.860+0000 7f15a5ffb640 1 -- 172.21.15.70:0/1066499989 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f159c011d30 con 0x7f15a8100480 2024-09-12T01:55:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.860+0000 7f15a5ffb640 1 -- 172.21.15.70:0/1066499989 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c00f2e0 con 0x7f15a8100480 2024-09-12T01:55:31.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.860+0000 7f15aef1b640 1 -- 172.21.15.70:0/1066499989 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a81a5050 con 0x7f15a8100480 2024-09-12T01:55:31.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15b12f4740 1 Processor -- start 2024-09-12T01:55:31.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15b12f4740 1 -- start start 2024-09-12T01:55:31.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15b12f4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be3b40 0x565224be2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15b12f4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be25d0 0x565224be2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15b12f4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224bed370 0x565224bef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15b12f4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x565224b482f0 con 0x565224be3b40 2024-09-12T01:55:31.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15b12f4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x565224aefcf0 con 0x565224be25d0 2024-09-12T01:55:31.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15b12f4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x565224b442b0 con 0x565224bed370 2024-09-12T01:55:31.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15ad4b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be3b40 0x565224be2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15ad4b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be3b40 0x565224be2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43668/0 (socket says 172.21.15.70:43668) 2024-09-12T01:55:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15ad4b8640 1 -- 172.21.15.70:0/3084526275 learned_addr learned my addr 172.21.15.70:0/3084526275 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15a5ffb640 1 -- 172.21.15.70:0/1066499989 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f159c018020 con 0x7f15a8100480 2024-09-12T01:55:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15ad4b8640 1 -- 172.21.15.70:0/3084526275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224bed370 msgr2=0x565224bef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/3084526275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224bed370 0x565224bef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15ad4b8640 1 -- 172.21.15.70:0/3084526275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be25d0 msgr2=0x565224be2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/3084526275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be25d0 0x565224be2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.863+0000 7f15ad4b8640 1 -- 172.21.15.70:0/3084526275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565224ad43a0 con 0x565224be3b40 2024-09-12T01:55:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.864+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/3084526275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be3b40 0x565224be2090 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009a30 tx=0x7f15a0031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadbb3eeb098c112 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.864+0000 7f1592ffd640 1 -- 172.21.15.70:0/3084526275 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0003b70 con 0x565224be3b40 2024-09-12T01:55:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.864+0000 7f1592ffd640 1 -- 172.21.15.70:0/3084526275 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f15a0036040 con 0x565224be3b40 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.864+0000 7f1592ffd640 1 -- 172.21.15.70:0/3084526275 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0004620 con 0x565224be3b40 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.864+0000 7f15a5ffb640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f15980a2b80 0x7f15980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.864+0000 7f15accb7640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f15980a2b80 0x7f15980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.864+0000 7f15a5ffb640 1 -- 172.21.15.70:0/1066499989 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f159c0ce850 con 0x7f15a8100480 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.865+0000 7f15b12f4740 1 -- 172.21.15.70:0/3084526275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be3b40 msgr2=0x565224be2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.865+0000 7f15b12f4740 1 --2- 172.21.15.70:0/3084526275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be3b40 0x565224be2090 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009a30 tx=0x7f15a0031bb0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.865+0000 7f15b12f4740 1 -- 172.21.15.70:0/3084526275 shutdown_connections 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.865+0000 7f15b12f4740 1 --2- 172.21.15.70:0/3084526275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224bed370 0x565224bef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.865+0000 7f15b12f4740 1 --2- 172.21.15.70:0/3084526275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be25d0 0x565224be2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.865+0000 7f15b12f4740 1 --2- 172.21.15.70:0/3084526275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be3b40 0x565224be2090 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.865+0000 7f15b12f4740 1 -- 172.21.15.70:0/3084526275 >> 172.21.15.70:0/3084526275 conn(0x565224bab310 msgr2=0x565224bdec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.865+0000 7f15b12f4740 1 -- 172.21.15.70:0/3084526275 shutdown_connections 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.865+0000 7f15accb7640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f15980a2b80 0x7f15980a5040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f159c0a37f0 tx=0x7f159c0bb040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:31.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.865+0000 7f15b12f4740 1 -- 172.21.15.70:0/3084526275 wait complete. 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.865+0000 7f15b12f4740 1 -- start start 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.865+0000 7f15b12f4740 1 Processor -- start 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15b12f4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224be25d0 0x565224becc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15b12f4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 0x565224be9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15b12f4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bed370 0x565224bea420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15b12f4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x565224befe90 con 0x565224bed370 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15b12f4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x565224b03060 con 0x565224be3b40 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15b12f4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x565224bf0010 con 0x565224be25d0 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15b12f4740 10 client.0 _ll_register_callbacks cb 0x5652248568c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15ad4b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bed370 0x565224bea420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15ad4b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bed370 0x565224bea420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43670/0 (socket says 172.21.15.70:43670) 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15ad4b8640 1 -- 172.21.15.70:0/3807825233 learned_addr learned my addr 172.21.15.70:0/3807825233 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15a7fff640 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 0x565224be9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224be25d0 0x565224becc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15ad4b8640 1 -- 172.21.15.70:0/3807825233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224be25d0 msgr2=0x565224becc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224be25d0 0x565224becc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15ad4b8640 1 -- 172.21.15.70:0/3807825233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 msgr2=0x565224be9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 0x565224be9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15ad4b8640 1 -- 172.21.15.70:0/3807825233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652248b93c0 con 0x565224bed370 2024-09-12T01:55:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bed370 0x565224bea420 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f15a002ade0 tx=0x7f15a0004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea862656f0695cd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f1587fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f1587fff640 1 -- 172.21.15.70:0/3807825233 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0031650 con 0x565224bed370 2024-09-12T01:55:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.866+0000 7f1587fff640 1 -- 172.21.15.70:0/3807825233 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f15a00317f0 con 0x565224bed370 2024-09-12T01:55:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f15b12f4740 1 -- 172.21.15.70:0/3807825233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15a0036040 con 0x565224bed370 2024-09-12T01:55:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f1587fff640 1 -- 172.21.15.70:0/3807825233 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f15a002f610 con 0x565224bed370 2024-09-12T01:55:31.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f15b12f4740 10 client.16677 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f15b12f4740 1 -- 172.21.15.70:0/3807825233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x565224befe90 con 0x565224bed370 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f1587fff640 1 -- 172.21.15.70:0/3807825233 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f15a0036040 con 0x565224bed370 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f1587fff640 1 -- 172.21.15.70:0/3807825233 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f15a0043070 con 0x565224bed370 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f15b12f4740 10 client.16677 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f15b12f4740 10 client.16677 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f15b12f4740 20 client.16677 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f15b12f4740 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x565224bfc9a0 0x565224bfedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f15b12f4740 4 client.16677 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f15b12f4740 1 -- 172.21.15.70:0/3807825233 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565224b55860 con 0x565224bfc9a0 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.867+0000 7f15a7fff640 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x565224bfc9a0 0x565224bfedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.868+0000 7f1587fff640 10 client.16677 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.868+0000 7f15a7fff640 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x565224bfc9a0 0x565224bfedc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da2c5633c0f0f750 server_cookie=bbe25803a27a4b12 in_seq=0 out_seq=0 2024-09-12T01:55:31.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.868+0000 7f1587fff640 1 -- 172.21.15.70:0/3807825233 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565224b55860 con 0x565224bfc9a0 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.868+0000 7f1587fff640 10 client.16677 handle_command_reply: tid=0 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f15b12f4740 1 client.16677 shutdown 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f15b12f4740 1 -- 172.21.15.70:0/3807825233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bed370 msgr2=0x565224bea420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f15b12f4740 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bed370 0x565224bea420 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f15a002ade0 tx=0x7f15a0004300 comp rx=0 tx=0).stop 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f15b12f4740 1 -- 172.21.15.70:0/3807825233 shutdown_connections 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f15b12f4740 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x565224bfc9a0 0x565224bfedc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f15b12f4740 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bed370 0x565224bea420 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f15b12f4740 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 0x565224be9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f15b12f4740 1 --2- 172.21.15.70:0/3807825233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224be25d0 0x565224becc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f1587fff640 0 client.16677 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f15b12f4740 1 -- 172.21.15.70:0/3807825233 >> 172.21.15.70:0/3807825233 conn(0x565224bab310 msgr2=0x565224be4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f15b12f4740 1 -- 172.21.15.70:0/3807825233 shutdown_connections 2024-09-12T01:55:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f15b12f4740 1 -- 172.21.15.70:0/3807825233 wait complete. 2024-09-12T01:55:31.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.869+0000 7f15b12f4740 20 client.16677 trim_cache size 0 max 16384 2024-09-12T01:55:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15b12f4740 1 Processor -- start 2024-09-12T01:55:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15b12f4740 1 -- start start 2024-09-12T01:55:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15b12f4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224bab310 0x565224bf9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15b12f4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be25d0 0x565224be8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15b12f4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 0x565224c046c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15b12f4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f15a81ad6b0 con 0x565224be25d0 2024-09-12T01:55:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15b12f4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f15a81af3a0 con 0x565224be3b40 2024-09-12T01:55:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15b12f4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f15a81adde0 con 0x565224bab310 2024-09-12T01:55:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15a7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be25d0 0x565224be8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15a7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be25d0 0x565224be8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43686/0 (socket says 172.21.15.70:43686) 2024-09-12T01:55:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15a7fff640 1 -- 172.21.15.70:0/1619428618 learned_addr learned my addr 172.21.15.70:0/1619428618 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/1619428618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 0x565224c046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/1619428618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224bab310 0x565224bf9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15a7fff640 1 -- 172.21.15.70:0/1619428618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224bab310 msgr2=0x565224bf9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15a7fff640 1 --2- 172.21.15.70:0/1619428618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224bab310 0x565224bf9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15a7fff640 1 -- 172.21.15.70:0/1619428618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 msgr2=0x565224c046c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15a7fff640 1 --2- 172.21.15.70:0/1619428618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 0x565224c046c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15a7fff640 1 -- 172.21.15.70:0/1619428618 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565224be5120 con 0x565224be25d0 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.882+0000 7f15a7fff640 1 --2- 172.21.15.70:0/1619428618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be25d0 0x565224be8fd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f159400abe0 tx=0x7f1594012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652b485e648cb530 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.883+0000 7f15927fc640 1 -- 172.21.15.70:0/1619428618 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594021030 con 0x565224be25d0 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.883+0000 7f15927fc640 1 -- 172.21.15.70:0/1619428618 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1594012e80 con 0x565224be25d0 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.883+0000 7f15927fc640 1 -- 172.21.15.70:0/1619428618 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594010690 con 0x565224be25d0 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.883+0000 7f15b12f4740 1 -- 172.21.15.70:0/1619428618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be25d0 msgr2=0x565224be8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.883+0000 7f15b12f4740 1 --2- 172.21.15.70:0/1619428618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be25d0 0x565224be8fd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f159400abe0 tx=0x7f1594012820 comp rx=0 tx=0).stop 2024-09-12T01:55:31.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.883+0000 7f15b12f4740 1 -- 172.21.15.70:0/1619428618 shutdown_connections 2024-09-12T01:55:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.883+0000 7f15b12f4740 1 --2- 172.21.15.70:0/1619428618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 0x565224c046c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.883+0000 7f15b12f4740 1 --2- 172.21.15.70:0/1619428618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224be25d0 0x565224be8fd0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.883+0000 7f15b12f4740 1 --2- 172.21.15.70:0/1619428618 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224bab310 0x565224bf9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.883+0000 7f15b12f4740 1 -- 172.21.15.70:0/1619428618 >> 172.21.15.70:0/1619428618 conn(0x565224bea580 msgr2=0x565224bde580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.883+0000 7f15b12f4740 1 -- 172.21.15.70:0/1619428618 shutdown_connections 2024-09-12T01:55:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.883+0000 7f15b12f4740 1 -- 172.21.15.70:0/1619428618 wait complete. 2024-09-12T01:55:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15b12f4740 1 -- start start 2024-09-12T01:55:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15b12f4740 1 Processor -- start 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15b12f4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bab310 0x565224bf1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15b12f4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224be25d0 0x565224bf1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15b12f4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 0x565224c66690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15b12f4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f15a81aec10 con 0x565224bab310 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15b12f4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f15a81ae4e0 con 0x565224be3b40 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15b12f4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f15a81ab670 con 0x565224be25d0 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15b12f4740 10 client.0 _ll_register_callbacks cb 0x7f15a0004840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15ad4b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bab310 0x565224bf1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15ad4b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bab310 0x565224bf1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43696/0 (socket says 172.21.15.70:43696) 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15ad4b8640 1 -- 172.21.15.70:0/2500823623 learned_addr learned my addr 172.21.15.70:0/2500823623 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15a7fff640 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224be25d0 0x565224bf1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.884+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 0x565224c66690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f15ad4b8640 1 -- 172.21.15.70:0/2500823623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224be25d0 msgr2=0x565224bf1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224be25d0 0x565224bf1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f15ad4b8640 1 -- 172.21.15.70:0/2500823623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 msgr2=0x565224c66690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 0x565224c66690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f15ad4b8640 1 -- 172.21.15.70:0/2500823623 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565224bf2140 con 0x565224bab310 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f15ad4b8640 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bab310 0x565224bf1350 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009bf0 tx=0x7f15a0004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4438baa8c38b89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f1587fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f1587fff640 1 -- 172.21.15.70:0/2500823623 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0004d40 con 0x565224bab310 2024-09-12T01:55:31.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f1587fff640 1 -- 172.21.15.70:0/2500823623 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f15a0031450 con 0x565224bab310 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f15b12f4740 1 -- 172.21.15.70:0/2500823623 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565224b4fd70 con 0x565224bab310 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f1587fff640 1 -- 172.21.15.70:0/2500823623 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f15a0031650 con 0x565224bab310 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f15b12f4740 10 client.16683 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f15b12f4740 1 -- 172.21.15.70:0/2500823623 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x565224c67cb0 con 0x565224bab310 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f1587fff640 1 -- 172.21.15.70:0/2500823623 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x565224b4fd70 con 0x565224bab310 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f1587fff640 1 -- 172.21.15.70:0/2500823623 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f15a0043070 con 0x565224bab310 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f15b12f4740 10 client.16683 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f15b12f4740 10 client.16683 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.885+0000 7f15b12f4740 20 client.16683 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.886+0000 7f15b12f4740 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x565224bed370 0x565224c6a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.886+0000 7f15b12f4740 4 client.16683 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.886+0000 7f15b12f4740 1 -- 172.21.15.70:0/2500823623 --> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565224acc170 con 0x565224bed370 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.886+0000 7f15a7fff640 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x565224bed370 0x565224c6a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.886+0000 7f1587fff640 10 client.16683 ms_handle_connect on v2:172.21.15.152:6836/3978171312 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.886+0000 7f15a7fff640 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x565224bed370 0x565224c6a390 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3bdc9b2ab12c9c22 server_cookie=51b15c1cdf68d1c7 in_seq=0 out_seq=0 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.886+0000 7f1587fff640 1 -- 172.21.15.70:0/2500823623 <== mds.2 v2:172.21.15.152:6836/3978171312 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565224acc170 con 0x565224bed370 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.886+0000 7f1587fff640 10 client.16683 handle_command_reply: tid=0 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15b12f4740 1 client.16683 shutdown 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15b12f4740 1 -- 172.21.15.70:0/2500823623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bab310 msgr2=0x565224bf1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15b12f4740 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bab310 0x565224bf1350 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009bf0 tx=0x7f15a0004260 comp rx=0 tx=0).stop 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15b12f4740 1 -- 172.21.15.70:0/2500823623 shutdown_connections 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15b12f4740 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.152:6836/3978171312,v1:172.21.15.152:6837/3978171312] conn(0x565224bed370 0x565224c6a390 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15b12f4740 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565224be3b40 0x565224c66690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15b12f4740 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565224be25d0 0x565224bf1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15b12f4740 1 --2- 172.21.15.70:0/2500823623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565224bab310 0x565224bf1350 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f1587fff640 0 client.16683 ms_handle_reset on v2:172.21.15.152:6836/3978171312 2024-09-12T01:55:31.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15b12f4740 1 -- 172.21.15.70:0/2500823623 >> 172.21.15.70:0/2500823623 conn(0x565224bea580 msgr2=0x565224beb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15b12f4740 1 -- 172.21.15.70:0/2500823623 shutdown_connections 2024-09-12T01:55:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15b12f4740 1 -- 172.21.15.70:0/2500823623 wait complete. 2024-09-12T01:55:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15b12f4740 20 client.16683 trim_cache size 0 max 16384 2024-09-12T01:55:31.894 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:55:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15aef1b640 1 -- 172.21.15.70:0/1066499989 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f15980a2b80 msgr2=0x7f15980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.887+0000 7f15aef1b640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f15980a2b80 0x7f15980a5040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f159c0a37f0 tx=0x7f159c0bb040 comp rx=0 tx=0).stop 2024-09-12T01:55:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.888+0000 7f15aef1b640 1 -- 172.21.15.70:0/1066499989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15a8100480 msgr2=0x7f15a81984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.888+0000 7f15aef1b640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15a8100480 0x7f15a81984d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f159c00b4a0 tx=0x7f159c00b8a0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.888+0000 7f15aef1b640 1 -- 172.21.15.70:0/1066499989 shutdown_connections 2024-09-12T01:55:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.888+0000 7f15aef1b640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f15980a2b80 0x7f15980a5040 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.888+0000 7f15aef1b640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15a81055b0 0x7f15a819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.888+0000 7f15aef1b640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15a8100e30 0x7f15a8198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.888+0000 7f15aef1b640 1 --2- 172.21.15.70:0/1066499989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15a8100480 0x7f15a81984d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.888+0000 7f15aef1b640 1 -- 172.21.15.70:0/1066499989 >> 172.21.15.70:0/1066499989 conn(0x7f15a8077210 msgr2=0x7f15a80fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.888+0000 7f15aef1b640 1 -- 172.21.15.70:0/1066499989 shutdown_connections 2024-09-12T01:55:31.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:31.888+0000 7f15aef1b640 1 -- 172.21.15.70:0/1066499989 wait complete. 2024-09-12T01:55:32.740 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T01:55:32.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:32 smithi191 ceph-mon[35770]: pgmap v438: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-12T01:55:32.985 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:33.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:32 smithi152 ceph-mon[35055]: pgmap v438: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-12T01:55:33.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:32 smithi070 ceph-mon[31177]: pgmap v438: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-12T01:55:33.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.446+0000 7f206e562640 1 -- 172.21.15.70:0/2003242183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2068100a80 msgr2=0x7f2068100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.446+0000 7f206e562640 1 --2- 172.21.15.70:0/2003242183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2068100a80 0x7f2068100ee0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2050009930 tx=0x7f205002a420 comp rx=0 tx=0).stop 2024-09-12T01:55:33.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.446+0000 7f206e562640 1 -- 172.21.15.70:0/2003242183 shutdown_connections 2024-09-12T01:55:33.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.446+0000 7f206e562640 1 --2- 172.21.15.70:0/2003242183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2068101420 0x7f206810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.446+0000 7f206e562640 1 --2- 172.21.15.70:0/2003242183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2068100a80 0x7f2068100ee0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.446+0000 7f206e562640 1 --2- 172.21.15.70:0/2003242183 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2068106a80 0x7f2068106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.446+0000 7f206e562640 1 -- 172.21.15.70:0/2003242183 >> 172.21.15.70:0/2003242183 conn(0x7f20680fc7a0 msgr2=0x7f20680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.446+0000 7f206e562640 1 -- 172.21.15.70:0/2003242183 shutdown_connections 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.446+0000 7f206e562640 1 -- 172.21.15.70:0/2003242183 wait complete. 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f206e562640 1 Processor -- start 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f206e562640 1 -- start start 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f206e562640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2068100a80 0x7f2068198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f206e562640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2068101420 0x7f2068198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f206e562640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2068106a80 0x7f206819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f206e562640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2068110fa0 con 0x7f2068100a80 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f206e562640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2068110e20 con 0x7f2068101420 2024-09-12T01:55:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f206e562640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2068111120 con 0x7f2068106a80 2024-09-12T01:55:33.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f2067fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2068100a80 0x7f2068198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f2067fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2068100a80 0x7f2068198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43726/0 (socket says 172.21.15.70:43726) 2024-09-12T01:55:33.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f2067fff640 1 -- 172.21.15.70:0/3455700783 learned_addr learned my addr 172.21.15.70:0/3455700783 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:33.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f205ffff640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2068101420 0x7f2068198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f206caff640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2068106a80 0x7f206819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f2067fff640 1 -- 172.21.15.70:0/3455700783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2068106a80 msgr2=0x7f206819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f2067fff640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2068106a80 0x7f206819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f2067fff640 1 -- 172.21.15.70:0/3455700783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2068101420 msgr2=0x7f2068198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f2067fff640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2068101420 0x7f2068198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.447+0000 7f2067fff640 1 -- 172.21.15.70:0/3455700783 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206819d510 con 0x7f2068100a80 2024-09-12T01:55:33.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.448+0000 7f2067fff640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2068100a80 0x7f2068198560 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f205800c890 tx=0x7f205800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.448+0000 7f2065ffb640 1 -- 172.21.15.70:0/3455700783 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058004220 con 0x7f2068100a80 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.448+0000 7f2065ffb640 1 -- 172.21.15.70:0/3455700783 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20580043c0 con 0x7f2068100a80 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.448+0000 7f206e562640 1 -- 172.21.15.70:0/3455700783 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206819d800 con 0x7f2068100a80 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.448+0000 7f2065ffb640 1 -- 172.21.15.70:0/3455700783 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058004b10 con 0x7f2068100a80 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.448+0000 7f206e562640 1 -- 172.21.15.70:0/3455700783 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20681a50e0 con 0x7f2068100a80 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.450+0000 7f2065ffb640 1 -- 172.21.15.70:0/3455700783 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f20580051b0 con 0x7f2068100a80 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.450+0000 7f207093b740 1 Processor -- start 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.450+0000 7f207093b740 1 -- start start 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f207093b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba671b40 0x55caba670090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f207093b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba6705d0 0x55caba670a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f207093b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba67f780 0x55caba681b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f207093b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55caba5d62f0 con 0x55caba671b40 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f207093b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55caba57dcf0 con 0x55caba6705d0 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f207093b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55caba5d22b0 con 0x55caba67f780 2024-09-12T01:55:33.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f206caff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba671b40 0x55caba670090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f206caff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba671b40 0x55caba670090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43728/0 (socket says 172.21.15.70:43728) 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f206caff640 1 -- 172.21.15.70:0/3606302471 learned_addr learned my addr 172.21.15.70:0/3606302471 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f2065ffb640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f20540a2c00 0x7f20540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f2067fff640 1 --2- 172.21.15.70:0/3606302471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba6705d0 0x55caba670a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f205ffff640 1 --2- 172.21.15.70:0/3606302471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba67f780 0x55caba681b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f206caff640 1 -- 172.21.15.70:0/3606302471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba67f780 msgr2=0x55caba681b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f206caff640 1 --2- 172.21.15.70:0/3606302471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba67f780 0x55caba681b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f206caff640 1 -- 172.21.15.70:0/3606302471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba6705d0 msgr2=0x55caba670a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f206caff640 1 --2- 172.21.15.70:0/3606302471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba6705d0 0x55caba670a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f2065ffb640 1 -- 172.21.15.70:0/3455700783 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f20580cefd0 con 0x7f2068100a80 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f206caff640 1 -- 172.21.15.70:0/3606302471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caba5623a0 con 0x55caba671b40 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f205ffff640 1 --2- 172.21.15.70:0/3606302471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba67f780 0x55caba681b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:33.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.451+0000 7f206caff640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f20540a2c00 0x7f20540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.452+0000 7f206caff640 1 --2- 172.21.15.70:0/3606302471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba671b40 0x55caba670090 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2060008f40 tx=0x7f206000e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2938d6b20446ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.452+0000 7f205e7fc640 1 -- 172.21.15.70:0/3606302471 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2060022070 con 0x55caba671b40 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.452+0000 7f205e7fc640 1 -- 172.21.15.70:0/3606302471 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2060011b70 con 0x55caba671b40 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.452+0000 7f205e7fc640 1 -- 172.21.15.70:0/3606302471 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206001cbd0 con 0x55caba671b40 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.453+0000 7f207093b740 1 -- 172.21.15.70:0/3606302471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba671b40 msgr2=0x55caba670090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.453+0000 7f206caff640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f20540a2c00 0x7f20540a50c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f206001f000 tx=0x7f2060020000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.453+0000 7f207093b740 1 --2- 172.21.15.70:0/3606302471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba671b40 0x55caba670090 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2060008f40 tx=0x7f206000e7e0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.453+0000 7f207093b740 1 -- 172.21.15.70:0/3606302471 shutdown_connections 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.453+0000 7f207093b740 1 --2- 172.21.15.70:0/3606302471 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba67f780 0x55caba681b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.453+0000 7f207093b740 1 --2- 172.21.15.70:0/3606302471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba6705d0 0x55caba670a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.453+0000 7f207093b740 1 --2- 172.21.15.70:0/3606302471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba671b40 0x55caba670090 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.453+0000 7f207093b740 1 -- 172.21.15.70:0/3606302471 >> 172.21.15.70:0/3606302471 conn(0x55caba639310 msgr2=0x55caba66cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.453+0000 7f207093b740 1 -- 172.21.15.70:0/3606302471 shutdown_connections 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.453+0000 7f207093b740 1 -- 172.21.15.70:0/3606302471 wait complete. 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.453+0000 7f207093b740 1 -- start start 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.453+0000 7f207093b740 1 Processor -- start 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f207093b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba6705d0 0x55caba67f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f207093b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba671b40 0x55caba67c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f207093b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 0x55caba67ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f207093b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55caba682480 con 0x55caba67f780 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f207093b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55caba591060 con 0x55caba6705d0 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f207093b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55caba682600 con 0x55caba671b40 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f207093b740 10 client.0 _ll_register_callbacks cb 0x55caba2e48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f206caff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 0x55caba67ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f206caff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 0x55caba67ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43738/0 (socket says 172.21.15.70:43738) 2024-09-12T01:55:33.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f206caff640 1 -- 172.21.15.70:0/2718464127 learned_addr learned my addr 172.21.15.70:0/2718464127 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f2067fff640 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba6705d0 0x55caba67f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f205ffff640 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba671b40 0x55caba67c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f206caff640 1 -- 172.21.15.70:0/2718464127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba671b40 msgr2=0x55caba67c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f206caff640 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba671b40 0x55caba67c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f206caff640 1 -- 172.21.15.70:0/2718464127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba6705d0 msgr2=0x55caba67f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f206caff640 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba6705d0 0x55caba67f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f206caff640 1 -- 172.21.15.70:0/2718464127 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caba3473c0 con 0x55caba67f780 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f205ffff640 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba671b40 0x55caba67c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f206caff640 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 0x55caba67ca10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2060004e60 tx=0x7f2060011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744696d6bb995eaa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f20477fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f20477fe640 1 -- 172.21.15.70:0/2718464127 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2060022070 con 0x55caba67f780 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f20477fe640 1 -- 172.21.15.70:0/2718464127 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f206001c680 con 0x55caba67f780 2024-09-12T01:55:33.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.454+0000 7f207093b740 1 -- 172.21.15.70:0/2718464127 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2060011b70 con 0x55caba67f780 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.455+0000 7f20477fe640 1 -- 172.21.15.70:0/2718464127 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f206001c880 con 0x55caba67f780 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.455+0000 7f207093b740 10 client.16695 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.455+0000 7f207093b740 1 -- 172.21.15.70:0/2718464127 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55caba68df20 con 0x55caba67f780 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.455+0000 7f20477fe640 1 -- 172.21.15.70:0/2718464127 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2060011b70 con 0x55caba67f780 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.455+0000 7f20477fe640 1 -- 172.21.15.70:0/2718464127 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f2060019040 con 0x55caba67f780 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.455+0000 7f207093b740 10 client.16695 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.455+0000 7f207093b740 10 client.16695 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.455+0000 7f207093b740 20 client.16695 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.455+0000 7f207093b740 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55caba68f270 0x55caba691660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.455+0000 7f207093b740 4 client.16695 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.455+0000 7f207093b740 1 -- 172.21.15.70:0/2718464127 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55caba5e3860 con 0x55caba68f270 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.455+0000 7f2067fff640 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55caba68f270 0x55caba691660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.456+0000 7f20477fe640 10 client.16695 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:55:33.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.456+0000 7f2067fff640 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55caba68f270 0x55caba691660 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6a6458901a57d13 server_cookie=ff21d72490e3f789 in_seq=0 out_seq=0 2024-09-12T01:55:33.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.456+0000 7f20477fe640 1 -- 172.21.15.70:0/2718464127 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55caba5e3860 con 0x55caba68f270 2024-09-12T01:55:33.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.456+0000 7f20477fe640 10 client.16695 handle_command_reply: tid=0 2024-09-12T01:55:33.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f207093b740 1 client.16695 shutdown 2024-09-12T01:55:33.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f207093b740 1 -- 172.21.15.70:0/2718464127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 msgr2=0x55caba67ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f207093b740 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 0x55caba67ca10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2060004e60 tx=0x7f2060011f50 comp rx=0 tx=0).stop 2024-09-12T01:55:33.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f207093b740 1 -- 172.21.15.70:0/2718464127 shutdown_connections 2024-09-12T01:55:33.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f207093b740 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55caba68f270 0x55caba691660 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f207093b740 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 0x55caba67ca10 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f20477fe640 0 client.16695 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:55:33.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f207093b740 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba671b40 0x55caba67c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f207093b740 1 --2- 172.21.15.70:0/2718464127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba6705d0 0x55caba67f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f207093b740 1 -- 172.21.15.70:0/2718464127 >> 172.21.15.70:0/2718464127 conn(0x55caba639310 msgr2=0x55caba672960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f207093b740 1 -- 172.21.15.70:0/2718464127 shutdown_connections 2024-09-12T01:55:33.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f207093b740 1 -- 172.21.15.70:0/2718464127 wait complete. 2024-09-12T01:55:33.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.457+0000 7f207093b740 20 client.16695 trim_cache size 0 max 16384 2024-09-12T01:55:33.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f207093b740 1 Processor -- start 2024-09-12T01:55:33.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f207093b740 1 -- start start 2024-09-12T01:55:33.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f207093b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba6705d0 0x55caba68b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f207093b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba671b40 0x55caba67e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f207093b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba67f780 0x55caba696e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f207093b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20681ab5c0 con 0x55caba6705d0 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f207093b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20681ad2b0 con 0x55caba671b40 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f207093b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f20681abcf0 con 0x55caba67f780 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f2067fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba6705d0 0x55caba68b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f2067fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba6705d0 0x55caba68b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43744/0 (socket says 172.21.15.70:43744) 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f2067fff640 1 -- 172.21.15.70:0/1890515466 learned_addr learned my addr 172.21.15.70:0/1890515466 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f205ffff640 1 --2- 172.21.15.70:0/1890515466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba671b40 0x55caba67e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f206caff640 1 --2- 172.21.15.70:0/1890515466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba67f780 0x55caba696e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f2067fff640 1 -- 172.21.15.70:0/1890515466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba67f780 msgr2=0x55caba696e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f2067fff640 1 --2- 172.21.15.70:0/1890515466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba67f780 0x55caba696e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f2067fff640 1 -- 172.21.15.70:0/1890515466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba671b40 msgr2=0x55caba67e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f2067fff640 1 --2- 172.21.15.70:0/1890515466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba671b40 0x55caba67e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f2067fff640 1 -- 172.21.15.70:0/1890515466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caba66c4f0 con 0x55caba6705d0 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f206caff640 1 --2- 172.21.15.70:0/1890515466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba67f780 0x55caba696e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:33.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f2067fff640 1 --2- 172.21.15.70:0/1890515466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba6705d0 0x55caba68b720 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2058005fd0 tx=0x7f20580cca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cb24c7808c793d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f205dffb640 1 -- 172.21.15.70:0/1890515466 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058084e60 con 0x55caba6705d0 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f205dffb640 1 -- 172.21.15.70:0/1890515466 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f205809b8d0 con 0x55caba6705d0 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.470+0000 7f205dffb640 1 -- 172.21.15.70:0/1890515466 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205801d040 con 0x55caba6705d0 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.471+0000 7f207093b740 1 -- 172.21.15.70:0/1890515466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba6705d0 msgr2=0x55caba68b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.471+0000 7f207093b740 1 --2- 172.21.15.70:0/1890515466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba6705d0 0x55caba68b720 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2058005fd0 tx=0x7f20580cca40 comp rx=0 tx=0).stop 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.471+0000 7f207093b740 1 -- 172.21.15.70:0/1890515466 shutdown_connections 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.471+0000 7f207093b740 1 --2- 172.21.15.70:0/1890515466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba67f780 0x55caba696e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.471+0000 7f207093b740 1 --2- 172.21.15.70:0/1890515466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba671b40 0x55caba67e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.471+0000 7f207093b740 1 --2- 172.21.15.70:0/1890515466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba6705d0 0x55caba68b720 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.471+0000 7f207093b740 1 -- 172.21.15.70:0/1890515466 >> 172.21.15.70:0/1890515466 conn(0x55caba639310 msgr2=0x55caba67dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.471+0000 7f207093b740 1 -- 172.21.15.70:0/1890515466 shutdown_connections 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.471+0000 7f207093b740 1 -- 172.21.15.70:0/1890515466 wait complete. 2024-09-12T01:55:33.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.472+0000 7f207093b740 1 -- start start 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.472+0000 7f207093b740 1 Processor -- start 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.472+0000 7f207093b740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba6705d0 0x55caba6793c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.472+0000 7f207093b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba671b40 0x55caba679900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.472+0000 7f207093b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 0x55caba679e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.472+0000 7f207093b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20681acb20 con 0x55caba67f780 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.472+0000 7f207093b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20681ac3f0 con 0x55caba671b40 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.472+0000 7f207093b740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f20681a9580 con 0x55caba6705d0 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.472+0000 7f207093b740 10 client.0 _ll_register_callbacks cb 0x7f2060020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f206caff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 0x55caba679e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f206caff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 0x55caba679e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43754/0 (socket says 172.21.15.70:43754) 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f206caff640 1 -- 172.21.15.70:0/3295973837 learned_addr learned my addr 172.21.15.70:0/3295973837 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f205ffff640 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba671b40 0x55caba679900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f2067fff640 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba6705d0 0x55caba6793c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f206caff640 1 -- 172.21.15.70:0/3295973837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba6705d0 msgr2=0x55caba6793c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f206caff640 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba6705d0 0x55caba6793c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f206caff640 1 -- 172.21.15.70:0/3295973837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba671b40 msgr2=0x55caba679900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f206caff640 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba671b40 0x55caba679900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f206caff640 1 -- 172.21.15.70:0/3295973837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caba6f8e40 con 0x55caba67f780 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f206caff640 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 0x55caba679e40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2060004fd0 tx=0x7f2060008ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d64e0241df4762 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f20477fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f20477fe640 1 -- 172.21.15.70:0/3295973837 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2060022070 con 0x55caba67f780 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f20477fe640 1 -- 172.21.15.70:0/3295973837 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2060011970 con 0x55caba67f780 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f207093b740 1 -- 172.21.15.70:0/3295973837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f205809b8d0 con 0x55caba67f780 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f20477fe640 1 -- 172.21.15.70:0/3295973837 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2060045050 con 0x55caba67f780 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f207093b740 10 client.16701 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:33.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.473+0000 7f207093b740 1 -- 172.21.15.70:0/3295973837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55caba6f9fb0 con 0x55caba67f780 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.474+0000 7f20477fe640 1 -- 172.21.15.70:0/3295973837 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f205809b8d0 con 0x55caba67f780 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.474+0000 7f20477fe640 1 -- 172.21.15.70:0/3295973837 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f2060019040 con 0x55caba67f780 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.474+0000 7f207093b740 10 client.16701 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.474+0000 7f207093b740 10 client.16701 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.474+0000 7f207093b740 20 client.16701 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.474+0000 7f207093b740 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55caba6fa6b0 0x55caba6fcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.474+0000 7f207093b740 4 client.16701 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.474+0000 7f207093b740 1 -- 172.21.15.70:0/3295973837 --> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55caba5ddd70 con 0x55caba6fa6b0 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.474+0000 7f2067fff640 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55caba6fa6b0 0x55caba6fcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f2067fff640 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55caba6fa6b0 0x55caba6fcad0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb514a4bbe872b4d server_cookie=68ed4f4fc447e8 in_seq=0 out_seq=0 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f20477fe640 10 client.16701 ms_handle_connect on v2:172.21.15.191:6838/1679121869 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f20477fe640 1 -- 172.21.15.70:0/3295973837 <== mds.1 v2:172.21.15.191:6838/1679121869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55caba5ddd70 con 0x55caba6fa6b0 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f20477fe640 10 client.16701 handle_command_reply: tid=0 2024-09-12T01:55:33.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f207093b740 1 client.16701 shutdown 2024-09-12T01:55:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f207093b740 1 -- 172.21.15.70:0/3295973837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 msgr2=0x55caba679e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f207093b740 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 0x55caba679e40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2060004fd0 tx=0x7f2060008ec0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f207093b740 1 -- 172.21.15.70:0/3295973837 shutdown_connections 2024-09-12T01:55:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f207093b740 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.191:6838/1679121869,v1:172.21.15.191:6839/1679121869] conn(0x55caba6fa6b0 0x55caba6fcad0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f207093b740 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55caba67f780 0x55caba679e40 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f207093b740 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55caba671b40 0x55caba679900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f20477fe640 0 client.16701 ms_handle_reset on v2:172.21.15.191:6838/1679121869 2024-09-12T01:55:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f207093b740 1 --2- 172.21.15.70:0/3295973837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55caba6705d0 0x55caba6793c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f207093b740 1 -- 172.21.15.70:0/3295973837 >> 172.21.15.70:0/3295973837 conn(0x55caba639310 msgr2=0x55caba66bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f207093b740 1 -- 172.21.15.70:0/3295973837 shutdown_connections 2024-09-12T01:55:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f207093b740 1 -- 172.21.15.70:0/3295973837 wait complete. 2024-09-12T01:55:33.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.475+0000 7f207093b740 20 client.16701 trim_cache size 0 max 16384 2024-09-12T01:55:33.493 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:55:33.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.476+0000 7f206e562640 1 -- 172.21.15.70:0/3455700783 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f20540a2c00 msgr2=0x7f20540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.476+0000 7f206e562640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f20540a2c00 0x7f20540a50c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f206001f000 tx=0x7f2060020000 comp rx=0 tx=0).stop 2024-09-12T01:55:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.476+0000 7f206e562640 1 -- 172.21.15.70:0/3455700783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2068100a80 msgr2=0x7f2068198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.476+0000 7f206e562640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2068100a80 0x7f2068198560 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f205800c890 tx=0x7f205800cd50 comp rx=0 tx=0).stop 2024-09-12T01:55:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.476+0000 7f206e562640 1 -- 172.21.15.70:0/3455700783 shutdown_connections 2024-09-12T01:55:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.476+0000 7f206e562640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f20540a2c00 0x7f20540a50c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.476+0000 7f206e562640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2068106a80 0x7f206819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.476+0000 7f206e562640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2068101420 0x7f2068198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.476+0000 7f206e562640 1 --2- 172.21.15.70:0/3455700783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2068100a80 0x7f2068198560 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.476+0000 7f206e562640 1 -- 172.21.15.70:0/3455700783 >> 172.21.15.70:0/3455700783 conn(0x7f20680fc7a0 msgr2=0x7f206806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.476+0000 7f206e562640 1 -- 172.21.15.70:0/3455700783 shutdown_connections 2024-09-12T01:55:33.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:33.476+0000 7f206e562640 1 -- 172.21.15.70:0/3455700783 wait complete. 2024-09-12T01:55:33.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:33 smithi191 ceph-mon[35770]: pgmap v439: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-12T01:55:34.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:33 smithi152 ceph-mon[35055]: pgmap v439: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-12T01:55:34.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:33 smithi070 ceph-mon[31177]: pgmap v439: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-12T01:55:34.147 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T01:55:34.391 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:34.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.887+0000 7f5828233640 1 -- 172.21.15.70:0/90409242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5820103780 msgr2=0x7f5820107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.887+0000 7f5828233640 1 --2- 172.21.15.70:0/90409242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5820103780 0x7f5820107bc0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5810009930 tx=0x7f581002a420 comp rx=0 tx=0).stop 2024-09-12T01:55:34.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 -- 172.21.15.70:0/90409242 shutdown_connections 2024-09-12T01:55:34.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 --2- 172.21.15.70:0/90409242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5820108300 0x7f582010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 --2- 172.21.15.70:0/90409242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5820103780 0x7f5820107bc0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 --2- 172.21.15.70:0/90409242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5820102dd0 0x7f58201031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 -- 172.21.15.70:0/90409242 >> 172.21.15.70:0/90409242 conn(0x7f58200fc7d0 msgr2=0x7f58200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 -- 172.21.15.70:0/90409242 shutdown_connections 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 -- 172.21.15.70:0/90409242 wait complete. 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 Processor -- start 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 -- start start 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5820102dd0 0x7f5820100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5820103780 0x7f5820100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5820108300 0x7f58201014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5820112260 con 0x7f5820108300 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f58201120e0 con 0x7f5820103780 2024-09-12T01:55:34.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.888+0000 7f5828233640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f58201123e0 con 0x7f5820102dd0 2024-09-12T01:55:34.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f58267d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5820108300 0x7f58201014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f58267d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5820108300 0x7f58201014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43772/0 (socket says 172.21.15.70:43772) 2024-09-12T01:55:34.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f58267d0640 1 -- 172.21.15.70:0/1401860403 learned_addr learned my addr 172.21.15.70:0/1401860403 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:34.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f58257ce640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5820103780 0x7f5820100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f5825fcf640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5820102dd0 0x7f5820100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f58267d0640 1 -- 172.21.15.70:0/1401860403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5820102dd0 msgr2=0x7f5820100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f58267d0640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5820102dd0 0x7f5820100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f58267d0640 1 -- 172.21.15.70:0/1401860403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5820103780 msgr2=0x7f5820100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f58267d0640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5820103780 0x7f5820100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f58267d0640 1 -- 172.21.15.70:0/1401860403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58201a6c00 con 0x7f5820108300 2024-09-12T01:55:34.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f58267d0640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5820108300 0x7f58201014b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f581c009fd0 tx=0x7f581c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:34.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f5816ffd640 1 -- 172.21.15.70:0/1401860403 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581c011830 con 0x7f5820108300 2024-09-12T01:55:34.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f5816ffd640 1 -- 172.21.15.70:0/1401860403 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f581c016070 con 0x7f5820108300 2024-09-12T01:55:34.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f5816ffd640 1 -- 172.21.15.70:0/1401860403 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581c00f2e0 con 0x7f5820108300 2024-09-12T01:55:34.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f5828233640 1 -- 172.21.15.70:0/1401860403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58201a6ef0 con 0x7f5820108300 2024-09-12T01:55:34.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.889+0000 7f5828233640 1 -- 172.21.15.70:0/1401860403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58201a73b0 con 0x7f5820108300 2024-09-12T01:55:34.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.891+0000 7f5816ffd640 1 -- 172.21.15.70:0/1401860403 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f581c01b460 con 0x7f5820108300 2024-09-12T01:55:34.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f582a60c740 1 Processor -- start 2024-09-12T01:55:34.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f582a60c740 1 -- start start 2024-09-12T01:55:34.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f582a60c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29028b40 0x55aa29027090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f582a60c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa290275d0 0x55aa29027a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f582a60c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29032370 0x55aa29034760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f582a60c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aa28f8d2f0 con 0x55aa29032370 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f582a60c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55aa28f34cf0 con 0x55aa29028b40 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f582a60c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55aa28f892b0 con 0x55aa290275d0 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f5816ffd640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f580c0a2b80 0x7f580c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f58257ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29032370 0x55aa29034760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f58257ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29032370 0x55aa29034760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43782/0 (socket says 172.21.15.70:43782) 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f58257ce640 1 -- 172.21.15.70:0/518856099 learned_addr learned my addr 172.21.15.70:0/518856099 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f58257ce640 1 --2- 172.21.15.70:0/518856099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29028b40 0x55aa29027090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f58267d0640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f580c0a2b80 0x7f580c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.892+0000 7f5825fcf640 1 --2- 172.21.15.70:0/518856099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa290275d0 0x55aa29027a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.893+0000 7f5816ffd640 1 -- 172.21.15.70:0/1401860403 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f581c0ce600 con 0x7f5820108300 2024-09-12T01:55:34.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.893+0000 7f58257ce640 1 -- 172.21.15.70:0/518856099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa290275d0 msgr2=0x55aa29027a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.893+0000 7f58257ce640 1 --2- 172.21.15.70:0/518856099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa290275d0 0x55aa29027a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.893+0000 7f58257ce640 1 -- 172.21.15.70:0/518856099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29028b40 msgr2=0x55aa29027090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.893+0000 7f58257ce640 1 --2- 172.21.15.70:0/518856099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29028b40 0x55aa29027090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.893+0000 7f58257ce640 1 -- 172.21.15.70:0/518856099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa28f193a0 con 0x55aa29032370 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.893+0000 7f58257ce640 1 --2- 172.21.15.70:0/518856099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29032370 0x55aa29034760 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f58100315e0 tx=0x7f5810000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bac1c4352377685 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.893+0000 7f58267d0640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f580c0a2b80 0x7f580c0a5040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f581c06def0 tx=0x7f581c0c59f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.893+0000 7f580bfff640 1 -- 172.21.15.70:0/518856099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810035070 con 0x55aa29032370 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.893+0000 7f580bfff640 1 -- 172.21.15.70:0/518856099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5810005520 con 0x55aa29032370 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.893+0000 7f580bfff640 1 -- 172.21.15.70:0/518856099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810004b20 con 0x55aa29032370 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.894+0000 7f582a60c740 1 -- 172.21.15.70:0/518856099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29032370 msgr2=0x55aa29034760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.894+0000 7f582a60c740 1 --2- 172.21.15.70:0/518856099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29032370 0x55aa29034760 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f58100315e0 tx=0x7f5810000bc0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.894+0000 7f582a60c740 1 -- 172.21.15.70:0/518856099 shutdown_connections 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.894+0000 7f582a60c740 1 --2- 172.21.15.70:0/518856099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29032370 0x55aa29034760 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.894+0000 7f582a60c740 1 --2- 172.21.15.70:0/518856099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa290275d0 0x55aa29027a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.894+0000 7f582a60c740 1 --2- 172.21.15.70:0/518856099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29028b40 0x55aa29027090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.894+0000 7f582a60c740 1 -- 172.21.15.70:0/518856099 >> 172.21.15.70:0/518856099 conn(0x55aa28ff0310 msgr2=0x55aa29023c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.894+0000 7f582a60c740 1 -- 172.21.15.70:0/518856099 shutdown_connections 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.894+0000 7f582a60c740 1 -- 172.21.15.70:0/518856099 wait complete. 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.894+0000 7f582a60c740 1 -- start start 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.894+0000 7f582a60c740 1 Processor -- start 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f582a60c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 0x55aa29031d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f582a60c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa29028b40 0x55aa2902f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f582a60c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 0x55aa2902f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f582a60c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aa29035010 con 0x55aa290275d0 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f582a60c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55aa28f48060 con 0x55aa29032370 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f582a60c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55aa29035190 con 0x55aa29028b40 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f582a60c740 10 client.0 _ll_register_callbacks cb 0x55aa28c9b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:34.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f58257ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 0x55aa29031d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f58257ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 0x55aa29031d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43788/0 (socket says 172.21.15.70:43788) 2024-09-12T01:55:34.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f58257ce640 1 -- 172.21.15.70:0/2843528463 learned_addr learned my addr 172.21.15.70:0/2843528463 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:34.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f5825fcf640 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa29028b40 0x55aa2902f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f58257ce640 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 0x55aa2902f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f58257ce640 1 -- 172.21.15.70:0/2843528463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa29028b40 msgr2=0x55aa2902f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:34.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f58257ce640 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa29028b40 0x55aa2902f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f58257ce640 1 -- 172.21.15.70:0/2843528463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 msgr2=0x55aa2902f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:34.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f58257ce640 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 0x55aa2902f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f58257ce640 1 -- 172.21.15.70:0/2843528463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa28cfe3c0 con 0x55aa290275d0 2024-09-12T01:55:34.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f58257ce640 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 0x55aa29031d70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f58100044e0 tx=0x7f58100047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633442bfeb44f7db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:34.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f58097fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:34.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.895+0000 7f58097fa640 1 -- 172.21.15.70:0/2843528463 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810035070 con 0x55aa290275d0 2024-09-12T01:55:34.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f58097fa640 1 -- 172.21.15.70:0/2843528463 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5810032b20 con 0x55aa290275d0 2024-09-12T01:55:34.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f582a60c740 1 -- 172.21.15.70:0/2843528463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5810005520 con 0x55aa290275d0 2024-09-12T01:55:34.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f58097fa640 1 -- 172.21.15.70:0/2843528463 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f5810032d20 con 0x55aa290275d0 2024-09-12T01:55:34.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f582a60c740 10 client.16713 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:34.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f582a60c740 1 -- 172.21.15.70:0/2843528463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55aa29040ae0 con 0x55aa290275d0 2024-09-12T01:55:34.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f58097fa640 1 -- 172.21.15.70:0/2843528463 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5810005520 con 0x55aa290275d0 2024-09-12T01:55:34.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f58097fa640 1 -- 172.21.15.70:0/2843528463 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f5810003bb0 con 0x55aa290275d0 2024-09-12T01:55:34.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f582a60c740 10 client.16713 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:34.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f582a60c740 10 client.16713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:55:34.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f582a60c740 20 client.16713 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:34.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f582a60c740 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aa29041e30 0x55aa29044220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f582a60c740 4 client.16713 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:55:34.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.896+0000 7f582a60c740 1 -- 172.21.15.70:0/2843528463 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa28f9a860 con 0x55aa29041e30 2024-09-12T01:55:34.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.897+0000 7f5825fcf640 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aa29041e30 0x55aa29044220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.897+0000 7f5825fcf640 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aa29041e30 0x55aa29044220 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c37a8a9d365dc162 server_cookie=2b75a833c515a943 in_seq=0 out_seq=0 2024-09-12T01:55:34.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.897+0000 7f58097fa640 10 client.16713 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:34.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f58097fa640 1 -- 172.21.15.70:0/2843528463 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa28f9a860 con 0x55aa29041e30 2024-09-12T01:55:34.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f58097fa640 10 client.16713 handle_command_reply: tid=0 2024-09-12T01:55:34.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f582a60c740 1 client.16713 shutdown 2024-09-12T01:55:34.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f582a60c740 1 -- 172.21.15.70:0/2843528463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 msgr2=0x55aa29031d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f582a60c740 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 0x55aa29031d70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f58100044e0 tx=0x7f58100047a0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f582a60c740 1 -- 172.21.15.70:0/2843528463 shutdown_connections 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f582a60c740 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aa29041e30 0x55aa29044220 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f582a60c740 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 0x55aa2902f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f582a60c740 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa29028b40 0x55aa2902f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f582a60c740 1 --2- 172.21.15.70:0/2843528463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 0x55aa29031d70 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f58097fa640 0 client.16713 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f582a60c740 1 -- 172.21.15.70:0/2843528463 >> 172.21.15.70:0/2843528463 conn(0x55aa28ff0310 msgr2=0x55aa29029990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f582a60c740 1 -- 172.21.15.70:0/2843528463 shutdown_connections 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f582a60c740 1 -- 172.21.15.70:0/2843528463 wait complete. 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.898+0000 7f582a60c740 20 client.16713 trim_cache size 0 max 16384 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f582a60c740 1 Processor -- start 2024-09-12T01:55:34.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f582a60c740 1 -- start start 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f582a60c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa290275d0 0x55aa2902e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f582a60c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29028b40 0x55aa2902e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f582a60c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 0x55aa29047240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f582a60c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58201af960 con 0x55aa29028b40 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f582a60c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f58201b1650 con 0x55aa29032370 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f582a60c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f58201b0090 con 0x55aa290275d0 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f5825fcf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29028b40 0x55aa2902e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f5825fcf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29028b40 0x55aa2902e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43790/0 (socket says 172.21.15.70:43790) 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f5825fcf640 1 -- 172.21.15.70:0/4176108317 learned_addr learned my addr 172.21.15.70:0/4176108317 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f5825fcf640 1 -- 172.21.15.70:0/4176108317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa290275d0 msgr2=0x55aa2902e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f5825fcf640 1 --2- 172.21.15.70:0/4176108317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa290275d0 0x55aa2902e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f5825fcf640 1 -- 172.21.15.70:0/4176108317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 msgr2=0x55aa29047240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:34.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.911+0000 7f58257ce640 1 --2- 172.21.15.70:0/4176108317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 0x55aa29047240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f5825fcf640 1 --2- 172.21.15.70:0/4176108317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 0x55aa29047240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f5825fcf640 1 -- 172.21.15.70:0/4176108317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa2902d590 con 0x55aa29028b40 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f5825fcf640 1 --2- 172.21.15.70:0/4176108317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29028b40 0x55aa2902e020 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x55aa2902e8b0 tx=0x7f5818012c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746388bd13bffd43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f580b7fe640 1 -- 172.21.15.70:0/4176108317 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5818011a90 con 0x55aa29028b40 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f580b7fe640 1 -- 172.21.15.70:0/4176108317 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5818012e10 con 0x55aa29028b40 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f580b7fe640 1 -- 172.21.15.70:0/4176108317 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58180103d0 con 0x55aa29028b40 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f582a60c740 1 -- 172.21.15.70:0/4176108317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29028b40 msgr2=0x55aa2902e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f582a60c740 1 --2- 172.21.15.70:0/4176108317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29028b40 0x55aa2902e020 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x55aa2902e8b0 tx=0x7f5818012c20 comp rx=0 tx=0).stop 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f582a60c740 1 -- 172.21.15.70:0/4176108317 shutdown_connections 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f582a60c740 1 --2- 172.21.15.70:0/4176108317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 0x55aa29047240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f582a60c740 1 --2- 172.21.15.70:0/4176108317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa29028b40 0x55aa2902e020 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f582a60c740 1 --2- 172.21.15.70:0/4176108317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa290275d0 0x55aa2902e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f582a60c740 1 -- 172.21.15.70:0/4176108317 >> 172.21.15.70:0/4176108317 conn(0x55aa28ff0310 msgr2=0x55aa2902d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f582a60c740 1 -- 172.21.15.70:0/4176108317 shutdown_connections 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.912+0000 7f582a60c740 1 -- 172.21.15.70:0/4176108317 wait complete. 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.913+0000 7f582a60c740 1 -- start start 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.913+0000 7f582a60c740 1 Processor -- start 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.913+0000 7f582a60c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 0x55aa29047390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.913+0000 7f582a60c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa29028b40 0x55aa290478d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.913+0000 7f582a60c740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 0x55aa290447c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.913+0000 7f582a60c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58201b0ec0 con 0x55aa290275d0 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.913+0000 7f582a60c740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f58201b0790 con 0x55aa29032370 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.913+0000 7f582a60c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f58201ad920 con 0x55aa29028b40 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.913+0000 7f582a60c740 10 client.0 _ll_register_callbacks cb 0x7f5810004270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.913+0000 7f58257ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 0x55aa29047390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.913+0000 7f58257ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 0x55aa29047390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43804/0 (socket says 172.21.15.70:43804) 2024-09-12T01:55:34.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.913+0000 7f58257ce640 1 -- 172.21.15.70:0/2408031387 learned_addr learned my addr 172.21.15.70:0/2408031387 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:34.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f5825fcf640 1 --2- 172.21.15.70:0/2408031387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa29028b40 0x55aa290478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f58257ce640 1 -- 172.21.15.70:0/2408031387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa29028b40 msgr2=0x55aa290478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:34.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f58257ce640 1 --2- 172.21.15.70:0/2408031387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa29028b40 0x55aa290478d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f58257ce640 1 -- 172.21.15.70:0/2408031387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 msgr2=0x55aa290447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:55:34.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f58257ce640 1 --2- 172.21.15.70:0/2408031387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 0x55aa290447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f58257ce640 1 -- 172.21.15.70:0/2408031387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa29044ff0 con 0x55aa290275d0 2024-09-12T01:55:34.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f58257ce640 1 --2- 172.21.15.70:0/2408031387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 0x55aa29047390 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f5810004180 tx=0x7f58100041b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b15ae918c9aa0a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:34.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f58097fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-12T01:55:34.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f58097fa640 1 -- 172.21.15.70:0/2408031387 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810060060 con 0x55aa290275d0 2024-09-12T01:55:34.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f58097fa640 1 -- 172.21.15.70:0/2408031387 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f581003dba0 con 0x55aa290275d0 2024-09-12T01:55:34.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f582a60c740 1 -- 172.21.15.70:0/2408031387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5818012e10 con 0x55aa290275d0 2024-09-12T01:55:34.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f58097fa640 1 -- 172.21.15.70:0/2408031387 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f5810035040 con 0x55aa290275d0 2024-09-12T01:55:34.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f582a60c740 10 client.16719 fetch_fsmap learned FSMap version 37 2024-09-12T01:55:34.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f582a60c740 1 -- 172.21.15.70:0/2408031387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55aa290ac290 con 0x55aa290275d0 2024-09-12T01:55:34.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.914+0000 7f58097fa640 1 -- 172.21.15.70:0/2408031387 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5818012e10 con 0x55aa290275d0 2024-09-12T01:55:34.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.915+0000 7f58097fa640 1 -- 172.21.15.70:0/2408031387 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f5810065070 con 0x55aa290275d0 2024-09-12T01:55:34.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.915+0000 7f582a60c740 10 client.16719 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T01:55:34.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.915+0000 7f582a60c740 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-12T01:55:34.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.915+0000 7f582a60c740 20 client.16719 populate_metadata read hostname 'smithi070' 2024-09-12T01:55:34.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.915+0000 7f582a60c740 1 --2- 172.21.15.70:0/2408031387 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aa290ac9b0 0x55aa290aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.915+0000 7f582a60c740 4 client.16719 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T01:55:34.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.915+0000 7f582a60c740 1 -- 172.21.15.70:0/2408031387 --> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aa28f94d70 con 0x55aa290ac9b0 2024-09-12T01:55:34.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.915+0000 7f5825fcf640 1 --2- 172.21.15.70:0/2408031387 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aa290ac9b0 0x55aa290aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.915+0000 7f58097fa640 10 client.16719 ms_handle_connect on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.915+0000 7f5825fcf640 1 --2- 172.21.15.70:0/2408031387 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aa290ac9b0 0x55aa290aedd0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f5eb5bb88626d1 server_cookie=2830d4dc9b0b09c3 in_seq=0 out_seq=0 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f58097fa640 1 -- 172.21.15.70:0/2408031387 <== mds.0 v2:172.21.15.152:6838/3057936512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aa28f94d70 con 0x55aa290ac9b0 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f58097fa640 10 client.16719 handle_command_reply: tid=0 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f582a60c740 1 client.16719 shutdown 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f582a60c740 1 -- 172.21.15.70:0/2408031387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 msgr2=0x55aa29047390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f582a60c740 1 --2- 172.21.15.70:0/2408031387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 0x55aa29047390 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f5810004180 tx=0x7f58100041b0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f582a60c740 1 -- 172.21.15.70:0/2408031387 shutdown_connections 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f582a60c740 1 --2- 172.21.15.70:0/2408031387 >> [v2:172.21.15.152:6838/3057936512,v1:172.21.15.152:6839/3057936512] conn(0x55aa290ac9b0 0x55aa290aedd0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f582a60c740 1 --2- 172.21.15.70:0/2408031387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa29032370 0x55aa290447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f582a60c740 1 --2- 172.21.15.70:0/2408031387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aa29028b40 0x55aa290478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f58097fa640 0 client.16719 ms_handle_reset on v2:172.21.15.152:6838/3057936512 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f582a60c740 1 --2- 172.21.15.70:0/2408031387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa290275d0 0x55aa29047390 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f582a60c740 1 -- 172.21.15.70:0/2408031387 >> 172.21.15.70:0/2408031387 conn(0x55aa28ff0310 msgr2=0x55aa2902e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:34.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f582a60c740 1 -- 172.21.15.70:0/2408031387 shutdown_connections 2024-09-12T01:55:34.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f582a60c740 1 -- 172.21.15.70:0/2408031387 wait complete. 2024-09-12T01:55:34.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f582a60c740 20 client.16719 trim_cache size 0 max 16384 2024-09-12T01:55:34.935 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-12T01:55:34.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f5828233640 1 -- 172.21.15.70:0/1401860403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f580c0a2b80 msgr2=0x7f580c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f5828233640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f580c0a2b80 0x7f580c0a5040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f581c06def0 tx=0x7f581c0c59f0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f5828233640 1 -- 172.21.15.70:0/1401860403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5820108300 msgr2=0x7f58201014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.916+0000 7f5828233640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5820108300 0x7f58201014b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f581c009fd0 tx=0x7f581c00b8e0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.917+0000 7f5828233640 1 -- 172.21.15.70:0/1401860403 shutdown_connections 2024-09-12T01:55:34.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.917+0000 7f5828233640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f580c0a2b80 0x7f580c0a5040 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.917+0000 7f5828233640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5820108300 0x7f58201014b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.917+0000 7f5828233640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5820103780 0x7f5820100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.917+0000 7f5828233640 1 --2- 172.21.15.70:0/1401860403 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5820102dd0 0x7f5820100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.917+0000 7f5828233640 1 -- 172.21.15.70:0/1401860403 >> 172.21.15.70:0/1401860403 conn(0x7f58200fc7d0 msgr2=0x7f58201063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:34.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.917+0000 7f5828233640 1 -- 172.21.15.70:0/1401860403 shutdown_connections 2024-09-12T01:55:34.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:34.917+0000 7f5828233640 1 -- 172.21.15.70:0/1401860403 wait complete. 2024-09-12T01:55:35.800 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-12T01:55:35.801 INFO:tasks.fwd_scrub:done joining 2024-09-12T01:55:35.801 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T01:55:35.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:55:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.922+0000 7f2d9168d640 1 -- 172.21.15.70:0/1712433615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8c100a10 msgr2=0x7f2d8c100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.922+0000 7f2d9168d640 1 --2- 172.21.15.70:0/1712433615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8c100a10 0x7f2d8c100e10 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009900 tx=0x7f2d7c02a410 comp rx=0 tx=0).stop 2024-09-12T01:55:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.922+0000 7f2d9168d640 1 -- 172.21.15.70:0/1712433615 shutdown_connections 2024-09-12T01:55:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.922+0000 7f2d9168d640 1 --2- 172.21.15.70:0/1712433615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d8c1025c0 0x7f2d8c108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.922+0000 7f2d9168d640 1 --2- 172.21.15.70:0/1712433615 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d8c101c00 0x7f2d8c102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.922+0000 7f2d9168d640 1 --2- 172.21.15.70:0/1712433615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8c100a10 0x7f2d8c100e10 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.922+0000 7f2d9168d640 1 -- 172.21.15.70:0/1712433615 >> 172.21.15.70:0/1712433615 conn(0x7f2d8c0fc170 msgr2=0x7f2d8c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.922+0000 7f2d9168d640 1 -- 172.21.15.70:0/1712433615 shutdown_connections 2024-09-12T01:55:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.922+0000 7f2d9168d640 1 -- 172.21.15.70:0/1712433615 wait complete. 2024-09-12T01:55:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.922+0000 7f2d9168d640 1 Processor -- start 2024-09-12T01:55:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.922+0000 7f2d9168d640 1 -- start start 2024-09-12T01:55:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d9168d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d8c100a10 0x7f2d8c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d9168d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8c101c00 0x7f2d8c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d9168d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d8c1025c0 0x7f2d8c19f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d9168d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8c10c7f0 con 0x7f2d8c101c00 2024-09-12T01:55:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d9168d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8c10c670 con 0x7f2d8c100a10 2024-09-12T01:55:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d9168d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8c10c970 con 0x7f2d8c1025c0 2024-09-12T01:55:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d8a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8c101c00 0x7f2d8c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d8a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8c101c00 0x7f2d8c19cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43812/0 (socket says 172.21.15.70:43812) 2024-09-12T01:55:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d8a7fc640 1 -- 172.21.15.70:0/3911010062 learned_addr learned my addr 172.21.15.70:0/3911010062 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d8affd640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d8c100a10 0x7f2d8c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d8b7fe640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d8c1025c0 0x7f2d8c19f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d8a7fc640 1 -- 172.21.15.70:0/3911010062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d8c1025c0 msgr2=0x7f2d8c19f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d8a7fc640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d8c1025c0 0x7f2d8c19f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d8a7fc640 1 -- 172.21.15.70:0/3911010062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d8c100a10 msgr2=0x7f2d8c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d8a7fc640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d8c100a10 0x7f2d8c069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d8a7fc640 1 -- 172.21.15.70:0/3911010062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8c19fbb0 con 0x7f2d8c101c00 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d8a7fc640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8c101c00 0x7f2d8c19cc80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000d950 tx=0x7f2d8000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d73fff640 1 -- 172.21.15.70:0/3911010062 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d80017030 con 0x7f2d8c101c00 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d9168d640 1 -- 172.21.15.70:0/3911010062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d8c19fe40 con 0x7f2d8c101c00 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d73fff640 1 -- 172.21.15.70:0/3911010062 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d80004020 con 0x7f2d8c101c00 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d73fff640 1 -- 172.21.15.70:0/3911010062 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d80004a00 con 0x7f2d8c101c00 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.923+0000 7f2d9168d640 1 -- 172.21.15.70:0/3911010062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d8c1a0300 con 0x7f2d8c101c00 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.924+0000 7f2d9168d640 1 -- 172.21.15.70:0/3911010062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d8c107e20 con 0x7f2d8c101c00 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.926+0000 7f2d73fff640 1 -- 172.21.15.70:0/3911010062 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2d800041d0 con 0x7f2d8c101c00 2024-09-12T01:55:35.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.926+0000 7f2d73fff640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2d740a2b90 0x7f2d740a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:35.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.926+0000 7f2d8affd640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2d740a2b90 0x7f2d740a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:35.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.926+0000 7f2d73fff640 1 -- 172.21.15.70:0/3911010062 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2d800cf180 con 0x7f2d8c101c00 2024-09-12T01:55:35.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.927+0000 7f2d8affd640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2d740a2b90 0x7f2d740a5050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c006010 tx=0x7f2d7c005be0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:35.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:35.930+0000 7f2d73fff640 1 -- 172.21.15.70:0/3911010062 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d8009c0e0 con 0x7f2d8c101c00 2024-09-12T01:55:36.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.097+0000 7f2d9168d640 1 -- 172.21.15.70:0/3911010062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d8c02da10 con 0x7f2d8c101c00 2024-09-12T01:55:36.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.098+0000 7f2d73fff640 1 -- 172.21.15.70:0/3911010062 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22713 (secure 0 0 0) 0x7f2d8009b9e0 con 0x7f2d8c101c00 2024-09-12T01:55:36.099 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:55:36.100 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:50:22.600430+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:49:54.140097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:49:56.005187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:55:36.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.100+0000 7f2d9168d640 1 -- 172.21.15.70:0/3911010062 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2d740a2b90 msgr2=0x7f2d740a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.100+0000 7f2d9168d640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2d740a2b90 0x7f2d740a5050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c006010 tx=0x7f2d7c005be0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.100+0000 7f2d9168d640 1 -- 172.21.15.70:0/3911010062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8c101c00 msgr2=0x7f2d8c19cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.100+0000 7f2d9168d640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8c101c00 0x7f2d8c19cc80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000d950 tx=0x7f2d8000de10 comp rx=0 tx=0).stop 2024-09-12T01:55:36.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.100+0000 7f2d9168d640 1 -- 172.21.15.70:0/3911010062 shutdown_connections 2024-09-12T01:55:36.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.100+0000 7f2d9168d640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f2d740a2b90 0x7f2d740a5050 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.100+0000 7f2d9168d640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2d8c1025c0 0x7f2d8c19f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.100+0000 7f2d9168d640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d8c101c00 0x7f2d8c19cc80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.100+0000 7f2d9168d640 1 --2- 172.21.15.70:0/3911010062 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d8c100a10 0x7f2d8c069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.100+0000 7f2d9168d640 1 -- 172.21.15.70:0/3911010062 >> 172.21.15.70:0/3911010062 conn(0x7f2d8c0fc170 msgr2=0x7f2d8c104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:36.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.100+0000 7f2d9168d640 1 -- 172.21.15.70:0/3911010062 shutdown_connections 2024-09-12T01:55:36.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.100+0000 7f2d9168d640 1 -- 172.21.15.70:0/3911010062 wait complete. 2024-09-12T01:55:36.113 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:45:33.697735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T01:49:54.140097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T01:49:56.005187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:55:36.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:55:36.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.216+0000 7f7e20a47640 1 -- 172.21.15.70:0/2114996913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e1c0ffe10 msgr2=0x7f7e1c100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.216+0000 7f7e20a47640 1 --2- 172.21.15.70:0/2114996913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e1c0ffe10 0x7f7e1c100210 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009900 tx=0x7f7e0c02a410 comp rx=0 tx=0).stop 2024-09-12T01:55:36.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.216+0000 7f7e20a47640 1 -- 172.21.15.70:0/2114996913 shutdown_connections 2024-09-12T01:55:36.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.216+0000 7f7e20a47640 1 --2- 172.21.15.70:0/2114996913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e1c103840 0x7f7e1c10a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.216+0000 7f7e20a47640 1 --2- 172.21.15.70:0/2114996913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e1c102e80 0x7f7e1c103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.216+0000 7f7e20a47640 1 --2- 172.21.15.70:0/2114996913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e1c0ffe10 0x7f7e1c100210 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.216+0000 7f7e20a47640 1 -- 172.21.15.70:0/2114996913 >> 172.21.15.70:0/2114996913 conn(0x7f7e1c0fb910 msgr2=0x7f7e1c0fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.216+0000 7f7e20a47640 1 -- 172.21.15.70:0/2114996913 shutdown_connections 2024-09-12T01:55:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.216+0000 7f7e20a47640 1 -- 172.21.15.70:0/2114996913 wait complete. 2024-09-12T01:55:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e20a47640 1 Processor -- start 2024-09-12T01:55:36.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e20a47640 1 -- start start 2024-09-12T01:55:36.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e20a47640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e1c0ffe10 0x7f7e1c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e20a47640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e1c102e80 0x7f7e1c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e20a47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e1c103840 0x7f7e1c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e20a47640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c10d8f0 con 0x7f7e1c103840 2024-09-12T01:55:36.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e20a47640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c10d770 con 0x7f7e1c102e80 2024-09-12T01:55:36.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e20a47640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c10da70 con 0x7f7e1c0ffe10 2024-09-12T01:55:36.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e1ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e1c103840 0x7f7e1c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e1ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e1c103840 0x7f7e1c19f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43826/0 (socket says 172.21.15.70:43826) 2024-09-12T01:55:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e1ad9d640 1 -- 172.21.15.70:0/3387026492 learned_addr learned my addr 172.21.15.70:0/3387026492 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e13fff640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e1c102e80 0x7f7e1c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e1ad9d640 1 -- 172.21.15.70:0/3387026492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e1c0ffe10 msgr2=0x7f7e1c197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e1a59c640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e1c0ffe10 0x7f7e1c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e1ad9d640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e1c0ffe10 0x7f7e1c197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e1ad9d640 1 -- 172.21.15.70:0/3387026492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e1c102e80 msgr2=0x7f7e1c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e1ad9d640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e1c102e80 0x7f7e1c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e1ad9d640 1 -- 172.21.15.70:0/3387026492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1c19fb00 con 0x7f7e1c103840 2024-09-12T01:55:36.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e13fff640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e1c102e80 0x7f7e1c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:36.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e1a59c640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e1c0ffe10 0x7f7e1c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:36.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.217+0000 7f7e1ad9d640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e1c103840 0x7f7e1c19f490 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400eaa0 tx=0x7f7e1400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:36.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.218+0000 7f7e137fe640 1 -- 172.21.15.70:0/3387026492 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1400cdb0 con 0x7f7e1c103840 2024-09-12T01:55:36.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.218+0000 7f7e137fe640 1 -- 172.21.15.70:0/3387026492 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7e14004b20 con 0x7f7e1c103840 2024-09-12T01:55:36.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.218+0000 7f7e20a47640 1 -- 172.21.15.70:0/3387026492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1c19fdf0 con 0x7f7e1c103840 2024-09-12T01:55:36.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.218+0000 7f7e137fe640 1 -- 172.21.15.70:0/3387026492 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e14011760 con 0x7f7e1c103840 2024-09-12T01:55:36.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.218+0000 7f7e20a47640 1 -- 172.21.15.70:0/3387026492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1c1a02b0 con 0x7f7e1c103840 2024-09-12T01:55:36.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.219+0000 7f7e20a47640 1 -- 172.21.15.70:0/3387026492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e1c108fb0 con 0x7f7e1c103840 2024-09-12T01:55:36.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.220+0000 7f7e137fe640 1 -- 172.21.15.70:0/3387026492 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7e14011900 con 0x7f7e1c103840 2024-09-12T01:55:36.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.220+0000 7f7e137fe640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7e080a2b90 0x7f7e080a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.221+0000 7f7e1a59c640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7e080a2b90 0x7f7e080a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.221+0000 7f7e137fe640 1 -- 172.21.15.70:0/3387026492 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7e140cf710 con 0x7f7e1c103840 2024-09-12T01:55:36.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.221+0000 7f7e1a59c640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7e080a2b90 0x7f7e080a5050 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c000c00 tx=0x7f7e0c009560 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:36.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.224+0000 7f7e137fe640 1 -- 172.21.15.70:0/3387026492 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e14016030 con 0x7f7e1c103840 2024-09-12T01:55:36.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.390+0000 7f7e20a47640 1 -- 172.21.15.70:0/3387026492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7e1c02da10 con 0x7f7e1c103840 2024-09-12T01:55:36.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.391+0000 7f7e137fe640 1 -- 172.21.15.70:0/3387026492 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) ==== 93+0+10 (secure 0 0 0) 0x7f7e1409c630 con 0x7f7e1c103840 2024-09-12T01:55:36.393 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-12T01:55:36.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.393+0000 7f7e20a47640 1 -- 172.21.15.70:0/3387026492 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7e080a2b90 msgr2=0x7f7e080a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.393+0000 7f7e20a47640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7e080a2b90 0x7f7e080a5050 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c000c00 tx=0x7f7e0c009560 comp rx=0 tx=0).stop 2024-09-12T01:55:36.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.393+0000 7f7e20a47640 1 -- 172.21.15.70:0/3387026492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e1c103840 msgr2=0x7f7e1c19f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.393+0000 7f7e20a47640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e1c103840 0x7f7e1c19f490 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400eaa0 tx=0x7f7e1400ef60 comp rx=0 tx=0).stop 2024-09-12T01:55:36.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.393+0000 7f7e20a47640 1 -- 172.21.15.70:0/3387026492 shutdown_connections 2024-09-12T01:55:36.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.393+0000 7f7e20a47640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f7e080a2b90 0x7f7e080a5050 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.393+0000 7f7e20a47640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e1c103840 0x7f7e1c19f490 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.393+0000 7f7e20a47640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e1c102e80 0x7f7e1c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.393+0000 7f7e20a47640 1 --2- 172.21.15.70:0/3387026492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e1c0ffe10 0x7f7e1c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.393+0000 7f7e20a47640 1 -- 172.21.15.70:0/3387026492 >> 172.21.15.70:0/3387026492 conn(0x7f7e1c0fb910 msgr2=0x7f7e1c106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:36.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.393+0000 7f7e20a47640 1 -- 172.21.15.70:0/3387026492 shutdown_connections 2024-09-12T01:55:36.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.393+0000 7f7e20a47640 1 -- 172.21.15.70:0/3387026492 wait complete. 2024-09-12T01:55:36.407 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T01:55:36.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.509+0000 7f3489282640 1 -- 172.21.15.70:0/1829311863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484104eb0 msgr2=0x7f34841072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.509+0000 7f3489282640 1 --2- 172.21.15.70:0/1829311863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484104eb0 0x7f34841072a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f3478009900 tx=0x7f347802a410 comp rx=0 tx=0).stop 2024-09-12T01:55:36.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.509+0000 7f3489282640 1 -- 172.21.15.70:0/1829311863 shutdown_connections 2024-09-12T01:55:36.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.509+0000 7f3489282640 1 --2- 172.21.15.70:0/1829311863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34841077e0 0x7f3484109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.509+0000 7f3489282640 1 --2- 172.21.15.70:0/1829311863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484104eb0 0x7f34841072a0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.509+0000 7f3489282640 1 --2- 172.21.15.70:0/1829311863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3484102580 0x7f3484104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.509+0000 7f3489282640 1 -- 172.21.15.70:0/1829311863 >> 172.21.15.70:0/1829311863 conn(0x7f34840fc140 msgr2=0x7f34840fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.509+0000 7f3489282640 1 -- 172.21.15.70:0/1829311863 shutdown_connections 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.509+0000 7f3489282640 1 -- 172.21.15.70:0/1829311863 wait complete. 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.510+0000 7f3489282640 1 Processor -- start 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.510+0000 7f3489282640 1 -- start start 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.510+0000 7f3489282640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3484102580 0x7f3484198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.510+0000 7f3489282640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3484104eb0 0x7f3484198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.510+0000 7f3489282640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34841077e0 0x7f348419f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.510+0000 7f3489282640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f348410d950 con 0x7f34841077e0 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.510+0000 7f3489282640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f348410d7d0 con 0x7f3484104eb0 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.510+0000 7f3489282640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f348410dad0 con 0x7f3484102580 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.510+0000 7f34837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34841077e0 0x7f348419f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.510+0000 7f34837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34841077e0 0x7f348419f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43846/0 (socket says 172.21.15.70:43846) 2024-09-12T01:55:36.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.510+0000 7f34837fe640 1 -- 172.21.15.70:0/222650138 learned_addr learned my addr 172.21.15.70:0/222650138 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:36.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f3482ffd640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3484102580 0x7f3484198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f34827fc640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3484104eb0 0x7f3484198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f34837fe640 1 -- 172.21.15.70:0/222650138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3484102580 msgr2=0x7f3484198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f34837fe640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3484102580 0x7f3484198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f34837fe640 1 -- 172.21.15.70:0/222650138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3484104eb0 msgr2=0x7f3484198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f34837fe640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3484104eb0 0x7f3484198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f34837fe640 1 -- 172.21.15.70:0/222650138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348419fc20 con 0x7f34841077e0 2024-09-12T01:55:36.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f3482ffd640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3484102580 0x7f3484198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:36.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f34837fe640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34841077e0 0x7f348419f5b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f347c00b3f0 tx=0x7f347c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:36.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f346bfff640 1 -- 172.21.15.70:0/222650138 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c015020 con 0x7f34841077e0 2024-09-12T01:55:36.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f346bfff640 1 -- 172.21.15.70:0/222650138 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f347c011d30 con 0x7f34841077e0 2024-09-12T01:55:36.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f3489282640 1 -- 172.21.15.70:0/222650138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348419ff10 con 0x7f34841077e0 2024-09-12T01:55:36.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f346bfff640 1 -- 172.21.15.70:0/222650138 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c00f2e0 con 0x7f34841077e0 2024-09-12T01:55:36.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.511+0000 7f3489282640 1 -- 172.21.15.70:0/222650138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34841a0400 con 0x7f34841077e0 2024-09-12T01:55:36.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.512+0000 7f3489282640 1 -- 172.21.15.70:0/222650138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34840fdc30 con 0x7f34841077e0 2024-09-12T01:55:36.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.513+0000 7f346bfff640 1 -- 172.21.15.70:0/222650138 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f347c018020 con 0x7f34841077e0 2024-09-12T01:55:36.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.514+0000 7f346bfff640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f346c0a2b90 0x7f346c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.514+0000 7f3482ffd640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f346c0a2b90 0x7f346c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.514+0000 7f346bfff640 1 -- 172.21.15.70:0/222650138 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f347c0ced20 con 0x7f34841077e0 2024-09-12T01:55:36.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.515+0000 7f3482ffd640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f346c0a2b90 0x7f346c0a5050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3474005fd0 tx=0x7f3474009520 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:36.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.518+0000 7f346bfff640 1 -- 172.21.15.70:0/222650138 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f347c01f020 con 0x7f34841077e0 2024-09-12T01:55:36.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.686+0000 7f3489282640 1 -- 172.21.15.70:0/222650138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f348402d7c0 con 0x7f34841077e0 2024-09-12T01:55:36.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.686+0000 7f346bfff640 1 -- 172.21.15.70:0/222650138 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) ==== 104+0+11 (secure 0 0 0) 0x7f347c09bc80 con 0x7f34841077e0 2024-09-12T01:55:36.687 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-12T01:55:36.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.688+0000 7f3489282640 1 -- 172.21.15.70:0/222650138 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f346c0a2b90 msgr2=0x7f346c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.688+0000 7f3489282640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f346c0a2b90 0x7f346c0a5050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3474005fd0 tx=0x7f3474009520 comp rx=0 tx=0).stop 2024-09-12T01:55:36.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.688+0000 7f3489282640 1 -- 172.21.15.70:0/222650138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34841077e0 msgr2=0x7f348419f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.688+0000 7f3489282640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34841077e0 0x7f348419f5b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f347c00b3f0 tx=0x7f347c00b8b0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.688+0000 7f3489282640 1 -- 172.21.15.70:0/222650138 shutdown_connections 2024-09-12T01:55:36.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.688+0000 7f3489282640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f346c0a2b90 0x7f346c0a5050 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.688+0000 7f3489282640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34841077e0 0x7f348419f5b0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.688+0000 7f3489282640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3484104eb0 0x7f3484198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.688+0000 7f3489282640 1 --2- 172.21.15.70:0/222650138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3484102580 0x7f3484198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.688+0000 7f3489282640 1 -- 172.21.15.70:0/222650138 >> 172.21.15.70:0/222650138 conn(0x7f34840fc140 msgr2=0x7f3484102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:36.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.688+0000 7f3489282640 1 -- 172.21.15.70:0/222650138 shutdown_connections 2024-09-12T01:55:36.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.688+0000 7f3489282640 1 -- 172.21.15.70:0/222650138 wait complete. 2024-09-12T01:55:36.699 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:36 smithi070 ceph-mon[31177]: pgmap v440: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T01:55:36.699 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:36 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3911010062' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:36.699 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:36 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/3387026492' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:55:36.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T01:55:36.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.801+0000 7febaa227640 1 -- 172.21.15.70:0/2439406744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba41099c0 msgr2=0x7feba410be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.801+0000 7febaa227640 1 --2- 172.21.15.70:0/2439406744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba41099c0 0x7feba410be50 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009ca0 tx=0x7feb9c02a950 comp rx=0 tx=0).stop 2024-09-12T01:55:36.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.801+0000 7febaa227640 1 -- 172.21.15.70:0/2439406744 shutdown_connections 2024-09-12T01:55:36.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.801+0000 7febaa227640 1 --2- 172.21.15.70:0/2439406744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba41099c0 0x7feba410be50 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.801+0000 7febaa227640 1 --2- 172.21.15.70:0/2439406744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feba4074bd0 0x7feba4075030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.801+0000 7febaa227640 1 --2- 172.21.15.70:0/2439406744 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feba40761b0 0x7feba4074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.801+0000 7febaa227640 1 -- 172.21.15.70:0/2439406744 >> 172.21.15.70:0/2439406744 conn(0x7feba40fd2b0 msgr2=0x7feba40ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:36.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.801+0000 7febaa227640 1 -- 172.21.15.70:0/2439406744 shutdown_connections 2024-09-12T01:55:36.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.801+0000 7febaa227640 1 -- 172.21.15.70:0/2439406744 wait complete. 2024-09-12T01:55:36.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.802+0000 7febaa227640 1 Processor -- start 2024-09-12T01:55:36.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.802+0000 7febaa227640 1 -- start start 2024-09-12T01:55:36.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.802+0000 7febaa227640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba4074bd0 0x7feba419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.802+0000 7febaa227640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feba40761b0 0x7feba419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.802+0000 7febaa227640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feba41099c0 0x7feba41a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.802+0000 7febaa227640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feba410fad0 con 0x7feba4074bd0 2024-09-12T01:55:36.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.802+0000 7febaa227640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7feba410f950 con 0x7feba40761b0 2024-09-12T01:55:36.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.802+0000 7febaa227640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feba410fc50 con 0x7feba41099c0 2024-09-12T01:55:36.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.802+0000 7feba37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba4074bd0 0x7feba419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.802+0000 7feba37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba4074bd0 0x7feba419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43866/0 (socket says 172.21.15.70:43866) 2024-09-12T01:55:36.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.802+0000 7feba37fe640 1 -- 172.21.15.70:0/973236153 learned_addr learned my addr 172.21.15.70:0/973236153 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:36.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7feba2ffd640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feba40761b0 0x7feba419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7feba3fff640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feba41099c0 0x7feba41a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7feba37fe640 1 -- 172.21.15.70:0/973236153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feba41099c0 msgr2=0x7feba41a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7feba37fe640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feba41099c0 0x7feba41a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7feba37fe640 1 -- 172.21.15.70:0/973236153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feba40761b0 msgr2=0x7feba419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7feba37fe640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feba40761b0 0x7feba419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7feba37fe640 1 -- 172.21.15.70:0/973236153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba41a1d40 con 0x7feba4074bd0 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7feba3fff640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feba41099c0 0x7feba41a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7feba37fe640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba4074bd0 0x7feba419a120 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7feb9400d770 tx=0x7feb9400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7feba0ff9640 1 -- 172.21.15.70:0/973236153 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94017070 con 0x7feba4074bd0 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7feba0ff9640 1 -- 172.21.15.70:0/973236153 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feb94005520 con 0x7feba4074bd0 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7feba0ff9640 1 -- 172.21.15.70:0/973236153 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94010460 con 0x7feba4074bd0 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7febaa227640 1 -- 172.21.15.70:0/973236153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba41a1fd0 con 0x7feba4074bd0 2024-09-12T01:55:36.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.803+0000 7febaa227640 1 -- 172.21.15.70:0/973236153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba41a2440 con 0x7feba4074bd0 2024-09-12T01:55:36.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.804+0000 7febaa227640 1 -- 172.21.15.70:0/973236153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba4108070 con 0x7feba4074bd0 2024-09-12T01:55:36.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.805+0000 7feba0ff9640 1 -- 172.21.15.70:0/973236153 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7feb94004ea0 con 0x7feba4074bd0 2024-09-12T01:55:36.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.806+0000 7feba0ff9640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7feb8c0a2b90 0x7feb8c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.806+0000 7feba2ffd640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7feb8c0a2b90 0x7feb8c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.806+0000 7feba0ff9640 1 -- 172.21.15.70:0/973236153 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7feb940ceaf0 con 0x7feba4074bd0 2024-09-12T01:55:36.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.806+0000 7feba2ffd640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7feb8c0a2b90 0x7feb8c0a5050 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feba419b630 tx=0x7feb9800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:36.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.810+0000 7feba0ff9640 1 -- 172.21.15.70:0/973236153 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb9409ba50 con 0x7feba4074bd0 2024-09-12T01:55:36.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:36 smithi191 ceph-mon[35770]: pgmap v440: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T01:55:36.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:36 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3911010062' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:36.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:36 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/3387026492' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:55:36.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.976+0000 7febaa227640 1 -- 172.21.15.70:0/973236153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7feba4062e90 con 0x7feba4074bd0 2024-09-12T01:55:36.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.977+0000 7feba0ff9640 1 -- 172.21.15.70:0/973236153 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) ==== 100+0+11 (secure 0 0 0) 0x7feb9409b350 con 0x7feba4074bd0 2024-09-12T01:55:36.978 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-12T01:55:36.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.978+0000 7febaa227640 1 -- 172.21.15.70:0/973236153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7feb8c0a2b90 msgr2=0x7feb8c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.978+0000 7febaa227640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7feb8c0a2b90 0x7feb8c0a5050 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feba419b630 tx=0x7feb9800b410 comp rx=0 tx=0).stop 2024-09-12T01:55:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.978+0000 7febaa227640 1 -- 172.21.15.70:0/973236153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba4074bd0 msgr2=0x7feba419a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.978+0000 7febaa227640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba4074bd0 0x7feba419a120 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7feb9400d770 tx=0x7feb9400dc30 comp rx=0 tx=0).stop 2024-09-12T01:55:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.978+0000 7febaa227640 1 -- 172.21.15.70:0/973236153 shutdown_connections 2024-09-12T01:55:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.978+0000 7febaa227640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7feb8c0a2b90 0x7feb8c0a5050 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.978+0000 7febaa227640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feba41099c0 0x7feba41a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.978+0000 7febaa227640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feba40761b0 0x7feba419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.978+0000 7febaa227640 1 --2- 172.21.15.70:0/973236153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba4074bd0 0x7feba419a120 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.978+0000 7febaa227640 1 -- 172.21.15.70:0/973236153 >> 172.21.15.70:0/973236153 conn(0x7feba40fd2b0 msgr2=0x7feba410bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.979+0000 7febaa227640 1 -- 172.21.15.70:0/973236153 shutdown_connections 2024-09-12T01:55:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:36.979+0000 7febaa227640 1 -- 172.21.15.70:0/973236153 wait complete. 2024-09-12T01:55:36.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T01:55:37.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:36 smithi152 ceph-mon[35055]: pgmap v440: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-12T01:55:37.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:36 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3911010062' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:55:37.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:36 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/3387026492' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:55:37.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.088+0000 7f44b1837640 1 -- 172.21.15.70:0/2140791898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44ac101b30 msgr2=0x7f44ac101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:37.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.088+0000 7f44b1837640 1 --2- 172.21.15.70:0/2140791898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44ac101b30 0x7f44ac101f30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f449c009ca0 tx=0x7f449c02a8c0 comp rx=0 tx=0).stop 2024-09-12T01:55:37.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 -- 172.21.15.70:0/2140791898 shutdown_connections 2024-09-12T01:55:37.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 --2- 172.21.15.70:0/2140791898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44ac1036e0 0x7f44ac109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:37.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 --2- 172.21.15.70:0/2140791898 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44ac102d20 0x7f44ac1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:37.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 --2- 172.21.15.70:0/2140791898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44ac101b30 0x7f44ac101f30 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:37.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 -- 172.21.15.70:0/2140791898 >> 172.21.15.70:0/2140791898 conn(0x7f44ac0fd2b0 msgr2=0x7f44ac0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:37.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 -- 172.21.15.70:0/2140791898 shutdown_connections 2024-09-12T01:55:37.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 -- 172.21.15.70:0/2140791898 wait complete. 2024-09-12T01:55:37.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 Processor -- start 2024-09-12T01:55:37.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 -- start start 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44ac101b30 0x7f44ac197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44ac102d20 0x7f44ac198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44ac1036e0 0x7f44ac19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac10d910 con 0x7f44ac101b30 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac10d790 con 0x7f44ac102d20 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.089+0000 7f44b1837640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac10da90 con 0x7f44ac1036e0 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44aaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44ac101b30 0x7f44ac197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44aaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44ac101b30 0x7f44ac197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43888/0 (socket says 172.21.15.70:43888) 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44aaffd640 1 -- 172.21.15.70:0/1098168904 learned_addr learned my addr 172.21.15.70:0/1098168904 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44aa7fc640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44ac102d20 0x7f44ac198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44ab7fe640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44ac1036e0 0x7f44ac19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44aaffd640 1 -- 172.21.15.70:0/1098168904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44ac1036e0 msgr2=0x7f44ac19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44aaffd640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44ac1036e0 0x7f44ac19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:37.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44aaffd640 1 -- 172.21.15.70:0/1098168904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44ac102d20 msgr2=0x7f44ac198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:37.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44aaffd640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44ac102d20 0x7f44ac198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:37.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44aaffd640 1 -- 172.21.15.70:0/1098168904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44ac19fb40 con 0x7f44ac101b30 2024-09-12T01:55:37.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44ab7fe640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44ac1036e0 0x7f44ac19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:37.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44aaffd640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44ac101b30 0x7f44ac197f20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f449c000f80 tx=0x7f449c02f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:37.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44b0835640 1 -- 172.21.15.70:0/1098168904 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c02fdc0 con 0x7f44ac101b30 2024-09-12T01:55:37.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44b0835640 1 -- 172.21.15.70:0/1098168904 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f449c031df0 con 0x7f44ac101b30 2024-09-12T01:55:37.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44b0835640 1 -- 172.21.15.70:0/1098168904 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c0469e0 con 0x7f44ac101b30 2024-09-12T01:55:37.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44b1837640 1 -- 172.21.15.70:0/1098168904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44ac19fdd0 con 0x7f44ac101b30 2024-09-12T01:55:37.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.090+0000 7f44b1837640 1 -- 172.21.15.70:0/1098168904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44ac1a0230 con 0x7f44ac101b30 2024-09-12T01:55:37.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.091+0000 7f44b1837640 1 -- 172.21.15.70:0/1098168904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44ac108ed0 con 0x7f44ac101b30 2024-09-12T01:55:37.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.092+0000 7f44b0835640 1 -- 172.21.15.70:0/1098168904 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f449c0305c0 con 0x7f44ac101b30 2024-09-12T01:55:37.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.093+0000 7f44b0835640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f44940a2b90 0x7f44940a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:37.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.093+0000 7f44aa7fc640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f44940a2b90 0x7f44940a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:37.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.094+0000 7f44b0835640 1 -- 172.21.15.70:0/1098168904 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f449c0f0680 con 0x7f44ac101b30 2024-09-12T01:55:37.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.094+0000 7f44aa7fc640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f44940a2b90 0x7f44940a5050 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f44ac199430 tx=0x7f44a000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:37.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.098+0000 7f44b0835640 1 -- 172.21.15.70:0/1098168904 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f449c0bd5a0 con 0x7f44ac101b30 2024-09-12T01:55:37.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.312+0000 7f44b1837640 1 -- 172.21.15.70:0/1098168904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f44ac062ec0 con 0x7f44ac101b30 2024-09-12T01:55:37.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.320+0000 7f44b0835640 1 -- 172.21.15.70:0/1098168904 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740367 (secure 0 0 0) 0x7f449c0bcea0 con 0x7f44ac101b30 2024-09-12T01:55:37.332 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:55:37.332 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 18, 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: "active_gid": 14148, 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: "active_name": "x", 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: "active_addrs": { 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 633920150 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 633920150 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: "active_addr": "172.21.15.70:6801/633920150", 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: "active_change": "2024-09-12T01:43:21.394841+0000", 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: "available": true, 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: "standbys": [ 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: "gid": 24115, 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "z", 2024-09-12T01:55:37.334 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_features": 4540701547738038271, 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:37.335 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.336 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.338 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.339 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-09-12T01:55:37.341 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-09-12T01:55:37.342 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-09-12T01:55:37.343 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-09-12T01:55:37.344 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-09-12T01:55:37.345 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.345 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.345 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.345 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.345 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.345 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.345 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-09-12T01:55:37.345 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-09-12T01:55:37.346 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-09-12T01:55:37.347 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.348 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.348 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-09-12T01:55:37.348 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-09-12T01:55:37.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.348 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.348 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.348 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.348 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.349 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.350 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.352 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.353 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.354 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.355 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-09-12T01:55:37.355 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-09-12T01:55:37.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.355 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.355 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T01:55:37.355 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.355 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.355 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.355 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-09-12T01:55:37.356 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.357 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-12T01:55:37.358 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.359 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.360 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.361 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.362 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.364 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.364 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.364 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.364 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.364 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.364 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.364 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.364 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-09-12T01:55:37.365 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-09-12T01:55:37.365 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:37.365 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.365 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:37.365 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.365 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.365 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.365 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T01:55:37.365 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-09-12T01:55:37.366 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.367 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:37.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-09-12T01:55:37.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-09-12T01:55:37.370 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.372 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.373 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.373 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T01:55:37.373 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.373 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.373 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-09-12T01:55:37.373 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-09-12T01:55:37.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-09-12T01:55:37.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.375 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.375 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-09-12T01:55:37.375 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.375 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.375 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.375 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T01:55:37.375 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-09-12T01:55:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-09-12T01:55:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.376 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.377 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.378 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.379 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-09-12T01:55:37.380 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.381 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.382 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.383 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.384 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.385 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.386 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.387 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-09-12T01:55:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-09-12T01:55:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T01:55:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-09-12T01:55:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-09-12T01:55:37.391 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.392 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.393 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.394 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.395 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.396 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.397 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.398 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.399 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-09-12T01:55:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-09-12T01:55:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-09-12T01:55:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.400 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.402 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-09-12T01:55:37.403 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.404 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-09-12T01:55:37.405 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.405 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.405 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.405 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-09-12T01:55:37.405 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.405 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.405 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-09-12T01:55:37.405 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-09-12T01:55:37.405 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.405 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.406 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.407 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:37.407 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.407 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.407 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.407 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-09-12T01:55:37.407 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.407 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.407 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-09-12T01:55:37.408 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-09-12T01:55:37.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.408 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.408 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T01:55:37.408 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.408 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.408 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.408 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T01:55:37.408 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.408 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.409 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.410 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-09-12T01:55:37.410 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-09-12T01:55:37.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.410 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.410 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.410 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.410 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.410 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.410 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T01:55:37.410 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T01:55:37.411 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.412 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.413 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.414 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.414 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.414 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.414 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.414 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T01:55:37.414 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.414 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.414 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.414 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.415 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.416 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.417 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.418 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-09-12T01:55:37.419 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.420 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.421 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.422 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.422 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.422 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T01:55:37.422 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.422 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.422 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-09-12T01:55:37.422 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.423 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.426 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.427 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.427 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-09-12T01:55:37.427 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-09-12T01:55:37.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.427 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.427 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.427 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.427 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.427 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.427 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.428 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.429 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.430 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.431 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.432 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.433 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.434 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.436 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.438 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.439 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.440 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.441 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.442 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.443 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.444 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.445 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.446 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.447 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.448 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T01:55:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T01:55:37.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T01:55:37.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T01:55:37.452 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.453 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.453 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.453 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.453 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.453 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.453 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.453 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.453 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.453 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.454 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T01:55:37.455 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T01:55:37.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.455 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.455 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.455 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.455 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.455 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.455 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.455 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.456 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.457 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.458 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.458 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.458 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T01:55:37.458 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T01:55:37.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.458 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.458 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.462 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.464 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.464 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.464 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.464 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.464 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.464 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.464 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.464 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.465 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.466 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.467 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T01:55:37.468 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T01:55:37.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.468 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.468 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.468 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.468 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.468 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.468 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.468 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.468 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.469 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.472 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.473 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.474 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.474 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.474 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.474 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T01:55:37.474 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T01:55:37.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.474 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.476 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.476 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.476 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.476 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.476 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.476 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.476 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.480 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.481 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.482 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T01:55:37.482 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T01:55:37.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.482 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.482 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T01:55:37.482 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.482 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.482 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.482 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.482 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.483 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.484 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.485 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.486 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.487 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.488 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.489 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.490 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.491 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.492 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.493 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.494 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.495 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-09-12T01:55:37.496 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.497 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.498 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.499 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.499 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.499 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.499 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.499 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.499 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.499 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.499 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.499 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.499 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.500 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.501 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.502 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.503 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.503 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.503 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.503 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.503 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.503 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.503 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.503 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.503 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.504 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.506 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.508 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.509 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.510 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.510 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.510 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.510 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-12T01:55:37.510 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-12T01:55:37.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.510 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.510 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.510 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-09-12T01:55:37.510 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.510 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.511 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.511 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.511 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-09-12T01:55:37.511 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.511 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.511 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.511 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.511 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-12T01:55:37.511 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.512 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.514 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.515 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.516 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.518 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.519 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.520 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.521 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.523 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-09-12T01:55:37.523 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.523 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.523 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.523 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-09-12T01:55:37.523 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.523 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.523 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.524 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-09-12T01:55:37.524 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-09-12T01:55:37.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.524 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.524 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-12T01:55:37.524 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.524 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.524 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T01:55:37.524 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.524 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T01:55:37.525 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T01:55:37.526 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.527 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.529 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.530 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.531 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-09-12T01:55:37.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-09-12T01:55:37.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:37.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.537 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.538 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.539 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.540 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.540 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-09-12T01:55:37.540 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.540 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.540 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:37.540 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:37.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.540 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.540 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.540 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.541 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.542 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.544 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.546 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.547 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-12T01:55:37.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-09-12T01:55:37.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-09-12T01:55:37.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-09-12T01:55:37.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-09-12T01:55:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-09-12T01:55:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:55:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.553 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.556 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.557 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.558 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.559 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.560 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.561 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.562 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.564 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.565 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-09-12T01:55:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T01:55:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.566 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.567 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.568 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.569 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.572 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.573 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.574 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.575 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.576 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.578 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.579 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-09-12T01:55:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-09-12T01:55:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-09-12T01:55:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-09-12T01:55:37.580 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T01:55:37.581 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-09-12T01:55:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T01:55:37.583 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.585 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.586 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.587 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.588 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.589 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.592 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.593 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.594 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.596 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.599 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.600 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-09-12T01:55:37.601 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.603 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.604 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.605 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.606 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.607 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-09-12T01:55:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.609 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.610 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.611 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.612 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-09-12T01:55:37.614 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.615 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.617 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.618 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.623 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.624 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T01:55:37.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.628 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-12T01:55:37.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.630 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.631 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.636 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.638 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.639 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.643 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.644 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.645 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.647 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:37.648 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.649 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-09-12T01:55:37.649 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.649 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.649 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.649 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.649 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.649 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.649 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.650 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.651 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-09-12T01:55:37.652 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-09-12T01:55:37.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.652 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.652 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-09-12T01:55:37.652 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.652 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.652 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.652 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.653 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.653 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.653 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-12T01:55:37.653 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-12T01:55:37.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.653 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.653 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.653 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-09-12T01:55:37.653 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.654 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.655 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.656 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.658 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.659 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.660 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.661 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.662 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.663 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-09-12T01:55:37.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.665 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.666 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.666 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.666 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.666 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.666 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.666 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.666 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.666 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.667 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.668 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.669 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.670 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.671 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.675 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.676 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.677 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.678 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-09-12T01:55:37.679 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.680 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.681 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.681 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.681 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.681 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.681 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.681 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.681 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.681 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.681 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.681 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.682 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.684 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.685 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.687 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.688 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.689 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.690 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-09-12T01:55:37.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-09-12T01:55:37.692 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-09-12T01:55:37.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-09-12T01:55:37.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-09-12T01:55:37.695 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-09-12T01:55:37.696 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-09-12T01:55:37.697 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-09-12T01:55:37.698 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-09-12T01:55:37.699 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-09-12T01:55:37.700 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-09-12T01:55:37.701 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-09-12T01:55:37.702 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.704 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.705 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.706 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.709 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.710 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.711 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.712 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.713 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.714 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.715 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.718 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.719 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.719 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.719 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.719 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.719 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.719 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.719 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.719 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.720 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.721 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.721 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.721 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.721 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.721 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.721 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.721 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.722 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.723 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.723 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.723 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.723 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.723 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.723 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.723 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.723 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.724 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.724 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.724 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.725 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-09-12T01:55:37.725 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.725 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.725 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.725 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-09-12T01:55:37.725 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-09-12T01:55:37.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.726 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.726 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T01:55:37.726 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.726 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.726 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.726 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.726 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.726 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.726 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.728 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.728 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.728 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.728 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.728 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.728 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.728 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.728 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.728 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.729 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.729 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.729 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.729 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.729 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.729 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.729 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.729 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.729 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.730 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.731 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.732 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.732 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.732 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.732 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.732 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.732 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.732 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.732 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-09-12T01:55:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-09-12T01:55:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-09-12T01:55:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.735 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.735 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T01:55:37.735 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.735 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.735 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-09-12T01:55:37.735 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-09-12T01:55:37.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.735 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-09-12T01:55:37.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-09-12T01:55:37.737 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-09-12T01:55:37.738 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-09-12T01:55:37.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.739 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.739 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.739 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.739 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.739 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.739 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T01:55:37.739 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.740 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.741 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.741 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.741 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.741 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-09-12T01:55:37.741 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-09-12T01:55:37.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.741 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.741 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.741 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.741 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T01:55:37.742 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.743 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.743 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.743 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.743 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.743 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.743 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-12T01:55:37.743 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-12T01:55:37.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.743 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.744 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.744 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.744 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.744 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.744 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.744 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.744 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.744 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:37.744 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:37.744 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.745 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.745 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-09-12T01:55:37.745 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-09-12T01:55:37.745 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.745 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.745 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.745 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.746 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.746 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-09-12T01:55:37.746 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-09-12T01:55:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-09-12T01:55:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-09-12T01:55:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-09-12T01:55:37.748 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.749 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.749 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.749 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.749 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.749 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.749 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.749 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.749 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.749 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.750 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-09-12T01:55:37.750 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-09-12T01:55:37.750 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.750 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.750 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.750 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.750 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.750 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.751 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.754 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.755 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.756 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.757 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.757 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.757 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.757 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.757 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.757 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.757 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-09-12T01:55:37.758 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-09-12T01:55:37.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.758 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.758 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.758 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.758 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.758 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.758 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.758 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.758 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.758 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.758 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.759 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-09-12T01:55:37.759 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-09-12T01:55:37.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.759 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.760 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T01:55:37.760 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.760 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.760 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.760 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.760 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.760 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.761 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.761 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-09-12T01:55:37.761 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.761 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.762 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.762 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.762 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.762 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.762 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.762 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.762 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.762 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.763 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.763 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.763 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.763 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.763 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.763 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.763 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.763 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.763 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.763 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.764 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.764 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.764 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.764 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.764 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.764 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.764 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.764 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.765 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.765 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.765 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.765 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.765 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.765 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.766 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.766 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.766 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.766 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.766 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.766 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.766 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.766 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.766 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.766 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.766 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.767 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.767 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.767 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.767 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.767 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.767 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.767 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.767 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.768 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.768 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.768 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.768 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.768 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.768 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.768 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.768 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.769 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-09-12T01:55:37.769 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.769 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.769 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.769 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.769 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.769 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.769 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.769 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.770 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.770 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.770 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.770 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.770 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.770 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.770 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.770 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.770 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.770 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.770 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.771 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.771 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.771 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.771 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.771 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.771 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.772 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.773 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.774 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.775 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.776 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-09-12T01:55:37.776 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-09-12T01:55:37.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.776 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.776 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.776 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.776 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.776 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.776 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-09-12T01:55:37.776 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.777 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.777 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-09-12T01:55:37.777 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-09-12T01:55:37.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.778 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.778 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:37.778 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.778 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.778 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.778 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.779 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.780 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-09-12T01:55:37.781 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-09-12T01:55:37.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:37.781 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.781 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-09-12T01:55:37.782 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.782 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.782 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.782 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.782 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.782 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.782 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.782 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-09-12T01:55:37.782 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-09-12T01:55:37.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.782 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:37.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.784 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.785 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.785 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.785 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.785 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.785 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.786 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.786 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.786 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.786 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.786 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.787 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.787 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.787 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.787 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.787 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.788 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.788 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.788 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.789 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.789 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.789 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.790 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.790 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.790 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.790 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.790 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.791 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.791 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.791 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.792 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.792 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.792 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.792 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.792 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.793 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.793 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.793 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.793 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.793 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.794 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.794 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.794 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.794 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.794 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.795 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.795 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.795 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.796 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.796 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.796 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.796 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.796 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.796 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.797 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.797 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-09-12T01:55:37.797 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-09-12T01:55:37.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.798 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.798 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.798 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.798 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.798 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.799 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.799 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.799 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.799 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.800 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-09-12T01:55:37.800 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-09-12T01:55:37.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.800 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.800 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.801 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-09-12T01:55:37.801 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.801 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.801 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.801 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.802 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.802 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.802 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-09-12T01:55:37.802 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-09-12T01:55:37.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.803 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.803 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T01:55:37.803 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.803 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.804 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.804 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.804 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.804 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.804 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.804 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-12T01:55:37.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: "gid": 24119, 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "y", 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_features": 4540701547738038271, 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:37.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.806 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.807 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.808 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.809 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.810 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.811 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.812 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-09-12T01:55:37.814 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-09-12T01:55:37.815 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.816 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.817 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.818 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.819 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T01:55:37.819 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.819 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.819 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.819 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-09-12T01:55:37.819 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-09-12T01:55:37.819 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.819 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.819 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.819 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.819 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.820 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.820 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.820 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-09-12T01:55:37.820 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.820 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.820 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.821 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.822 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-12T01:55:37.823 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-12T01:55:37.824 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.824 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T01:55:37.824 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:55:37.824 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.824 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.824 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-09-12T01:55:37.824 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-09-12T01:55:37.825 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:37.825 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.825 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.825 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-09-12T01:55:37.825 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-12T01:55:37.825 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-09-12T01:55:37.825 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.825 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T01:55:37.825 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.825 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.826 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-09-12T01:55:37.826 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-09-12T01:55:37.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.826 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.826 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T01:55:37.826 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.826 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.826 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.826 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T01:55:37.826 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T01:55:37.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.827 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.827 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-09-12T01:55:37.827 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-09-12T01:55:37.827 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:37.827 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.827 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-09-12T01:55:37.827 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-09-12T01:55:37.827 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-09-12T01:55:37.828 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.829 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.830 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.831 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.832 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.833 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.835 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.835 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.835 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.835 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.835 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.835 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.835 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.835 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.835 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.836 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-09-12T01:55:37.836 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-09-12T01:55:37.836 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:37.836 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.836 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.836 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:37.836 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.836 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.836 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.836 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.837 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-09-12T01:55:37.838 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:37.839 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.840 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-12T01:55:37.843 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.844 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.844 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.844 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T01:55:37.844 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.844 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.844 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-09-12T01:55:37.844 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-09-12T01:55:37.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.844 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.845 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.846 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-09-12T01:55:37.846 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.846 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.846 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.846 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T01:55:37.846 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.846 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.846 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.847 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-09-12T01:55:37.847 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-09-12T01:55:37.847 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.847 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.847 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.847 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.847 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.847 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.847 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.848 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T01:55:37.848 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T01:55:37.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.848 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.848 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-09-12T01:55:37.848 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-09-12T01:55:37.849 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.849 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.849 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.849 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:37.849 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.849 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.850 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.850 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T01:55:37.850 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.850 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.850 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.850 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-09-12T01:55:37.850 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T01:55:37.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:37.850 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.851 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-09-12T01:55:37.851 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.851 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.851 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.851 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T01:55:37.851 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.852 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.852 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.852 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-09-12T01:55:37.852 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-09-12T01:55:37.852 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.852 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.853 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.853 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.853 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.853 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.853 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.853 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-09-12T01:55:37.853 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-09-12T01:55:37.853 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-09-12T01:55:37.853 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.854 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.855 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T01:55:37.855 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.855 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.855 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.855 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-09-12T01:55:37.855 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-09-12T01:55:37.855 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.855 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.855 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.855 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.855 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.857 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.857 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.857 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.857 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T01:55:37.857 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.857 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.857 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.857 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-09-12T01:55:37.857 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-09-12T01:55:37.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.858 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.858 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T01:55:37.858 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.858 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.858 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.858 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-12T01:55:37.858 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.858 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.859 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.860 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.860 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-09-12T01:55:37.860 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-09-12T01:55:37.860 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.860 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.860 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.860 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T01:55:37.860 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.860 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.860 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.861 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-09-12T01:55:37.861 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.861 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.861 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.861 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-09-12T01:55:37.861 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-09-12T01:55:37.861 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.861 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.861 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.861 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T01:55:37.862 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.862 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.862 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.862 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-12T01:55:37.862 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.862 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.862 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.862 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-09-12T01:55:37.862 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-09-12T01:55:37.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.863 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.863 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.863 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T01:55:37.863 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.863 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.863 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.863 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-09-12T01:55:37.863 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.863 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.864 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-09-12T01:55:37.864 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-09-12T01:55:37.864 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.864 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.864 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.864 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T01:55:37.864 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-09-12T01:55:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-09-12T01:55:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-09-12T01:55:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T01:55:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-09-12T01:55:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.867 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-09-12T01:55:37.867 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-09-12T01:55:37.867 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.867 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.867 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.867 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T01:55:37.867 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.867 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.867 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.867 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-09-12T01:55:37.867 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.867 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.868 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.868 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-09-12T01:55:37.868 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-09-12T01:55:37.868 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.868 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.868 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.868 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T01:55:37.868 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.868 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.868 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.868 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-09-12T01:55:37.869 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.869 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.869 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.869 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-09-12T01:55:37.869 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-09-12T01:55:37.869 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.869 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.869 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.870 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-09-12T01:55:37.871 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.872 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.872 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.872 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T01:55:37.872 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.872 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.872 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.872 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-09-12T01:55:37.872 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.872 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.872 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.873 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.874 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-09-12T01:55:37.875 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.876 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-09-12T01:55:37.877 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.877 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.877 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.877 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-09-12T01:55:37.877 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-09-12T01:55:37.877 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.877 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.877 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.878 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.878 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.878 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.878 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.878 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T01:55:37.878 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.878 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.878 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.879 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-09-12T01:55:37.879 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-09-12T01:55:37.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.879 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.879 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:37.879 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.879 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.879 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.879 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T01:55:37.879 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.880 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.880 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-09-12T01:55:37.880 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T01:55:37.880 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.880 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.880 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.880 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-09-12T01:55:37.880 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.880 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.880 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.880 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.881 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.882 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.883 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.884 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.884 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.884 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T01:55:37.884 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.884 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.884 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.884 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-09-12T01:55:37.884 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-09-12T01:55:37.884 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.885 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.885 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.885 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:37.885 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.885 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.885 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.885 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-09-12T01:55:37.885 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.885 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.885 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.886 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-09-12T01:55:37.886 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-09-12T01:55:37.886 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.886 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.886 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T01:55:37.886 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.887 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.889 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.890 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.890 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.890 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.890 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.890 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T01:55:37.890 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.890 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.890 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.890 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.891 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.891 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.891 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.891 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.891 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.891 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.891 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.891 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.891 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.891 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.892 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.892 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.892 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.892 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.892 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.892 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.892 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.892 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-09-12T01:55:37.892 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-09-12T01:55:37.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.893 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.893 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.893 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.893 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.893 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.893 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.893 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T01:55:37.893 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.894 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.894 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.894 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.894 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.894 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.894 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.894 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.895 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.897 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.898 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.898 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T01:55:37.898 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T01:55:37.898 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.898 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.898 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.898 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.898 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.898 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.899 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T01:55:37.899 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.899 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.899 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.899 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T01:55:37.899 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T01:55:37.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.899 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-09-12T01:55:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T01:55:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-09-12T01:55:37.900 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.901 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.903 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-09-12T01:55:37.903 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-09-12T01:55:37.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.903 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.903 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.903 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.903 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.904 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.904 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-09-12T01:55:37.904 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.904 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.904 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-12T01:55:37.904 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-12T01:55:37.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.904 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.905 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.907 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.908 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-09-12T01:55:37.908 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-09-12T01:55:37.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.908 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.908 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.908 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.908 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.908 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.908 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T01:55:37.908 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-09-12T01:55:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T01:55:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-09-12T01:55:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-09-12T01:55:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T01:55:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-09-12T01:55:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-09-12T01:55:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T01:55:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-09-12T01:55:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-09-12T01:55:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T01:55:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-09-12T01:55:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-09-12T01:55:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-09-12T01:55:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-09-12T01:55:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T01:55:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-09-12T01:55:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-09-12T01:55:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-09-12T01:55:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T01:55:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-09-12T01:55:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T01:55:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T01:55:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T01:55:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T01:55:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T01:55:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T01:55:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T01:55:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T01:55:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T01:55:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T01:55:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T01:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T01:55:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T01:55:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T01:55:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T01:55:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-09-12T01:55:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-09-12T01:55:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-09-12T01:55:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-12T01:55:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-09-12T01:55:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T01:55:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-09-12T01:55:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-09-12T01:55:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.039 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.040 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.041 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.041 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-09-12T01:55:38.041 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.041 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.041 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.041 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T01:55:38.041 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.041 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.041 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.041 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-09-12T01:55:38.041 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:38.042 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.043 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.044 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.045 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.046 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.048 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.049 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.050 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.051 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-09-12T01:55:38.053 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.054 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.055 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.056 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.056 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.056 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.056 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.056 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.056 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.056 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.056 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.056 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.056 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.057 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.058 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.059 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.060 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.061 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.062 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.063 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.064 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.065 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.066 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.067 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:38.068 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.069 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.070 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.072 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.073 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.075 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.076 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.077 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.078 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.079 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-09-12T01:55:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-09-12T01:55:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-09-12T01:55:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-09-12T01:55:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-09-12T01:55:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T01:55:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-09-12T01:55:38.084 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-09-12T01:55:38.085 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.087 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.088 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.089 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.090 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.093 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.094 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.096 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.097 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.098 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.099 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.100 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.101 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.104 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.105 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.115 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.116 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.118 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.120 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.124 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.125 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.126 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.129 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.130 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-09-12T01:55:38.131 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.132 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.133 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.134 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.135 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.136 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.138 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.139 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.140 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-09-12T01:55:38.141 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-09-12T01:55:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.143 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.144 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.145 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.146 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.147 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.148 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.149 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.150 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.151 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.152 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.153 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.154 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-09-12T01:55:38.155 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-12T01:55:38.156 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.158 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.161 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.163 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T01:55:38.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-09-12T01:55:38.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.167 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.168 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.169 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.170 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.171 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.172 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.173 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-12T01:55:38.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-12T01:55:38.175 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.177 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.180 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.181 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.182 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.183 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.184 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.186 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.187 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.188 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T01:55:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-09-12T01:55:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.189 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.190 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.191 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.193 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.195 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.197 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.198 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.199 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.200 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.203 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-09-12T01:55:38.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-09-12T01:55:38.205 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-09-12T01:55:38.206 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.212 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.213 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-09-12T01:55:38.215 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.216 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.218 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.219 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.220 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.221 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.222 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.223 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.228 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.230 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.231 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.232 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.234 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.236 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-09-12T01:55:38.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-09-12T01:55:38.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-09-12T01:55:38.239 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.240 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.241 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.243 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.244 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.245 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.246 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.247 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.248 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.249 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.252 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.253 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.267 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.269 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T01:55:38.271 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.272 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-09-12T01:55:38.273 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.274 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.275 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.277 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.279 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.281 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.284 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: "modules": [ 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: "dashboard", 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: "iostat", 2024-09-12T01:55:38.285 INFO:teuthology.orchestra.run.smithi070.stdout: "nfs", 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: "restful" 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.288 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.289 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.290 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.294 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.295 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T01:55:38.299 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-09-12T01:55:38.300 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.301 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.302 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-09-12T01:55:38.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:38.304 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.304 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:38.304 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-12T01:55:38.304 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-12T01:55:38.304 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.304 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T01:55:38.304 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:55:38.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.304 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.304 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.305 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.307 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T01:55:38.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T01:55:38.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.310 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.312 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.313 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.314 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.315 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T01:55:38.316 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.316 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.316 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-12T01:55:38.316 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-12T01:55:38.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.316 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.316 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-09-12T01:55:38.316 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.316 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-09-12T01:55:38.317 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.318 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.319 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-09-12T01:55:38.320 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-09-12T01:55:38.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.320 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.320 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-12T01:55:38.320 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-12T01:55:38.320 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.320 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.320 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T01:55:38.320 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T01:55:38.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.320 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.321 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-09-12T01:55:38.321 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-09-12T01:55:38.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:38.321 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.321 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:38.321 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.321 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.321 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.321 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T01:55:38.321 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-09-12T01:55:38.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-09-12T01:55:38.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-09-12T01:55:38.324 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.325 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.326 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.327 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.329 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.330 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.331 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.332 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T01:55:38.333 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T01:55:38.334 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.335 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.338 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T01:55:38.341 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.341 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.341 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.341 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-09-12T01:55:38.341 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.341 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.341 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-09-12T01:55:38.341 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-09-12T01:55:38.342 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-09-12T01:55:38.343 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.344 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.345 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.346 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.347 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.352 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T01:55:38.354 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.355 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.357 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.358 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:38.359 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.360 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.361 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.364 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.365 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.366 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.367 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T01:55:38.368 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.368 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.368 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.368 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.368 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.368 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.368 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.368 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.371 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.372 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.373 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.373 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-09-12T01:55:38.373 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-09-12T01:55:38.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.373 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.373 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T01:55:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T01:55:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T01:55:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T01:55:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T01:55:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T01:55:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T01:55:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T01:55:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T01:55:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T01:55:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T01:55:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T01:55:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T01:55:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T01:55:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T01:55:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-12T01:55:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-09-12T01:55:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-09-12T01:55:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-09-12T01:55:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-09-12T01:55:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-09-12T01:55:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-12T01:55:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-09-12T01:55:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-09-12T01:55:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-12T01:55:38.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-09-12T01:55:38.500 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.501 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.502 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.504 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.506 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.507 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.508 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-09-12T01:55:38.509 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.510 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.512 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.513 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.514 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-09-12T01:55:38.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-09-12T01:55:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.517 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.518 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.519 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.520 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.521 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-09-12T01:55:38.523 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.524 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.525 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.526 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.527 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.528 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.529 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.530 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.531 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-09-12T01:55:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-09-12T01:55:38.533 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.534 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.535 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.536 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.536 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.536 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.536 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.536 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.536 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.536 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.536 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.536 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.536 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.536 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.537 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.538 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.541 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.548 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.549 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.550 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.551 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.554 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.555 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.556 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.557 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.558 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.559 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.560 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.561 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.562 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.563 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.565 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.566 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.567 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.568 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.569 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.570 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-09-12T01:55:38.571 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.572 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.575 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.576 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:38.577 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-12T01:55:38.578 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.579 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.580 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.581 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.582 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.584 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.585 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.586 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-09-12T01:55:38.587 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.588 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-09-12T01:55:38.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.590 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.590 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.590 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.590 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.590 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.590 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.590 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.590 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.590 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.591 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.592 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.593 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.594 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.597 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.598 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.599 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T01:55:38.600 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T01:55:38.601 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.602 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.603 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-12T01:55:38.604 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.605 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.606 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.607 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.610 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.611 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.612 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.613 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-09-12T01:55:38.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-12T01:55:38.615 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.616 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.617 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.618 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.619 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.621 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.623 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.626 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.627 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.628 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.630 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.631 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.632 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.633 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.634 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.635 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.636 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.638 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.639 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.642 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.643 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.644 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.645 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.646 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.647 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.648 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.649 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-09-12T01:55:38.650 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.651 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.652 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.653 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.654 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.655 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.657 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.658 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.659 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.660 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.661 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.662 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.663 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.664 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.665 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.666 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.667 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-09-12T01:55:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-09-12T01:55:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-09-12T01:55:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-09-12T01:55:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-09-12T01:55:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-12T01:55:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-12T01:55:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "services": { 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "dashboard": "https://172.21.15.70:8443/" 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "always_on_modules": { 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "octopus": [ 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-12T01:55:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "pacific": [ 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-12T01:55:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "quincy": [ 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-12T01:55:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "reef": [ 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-12T01:55:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "squid": [ 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-12T01:55:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "last_failure_osd_epoch": 3, 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "active_clients": [ 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3471713785 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "libcephsqlite", 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 110357308 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2790890908 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-12T01:55:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-12T01:55:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-12T01:55:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2750318068 2024-09-12T01:55:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-12T01:55:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-12T01:55:38.739 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:55:38.740 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:37 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/222650138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:55:38.740 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:37 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/973236153' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:55:38.740 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:37 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1098168904' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T01:55:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:37 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/222650138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:55:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:37 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/973236153' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:55:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:37 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1098168904' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T01:55:38.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.325+0000 7f44b1837640 1 -- 172.21.15.70:0/1098168904 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f44940a2b90 msgr2=0x7f44940a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:38.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.325+0000 7f44b1837640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f44940a2b90 0x7f44940a5050 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f44ac199430 tx=0x7f44a000b410 comp rx=0 tx=0).stop 2024-09-12T01:55:38.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.325+0000 7f44b1837640 1 -- 172.21.15.70:0/1098168904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44ac101b30 msgr2=0x7f44ac197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:38.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.325+0000 7f44b1837640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44ac101b30 0x7f44ac197f20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f449c000f80 tx=0x7f449c02f840 comp rx=0 tx=0).stop 2024-09-12T01:55:38.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.325+0000 7f44b1837640 1 -- 172.21.15.70:0/1098168904 shutdown_connections 2024-09-12T01:55:38.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.325+0000 7f44b1837640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f44940a2b90 0x7f44940a5050 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.325+0000 7f44b1837640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44ac1036e0 0x7f44ac19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.325+0000 7f44b1837640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44ac102d20 0x7f44ac198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.325+0000 7f44b1837640 1 --2- 172.21.15.70:0/1098168904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44ac101b30 0x7f44ac197f20 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:38.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.325+0000 7f44b1837640 1 -- 172.21.15.70:0/1098168904 >> 172.21.15.70:0/1098168904 conn(0x7f44ac0fd2b0 msgr2=0x7f44ac1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:38.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.326+0000 7f44b1837640 1 -- 172.21.15.70:0/1098168904 shutdown_connections 2024-09-12T01:55:38.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:37.326+0000 7f44b1837640 1 -- 172.21.15.70:0/1098168904 wait complete. 2024-09-12T01:55:38.752 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T01:55:38.752 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T01:55:38.753 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:37 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/222650138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T01:55:38.753 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:37 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/973236153' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T01:55:38.753 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:37 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1098168904' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T01:55:38.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:38 smithi191 ceph-mon[35770]: pgmap v441: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-12T01:55:39.010 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:39.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:38 smithi152 ceph-mon[35055]: pgmap v441: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-12T01:55:39.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:38 smithi070 ceph-mon[31177]: pgmap v441: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-12T01:55:39.468 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:55:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:55:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 685, 2024-09-12T01:55:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 685, 2024-09-12T01:55:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 4400179, 2024-09-12T01:55:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 217007, 2024-09-12T01:55:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 6, 2024-09-12T01:55:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 2, 2024-09-12T01:55:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.057509934, 2024-09-12T01:55:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.016676513, 2024-09-12T01:55:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.019349926, 2024-09-12T01:55:39.469 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.016350055, 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 684, 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.024612600, 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000035983 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T01:55:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 380, 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 367, 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 603358, 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 143800, 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.035996383, 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.012354765, 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.017343300, 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.007900969, 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 366, 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.014902542, 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000040717 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 528048, 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 60416 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:55:39.472 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 2, 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 75, 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 428, 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 207758, 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.006039018, 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.004022876, 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.001383246, 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000021591, 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 73, 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.004476949, 2024-09-12T01:55:39.473 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000061328 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 207440 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-12T01:55:39.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1573, 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.038536921, 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000024498 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.475 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 0, 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 0, 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 0, 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2024-09-12T01:55:39.476 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 0, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 872, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 0, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 872, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 0, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 872, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 0, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 0, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 0, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 1, 2024-09-12T01:55:39.477 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-09-12T01:55:39.478 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:55:39.479 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 0, 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 0, 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 0 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 0, 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 0, 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 0, 2024-09-12T01:55:39.480 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-09-12T01:55:39.481 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 0, 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 0, 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2024-09-12T01:55:39.482 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 1870, 2024-09-12T01:55:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-09-12T01:55:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2024-09-12T01:55:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 0, 2024-09-12T01:55:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2024-09-12T01:55:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2024-09-12T01:55:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 4, 2024-09-12T01:55:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 2, 2024-09-12T01:55:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-09-12T01:55:39.483 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2024-09-12T01:55:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 4194304, 2024-09-12T01:55:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 8397838, 2024-09-12T01:55:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 8396700, 2024-09-12T01:55:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-09-12T01:55:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 1870 2024-09-12T01:55:39.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 5, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 898, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 893, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 3, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 102, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 99, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 872, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 1765, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 893, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 0, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 0, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 0, 2024-09-12T01:55:39.485 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 48764, 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 215328 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 0, 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 0, 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 0, 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 0, 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 0, 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.486 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.487 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.488 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-09-12T01:55:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-09-12T01:55:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.489 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-09-12T01:55:39.490 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-09-12T01:55:39.491 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.492 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.493 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-09-12T01:55:39.494 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.495 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.496 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-09-12T01:55:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-09-12T01:55:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.497 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 1, 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 2, 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 1, 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 1, 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 0, 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 0, 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 1207, 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.499 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:55:39.500 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:55:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:55:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:55:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-12T01:55:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:55:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-12T01:55:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:55:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:55:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:55:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:55:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:55:39.501 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:55:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:55:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-12T01:55:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:55:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:55:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:55:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-12T01:55:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-12T01:55:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-12T01:55:39.502 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:55:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:55:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:55:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:55:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 189217, 2024-09-12T01:55:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 48, 2024-09-12T01:55:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:55:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-12T01:55:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-12T01:55:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-12T01:55:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:55:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-12T01:55:39.503 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 7592, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 156, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 629448, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 3528, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-12T01:55:39.504 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 944, 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 21, 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 3, 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 944, 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 944, 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.858988408, 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000909945 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.505 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 944, 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 945 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 944, 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 944, 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 0, 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 588, 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 0, 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 354, 2024-09-12T01:55:39.506 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 0, 2024-09-12T01:55:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 0, 2024-09-12T01:55:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-09-12T01:55:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-09-12T01:55:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-09-12T01:55:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2024-09-12T01:55:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 0, 2024-09-12T01:55:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-09-12T01:55:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-09-12T01:55:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-09-12T01:55:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 1, 2024-09-12T01:55:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 0, 2024-09-12T01:55:39.507 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-09-12T01:55:39.508 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-09-12T01:55:39.509 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 83, 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 2, 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 5, 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 5, 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 0, 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 2, 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 0 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 0, 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:55:39.510 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "osd-slow-ops": { 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 0, 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 0, 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 0, 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-09-12T01:55:39.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 1063, 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 4899294, 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 1063, 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1063, 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 4899294, 2024-09-12T01:55:39.512 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:39.513 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 944, 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 4203881, 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 944, 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 4203881, 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-12T01:55:39.514 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 944, 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 944, 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 944, 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 944, 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.515 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.516 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x55f69c296b40": { 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-12T01:55:39.517 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-12T01:55:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-09-12T01:55:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-09-12T01:55:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-12T01:55:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:39.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:39.518 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:55:40.441 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-12T01:55:40.441 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-12T01:55:40.441 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T01:55:40.441 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T01:55:40.694 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:40.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:40 smithi070 ceph-mon[31177]: pgmap v442: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:55:40.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:40 smithi191 ceph-mon[35770]: pgmap v442: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:55:41.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:40 smithi152 ceph-mon[35055]: pgmap v442: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:55:41.145 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:55:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:55:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 4, 2024-09-12T01:55:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 4, 2024-09-12T01:55:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2992, 2024-09-12T01:55:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 448, 2024-09-12T01:55:41.145 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.002994503, 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000043491, 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.002171949, 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3, 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.003958104, 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001319368 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:41.146 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 1, 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 78, 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 160, 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 92208, 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 3, 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 2, 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.005775387, 2024-09-12T01:55:41.147 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.004010442, 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.001001363, 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 76, 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.003799757, 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000049996 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:41.148 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 92208 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 107, 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 104, 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 446304, 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 62768, 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.015087908, 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.006907816, 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.011311564, 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:55:41.149 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 103, 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.005402473, 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000052451 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 446304, 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 62768 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-12T01:55:41.150 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:55:41.151 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:55:41.152 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 148801, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 27, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:55:41.153 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-12T01:55:41.154 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 108, 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 431223, 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:41.155 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 108, 2024-09-12T01:55:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-12T01:55:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-12T01:55:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 108, 2024-09-12T01:55:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 431223, 2024-09-12T01:55:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-12T01:55:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:41.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:41.156 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:55:41.885 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T01:55:41.885 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T01:55:41.885 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T01:55:41.886 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T01:55:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:42.572 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:55:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:55:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 520, 2024-09-12T01:55:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 506, 2024-09-12T01:55:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 657686, 2024-09-12T01:55:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 188596, 2024-09-12T01:55:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-09-12T01:55:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.054018705, 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.022064802, 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.022208263, 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.009991622, 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 505, 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.020715752, 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000041021 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 529488, 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 62032 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 555, 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 630, 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 11865044, 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 385637, 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.043540371, 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.012532342, 2024-09-12T01:55:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.016876474, 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.011250783, 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 628, 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.017002418, 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000027073 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T01:55:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 209408 2024-09-12T01:55:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:55:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 8, 2024-09-12T01:55:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 8, 2024-09-12T01:55:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 4621, 2024-09-12T01:55:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 1732, 2024-09-12T01:55:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-09-12T01:55:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2024-09-12T01:55:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.003036539, 2024-09-12T01:55:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000095140, 2024-09-12T01:55:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.002839511, 2024-09-12T01:55:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000073738, 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 7, 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.006253110, 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000893301 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T01:55:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1632, 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.035429624, 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000021709 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-09-12T01:55:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 0, 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 0, 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 0, 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 0, 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 2331, 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 0, 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 2331, 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 0, 2024-09-12T01:55:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 2331, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 0, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 0, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 0, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 1, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 0, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 0, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 0, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 0, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 0, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-09-12T01:55:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:55:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 0, 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 0 2024-09-12T01:55:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 0, 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 0, 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 0, 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 0, 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 0, 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 0, 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 0, 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 0, 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-09-12T01:55:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-09-12T01:55:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 0, 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 5367, 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 0, 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 7, 2024-09-12T01:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 2, 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 4194304, 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 15917336, 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 15908745, 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 5367 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-09-12T01:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 9, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 2351, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 2342, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 7, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 224, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 217, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 2331, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 4673, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 2342, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 0, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 0, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 0, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 54096, 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 215328 2024-09-12T01:55:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-09-12T01:55:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 0, 2024-09-12T01:55:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 0, 2024-09-12T01:55:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 0, 2024-09-12T01:55:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 0, 2024-09-12T01:55:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 0, 2024-09-12T01:55:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-09-12T01:55:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-09-12T01:55:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-09-12T01:55:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-09-12T01:55:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-09-12T01:55:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-09-12T01:55:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-09-12T01:55:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-09-12T01:55:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-09-12T01:55:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-09-12T01:55:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-09-12T01:55:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-09-12T01:55:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-09-12T01:55:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:55:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 1, 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 2, 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 1, 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 1, 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 0, 2024-09-12T01:55:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 0, 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 1214, 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:55:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:55:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:55:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 197255, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 50, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 7592, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 156, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:55:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 1670592, 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 9407, 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 956, 2024-09-12T01:55:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 21, 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 3, 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 956, 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 956, 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 1.209983643, 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001265673 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 956, 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 957 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 956, 2024-09-12T01:55:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 956, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 0, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 597, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 0, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 357, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 0, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 0, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 0, 2024-09-12T01:55:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 1, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:55:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-09-12T01:55:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 83, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 2, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 6, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 6, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 0, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 2, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 0 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 0, 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "osd-slow-ops": { 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-09-12T01:55:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 0, 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 0, 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 0, 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 1079, 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 12421097, 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 1079, 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-12T01:55:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1079, 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 12421097, 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-12T01:55:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 956, 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 11723037, 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 956, 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 11723037, 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 956, 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 956, 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 956, 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 956, 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-12T01:55:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-09-12T01:55:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-09-12T01:55:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-12T01:55:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x55ffc83f4b40": { 2024-09-12T01:55:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:42.622 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:55:42.934 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:42 smithi070 ceph-mon[31177]: pgmap v443: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-12T01:55:42.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:42 smithi191 ceph-mon[35770]: pgmap v443: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-12T01:55:43.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:42 smithi152 ceph-mon[35055]: pgmap v443: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-12T01:55:43.623 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-12T01:55:43.623 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-12T01:55:43.624 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T01:55:43.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T01:55:43.874 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:44.316 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-12T01:55:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:55:44.316 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 0, 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2, 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 0, 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 0, 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.001055214, 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.000238023, 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:44.317 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:55:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:55:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:55:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 113, 2024-09-12T01:55:44.318 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 108, 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 449840, 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 64496, 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.016234642, 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.006008999, 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.013622350, 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 108, 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.008749972, 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000081018 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:44.319 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 449840, 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 64496 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 1, 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 80, 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 160, 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 92560, 2024-09-12T01:55:44.320 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 3, 2024-09-12T01:55:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 2, 2024-09-12T01:55:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.006311066, 2024-09-12T01:55:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.004418885, 2024-09-12T01:55:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.001153866, 2024-09-12T01:55:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T01:55:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 78, 2024-09-12T01:55:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.003582976, 2024-09-12T01:55:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000045935 2024-09-12T01:55:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:44.321 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 92560 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:55:44.322 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-12T01:55:44.323 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-12T01:55:44.324 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-12T01:55:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:55:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:55:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:55:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:55:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 148840, 2024-09-12T01:55:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 28, 2024-09-12T01:55:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:55:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-12T01:55:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-12T01:55:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-12T01:55:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:55:44.325 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-12T01:55:44.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 110, 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 431483, 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 110, 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 110, 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 431483, 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-12T01:55:44.327 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-12T01:55:44.328 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-12T01:55:44.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:44 smithi191 ceph-mon[35770]: pgmap v444: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-12T01:55:45.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:44 smithi152 ceph-mon[35055]: pgmap v444: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-12T01:55:45.016 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:44 smithi070 ceph-mon[31177]: pgmap v444: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-12T01:55:45.134 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T01:55:45.135 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T01:55:45.135 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T01:55:45.135 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T01:55:45.398 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:55:45.877 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-12T01:55:45.877 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:55:45.877 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 43515, 2024-09-12T01:55:45.877 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 76981, 2024-09-12T01:55:45.877 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 16630518, 2024-09-12T01:55:45.877 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 71724899, 2024-09-12T01:55:45.877 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 20, 2024-09-12T01:55:45.877 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 3, 2024-09-12T01:55:45.877 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 2.830099051, 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 1.338546917, 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 6.491233203, 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.211248727, 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 76979, 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 7.771406437, 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000100954 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 98074, 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.013598327, 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000138 2024-09-12T01:55:45.878 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 13158608, 2024-09-12T01:55:45.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 35338208 2024-09-12T01:55:45.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.879 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:55:45.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 12143, 2024-09-12T01:55:45.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 11630, 2024-09-12T01:55:45.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 4515043, 2024-09-12T01:55:45.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 28506358, 2024-09-12T01:55:45.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 11, 2024-09-12T01:55:45.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 5, 2024-09-12T01:55:45.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.719993768, 2024-09-12T01:55:45.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.269204149, 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.169408918, 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.269551522, 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 11628, 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 11.478705594, 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000987160 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2284, 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000350057, 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000153 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T01:55:45.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 213968 2024-09-12T01:55:45.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.881 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:55:45.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 9674, 2024-09-12T01:55:45.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 8217, 2024-09-12T01:55:45.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 3860759, 2024-09-12T01:55:45.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 28951367, 2024-09-12T01:55:45.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 92, 2024-09-12T01:55:45.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 10, 2024-09-12T01:55:45.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.665327796, 2024-09-12T01:55:45.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.282707969, 2024-09-12T01:55:45.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.289565945, 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.138020553, 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 8217, 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3.703302825, 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000450687 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7517, 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.001092538, 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000145 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 567552, 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 74720 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.882 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2899, 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 21.403241358, 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.007382973 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-12T01:55:45.883 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 8775, 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2.162329903, 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000246419 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 17704, 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 17643, 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 17643, 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 47.009921358, 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002664508 2024-09-12T01:55:45.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 61, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 6, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 2, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 1351, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 19, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 8, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 261, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 154, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 92, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 15, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 19, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 6415, 2024-09-12T01:55:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 1, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 1, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 5, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 18860, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 18703, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 37, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 0, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 13, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 44, 2024-09-12T01:55:45.886 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 6210, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 27, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 361, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 1149, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 4, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 234, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 1149, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:55:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 159, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 6, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 153, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 990, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 33, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 2035, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 16140, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 15622, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 10112, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 75, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 6478 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.888 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 0, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 45, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 2, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 4837, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 4835, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2024-09-12T01:55:45.889 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_path": 3, 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_inode": 1067, 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 6, 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 44, 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 27, 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2024-09-12T01:55:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 35102, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 35088, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 35088, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 14, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 312, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 54, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 53, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 53, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 1, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 1, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2024-09-12T01:55:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 1, 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 77016419, 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 77040363, 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1180, 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 50.972648732, 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.043197159 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 36, 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 11093, 2024-09-12T01:55:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 11057, 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 51, 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 816, 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 765, 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 261, 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 13427, 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 13166, 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 1, 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 11926, 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 11925, 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 98172, 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 231712 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2024-09-12T01:55:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 18989, 2024-09-12T01:55:45.896 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 1091, 2024-09-12T01:55:45.896 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 17704, 2024-09-12T01:55:45.896 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 54, 2024-09-12T01:55:45.896 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 2204, 2024-09-12T01:55:45.896 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2024-09-12T01:55:45.896 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 10433, 2024-09-12T01:55:45.896 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 18.319019191, 2024-09-12T01:55:45.896 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001755872 2024-09-12T01:55:45.896 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.896 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2024-09-12T01:55:45.897 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 25, 2024-09-12T01:55:45.897 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.105809038, 2024-09-12T01:55:45.897 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.004232361 2024-09-12T01:55:45.897 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.897 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2024-09-12T01:55:45.897 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.897 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.897 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.897 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.897 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1065, 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.501690050, 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001410037 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.898 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.899 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2024-09-12T01:55:45.899 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.899 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.899 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.899 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.899 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2024-09-12T01:55:45.899 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.899 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.899 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.899 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.899 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2024-09-12T01:55:45.899 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.900 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.900 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.900 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.900 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2024-09-12T01:55:45.900 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.900 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.900 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.901 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.901 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2024-09-12T01:55:45.901 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.901 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.901 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.901 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.901 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2024-09-12T01:55:45.902 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 623, 2024-09-12T01:55:45.902 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.786294406, 2024-09-12T01:55:45.902 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001262109 2024-09-12T01:55:45.902 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.902 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2024-09-12T01:55:45.902 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.902 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.902 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.903 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.903 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2024-09-12T01:55:45.903 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.903 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.903 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.903 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.903 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2024-09-12T01:55:45.903 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2, 2024-09-12T01:55:45.903 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000676348, 2024-09-12T01:55:45.903 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000338174 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 646, 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.018503070, 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001576630 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2, 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.001915911, 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000957955 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2024-09-12T01:55:45.904 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 169, 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 16.641000305, 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.098467457 2024-09-12T01:55:45.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 3, 2024-09-12T01:55:45.906 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.587723182, 2024-09-12T01:55:45.907 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.529241060 2024-09-12T01:55:45.907 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.907 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2024-09-12T01:55:45.907 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.907 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.907 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.907 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.907 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2024-09-12T01:55:45.907 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.907 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7, 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.018674861, 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002667837 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.908 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4668, 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 7.028614996, 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001505701 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2024-09-12T01:55:45.909 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 2, 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 1, 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 7966, 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 7966, 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 231, 2024-09-12T01:55:45.910 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:55:45.911 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:55:45.912 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:55:45.912 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:55:45.912 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:55:45.912 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:55:45.912 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-09-12T01:55:45.912 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:55:45.912 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-09-12T01:55:45.912 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:55:45.912 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:55:45.913 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 319025, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 114, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 7592, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 156, 2024-09-12T01:55:45.914 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 350327, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 3817, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 22778, 2024-09-12T01:55:45.915 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 91595508, 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 37, 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 22778, 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 22778, 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3092.393544961, 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.135762294 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 22778, 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 51348 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.916 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 22778, 2024-09-12T01:55:45.917 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 1228, 2024-09-12T01:55:45.917 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 21550, 2024-09-12T01:55:45.917 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2024-09-12T01:55:45.917 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2024-09-12T01:55:45.917 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 577, 2024-09-12T01:55:45.917 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 13271, 2024-09-12T01:55:45.917 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 65, 2024-09-12T01:55:45.917 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 1239, 2024-09-12T01:55:45.917 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 96, 2024-09-12T01:55:45.917 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 19, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 5479, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 1163, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 26542, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2024-09-12T01:55:45.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2024-09-12T01:55:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2024-09-12T01:55:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:55:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2024-09-12T01:55:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:55:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2024-09-12T01:55:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2024-09-12T01:55:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2024-09-12T01:55:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2024-09-12T01:55:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2024-09-12T01:55:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2024-09-12T01:55:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2024-09-12T01:55:45.919 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 83, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 2, 2024-09-12T01:55:45.920 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 2748, 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 16, 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 133 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2024-09-12T01:55:45.921 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 1065 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 20, 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 6, 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed_ops": 4875, 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 4835, 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.922 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 65328, 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 17399603, 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 65328, 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 65328, 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 17399603, 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:45.923 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:45.924 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 22778, 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 92083755, 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 22778, 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 92083755, 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2024-09-12T01:55:45.925 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 22778, 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 22778, 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 22778, 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 22778, 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.926 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 4835, 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 488351, 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 4835, 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 59, 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 488351, 2024-09-12T01:55:45.927 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x5605e244c960": { 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 35102, 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 72846059, 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 35102, 2024-09-12T01:55:45.928 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-12T01:55:45.929 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-12T01:55:45.929 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1180, 2024-09-12T01:55:45.929 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 72846059, 2024-09-12T01:55:45.929 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:45.929 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:45.929 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:45.929 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:45.929 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:45.929 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:45.929 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-12T01:55:46.564 INFO:tasks.check_counter:Daemon mds.b mds.exported=44 2024-09-12T01:55:46.564 INFO:tasks.check_counter:Daemon mds.b mds.imported=27 2024-09-12T01:55:46.564 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T01:55:46.564 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T01:55:46.825 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:55:46.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:46 smithi191 ceph-mon[35770]: pgmap v445: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-09-12T01:55:46.946 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:46 smithi152 ceph-mon[35055]: pgmap v445: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-09-12T01:55:47.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:46 smithi070 ceph-mon[31177]: pgmap v445: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-09-12T01:55:47.313 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-12T01:55:47.313 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:55:47.313 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 695, 2024-09-12T01:55:47.313 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 696, 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 33762350, 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 220702, 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 7, 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 3, 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.078843882, 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.023759260, 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.032869905, 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.015942058, 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 694, 2024-09-12T01:55:47.314 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.026782330, 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000038591 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T01:55:47.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 210, 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 195, 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 21529920, 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 90706, 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 5, 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 4, 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.038012206, 2024-09-12T01:55:47.316 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.008837458, 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.031685350, 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.001574984, 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 195, 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.017546327, 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000089981 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.317 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:47.318 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.318 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.318 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.318 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 533728, 2024-09-12T01:55:47.318 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 65200 2024-09-12T01:55:47.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.318 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:55:47.318 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 419, 2024-09-12T01:55:47.318 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 497, 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 18427677, 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 344477, 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 6, 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 5, 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.046413213, 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.011574133, 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.019786148, 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.011565095, 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 495, 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.018194062, 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000036755 2024-09-12T01:55:47.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 211552 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1940, 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.153104152, 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000078919 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-09-12T01:55:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 0, 2024-09-12T01:55:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 0, 2024-09-12T01:55:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2024-09-12T01:55:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2024-09-12T01:55:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 0, 2024-09-12T01:55:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2024-09-12T01:55:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2024-09-12T01:55:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 0, 2024-09-12T01:55:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 0, 2024-09-12T01:55:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2024-09-12T01:55:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 5289, 2024-09-12T01:55:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 3688, 2024-09-12T01:55:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 1601, 2024-09-12T01:55:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 0, 2024-09-12T01:55:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 19, 2024-09-12T01:55:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 0, 2024-09-12T01:55:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 0, 2024-09-12T01:55:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 0, 2024-09-12T01:55:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 2, 2024-09-12T01:55:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 0, 2024-09-12T01:55:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 0, 2024-09-12T01:55:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 0, 2024-09-12T01:55:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 0, 2024-09-12T01:55:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:55:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2024-09-12T01:55:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2024-09-12T01:55:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 0, 2024-09-12T01:55:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2024-09-12T01:55:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 0, 2024-09-12T01:55:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 0, 2024-09-12T01:55:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 0, 2024-09-12T01:55:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 0, 2024-09-12T01:55:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2024-09-12T01:55:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 4, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 234, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:55:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 0, 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 0, 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 0 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 0, 2024-09-12T01:55:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2024-09-12T01:55:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 0, 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 0, 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2024-09-12T01:55:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 35102, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 0, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 2, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 16, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 77016419, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 77040363, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 77037866, 2024-09-12T01:55:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 35102 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 25, 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 11069, 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 11044, 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 40, 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 795, 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 755, 2024-09-12T01:55:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 5289, 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 13266, 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 7977, 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 0, 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 0, 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 0, 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 64396, 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 215328 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 0, 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 0, 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 0, 2024-09-12T01:55:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 0, 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 0, 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.333 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.334 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.335 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.336 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2024-09-12T01:55:47.337 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.337 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.337 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.337 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2024-09-12T01:55:47.337 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.337 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.338 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.338 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2024-09-12T01:55:47.338 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.338 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.338 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.338 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2024-09-12T01:55:47.338 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.338 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.338 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.339 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.340 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.340 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2024-09-12T01:55:47.340 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.340 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.340 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.340 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2024-09-12T01:55:47.340 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.340 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.340 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2024-09-12T01:55:47.341 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.343 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2024-09-12T01:55:47.343 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.343 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.343 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.343 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2024-09-12T01:55:47.343 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.343 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.343 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.343 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2024-09-12T01:55:47.343 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.344 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.344 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.344 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2024-09-12T01:55:47.344 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.344 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.344 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.344 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:55:47.344 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:55:47.344 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2024-09-12T01:55:47.344 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.345 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.345 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.345 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:47.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.345 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2024-09-12T01:55:47.345 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2024-09-12T01:55:47.345 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 2, 2024-09-12T01:55:47.345 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 1, 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 0, 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 0, 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 1433, 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:55:47.346 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:55:47.347 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:55:47.347 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:55:47.347 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:55:47.347 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:55:47.347 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:55:47.347 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:55:47.347 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:55:47.347 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:55:47.347 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:55:47.347 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:55:47.347 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-09-12T01:55:47.348 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:55:47.348 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-09-12T01:55:47.348 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:55:47.348 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:55:47.348 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:55:47.348 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:55:47.348 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:55:47.348 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:55:47.348 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:55:47.349 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-09-12T01:55:47.349 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:55:47.349 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:55:47.349 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:55:47.349 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-09-12T01:55:47.349 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-09-12T01:55:47.349 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-09-12T01:55:47.349 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:55:47.349 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:55:47.349 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:55:47.349 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:55:47.349 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 222412, 2024-09-12T01:55:47.350 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 69, 2024-09-12T01:55:47.350 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:55:47.350 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-09-12T01:55:47.350 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-09-12T01:55:47.350 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-09-12T01:55:47.350 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:55:47.350 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-09-12T01:55:47.350 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:55:47.350 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-09-12T01:55:47.350 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 7592, 2024-09-12T01:55:47.351 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 156, 2024-09-12T01:55:47.351 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:55:47.351 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:55:47.351 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-09-12T01:55:47.351 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-09-12T01:55:47.351 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 3832614, 2024-09-12T01:55:47.351 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 23087, 2024-09-12T01:55:47.351 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-09-12T01:55:47.351 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-09-12T01:55:47.351 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-09-12T01:55:47.351 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-09-12T01:55:47.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.352 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2024-09-12T01:55:47.352 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2024-09-12T01:55:47.352 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2024-09-12T01:55:47.352 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 1192, 2024-09-12T01:55:47.352 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 26, 2024-09-12T01:55:47.352 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 4, 2024-09-12T01:55:47.352 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 1192, 2024-09-12T01:55:47.352 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2024-09-12T01:55:47.352 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1192, 2024-09-12T01:55:47.352 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.929988670, 2024-09-12T01:55:47.353 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000780191 2024-09-12T01:55:47.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.353 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2024-09-12T01:55:47.353 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2024-09-12T01:55:47.353 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1192, 2024-09-12T01:55:47.353 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1193 2024-09-12T01:55:47.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.353 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 1192, 2024-09-12T01:55:47.353 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 1192, 2024-09-12T01:55:47.353 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 0, 2024-09-12T01:55:47.354 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2024-09-12T01:55:47.354 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2024-09-12T01:55:47.354 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 735, 2024-09-12T01:55:47.354 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 0, 2024-09-12T01:55:47.354 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 454, 2024-09-12T01:55:47.354 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 0, 2024-09-12T01:55:47.354 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 0, 2024-09-12T01:55:47.354 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2024-09-12T01:55:47.354 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2024-09-12T01:55:47.354 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2024-09-12T01:55:47.354 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 0, 2024-09-12T01:55:47.355 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 0, 2024-09-12T01:55:47.355 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2024-09-12T01:55:47.355 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2024-09-12T01:55:47.355 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2024-09-12T01:55:47.355 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 2, 2024-09-12T01:55:47.355 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 0, 2024-09-12T01:55:47.355 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:55:47.355 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2024-09-12T01:55:47.355 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:55:47.356 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2024-09-12T01:55:47.356 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2024-09-12T01:55:47.356 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2024-09-12T01:55:47.356 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:55:47.356 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2024-09-12T01:55:47.356 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:55:47.356 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2024-09-12T01:55:47.356 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2024-09-12T01:55:47.357 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2024-09-12T01:55:47.357 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2024-09-12T01:55:47.357 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2024-09-12T01:55:47.357 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2024-09-12T01:55:47.357 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2024-09-12T01:55:47.357 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2024-09-12T01:55:47.357 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2024-09-12T01:55:47.357 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2024-09-12T01:55:47.358 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2024-09-12T01:55:47.358 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2024-09-12T01:55:47.358 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2024-09-12T01:55:47.358 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2024-09-12T01:55:47.358 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2024-09-12T01:55:47.358 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2024-09-12T01:55:47.358 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2024-09-12T01:55:47.358 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 83, 2024-09-12T01:55:47.358 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2024-09-12T01:55:47.358 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 2, 2024-09-12T01:55:47.358 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 9, 2024-09-12T01:55:47.358 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 9, 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 0, 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 2, 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 0 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 0, 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.359 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 0 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 0, 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed_ops": 0, 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 0, 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:55:47.360 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 1320, 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 73591749, 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 1320, 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1320, 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 73591749, 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.361 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 1192, 2024-09-12T01:55:47.362 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 72853825, 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1192, 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 72853825, 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:47.363 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-12T01:55:47.364 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-12T01:55:47.364 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:47.364 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:47.364 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 1192, 2024-09-12T01:55:47.364 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 1192, 2024-09-12T01:55:47.364 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 1192, 2024-09-12T01:55:47.364 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 1192, 2024-09-12T01:55:47.364 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:47.364 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.364 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.364 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.364 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:47.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.365 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:55:47.365 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:47.365 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-12T01:55:47.365 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:47.365 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-12T01:55:47.365 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-12T01:55:47.365 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:47.365 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:47.365 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-12T01:55:47.365 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-12T01:55:47.365 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 0, 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 0, 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x55d9b3f3eb40": { 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-12T01:55:47.366 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:47.367 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:47.367 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-12T01:55:47.367 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-12T01:55:47.367 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 0, 2024-09-12T01:55:47.367 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 0, 2024-09-12T01:55:47.367 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:47.367 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:47.367 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:47.367 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:47.367 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:47.367 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:47.367 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-12T01:55:48.143 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-12T01:55:48.143 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-12T01:55:48.143 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T01:55:48.143 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T01:55:48.394 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:55:48.777 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:48 smithi152 ceph-mon[35055]: pgmap v446: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:55:48.878 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-12T01:55:48.879 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:55:48.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 2527, 2024-09-12T01:55:48.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 4063, 2024-09-12T01:55:48.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 2000953, 2024-09-12T01:55:48.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 5578887, 2024-09-12T01:55:48.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 10, 2024-09-12T01:55:48.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 3, 2024-09-12T01:55:48.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.218033333, 2024-09-12T01:55:48.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.101811665, 2024-09-12T01:55:48.879 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.103196987, 2024-09-12T01:55:48.880 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.017503379, 2024-09-12T01:55:48.880 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:48.880 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 4066, 2024-09-12T01:55:48.880 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.168761935, 2024-09-12T01:55:48.880 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000041505 2024-09-12T01:55:48.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.880 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:48.880 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 5091, 2024-09-12T01:55:48.880 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000958800, 2024-09-12T01:55:48.880 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000188 2024-09-12T01:55:48.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T01:55:48.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T01:55:48.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.881 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:55:48.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 3869, 2024-09-12T01:55:48.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 7571, 2024-09-12T01:55:48.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1458656, 2024-09-12T01:55:48.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 6018981, 2024-09-12T01:55:48.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 19, 2024-09-12T01:55:48.881 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 7, 2024-09-12T01:55:48.882 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.284380950, 2024-09-12T01:55:48.882 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.136760635, 2024-09-12T01:55:48.882 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.137780364, 2024-09-12T01:55:48.882 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.020179455, 2024-09-12T01:55:48.882 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:48.882 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7567, 2024-09-12T01:55:48.882 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.191066272, 2024-09-12T01:55:48.882 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000025249 2024-09-12T01:55:48.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.882 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:48.882 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 7516, 2024-09-12T01:55:48.882 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.001300995, 2024-09-12T01:55:48.883 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000173 2024-09-12T01:55:48.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.883 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 1122000, 2024-09-12T01:55:48.883 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 4189568 2024-09-12T01:55:48.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.883 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:55:48.883 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 790, 2024-09-12T01:55:48.883 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 774, 2024-09-12T01:55:48.883 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 968723, 2024-09-12T01:55:48.883 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 586011, 2024-09-12T01:55:48.883 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 19, 2024-09-12T01:55:48.884 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 10, 2024-09-12T01:55:48.884 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.073676278, 2024-09-12T01:55:48.884 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.027190295, 2024-09-12T01:55:48.884 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.034455116, 2024-09-12T01:55:48.884 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.012831652, 2024-09-12T01:55:48.884 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:48.884 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 771, 2024-09-12T01:55:48.884 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.045528533, 2024-09-12T01:55:48.884 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000059051 2024-09-12T01:55:48.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.884 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:48.885 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 84, 2024-09-12T01:55:48.885 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000029623, 2024-09-12T01:55:48.885 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000352 2024-09-12T01:55:48.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.885 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 554528, 2024-09-12T01:55:48.885 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 70432 2024-09-12T01:55:48.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.885 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-09-12T01:55:48.885 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2024-09-12T01:55:48.885 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-09-12T01:55:48.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.886 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2024-09-12T01:55:48.886 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-12T01:55:48.886 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-12T01:55:48.886 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 878, 2024-09-12T01:55:48.886 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.136367321, 2024-09-12T01:55:48.886 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001294268 2024-09-12T01:55:48.886 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:48.886 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.886 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2024-09-12T01:55:48.886 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-12T01:55:48.886 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-12T01:55:48.887 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2019, 2024-09-12T01:55:48.887 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.172971969, 2024-09-12T01:55:48.887 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000085672 2024-09-12T01:55:48.887 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:48.887 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.887 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-09-12T01:55:48.887 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 2045, 2024-09-12T01:55:48.887 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 2027, 2024-09-12T01:55:48.887 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2024-09-12T01:55:48.887 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2027, 2024-09-12T01:55:48.887 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 27.187202534, 2024-09-12T01:55:48.888 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.013412532 2024-09-12T01:55:48.888 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.888 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2024-09-12T01:55:48.888 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 18, 2024-09-12T01:55:48.888 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2024-09-12T01:55:48.888 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2024-09-12T01:55:48.888 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 11, 2024-09-12T01:55:48.888 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 0, 2024-09-12T01:55:48.888 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2024-09-12T01:55:48.888 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 15, 2024-09-12T01:55:48.888 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 1, 2024-09-12T01:55:48.889 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 1, 2024-09-12T01:55:48.889 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 13, 2024-09-12T01:55:48.889 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 13, 2024-09-12T01:55:48.889 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 115, 2024-09-12T01:55:48.889 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 0, 2024-09-12T01:55:48.889 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 0, 2024-09-12T01:55:48.889 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 3, 2024-09-12T01:55:48.889 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 3283, 2024-09-12T01:55:48.889 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 2782, 2024-09-12T01:55:48.889 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 18, 2024-09-12T01:55:48.889 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 7, 2024-09-12T01:55:48.890 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:55:48.890 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2024-09-12T01:55:48.890 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2024-09-12T01:55:48.890 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 0, 2024-09-12T01:55:48.890 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2024-09-12T01:55:48.890 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 8, 2024-09-12T01:55:48.890 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 86, 2024-09-12T01:55:48.890 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 8, 2024-09-12T01:55:48.890 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 1135, 2024-09-12T01:55:48.890 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2024-09-12T01:55:48.890 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 602, 2024-09-12T01:55:48.890 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2024-09-12T01:55:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 192, 2024-09-12T01:55:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 1637365, 2024-09-12T01:55:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2024-09-12T01:55:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 602, 2024-09-12T01:55:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2024-09-12T01:55:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:55:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:55:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 40, 2024-09-12T01:55:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:55:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 40, 2024-09-12T01:55:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 562, 2024-09-12T01:55:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:55:48.892 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 804, 2024-09-12T01:55:48.892 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 1406, 2024-09-12T01:55:48.892 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:55:48.892 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:55:48.892 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:55:48.892 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 861, 2024-09-12T01:55:48.892 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 33, 2024-09-12T01:55:48.892 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 28, 2024-09-12T01:55:48.892 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 1699 2024-09-12T01:55:48.892 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.892 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2024-09-12T01:55:48.892 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2024-09-12T01:55:48.893 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2024-09-12T01:55:48.893 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2024-09-12T01:55:48.893 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 7, 2024-09-12T01:55:48.893 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 0, 2024-09-12T01:55:48.893 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 0, 2024-09-12T01:55:48.893 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2024-09-12T01:55:48.893 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:55:48.893 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 1135, 2024-09-12T01:55:48.893 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 1135, 2024-09-12T01:55:48.893 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2024-09-12T01:55:48.893 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2024-09-12T01:55:48.893 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2024-09-12T01:55:48.894 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:55:48.894 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:55:48.894 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2024-09-12T01:55:48.894 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2024-09-12T01:55:48.894 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_path": 3, 2024-09-12T01:55:48.894 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_inode": 626, 2024-09-12T01:55:48.894 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:55:48.894 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 8, 2024-09-12T01:55:48.894 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2024-09-12T01:55:48.894 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:55:48.894 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2024-09-12T01:55:48.895 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2024-09-12T01:55:48.895 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.895 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2024-09-12T01:55:48.895 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2024-09-12T01:55:48.895 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 2730, 2024-09-12T01:55:48.895 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2024-09-12T01:55:48.895 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2024-09-12T01:55:48.895 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 2730, 2024-09-12T01:55:48.895 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2024-09-12T01:55:48.895 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2024-09-12T01:55:48.895 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 4, 2024-09-12T01:55:48.895 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2024-09-12T01:55:48.896 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2024-09-12T01:55:48.896 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 4, 2024-09-12T01:55:48.896 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 2, 2024-09-12T01:55:48.896 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2024-09-12T01:55:48.896 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2024-09-12T01:55:48.896 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2024-09-12T01:55:48.896 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 9760224, 2024-09-12T01:55:48.896 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 0, 2024-09-12T01:55:48.896 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2024-09-12T01:55:48.896 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 220, 2024-09-12T01:55:48.896 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.444862231, 2024-09-12T01:55:48.897 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.002022101 2024-09-12T01:55:48.897 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.897 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 0 2024-09-12T01:55:48.897 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.897 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2024-09-12T01:55:48.897 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 19, 2024-09-12T01:55:48.897 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 1171, 2024-09-12T01:55:48.897 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 1152, 2024-09-12T01:55:48.897 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 18, 2024-09-12T01:55:48.897 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 141, 2024-09-12T01:55:48.897 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 123, 2024-09-12T01:55:48.897 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 15, 2024-09-12T01:55:48.898 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 2314, 2024-09-12T01:55:48.898 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 2299, 2024-09-12T01:55:48.898 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 0, 2024-09-12T01:55:48.898 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 1689, 2024-09-12T01:55:48.898 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 1689, 2024-09-12T01:55:48.898 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 64356, 2024-09-12T01:55:48.898 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 223520 2024-09-12T01:55:48.898 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.898 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2024-09-12T01:55:48.898 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 2953, 2024-09-12T01:55:48.898 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 5, 2024-09-12T01:55:48.898 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 2045, 2024-09-12T01:55:48.899 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 3, 2024-09-12T01:55:48.899 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 399, 2024-09-12T01:55:48.899 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2024-09-12T01:55:48.899 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.899 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.899 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.899 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.899 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2024-09-12T01:55:48.899 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.899 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.899 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2024-09-12T01:55:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2024-09-12T01:55:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2024-09-12T01:55:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 744, 2024-09-12T01:55:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.217306014, 2024-09-12T01:55:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000292077 2024-09-12T01:55:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2024-09-12T01:55:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2024-09-12T01:55:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2024-09-12T01:55:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2024-09-12T01:55:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2024-09-12T01:55:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2024-09-12T01:55:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2024-09-12T01:55:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2024-09-12T01:55:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2024-09-12T01:55:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2024-09-12T01:55:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2024-09-12T01:55:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 148, 2024-09-12T01:55:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.106391006, 2024-09-12T01:55:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000718858 2024-09-12T01:55:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2024-09-12T01:55:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2024-09-12T01:55:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2024-09-12T01:55:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2024-09-12T01:55:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 90, 2024-09-12T01:55:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 1.120477960, 2024-09-12T01:55:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.012449755 2024-09-12T01:55:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2024-09-12T01:55:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2024-09-12T01:55:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2024-09-12T01:55:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2024-09-12T01:55:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2024-09-12T01:55:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2024-09-12T01:55:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2024-09-12T01:55:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2024-09-12T01:55:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2024-09-12T01:55:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1045, 2024-09-12T01:55:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 25.743027554, 2024-09-12T01:55:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.024634476 2024-09-12T01:55:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:55:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:55:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2024-09-12T01:55:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2024-09-12T01:55:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2024-09-12T01:55:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 1, 2024-09-12T01:55:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 0, 2024-09-12T01:55:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2024-09-12T01:55:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2024-09-12T01:55:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 1226, 2024-09-12T01:55:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 1226, 2024-09-12T01:55:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 1435, 2024-09-12T01:55:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2024-09-12T01:55:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-09-12T01:55:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:55:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-09-12T01:55:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:55:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:55:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:55:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:55:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:55:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:55:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:55:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:55:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:55:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:55:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:55:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:55:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:55:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-09-12T01:55:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:55:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-09-12T01:55:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:55:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:55:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:55:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:55:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:55:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:55:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:55:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-09-12T01:55:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:55:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:55:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:55:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-09-12T01:55:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-09-12T01:55:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-09-12T01:55:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:55:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:55:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:55:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:55:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 295895, 2024-09-12T01:55:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 107, 2024-09-12T01:55:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:55:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-09-12T01:55:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-09-12T01:55:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-09-12T01:55:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:55:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-09-12T01:55:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:55:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-09-12T01:55:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 7592, 2024-09-12T01:55:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 156, 2024-09-12T01:55:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:55:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:55:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-09-12T01:55:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-09-12T01:55:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 77293, 2024-09-12T01:55:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 347, 2024-09-12T01:55:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-09-12T01:55:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-09-12T01:55:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-09-12T01:55:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-09-12T01:55:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2024-09-12T01:55:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2024-09-12T01:55:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2024-09-12T01:55:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 2111, 2024-09-12T01:55:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 5756237, 2024-09-12T01:55:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 30, 2024-09-12T01:55:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 2111, 2024-09-12T01:55:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2024-09-12T01:55:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2111, 2024-09-12T01:55:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 3.216960886, 2024-09-12T01:55:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.001523903 2024-09-12T01:55:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2024-09-12T01:55:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2024-09-12T01:55:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 2111, 2024-09-12T01:55:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 2162 2024-09-12T01:55:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 2111, 2024-09-12T01:55:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 634, 2024-09-12T01:55:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 1477, 2024-09-12T01:55:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2024-09-12T01:55:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2024-09-12T01:55:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 0, 2024-09-12T01:55:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 10, 2024-09-12T01:55:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 32, 2024-09-12T01:55:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 252, 2024-09-12T01:55:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 26, 2024-09-12T01:55:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2024-09-12T01:55:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2024-09-12T01:55:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2024-09-12T01:55:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 0, 2024-09-12T01:55:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 1156, 2024-09-12T01:55:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2024-09-12T01:55:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2024-09-12T01:55:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2024-09-12T01:55:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 602, 2024-09-12T01:55:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 20, 2024-09-12T01:55:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:55:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2024-09-12T01:55:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:55:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2024-09-12T01:55:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2024-09-12T01:55:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2024-09-12T01:55:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:55:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2024-09-12T01:55:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:55:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2024-09-12T01:55:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2024-09-12T01:55:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2024-09-12T01:55:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2024-09-12T01:55:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2024-09-12T01:55:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2024-09-12T01:55:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2024-09-12T01:55:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2024-09-12T01:55:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2024-09-12T01:55:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2024-09-12T01:55:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2024-09-12T01:55:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2024-09-12T01:55:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2024-09-12T01:55:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2024-09-12T01:55:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2024-09-12T01:55:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2024-09-12T01:55:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2024-09-12T01:55:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 83, 2024-09-12T01:55:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2024-09-12T01:55:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 2, 2024-09-12T01:55:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 12, 2024-09-12T01:55:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 12, 2024-09-12T01:55:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2024-09-12T01:55:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2024-09-12T01:55:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 48, 2024-09-12T01:55:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 0, 2024-09-12T01:55:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 16 2024-09-12T01:55:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2024-09-12T01:55:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 1, 2024-09-12T01:55:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:55:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2024-09-12T01:55:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2024-09-12T01:55:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2024-09-12T01:55:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 630 2024-09-12T01:55:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2024-09-12T01:55:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2024-09-12T01:55:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 12, 2024-09-12T01:55:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2024-09-12T01:55:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 6, 2024-09-12T01:55:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed_ops": 1143, 2024-09-12T01:55:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 1135, 2024-09-12T01:55:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2024-09-12T01:55:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:55:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-12T01:55:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 7182, 2024-09-12T01:55:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 3635238, 2024-09-12T01:55:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 7182, 2024-09-12T01:55:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-12T01:55:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-12T01:55:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 7182, 2024-09-12T01:55:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 3635238, 2024-09-12T01:55:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2024-09-12T01:55:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-12T01:55:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-12T01:55:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-12T01:55:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 2111, 2024-09-12T01:55:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 5870880, 2024-09-12T01:55:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2111, 2024-09-12T01:55:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 5870880, 2024-09-12T01:55:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 2111, 2024-09-12T01:55:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 2111, 2024-09-12T01:55:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 2111, 2024-09-12T01:55:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 2111, 2024-09-12T01:55:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:55:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-12T01:55:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 1135, 2024-09-12T01:55:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 114643, 2024-09-12T01:55:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 1135, 2024-09-12T01:55:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-12T01:55:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-12T01:55:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 32, 2024-09-12T01:55:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 114643, 2024-09-12T01:55:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x55fc3f166960": { 2024-09-12T01:55:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-12T01:55:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 2730, 2024-09-12T01:55:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 5565920, 2024-09-12T01:55:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 2730, 2024-09-12T01:55:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-12T01:55:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-12T01:55:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 220, 2024-09-12T01:55:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 5565920, 2024-09-12T01:55:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:48.936 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-12T01:55:48.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:48 smithi191 ceph-mon[35770]: pgmap v446: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:55:49.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:48 smithi070 ceph-mon[31177]: pgmap v446: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:55:49.619 INFO:tasks.check_counter:Daemon mds.h mds.exported=8 2024-09-12T01:55:49.620 INFO:tasks.check_counter:Daemon mds.h mds.imported=8 2024-09-12T01:55:49.620 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T01:55:49.620 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T01:55:49.867 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T01:55:50.391 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-12T01:55:50.391 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:55:50.391 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 293, 2024-09-12T01:55:50.391 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 293, 2024-09-12T01:55:50.391 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 4273349, 2024-09-12T01:55:50.391 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 92414, 2024-09-12T01:55:50.391 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 6, 2024-09-12T01:55:50.391 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 2, 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.029726830, 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.009676636, 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.010674113, 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.006332650, 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 292, 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.015586043, 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000053376 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.392 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 131, 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 211, 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 1404994, 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 253249, 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 5, 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 4, 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.017664152, 2024-09-12T01:55:50.393 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.007058357, 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.005097796, 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.003427488, 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 209, 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.012207927, 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000058411 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.394 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 211904 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_messages": 543, 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages": 530, 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_bytes": 664172, 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_bytes": 198482, 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_created_connections": 4, 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_active_connections": 3, 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_total_time": 0.065347383, 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_send_time": 0.022316652, 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_recv_time": 0.029252779, 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_running_fast_dispatch_time": 0.015214244, 2024-09-12T01:55:50.395 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 529, 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.027153315, 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000051329 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_recv_encrypted_bytes": 531392, 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: "msgr_send_encrypted_bytes": 66512 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.396 INFO:teuthology.orchestra.run.smithi152.stdout: "cct": { 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: "total_workers": 1, 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: "unhealthy_workers": 0 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-MDSRank": { 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 1535, 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.042367707, 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000027601 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: "finisher-PurgeQueue": { 2024-09-12T01:55:50.397 INFO:teuthology.orchestra.run.smithi152.stdout: "queue_len": 0, 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: "complete_latency": { 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: "request": 0, 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: "reply": 0, 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: "reply_latency": { 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.398 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_reply": 0, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "forward": 0, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_complete": 0, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_fetch_keys": 0, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_commit": 0, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_split": 0, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_merge": 0, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes": 1138, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_top": 0, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_bottom": 1138, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pin_tail": 0, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_pinned": 1138, 2024-09-12T01:55:50.399 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_expired": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "inodes_with_caps": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "subtrees": 1, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_hit": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_forward": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_discover": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_remote_ino": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "traverse_lock": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "load_cent": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "q": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "exported": 0, 2024-09-12T01:55:50.400 INFO:teuthology.orchestra.run.smithi152.stdout: "exported_inodes": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "imported": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "imported_inodes": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_dir_fetch": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "openino_peer_discover": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rfiles": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rbytes": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "root_rsnaps": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_set_tag": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:55:50.401 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "scrub_file_inodes": 0, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps": 0, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_cap_release": 0, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "process_request_cap_release": 0 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.402 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_cache": { 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_update_receipt": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_try_discover": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_send_discover": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "dir_handle_discover": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_delayed": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_created": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_enqueued": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_reintegrated": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "strays_migrated": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_processing": 0, 2024-09-12T01:55:50.403 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_started": 0, 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: "recovery_completed": 0, 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_exportdir": 0, 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_flush": 0, 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_fragstats": 0, 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: "ireq_inodestats": 0 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.404 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_log": { 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "evlrg": 0, 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "evadd": 0, 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "evex": 0, 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "evtrm": 0, 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "ev": 2730, 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "evexg": 0, 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "evexd": 0, 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "segadd": 0, 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "segex": 0, 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "segtrm": 0, 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "seg": 4, 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "segmjr": 2, 2024-09-12T01:55:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: "segexg": 0, 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: "segexd": 0, 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: "expos": 4194304, 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: "wrpos": 9760224, 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: "rdpos": 9759086, 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: "jlat": { 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: "replayed": 2730 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_mem": { 2024-09-12T01:55:50.406 INFO:teuthology.orchestra.run.smithi152.stdout: "ino": 6, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "ino+": 1173, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "ino-": 1167, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "dir": 4, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "dir+": 140, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "dir-": 136, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "dn": 1138, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "dn+": 2306, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "dn-": 1168, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "cap": 0, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "cap+": 0, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "cap-": 0, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "rss": 49616, 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: "heap": 215328 2024-09-12T01:55:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_server": { 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_client_request": 0, 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: "dispatch_server_request": 0, 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_request": 0, 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_client_session": 0, 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: "handle_peer_request": 0, 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: "req_create_latency": { 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getattr_latency": { 2024-09-12T01:55:50.408 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getfilelock_latency": { 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: "req_link_latency": { 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.409 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookup_latency": { 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookuphash_latency": { 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupino_latency": { 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.410 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupname_latency": { 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupparent_latency": { 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lookupsnap_latency": { 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.411 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.412 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.412 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.412 INFO:teuthology.orchestra.run.smithi152.stdout: "req_lssnap_latency": { 2024-09-12T01:55:50.412 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.412 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.412 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.412 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.412 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mkdir_latency": { 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mknod_latency": { 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: "req_mksnap_latency": { 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.413 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: "req_open_latency": { 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: "req_readdir_latency": { 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rename_latency": { 2024-09-12T01:55:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: "req_renamesnap_latency": { 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: "req_snapdiff_latency": { 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.415 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmdir_latency": { 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmsnap_latency": { 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: "req_rmxattr_latency": { 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.416 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setattr_latency": { 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setdirlayout_latency": { 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setfilelock_latency": { 2024-09-12T01:55:50.417 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setlayout_latency": { 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: "req_setxattr_latency": { 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.418 INFO:teuthology.orchestra.run.smithi152.stdout: "req_symlink_latency": { 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: "req_unlink_latency": { 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: "req_getvxattr_latency": { 2024-09-12T01:55:50.419 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.420 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.420 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.420 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:50.420 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.420 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_sessions": { 2024-09-12T01:55:50.420 INFO:teuthology.orchestra.run.smithi152.stdout: "session_count": 1, 2024-09-12T01:55:50.420 INFO:teuthology.orchestra.run.smithi152.stdout: "session_add": 1, 2024-09-12T01:55:50.420 INFO:teuthology.orchestra.run.smithi152.stdout: "session_remove": 0, 2024-09-12T01:55:50.420 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_open": 1, 2024-09-12T01:55:50.420 INFO:teuthology.orchestra.run.smithi152.stdout: "sessions_stale": 0, 2024-09-12T01:55:50.420 INFO:teuthology.orchestra.run.smithi152.stdout: "total_load": 0, 2024-09-12T01:55:50.420 INFO:teuthology.orchestra.run.smithi152.stdout: "average_load": 0, 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "avg_session_uptime": 1434, 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "mdthresh_evicted": 0 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "mempool": { 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "bloom_filter_items": 0, 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:55:50.421 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_extent_items": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_blob_items": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:55:50.422 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_txc_items": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "bluestore_writing_items": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_bytes": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_items": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:55:50.423 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_bytes": 198081, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_anon_items": 54, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "buffer_meta_items": 0, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_bytes": 0, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_items": 0, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_mapbl_items": 0, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_pglog_items": 0, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_bytes": 7592, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_items": 156, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:55:50.424 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_bytes": 0, 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: "pgmap_items": 0, 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_bytes": 820216, 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_co_items": 4603, 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_bytes": 0, 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_1_items": 0, 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_bytes": 0, 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: "unittest_2_items": 0 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: "objecter": { 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: "op_active": 0, 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: "op_laggy": 0, 2024-09-12T01:55:50.425 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send": 834, 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: "op_send_bytes": 21, 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: "op_resend": 3, 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: "op_reply": 834, 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: "op_latency": { 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 834, 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.484994096, 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000581527 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: "op_inflight": 0, 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: "oplen_avg": { 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 834, 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 835 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.426 INFO:teuthology.orchestra.run.smithi152.stdout: "op": 834, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "op_r": 834, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "op_w": 0, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "op_rmw": 0, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "op_pg": 0, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_stat": 461, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_create": 0, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_read": 371, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_write": 0, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writefull": 0, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_writesame": 0, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_append": 0, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_zero": 0, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_truncate": 0, 2024-09-12T01:55:50.427 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_delete": 0, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_mapext": 0, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_sparse_read": 0, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_clonerange": 0, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_getxattr": 1, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_setxattr": 0, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_rmxattr": 0, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_call": 0, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_watch": 0, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_notify": 0, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:55:50.428 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "osdop_other": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_active": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_send": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_resend": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "linger_ping": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_active": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_send": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "poolop_resend": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_active": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_send": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "poolstat_resend": 0, 2024-09-12T01:55:50.429 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_active": 0, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_send": 0, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "statfs_resend": 0, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "command_active": 0, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "command_send": 0, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "command_resend": 0, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "map_epoch": 83, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "map_full": 0, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "map_inc": 2, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_sessions": 6, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_open": 6, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_session_close": 0, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_laggy": 0, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_wr": 0, 2024-09-12T01:55:50.430 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_rd": 2, 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_del": 0 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: "oft": { 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_objs": 0, 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_updates": 0, 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: "omap_total_removes": 0 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: "osd-slow-ops": { 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: "slow_ops_count": 0 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: "purge_queue": { 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops": 0, 2024-09-12T01:55:50.431 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing": 0, 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executing_high_water": 0, 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed_ops": 0, 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_executed": 0, 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "pq_item_in_journal": 0 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 963, 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 6246337, 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:50.432 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 963, 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 963, 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 6246337, 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_bytes": { 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:50.433 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 104857600, 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 834, 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 5565925, 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 834, 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 5565925, 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.434 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-objecter_ops": { 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 1024, 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 834, 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 834, 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 834, 2024-09-12T01:55:50.435 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 834, 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:50.436 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 0, 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 0, 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: "throttle-write_buf_throttle-0x559f38e6ab40": { 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: "val": 0, 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: "max": 3758096384, 2024-09-12T01:55:50.437 INFO:teuthology.orchestra.run.smithi152.stdout: "get_started": 0, 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: "get": 0, 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: "get_sum": 0, 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: "take": 0, 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: "take_sum": 0, 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: "put": 0, 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: "put_sum": 0, 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: "wait": { 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: "avgcount": 0, 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: "sum": 0.000000000, 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: "avgtime": 0.000000000 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-12T01:55:50.438 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-12T01:55:50.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:50 smithi191 ceph-mon[35770]: pgmap v447: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:55:51.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:50 smithi152 ceph-mon[35055]: pgmap v447: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:55:51.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:50 smithi070 ceph-mon[31177]: pgmap v447: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:55:51.221 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-12T01:55:51.221 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-12T01:55:51.221 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T01:55:51.221 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T01:55:51.480 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:55:51.974 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-09-12T01:55:51.975 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:55:51.975 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 2502, 2024-09-12T01:55:51.975 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 3288, 2024-09-12T01:55:51.975 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 2317748, 2024-09-12T01:55:51.975 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 5659806, 2024-09-12T01:55:51.975 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 21, 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 2, 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.192861467, 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.077821868, 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.106177727, 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.019408654, 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3289, 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.117062838, 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000035592 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3986, 2024-09-12T01:55:51.976 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000658741, 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000165 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 550032, 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 71040 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 406, 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 482, 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 226350, 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 455176, 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 11, 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 7, 2024-09-12T01:55:51.977 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.039011048, 2024-09-12T01:55:51.978 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.013720302, 2024-09-12T01:55:51.978 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.015105937, 2024-09-12T01:55:51.978 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.007476763, 2024-09-12T01:55:51.978 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:51.978 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 481, 2024-09-12T01:55:51.978 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.047334276, 2024-09-12T01:55:51.978 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000098408 2024-09-12T01:55:51.978 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.978 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:51.978 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 77, 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000015796, 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000205 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 213648 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 2419, 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 5189, 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 951180, 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 2908589, 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 17, 2024-09-12T01:55:51.979 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 6, 2024-09-12T01:55:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.182388643, 2024-09-12T01:55:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.084988542, 2024-09-12T01:55:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.097398438, 2024-09-12T01:55:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.011822542, 2024-09-12T01:55:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 5185, 2024-09-12T01:55:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.131369793, 2024-09-12T01:55:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000025336 2024-09-12T01:55:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 5132, 2024-09-12T01:55:51.980 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000922796, 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000179 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 730464, 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 2624976 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-12T01:55:51.981 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 517, 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.705878984, 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001365336 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1544, 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.128324882, 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000083111 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2024-09-12T01:55:51.982 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 1350, 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 1330, 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1330, 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.945858582, 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001463051 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 20, 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 0, 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 11, 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2024-09-12T01:55:51.983 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 16, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 0, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 2, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 14, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 14, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 136, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 2, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 2, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 3, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 2055, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 1721, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 18, 2024-09-12T01:55:51.984 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 26, 2024-09-12T01:55:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:55:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2024-09-12T01:55:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 0, 2024-09-12T01:55:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 1000, 2024-09-12T01:55:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 1, 2024-09-12T01:55:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 5, 2024-09-12T01:55:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 115, 2024-09-12T01:55:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 19, 2024-09-12T01:55:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 870, 2024-09-12T01:55:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2024-09-12T01:55:51.985 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 346, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 0, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 192, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 1637365, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 0, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 346, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 27, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 27, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 319, 2024-09-12T01:55:51.986 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 496, 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 1062, 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 543, 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 23, 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 12, 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 1180 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2024-09-12T01:55:51.987 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 0, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 0, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 26, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 0, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 0, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 870, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 870, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 0, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 0, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:55:51.988 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_path": 3, 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_inode": 374, 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 5, 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2024-09-12T01:55:51.989 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 1870, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 1870, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 4, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 4, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 2, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2024-09-12T01:55:51.990 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 8397838, 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 0, 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 115, 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.229259813, 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001993563 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 0 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 20, 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 902, 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 882, 2024-09-12T01:55:51.991 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 19, 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 107, 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 88, 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 16, 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 1777, 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 1761, 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 2, 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 1172, 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 1170, 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 62524, 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 223520 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 2001, 2024-09-12T01:55:51.992 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 2, 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 1350, 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 8, 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 214, 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2, 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.001201038, 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000600519 2024-09-12T01:55:51.993 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 383, 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.103939554, 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000271382 2024-09-12T01:55:51.994 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1, 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000266246, 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000266246 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.995 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2024-09-12T01:55:51.996 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2024-09-12T01:55:51.997 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.998 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 74, 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.036767634, 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000496859 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:51.999 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 64, 2024-09-12T01:55:52.000 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.851975160, 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.013312111 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.001 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2024-09-12T01:55:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2024-09-12T01:55:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2024-09-12T01:55:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.002 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.003 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 806, 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.951708950, 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001180780 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2024-09-12T01:55:52.004 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 1, 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 2, 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 1, 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 1, 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 1162, 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 1162, 2024-09-12T01:55:52.005 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 238, 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:55:52.006 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:55:52.007 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 303095, 2024-09-12T01:55:52.008 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 101, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 0, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 7592, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 156, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:55:52.009 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 82261, 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 369, 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 1466, 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 4388624, 2024-09-12T01:55:52.010 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 33, 2024-09-12T01:55:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 1466, 2024-09-12T01:55:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2024-09-12T01:55:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1466, 2024-09-12T01:55:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2.597953437, 2024-09-12T01:55:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001772137 2024-09-12T01:55:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2024-09-12T01:55:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2024-09-12T01:55:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1466, 2024-09-12T01:55:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1519 2024-09-12T01:55:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.011 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 1466, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 369, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 1097, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 0, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 10, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 23, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 138, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 21, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2024-09-12T01:55:52.012 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 891, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 346, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 20, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2024-09-12T01:55:52.013 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:55:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 0, 2024-09-12T01:55:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2024-09-12T01:55:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2024-09-12T01:55:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2024-09-12T01:55:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2024-09-12T01:55:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2024-09-12T01:55:52.014 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2024-09-12T01:55:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2024-09-12T01:55:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2024-09-12T01:55:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2024-09-12T01:55:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2024-09-12T01:55:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2024-09-12T01:55:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2024-09-12T01:55:52.015 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2024-09-12T01:55:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2024-09-12T01:55:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2024-09-12T01:55:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2024-09-12T01:55:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 83, 2024-09-12T01:55:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2024-09-12T01:55:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 2, 2024-09-12T01:55:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 12, 2024-09-12T01:55:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 12, 2024-09-12T01:55:52.016 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2024-09-12T01:55:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2024-09-12T01:55:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 55, 2024-09-12T01:55:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 0, 2024-09-12T01:55:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 15 2024-09-12T01:55:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.017 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2024-09-12T01:55:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 1, 2024-09-12T01:55:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:55:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2024-09-12T01:55:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2024-09-12T01:55:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "osd-slow-ops": { 2024-09-12T01:55:52.018 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 377 2024-09-12T01:55:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2024-09-12T01:55:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2024-09-12T01:55:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 14, 2024-09-12T01:55:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2024-09-12T01:55:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 6, 2024-09-12T01:55:52.019 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed_ops": 878, 2024-09-12T01:55:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 870, 2024-09-12T01:55:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2024-09-12T01:55:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:55:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-12T01:55:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:52.020 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 5323, 2024-09-12T01:55:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 2916740, 2024-09-12T01:55:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 5323, 2024-09-12T01:55:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-12T01:55:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-12T01:55:52.021 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 5323, 2024-09-12T01:55:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 2916740, 2024-09-12T01:55:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:52.022 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2024-09-12T01:55:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-12T01:55:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-12T01:55:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-12T01:55:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:52.023 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 1466, 2024-09-12T01:55:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 4476502, 2024-09-12T01:55:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 1466, 2024-09-12T01:55:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 4476502, 2024-09-12T01:55:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.024 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2024-09-12T01:55:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2024-09-12T01:55:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-12T01:55:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-12T01:55:52.025 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 1466, 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 1466, 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 1466, 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 1466, 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:55:52.026 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 870, 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 87878, 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 870, 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 23, 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 87878, 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.027 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x55f726570960": { 2024-09-12T01:55:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-12T01:55:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 1870, 2024-09-12T01:55:52.028 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 4203534, 2024-09-12T01:55:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 1870, 2024-09-12T01:55:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-12T01:55:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-12T01:55:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 115, 2024-09-12T01:55:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 4203534, 2024-09-12T01:55:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:52.029 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:52.030 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:52.030 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-09-12T01:55:52.850 INFO:tasks.check_counter:Daemon mds.c mds.exported=5 2024-09-12T01:55:52.850 INFO:tasks.check_counter:Daemon mds.c mds.imported=19 2024-09-12T01:55:52.850 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T01:55:52.851 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T01:55:52.874 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:52 smithi191 ceph-mon[35770]: pgmap v448: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-12T01:55:53.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:52 smithi152 ceph-mon[35055]: pgmap v448: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-12T01:55:53.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:52 smithi070 ceph-mon[31177]: pgmap v448: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-12T01:55:53.094 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:55:53.577 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-09-12T01:55:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:55:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 4374, 2024-09-12T01:55:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 11689, 2024-09-12T01:55:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 2301275, 2024-09-12T01:55:53.578 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 9685225, 2024-09-12T01:55:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 15, 2024-09-12T01:55:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 7, 2024-09-12T01:55:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.376224099, 2024-09-12T01:55:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.186941019, 2024-09-12T01:55:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.332847415, 2024-09-12T01:55:53.579 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.022296232, 2024-09-12T01:55:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 11684, 2024-09-12T01:55:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.340483889, 2024-09-12T01:55:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000029141 2024-09-12T01:55:53.580 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 10475, 2024-09-12T01:55:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.001496591, 2024-09-12T01:55:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000142 2024-09-12T01:55:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.581 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 1820208, 2024-09-12T01:55:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 5877104 2024-09-12T01:55:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:55:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 1760, 2024-09-12T01:55:53.582 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 2424, 2024-09-12T01:55:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 2996366, 2024-09-12T01:55:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 1092898, 2024-09-12T01:55:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 9, 2024-09-12T01:55:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 5, 2024-09-12T01:55:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.152502262, 2024-09-12T01:55:53.583 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.063398272, 2024-09-12T01:55:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.068480577, 2024-09-12T01:55:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.021297799, 2024-09-12T01:55:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2426, 2024-09-12T01:55:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.094487402, 2024-09-12T01:55:53.584 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000038947 2024-09-12T01:55:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2374, 2024-09-12T01:55:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000451093, 2024-09-12T01:55:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000190 2024-09-12T01:55:53.585 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T01:55:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 213376 2024-09-12T01:55:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:55:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 1093, 2024-09-12T01:55:53.586 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 1093, 2024-09-12T01:55:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 316767, 2024-09-12T01:55:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 8382548, 2024-09-12T01:55:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 25, 2024-09-12T01:55:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 6, 2024-09-12T01:55:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.122766463, 2024-09-12T01:55:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.056709811, 2024-09-12T01:55:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.029408062, 2024-09-12T01:55:53.588 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.028814699, 2024-09-12T01:55:53.588 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:53.588 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1092, 2024-09-12T01:55:53.588 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.069778709, 2024-09-12T01:55:53.588 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000063899 2024-09-12T01:55:53.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.589 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:53.589 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 60, 2024-09-12T01:55:53.589 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000012731, 2024-09-12T01:55:53.589 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000212 2024-09-12T01:55:53.589 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T01:55:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T01:55:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2024-09-12T01:55:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2024-09-12T01:55:53.590 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2024-09-12T01:55:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2024-09-12T01:55:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-12T01:55:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-12T01:55:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 516, 2024-09-12T01:55:53.591 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.836105677, 2024-09-12T01:55:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003558344 2024-09-12T01:55:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2024-09-12T01:55:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-12T01:55:53.592 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-12T01:55:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 4049, 2024-09-12T01:55:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.484106839, 2024-09-12T01:55:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000119562 2024-09-12T01:55:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:53.593 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2024-09-12T01:55:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 2774, 2024-09-12T01:55:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 2767, 2024-09-12T01:55:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2024-09-12T01:55:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2767, 2024-09-12T01:55:53.594 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 4.790643822, 2024-09-12T01:55:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001731349 2024-09-12T01:55:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2024-09-12T01:55:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 7, 2024-09-12T01:55:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 0, 2024-09-12T01:55:53.595 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2024-09-12T01:55:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 11, 2024-09-12T01:55:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2024-09-12T01:55:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2024-09-12T01:55:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 15, 2024-09-12T01:55:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 0, 2024-09-12T01:55:53.596 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 2, 2024-09-12T01:55:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 13, 2024-09-12T01:55:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 13, 2024-09-12T01:55:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 82, 2024-09-12T01:55:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 1, 2024-09-12T01:55:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 1, 2024-09-12T01:55:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 3, 2024-09-12T01:55:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 3278, 2024-09-12T01:55:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 3014, 2024-09-12T01:55:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 7, 2024-09-12T01:55:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 6, 2024-09-12T01:55:53.598 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:55:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2024-09-12T01:55:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 0, 2024-09-12T01:55:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 1000, 2024-09-12T01:55:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 1, 2024-09-12T01:55:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 9, 2024-09-12T01:55:53.599 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 63, 2024-09-12T01:55:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 9, 2024-09-12T01:55:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 2325, 2024-09-12T01:55:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2024-09-12T01:55:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:55:53.600 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 0, 2024-09-12T01:55:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 192, 2024-09-12T01:55:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 1637365, 2024-09-12T01:55:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 0, 2024-09-12T01:55:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:55:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2024-09-12T01:55:53.601 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:55:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:55:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:55:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:55:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:55:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 0, 2024-09-12T01:55:53.602 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:55:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 389, 2024-09-12T01:55:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 2713, 2024-09-12T01:55:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:55:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:55:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:55:53.603 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 598, 2024-09-12T01:55:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 186, 2024-09-12T01:55:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 16, 2024-09-12T01:55:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 2765 2024-09-12T01:55:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.604 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2024-09-12T01:55:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2024-09-12T01:55:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 0, 2024-09-12T01:55:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 0, 2024-09-12T01:55:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 6, 2024-09-12T01:55:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 0, 2024-09-12T01:55:53.605 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 0, 2024-09-12T01:55:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2024-09-12T01:55:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:55:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 2325, 2024-09-12T01:55:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 2325, 2024-09-12T01:55:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 0, 2024-09-12T01:55:53.606 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 0, 2024-09-12T01:55:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2024-09-12T01:55:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:55:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:55:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2024-09-12T01:55:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2024-09-12T01:55:53.607 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_path": 3, 2024-09-12T01:55:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_inode": 12, 2024-09-12T01:55:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:55:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 9, 2024-09-12T01:55:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2024-09-12T01:55:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:55:53.608 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2024-09-12T01:55:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0 2024-09-12T01:55:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2024-09-12T01:55:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 1, 2024-09-12T01:55:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 5367, 2024-09-12T01:55:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2024-09-12T01:55:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2024-09-12T01:55:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 5367, 2024-09-12T01:55:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2024-09-12T01:55:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2024-09-12T01:55:53.610 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 7, 2024-09-12T01:55:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2024-09-12T01:55:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2024-09-12T01:55:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 7, 2024-09-12T01:55:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 2, 2024-09-12T01:55:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2024-09-12T01:55:53.611 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2024-09-12T01:55:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2024-09-12T01:55:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 15917336, 2024-09-12T01:55:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 0, 2024-09-12T01:55:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2024-09-12T01:55:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 230, 2024-09-12T01:55:53.612 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.516012000, 2024-09-12T01:55:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002243530 2024-09-12T01:55:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 0 2024-09-12T01:55:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.613 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2024-09-12T01:55:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 20, 2024-09-12T01:55:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 2356, 2024-09-12T01:55:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 2336, 2024-09-12T01:55:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 18, 2024-09-12T01:55:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 231, 2024-09-12T01:55:53.614 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 213, 2024-09-12T01:55:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 15, 2024-09-12T01:55:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 4684, 2024-09-12T01:55:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 4669, 2024-09-12T01:55:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 1, 2024-09-12T01:55:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 2329, 2024-09-12T01:55:53.615 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 2328, 2024-09-12T01:55:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 66876, 2024-09-12T01:55:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 223520 2024-09-12T01:55:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2024-09-12T01:55:53.616 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 3587, 2024-09-12T01:55:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 2, 2024-09-12T01:55:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 2774, 2024-09-12T01:55:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 8, 2024-09-12T01:55:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 252, 2024-09-12T01:55:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2024-09-12T01:55:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.617 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2024-09-12T01:55:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.618 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2024-09-12T01:55:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.619 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2024-09-12T01:55:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.620 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2024-09-12T01:55:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 240, 2024-09-12T01:55:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.056321645, 2024-09-12T01:55:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000234673 2024-09-12T01:55:53.621 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2024-09-12T01:55:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.622 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2024-09-12T01:55:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1, 2024-09-12T01:55:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000134286, 2024-09-12T01:55:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000134286 2024-09-12T01:55:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2024-09-12T01:55:53.623 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2024-09-12T01:55:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.624 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2024-09-12T01:55:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.625 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2024-09-12T01:55:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.626 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2024-09-12T01:55:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2024-09-12T01:55:53.627 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2024-09-12T01:55:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.628 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2024-09-12T01:55:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.629 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2024-09-12T01:55:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 201, 2024-09-12T01:55:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.088063655, 2024-09-12T01:55:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000438127 2024-09-12T01:55:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.630 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2024-09-12T01:55:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2024-09-12T01:55:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.631 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2024-09-12T01:55:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.632 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2024-09-12T01:55:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 186, 2024-09-12T01:55:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2.233025551, 2024-09-12T01:55:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.012005513 2024-09-12T01:55:53.633 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2024-09-12T01:55:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.634 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2024-09-12T01:55:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2024-09-12T01:55:53.635 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2024-09-12T01:55:53.636 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2024-09-12T01:55:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.637 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2024-09-12T01:55:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.638 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2024-09-12T01:55:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.639 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2024-09-12T01:55:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.640 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2024-09-12T01:55:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2139, 2024-09-12T01:55:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2.413098685, 2024-09-12T01:55:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001128143 2024-09-12T01:55:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:55:53.641 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:55:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2024-09-12T01:55:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2024-09-12T01:55:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 1, 2024-09-12T01:55:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 2, 2024-09-12T01:55:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 1, 2024-09-12T01:55:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 1, 2024-09-12T01:55:53.642 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 2594, 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 2594, 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 219, 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:55:53.643 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:55:53.644 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:55:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 279223, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 94, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 0, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 7592, 2024-09-12T01:55:53.646 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 156, 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 79397, 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 343, 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2024-09-12T01:55:53.647 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2024-09-12T01:55:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2024-09-12T01:55:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 2680, 2024-09-12T01:55:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 12236623, 2024-09-12T01:55:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 32, 2024-09-12T01:55:53.648 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 2680, 2024-09-12T01:55:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2024-09-12T01:55:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2680, 2024-09-12T01:55:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5.545900646, 2024-09-12T01:55:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002069365 2024-09-12T01:55:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2024-09-12T01:55:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2024-09-12T01:55:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2680, 2024-09-12T01:55:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2722 2024-09-12T01:55:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 2680, 2024-09-12T01:55:53.649 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 24, 2024-09-12T01:55:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 2656, 2024-09-12T01:55:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2024-09-12T01:55:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2024-09-12T01:55:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 0, 2024-09-12T01:55:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 10, 2024-09-12T01:55:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 24, 2024-09-12T01:55:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 254, 2024-09-12T01:55:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 20, 2024-09-12T01:55:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2024-09-12T01:55:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2024-09-12T01:55:53.650 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 2347, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 0, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 20, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2024-09-12T01:55:53.651 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2024-09-12T01:55:53.652 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 83, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 2, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 12, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 12, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2024-09-12T01:55:53.653 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 36, 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 0, 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 11 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 1, 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "osd-slow-ops": { 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 15 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.654 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 14, 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 6, 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed_ops": 2333, 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 2325, 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:53.655 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 7223, 2024-09-12T01:55:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 4796849, 2024-09-12T01:55:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 7223, 2024-09-12T01:55:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-12T01:55:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-12T01:55:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 7223, 2024-09-12T01:55:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 4796849, 2024-09-12T01:55:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.656 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2024-09-12T01:55:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-12T01:55:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-12T01:55:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-12T01:55:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 2680, 2024-09-12T01:55:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 12471456, 2024-09-12T01:55:53.657 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2680, 2024-09-12T01:55:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 12471456, 2024-09-12T01:55:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:53.658 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 2680, 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 2680, 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2680, 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 2680, 2024-09-12T01:55:53.659 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 2325, 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 234833, 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:53.660 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 2325, 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 24, 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 234833, 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x55a4428c8960": { 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:53.661 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 5367, 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 11723032, 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 5367, 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 230, 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 11723032, 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:53.662 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:53.663 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:53.663 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:53.663 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-09-12T01:55:54.347 INFO:tasks.check_counter:Daemon mds.f mds.exported=9 2024-09-12T01:55:54.347 INFO:tasks.check_counter:Daemon mds.f mds.imported=9 2024-09-12T01:55:54.347 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T01:55:54.348 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T01:55:54.632 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:55:54.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:54 smithi191 ceph-mon[35770]: pgmap v449: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-12T01:55:55.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:54 smithi152 ceph-mon[35055]: pgmap v449: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-12T01:55:55.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:54 smithi070 ceph-mon[31177]: pgmap v449: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-12T01:55:55.100 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-09-12T01:55:55.100 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:55:55.100 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 11523, 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 19850, 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 4239082, 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 27071962, 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 26, 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 6, 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.774882523, 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.374114881, 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.541090742, 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.056795478, 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 19844, 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2.493945616, 2024-09-12T01:55:55.101 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000125677 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 21294, 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.002823361, 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000132 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 3529296, 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 9687904 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 3059, 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 3768, 2024-09-12T01:55:55.102 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 2898947, 2024-09-12T01:55:55.103 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 1703671, 2024-09-12T01:55:55.103 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 9, 2024-09-12T01:55:55.103 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 5, 2024-09-12T01:55:55.103 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.213901773, 2024-09-12T01:55:55.103 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.083010417, 2024-09-12T01:55:55.103 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.095409992, 2024-09-12T01:55:55.103 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.035931062, 2024-09-12T01:55:55.103 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:55.103 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3770, 2024-09-12T01:55:55.103 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.234486064, 2024-09-12T01:55:55.103 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000062197 2024-09-12T01:55:55.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.104 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:55.104 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3343, 2024-09-12T01:55:55.104 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000656707, 2024-09-12T01:55:55.104 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000196 2024-09-12T01:55:55.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.104 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T01:55:55.104 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 214848 2024-09-12T01:55:55.104 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.104 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:55:55.104 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 1593, 2024-09-12T01:55:55.104 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 1572, 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 1256607, 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 5070590, 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 14, 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 6, 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.146039657, 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.062533664, 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.046197223, 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.034470589, 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1572, 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.111807877, 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000071124 2024-09-12T01:55:55.105 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 48, 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000011854, 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000246 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 562240, 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 71856 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.106 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1566, 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5.382797730, 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003437291 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 4631, 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.814948453, 2024-09-12T01:55:55.107 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000175976 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 4766, 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 4742, 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 4742, 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 6.984284335, 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001472856 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 24, 2024-09-12T01:55:55.108 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 0, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 20, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 1, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 15, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 0, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 2, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 13, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 13, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 117, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 0, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 0, 2024-09-12T01:55:55.109 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 3, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 6273, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 5936, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 24, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 8, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 1, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 0, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 0, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 7, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 97, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 10, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 1880, 2024-09-12T01:55:55.110 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 1391, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 0, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 192, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 1637365, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 0, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 1391, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 83, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 83, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 1308, 2024-09-12T01:55:55.111 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 2, 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 1644, 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 3725, 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 4190, 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 1995, 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 45, 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 3113 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 0, 2024-09-12T01:55:55.112 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 0, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 8, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 2, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 0, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 2594, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 2594, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 0, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 0, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2024-09-12T01:55:55.113 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_path": 3, 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_inode": 1413, 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 7, 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 1, 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 9675, 2024-09-12T01:55:55.114 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2024-09-12T01:55:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2024-09-12T01:55:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 9675, 2024-09-12T01:55:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2024-09-12T01:55:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2024-09-12T01:55:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 12, 2024-09-12T01:55:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2024-09-12T01:55:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2024-09-12T01:55:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 12, 2024-09-12T01:55:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 2, 2024-09-12T01:55:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2024-09-12T01:55:55.115 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2024-09-12T01:55:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2024-09-12T01:55:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 24717656, 2024-09-12T01:55:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 0, 2024-09-12T01:55:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2024-09-12T01:55:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1250, 2024-09-12T01:55:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 58.215177659, 2024-09-12T01:55:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.046572142 2024-09-12T01:55:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 0 2024-09-12T01:55:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.116 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2024-09-12T01:55:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 19, 2024-09-12T01:55:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 2623, 2024-09-12T01:55:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 2604, 2024-09-12T01:55:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 18, 2024-09-12T01:55:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 180, 2024-09-12T01:55:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 162, 2024-09-12T01:55:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 15, 2024-09-12T01:55:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 4506, 2024-09-12T01:55:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 4491, 2024-09-12T01:55:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 0, 2024-09-12T01:55:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 3916, 2024-09-12T01:55:55.117 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 3916, 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 75276, 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 223520 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 5544, 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 2, 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 4766, 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 7, 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 248, 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 715, 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.873922319, 2024-09-12T01:55:55.118 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001222268 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.119 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2024-09-12T01:55:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1188, 2024-09-12T01:55:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.102357643, 2024-09-12T01:55:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000927910 2024-09-12T01:55:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2024-09-12T01:55:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.120 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.121 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2024-09-12T01:55:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2024-09-12T01:55:55.122 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.123 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.123 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.123 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2024-09-12T01:55:55.123 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.123 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.123 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.123 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.123 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2024-09-12T01:55:55.123 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.124 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.124 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.124 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2024-09-12T01:55:55.124 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.124 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.124 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.124 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.124 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2024-09-12T01:55:55.124 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.124 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.125 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.125 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2024-09-12T01:55:55.125 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 245, 2024-09-12T01:55:55.125 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.138473808, 2024-09-12T01:55:55.125 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000565199 2024-09-12T01:55:55.125 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.125 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2024-09-12T01:55:55.125 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.125 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2024-09-12T01:55:55.126 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 108, 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.871510306, 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.017328799 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.127 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2024-09-12T01:55:55.128 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.128 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.128 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.128 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2024-09-12T01:55:55.128 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.128 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.128 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.128 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.128 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2024-09-12T01:55:55.128 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.128 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.129 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2024-09-12T01:55:55.130 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.130 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.130 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.130 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2024-09-12T01:55:55.130 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2486, 2024-09-12T01:55:55.130 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2.998020259, 2024-09-12T01:55:55.130 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001205961 2024-09-12T01:55:55.130 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.130 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:55:55.130 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 1, 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 2, 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 1, 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 1, 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2024-09-12T01:55:55.131 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 3454, 2024-09-12T01:55:55.132 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 3454, 2024-09-12T01:55:55.132 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 1461, 2024-09-12T01:55:55.132 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2024-09-12T01:55:55.132 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.132 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2024-09-12T01:55:55.132 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:55:55.132 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2024-09-12T01:55:55.132 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:55:55.132 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:55:55.132 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:55:55.132 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:55:55.132 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2024-09-12T01:55:55.133 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2024-09-12T01:55:55.134 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2024-09-12T01:55:55.135 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:55:55.135 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:55:55.135 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:55:55.135 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:55:55.135 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 286999, 2024-09-12T01:55:55.135 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 95, 2024-09-12T01:55:55.135 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:55:55.135 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 0, 2024-09-12T01:55:55.135 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2024-09-12T01:55:55.135 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2024-09-12T01:55:55.135 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:55:55.135 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 7592, 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 156, 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 77773, 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 379, 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2024-09-12T01:55:55.136 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 5477, 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 21270728, 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 33, 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 5477, 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 5477, 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 26.264530789, 2024-09-12T01:55:55.137 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.004795422 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 5477, 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5552 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 5477, 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 1436, 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 4041, 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 0, 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 10, 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 45, 2024-09-12T01:55:55.138 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 1295, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 32, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 1, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 2650, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 1391, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 20, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2024-09-12T01:55:55.139 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2024-09-12T01:55:55.140 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 83, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 2, 2024-09-12T01:55:55.141 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 12, 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 12, 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 87, 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 0, 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 21 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 1, 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2024-09-12T01:55:55.142 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: "osd-slow-ops": { 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 1416 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 14, 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 6, 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed_ops": 2634, 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 2594, 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.143 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:55:55.144 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:55.144 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-12T01:55:55.144 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:55.144 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 16171, 2024-09-12T01:55:55.144 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 6492023, 2024-09-12T01:55:55.144 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:55.144 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 16171, 2024-09-12T01:55:55.144 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-12T01:55:55.144 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-12T01:55:55.144 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 16171, 2024-09-12T01:55:55.144 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 6492023, 2024-09-12T01:55:55.144 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:55.145 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 5477, 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 21532762, 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 5477, 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 21532762, 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2024-09-12T01:55:55.146 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 5477, 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 5477, 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 5477, 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 5477, 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:55.147 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 2594, 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 262034, 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 2594, 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 45, 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 262034, 2024-09-12T01:55:55.148 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x558738078960": { 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 9675, 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 20523352, 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 9675, 2024-09-12T01:55:55.149 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-12T01:55:55.150 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-12T01:55:55.150 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 1250, 2024-09-12T01:55:55.150 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 20523352, 2024-09-12T01:55:55.150 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:55.150 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:55.150 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:55.150 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:55.150 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:55.150 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:55.150 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-09-12T01:55:55.863 INFO:tasks.check_counter:Daemon mds.i mds.exported=7 2024-09-12T01:55:55.863 INFO:tasks.check_counter:Daemon mds.i mds.imported=10 2024-09-12T01:55:55.863 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T01:55:55.863 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T01:55:56.106 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T01:55:56.655 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-09-12T01:55:56.655 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T01:55:56.656 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 901, 2024-09-12T01:55:56.656 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 901, 2024-09-12T01:55:56.656 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 16592546, 2024-09-12T01:55:56.656 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 285701, 2024-09-12T01:55:56.656 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 6, 2024-09-12T01:55:56.656 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 2, 2024-09-12T01:55:56.656 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.090668533, 2024-09-12T01:55:56.656 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.027293292, 2024-09-12T01:55:56.656 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.030043341, 2024-09-12T01:55:56.656 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.026230468, 2024-09-12T01:55:56.656 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 900, 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.040322914, 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000044803 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.657 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 38, 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 120, 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 4203934, 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 225700, 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 5, 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 4, 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.012248377, 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.004100194, 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.006045558, 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.000941152, 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 118, 2024-09-12T01:55:56.658 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.008067522, 2024-09-12T01:55:56.659 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000068368 2024-09-12T01:55:56.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.659 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:56.659 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.659 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.659 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.659 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T01:55:56.659 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 213872 2024-09-12T01:55:56.659 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.659 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 217, 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 204, 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 553360, 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 95458, 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 4, 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 3, 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.027469700, 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.010314272, 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.017854495, 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.002848202, 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 203, 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.012007507, 2024-09-12T01:55:56.660 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000059150 2024-09-12T01:55:56.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.661 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-09-12T01:55:56.661 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.661 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.661 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.661 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 531936, 2024-09-12T01:55:56.661 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 67792 2024-09-12T01:55:56.661 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.661 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2024-09-12T01:55:56.661 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2024-09-12T01:55:56.662 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2024-09-12T01:55:56.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.662 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2024-09-12T01:55:56.662 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-12T01:55:56.662 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-12T01:55:56.662 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1744, 2024-09-12T01:55:56.662 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.046856642, 2024-09-12T01:55:56.662 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000026867 2024-09-12T01:55:56.662 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:56.662 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.662 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2024-09-12T01:55:56.662 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 0, 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 0, 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.663 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 0, 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 0, 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 0, 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 2601, 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 0, 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 2601, 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 0, 2024-09-12T01:55:56.664 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 2601, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 0, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 0, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 0, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 1, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 0, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 0, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 0, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 0, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 0, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 0, 2024-09-12T01:55:56.665 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T01:55:56.666 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 0, 2024-09-12T01:55:56.667 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 0 2024-09-12T01:55:56.668 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.668 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2024-09-12T01:55:56.668 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2024-09-12T01:55:56.668 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 0, 2024-09-12T01:55:56.668 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 0, 2024-09-12T01:55:56.668 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 0, 2024-09-12T01:55:56.668 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 0, 2024-09-12T01:55:56.668 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 0, 2024-09-12T01:55:56.669 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2024-09-12T01:55:56.669 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2024-09-12T01:55:56.669 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 0, 2024-09-12T01:55:56.669 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 0, 2024-09-12T01:55:56.669 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 0, 2024-09-12T01:55:56.669 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 0, 2024-09-12T01:55:56.669 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2024-09-12T01:55:56.669 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2024-09-12T01:55:56.669 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2024-09-12T01:55:56.669 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2024-09-12T01:55:56.669 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2024-09-12T01:55:56.669 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_path": 0, 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_quiesce_inode": 0, 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 0, 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 0, 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2024-09-12T01:55:56.670 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 9675, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 0, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 12, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 2, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 24717656, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 24717057, 2024-09-12T01:55:56.671 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2024-09-12T01:55:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 9675 2024-09-12T01:55:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2024-09-12T01:55:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 10, 2024-09-12T01:55:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 2636, 2024-09-12T01:55:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 2626, 2024-09-12T01:55:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 8, 2024-09-12T01:55:56.672 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 190, 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 182, 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 2601, 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 4513, 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 1912, 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 0, 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 0, 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 0, 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 57972, 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 215328 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 0, 2024-09-12T01:55:56.673 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 0, 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 0, 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 0, 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 0, 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.674 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.675 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.676 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2024-09-12T01:55:56.676 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.676 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.676 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.676 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2024-09-12T01:55:56.676 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.676 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.676 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.676 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.677 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.678 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.678 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2024-09-12T01:55:56.678 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.678 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.678 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.678 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.678 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2024-09-12T01:55:56.678 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.679 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.680 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2024-09-12T01:55:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2024-09-12T01:55:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.681 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2024-09-12T01:55:56.682 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.682 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.682 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.682 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2024-09-12T01:55:56.682 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.682 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.682 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.682 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.683 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2024-09-12T01:55:56.683 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.683 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.683 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.683 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2024-09-12T01:55:56.683 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.683 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.683 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.683 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.684 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2024-09-12T01:55:56.684 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.684 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.684 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.684 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.684 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2024-09-12T01:55:56.684 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.684 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.685 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.685 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2024-09-12T01:55:56.685 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.685 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.685 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.685 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.685 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2024-09-12T01:55:56.685 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.685 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.685 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2024-09-12T01:55:56.686 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 1, 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 2, 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 1, 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 1, 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 0, 2024-09-12T01:55:56.687 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 0, 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 1460, 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T01:55:56.688 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T01:55:56.689 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T01:55:56.690 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2024-09-12T01:55:56.691 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 198143, 2024-09-12T01:55:56.691 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 55, 2024-09-12T01:55:56.691 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 0, 2024-09-12T01:55:56.691 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 0, 2024-09-12T01:55:56.691 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2024-09-12T01:55:56.691 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2024-09-12T01:55:56.691 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2024-09-12T01:55:56.691 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2024-09-12T01:55:56.691 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2024-09-12T01:55:56.691 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2024-09-12T01:55:56.691 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 7592, 2024-09-12T01:55:56.691 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 156, 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 1864184, 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 10499, 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2024-09-12T01:55:56.692 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 1021, 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 21, 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 3, 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 1021, 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1021, 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.992982135, 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000972558 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2024-09-12T01:55:56.693 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1021, 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1022 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 1021, 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 1021, 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 0, 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 631, 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 0, 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 388, 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 0, 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 0, 2024-09-12T01:55:56.694 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 1, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2024-09-12T01:55:56.695 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2024-09-12T01:55:56.696 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2024-09-12T01:55:56.697 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2024-09-12T01:55:56.697 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2024-09-12T01:55:56.697 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2024-09-12T01:55:56.697 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2024-09-12T01:55:56.697 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2024-09-12T01:55:56.697 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2024-09-12T01:55:56.697 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2024-09-12T01:55:56.697 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 83, 2024-09-12T01:55:56.697 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2024-09-12T01:55:56.697 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 2, 2024-09-12T01:55:56.697 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 6, 2024-09-12T01:55:56.697 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 6, 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 0, 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 2, 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 0 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 0, 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: "osd-slow-ops": { 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 0 2024-09-12T01:55:56.698 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 0, 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed_ops": 0, 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 0, 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 1152, 2024-09-12T01:55:56.699 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 21236548, 2024-09-12T01:55:56.700 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:56.700 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 1152, 2024-09-12T01:55:56.700 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-12T01:55:56.700 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-12T01:55:56.700 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 1152, 2024-09-12T01:55:56.700 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 21236548, 2024-09-12T01:55:56.700 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:56.700 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 1021, 2024-09-12T01:55:56.701 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 20525582, 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 1021, 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 20525582, 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-12T01:55:56.702 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 1021, 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 1021, 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 1021, 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 1021, 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2024-09-12T01:55:56.703 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:56.704 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-12T01:55:56.704 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:56.704 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-12T01:55:56.704 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-12T01:55:56.704 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:56.704 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:56.704 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-12T01:55:56.704 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-12T01:55:56.704 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 0, 2024-09-12T01:55:56.704 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 0, 2024-09-12T01:55:56.704 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:56.704 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x55bfad970b40": { 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-09-12T01:55:56.705 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-09-12T01:55:56.706 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-09-12T01:55:56.706 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 0, 2024-09-12T01:55:56.706 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 0, 2024-09-12T01:55:56.706 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-09-12T01:55:56.706 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-09-12T01:55:56.706 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-09-12T01:55:56.706 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-09-12T01:55:56.706 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:56.706 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-09-12T01:55:56.706 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-09-12T01:55:56.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:56 smithi191 ceph-mon[35770]: pgmap v450: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-09-12T01:55:57.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:56 smithi152 ceph-mon[35055]: pgmap v450: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-09-12T01:55:57.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:56 smithi070 ceph-mon[31177]: pgmap v450: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-09-12T01:55:57.430 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-12T01:55:57.430 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-12T01:55:57.431 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T01:55:57.442 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T01:55:57.442 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:55:57.442 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:55:57.465 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-12T01:55:57.465 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:55:57.526 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T01:55:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:57.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:57 smithi191 ceph-mon[35770]: pgmap v451: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:55:57.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:57 smithi070 ceph-mon[31177]: pgmap v451: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:55:58.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:57 smithi152 ceph-mon[35055]: pgmap v451: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T01:55:58.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.298+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1352140953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ad4102790 msgr2=0x7f9ad41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.298+0000 7f9adbbaa640 1 --2- 172.21.15.70:0/1352140953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ad4102790 0x7f9ad41067e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009900 tx=0x7f9ac402a410 comp rx=0 tx=0).stop 2024-09-12T01:55:58.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.298+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1352140953 shutdown_connections 2024-09-12T01:55:58.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.298+0000 7f9adbbaa640 1 --2- 172.21.15.70:0/1352140953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ad4106f10 0x7f9ad410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.298+0000 7f9adbbaa640 1 --2- 172.21.15.70:0/1352140953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ad4102790 0x7f9ad41067e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.298+0000 7f9adbbaa640 1 --2- 172.21.15.70:0/1352140953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ad4101de0 0x7f9ad41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.298+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1352140953 >> 172.21.15.70:0/1352140953 conn(0x7f9ad40fd8c0 msgr2=0x7f9ad40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:58.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.298+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1352140953 shutdown_connections 2024-09-12T01:55:58.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.298+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1352140953 wait complete. 2024-09-12T01:55:58.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9adbbaa640 1 Processor -- start 2024-09-12T01:55:58.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9adbbaa640 1 -- start start 2024-09-12T01:55:58.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9adbbaa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ad4101de0 0x7f9ad41984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9adbbaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ad4102790 0x7f9ad4198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9adbbaa640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ad4106f10 0x7f9ad419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9adbbaa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad4112050 con 0x7f9ad4102790 2024-09-12T01:55:58.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9adbbaa640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad4111ed0 con 0x7f9ad4101de0 2024-09-12T01:55:58.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9adbbaa640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad41121d0 con 0x7f9ad4106f10 2024-09-12T01:55:58.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9ad9145640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ad4102790 0x7f9ad4198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9ad9145640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ad4102790 0x7f9ad4198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40726/0 (socket says 172.21.15.70:40726) 2024-09-12T01:55:58.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9ad9145640 1 -- 172.21.15.70:0/1431593495 learned_addr learned my addr 172.21.15.70:0/1431593495 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:55:58.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9ad9946640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ad4101de0 0x7f9ad41984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.299+0000 7f9ada147640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ad4106f10 0x7f9ad419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.300+0000 7f9ad9145640 1 -- 172.21.15.70:0/1431593495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ad4106f10 msgr2=0x7f9ad419cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.300+0000 7f9ad9145640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ad4106f10 0x7f9ad419cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.300+0000 7f9ad9145640 1 -- 172.21.15.70:0/1431593495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ad4101de0 msgr2=0x7f9ad41984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.300+0000 7f9ad9145640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ad4101de0 0x7f9ad41984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.300+0000 7f9ad9145640 1 -- 172.21.15.70:0/1431593495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad419d490 con 0x7f9ad4102790 2024-09-12T01:55:58.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.300+0000 7f9ad9145640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ad4102790 0x7f9ad4198a20 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006010 tx=0x7f9ac40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:58.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.300+0000 7f9acaffd640 1 -- 172.21.15.70:0/1431593495 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac403f030 con 0x7f9ad4102790 2024-09-12T01:55:58.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.300+0000 7f9acaffd640 1 -- 172.21.15.70:0/1431593495 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ac4003d00 con 0x7f9ad4102790 2024-09-12T01:55:58.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.300+0000 7f9acaffd640 1 -- 172.21.15.70:0/1431593495 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4035070 con 0x7f9ad4102790 2024-09-12T01:55:58.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.300+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1431593495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad419d720 con 0x7f9ad4102790 2024-09-12T01:55:58.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.300+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1431593495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad41a5060 con 0x7f9ad4102790 2024-09-12T01:55:58.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.301+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1431593495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad41032c0 con 0x7f9ad4102790 2024-09-12T01:55:58.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.302+0000 7f9acaffd640 1 -- 172.21.15.70:0/1431593495 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9ac4042030 con 0x7f9ad4102790 2024-09-12T01:55:58.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.303+0000 7f9acaffd640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9ac00a2b80 0x7f9ac00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:58.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.303+0000 7f9ad9946640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9ac00a2b80 0x7f9ac00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:58.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.303+0000 7f9acaffd640 1 -- 172.21.15.70:0/1431593495 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9ac40ef420 con 0x7f9ad4102790 2024-09-12T01:55:58.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.303+0000 7f9ad9946640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9ac00a2b80 0x7f9ac00a5040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009bd0 tx=0x7f9ad0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:58.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.307+0000 7f9acaffd640 1 -- 172.21.15.70:0/1431593495 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ac40bc380 con 0x7f9ad4102790 2024-09-12T01:55:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.484+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1431593495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9ad410a150 con 0x7f9ad4102790 2024-09-12T01:55:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.484+0000 7f9acaffd640 1 -- 172.21.15.70:0/1431593495 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v83) ==== 81+0+588 (secure 0 0 0) 0x7f9ac40bbc80 con 0x7f9ad4102790 2024-09-12T01:55:58.485 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2778664397 2024-09-13T01:43:21.394738+0000 2024-09-12T01:55:58.485 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/745799282 2024-09-13T01:43:21.394738+0000 2024-09-12T01:55:58.485 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1352687155 2024-09-13T01:43:21.394738+0000 2024-09-12T01:55:58.485 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/896141869 2024-09-13T01:43:21.394738+0000 2024-09-12T01:55:58.485 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1352687155 2024-09-13T01:43:21.394738+0000 2024-09-12T01:55:58.485 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/687202663 2024-09-13T01:42:58.411979+0000 2024-09-12T01:55:58.485 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1934942517 2024-09-13T01:42:58.411979+0000 2024-09-12T01:55:58.485 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/445870040 2024-09-13T01:42:58.411979+0000 2024-09-12T01:55:58.485 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1799979884 2024-09-13T01:42:58.411979+0000 2024-09-12T01:55:58.485 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1934942517 2024-09-13T01:42:58.411979+0000 2024-09-12T01:55:58.486 INFO:teuthology.orchestra.run.smithi070.stderr:listed 10 entries 2024-09-12T01:55:58.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.487+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1431593495 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9ac00a2b80 msgr2=0x7f9ac00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.487+0000 7f9adbbaa640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9ac00a2b80 0x7f9ac00a5040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009bd0 tx=0x7f9ad0005f90 comp rx=0 tx=0).stop 2024-09-12T01:55:58.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.487+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1431593495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ad4102790 msgr2=0x7f9ad4198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:58.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.487+0000 7f9adbbaa640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ad4102790 0x7f9ad4198a20 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006010 tx=0x7f9ac40042f0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.487+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1431593495 shutdown_connections 2024-09-12T01:55:58.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.487+0000 7f9adbbaa640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9ac00a2b80 0x7f9ac00a5040 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.487+0000 7f9adbbaa640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ad4106f10 0x7f9ad419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.487+0000 7f9adbbaa640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ad4102790 0x7f9ad4198a20 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.487+0000 7f9adbbaa640 1 --2- 172.21.15.70:0/1431593495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9ad4101de0 0x7f9ad41984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:58.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.487+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1431593495 >> 172.21.15.70:0/1431593495 conn(0x7f9ad40fd8c0 msgr2=0x7f9ad40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:58.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.487+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1431593495 shutdown_connections 2024-09-12T01:55:58.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:55:58.487+0000 7f9adbbaa640 1 -- 172.21.15.70:0/1431593495 wait complete. 2024-09-12T01:55:58.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:58 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1431593495' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:55:58.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:58 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1431593495' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:55:59.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:58 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1431593495' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:55:59.172 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:55:59.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:59.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:55:59.228 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:55:59.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:59.228 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:55:59.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:59.266 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-12T01:55:59.322 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:55:59.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:59.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:55:59.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:59.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-09-12T01:55:59.488 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T01:55:59.498 INFO:tasks.cephadm:Teardown begin 2024-09-12T01:55:59.498 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:55:59.498 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:55:59.751 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:55:59.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:55:59 smithi070 ceph-mon[31177]: pgmap v452: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:55:59.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:55:59 smithi191 ceph-mon[35770]: pgmap v452: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:56:00.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:55:59 smithi152 ceph-mon[35055]: pgmap v452: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-12T01:56:00.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.282+0000 7f5394334640 1 -- 172.21.15.70:0/785038757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f538c100a80 msgr2=0x7f538c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.282+0000 7f5394334640 1 --2- 172.21.15.70:0/785038757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f538c100a80 0x7f538c100ee0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f5388009930 tx=0x7f538802a420 comp rx=0 tx=0).stop 2024-09-12T01:56:00.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.282+0000 7f5394334640 1 -- 172.21.15.70:0/785038757 shutdown_connections 2024-09-12T01:56:00.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.282+0000 7f5394334640 1 --2- 172.21.15.70:0/785038757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f538c101420 0x7f538c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.282+0000 7f5394334640 1 --2- 172.21.15.70:0/785038757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f538c100a80 0x7f538c100ee0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.282+0000 7f5394334640 1 --2- 172.21.15.70:0/785038757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f538c106a80 0x7f538c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.282+0000 7f5394334640 1 -- 172.21.15.70:0/785038757 >> 172.21.15.70:0/785038757 conn(0x7f538c0fc7a0 msgr2=0x7f538c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:00.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.282+0000 7f5394334640 1 -- 172.21.15.70:0/785038757 shutdown_connections 2024-09-12T01:56:00.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.282+0000 7f5394334640 1 -- 172.21.15.70:0/785038757 wait complete. 2024-09-12T01:56:00.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.283+0000 7f5394334640 1 Processor -- start 2024-09-12T01:56:00.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.283+0000 7f5394334640 1 -- start start 2024-09-12T01:56:00.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.283+0000 7f5394334640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f538c100a80 0x7f538c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.283+0000 7f5394334640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f538c101420 0x7f538c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.283+0000 7f5394334640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f538c106a80 0x7f538c199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.283+0000 7f5394334640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f538c110fa0 con 0x7f538c101420 2024-09-12T01:56:00.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.283+0000 7f5394334640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f538c110e20 con 0x7f538c100a80 2024-09-12T01:56:00.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.283+0000 7f5394334640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f538c111120 con 0x7f538c106a80 2024-09-12T01:56:00.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.283+0000 7f53918cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f538c101420 0x7f538c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.283+0000 7f53918cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f538c101420 0x7f538c199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40750/0 (socket says 172.21.15.70:40750) 2024-09-12T01:56:00.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.283+0000 7f53918cf640 1 -- 172.21.15.70:0/1316752553 learned_addr learned my addr 172.21.15.70:0/1316752553 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.283+0000 7f53920d0640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f538c100a80 0x7f538c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.284+0000 7f53918cf640 1 -- 172.21.15.70:0/1316752553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f538c106a80 msgr2=0x7f538c199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.284+0000 7f53918cf640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f538c106a80 0x7f538c199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.284+0000 7f53918cf640 1 -- 172.21.15.70:0/1316752553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f538c100a80 msgr2=0x7f538c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.284+0000 7f53918cf640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f538c100a80 0x7f538c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.284+0000 7f53918cf640 1 -- 172.21.15.70:0/1316752553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c1a4750 con 0x7f538c101420 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.284+0000 7f53918cf640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f538c101420 0x7f538c199890 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5388009a50 tx=0x7f5388004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.284+0000 7f537f7fe640 1 -- 172.21.15.70:0/1316752553 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538803f030 con 0x7f538c101420 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.284+0000 7f5394334640 1 -- 172.21.15.70:0/1316752553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538c1a49e0 con 0x7f538c101420 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.284+0000 7f537f7fe640 1 -- 172.21.15.70:0/1316752553 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5388003af0 con 0x7f538c101420 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.284+0000 7f537f7fe640 1 -- 172.21.15.70:0/1316752553 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388035070 con 0x7f538c101420 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.284+0000 7f5394334640 1 -- 172.21.15.70:0/1316752553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538c1a4f10 con 0x7f538c101420 2024-09-12T01:56:00.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.285+0000 7f5394334640 1 -- 172.21.15.70:0/1316752553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f538c100ee0 con 0x7f538c101420 2024-09-12T01:56:00.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.286+0000 7f537f7fe640 1 -- 172.21.15.70:0/1316752553 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5388042030 con 0x7f538c101420 2024-09-12T01:56:00.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.287+0000 7f537f7fe640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f53780a2b80 0x7f53780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:00.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.287+0000 7f53920d0640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f53780a2b80 0x7f53780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:00.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.287+0000 7f537f7fe640 1 -- 172.21.15.70:0/1316752553 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f53880efd20 con 0x7f538c101420 2024-09-12T01:56:00.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.287+0000 7f53920d0640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f53780a2b80 0x7f53780a5040 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f538000ab60 tx=0x7f538000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:00.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.290+0000 7f537f7fe640 1 -- 172.21.15.70:0/1316752553 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f53880bcc80 con 0x7f538c101420 2024-09-12T01:56:00.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.490+0000 7f5394334640 1 -- 172.21.15.70:0/1316752553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f538c1a5230 con 0x7f538c101420 2024-09-12T01:56:00.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.491+0000 7f537f7fe640 1 -- 172.21.15.70:0/1316752553 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11994 (secure 0 0 0) 0x7f53880bc580 con 0x7f538c101420 2024-09-12T01:56:00.491 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:56:00.491 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"btime":"2024-09-12T01:54:37:622268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:54:36.766931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:56:00.491 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 37 2024-09-12T01:56:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.493+0000 7f5394334640 1 -- 172.21.15.70:0/1316752553 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f53780a2b80 msgr2=0x7f53780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.493+0000 7f5394334640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f53780a2b80 0x7f53780a5040 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f538000ab60 tx=0x7f538000a2d0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.493+0000 7f5394334640 1 -- 172.21.15.70:0/1316752553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f538c101420 msgr2=0x7f538c199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.493+0000 7f5394334640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f538c101420 0x7f538c199890 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5388009a50 tx=0x7f5388004270 comp rx=0 tx=0).stop 2024-09-12T01:56:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.493+0000 7f5394334640 1 -- 172.21.15.70:0/1316752553 shutdown_connections 2024-09-12T01:56:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.493+0000 7f5394334640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f53780a2b80 0x7f53780a5040 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.493+0000 7f5394334640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f538c106a80 0x7f538c199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.493+0000 7f5394334640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f538c101420 0x7f538c199890 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.493+0000 7f5394334640 1 --2- 172.21.15.70:0/1316752553 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f538c100a80 0x7f538c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.493+0000 7f5394334640 1 -- 172.21.15.70:0/1316752553 >> 172.21.15.70:0/1316752553 conn(0x7f538c0fc7a0 msgr2=0x7f538c0fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.493+0000 7f5394334640 1 -- 172.21.15.70:0/1316752553 shutdown_connections 2024-09-12T01:56:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:00.493+0000 7f5394334640 1 -- 172.21.15.70:0/1316752553 wait complete. 2024-09-12T01:56:00.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:00 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1316752553' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:00.914 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:00 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1316752553' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:00.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:00 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1316752553' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:01.092 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:56:01.338 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:01.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:01 smithi070 ceph-mon[31177]: pgmap v453: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2024-09-12T01:56:01.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.870+0000 7f94149a6640 1 -- 172.21.15.70:0/724223699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9410101de0 msgr2=0x7f94101021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.870+0000 7f94149a6640 1 --2- 172.21.15.70:0/724223699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9410101de0 0x7f94101021c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f9400009900 tx=0x7f940002a3f0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.870+0000 7f94149a6640 1 -- 172.21.15.70:0/724223699 shutdown_connections 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.870+0000 7f94149a6640 1 --2- 172.21.15.70:0/724223699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9410106f10 0x7f941010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.870+0000 7f94149a6640 1 --2- 172.21.15.70:0/724223699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9410102790 0x7f94101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.870+0000 7f94149a6640 1 --2- 172.21.15.70:0/724223699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9410101de0 0x7f94101021c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.870+0000 7f94149a6640 1 -- 172.21.15.70:0/724223699 >> 172.21.15.70:0/724223699 conn(0x7f94100fd8c0 msgr2=0x7f94100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.870+0000 7f94149a6640 1 -- 172.21.15.70:0/724223699 shutdown_connections 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.870+0000 7f94149a6640 1 -- 172.21.15.70:0/724223699 wait complete. 2024-09-12T01:56:01.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.871+0000 7f94149a6640 1 Processor -- start 2024-09-12T01:56:01.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.871+0000 7f94149a6640 1 -- start start 2024-09-12T01:56:01.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.871+0000 7f94149a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9410101de0 0x7f9410198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.871+0000 7f94149a6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9410102790 0x7f94101989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.871+0000 7f94149a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9410106f10 0x7f941019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.871+0000 7f94149a6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9410112090 con 0x7f9410101de0 2024-09-12T01:56:01.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.871+0000 7f94149a6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9410111f10 con 0x7f9410106f10 2024-09-12T01:56:01.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.871+0000 7f94149a6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9410112210 con 0x7f9410102790 2024-09-12T01:56:01.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f940e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9410101de0 0x7f9410198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f940e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9410101de0 0x7f9410198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41462/0 (socket says 172.21.15.70:41462) 2024-09-12T01:56:01.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f940e59c640 1 -- 172.21.15.70:0/4011758316 learned_addr learned my addr 172.21.15.70:0/4011758316 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:56:01.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f940ed9d640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9410106f10 0x7f941019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f940dd9b640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9410102790 0x7f94101989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f940e59c640 1 -- 172.21.15.70:0/4011758316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9410102790 msgr2=0x7f94101989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f940e59c640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9410102790 0x7f94101989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f940e59c640 1 -- 172.21.15.70:0/4011758316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9410106f10 msgr2=0x7f941019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f940e59c640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9410106f10 0x7f941019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f940e59c640 1 -- 172.21.15.70:0/4011758316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941019d440 con 0x7f9410101de0 2024-09-12T01:56:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f940e59c640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9410101de0 0x7f9410198490 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9400006010 tx=0x7f94000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f93ff7fe640 1 -- 172.21.15.70:0/4011758316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940003f030 con 0x7f9410101de0 2024-09-12T01:56:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f93ff7fe640 1 -- 172.21.15.70:0/4011758316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9400003d00 con 0x7f9410101de0 2024-09-12T01:56:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f94149a6640 1 -- 172.21.15.70:0/4011758316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941019d6d0 con 0x7f9410101de0 2024-09-12T01:56:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f93ff7fe640 1 -- 172.21.15.70:0/4011758316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400035070 con 0x7f9410101de0 2024-09-12T01:56:01.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.872+0000 7f94149a6640 1 -- 172.21.15.70:0/4011758316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94101a5010 con 0x7f9410101de0 2024-09-12T01:56:01.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.873+0000 7f94149a6640 1 -- 172.21.15.70:0/4011758316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94101021c0 con 0x7f9410101de0 2024-09-12T01:56:01.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.875+0000 7f93ff7fe640 1 -- 172.21.15.70:0/4011758316 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9400042030 con 0x7f9410101de0 2024-09-12T01:56:01.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.875+0000 7f93ff7fe640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93f80a2c00 0x7f93f80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:01.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.876+0000 7f940dd9b640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93f80a2c00 0x7f93f80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:01.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.876+0000 7f93ff7fe640 1 -- 172.21.15.70:0/4011758316 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f94000ef540 con 0x7f9410101de0 2024-09-12T01:56:01.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.876+0000 7f940dd9b640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93f80a2c00 0x7f93f80a50c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f94101088e0 tx=0x7f940400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:01.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:01.880+0000 7f93ff7fe640 1 -- 172.21.15.70:0/4011758316 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f94000bbf10 con 0x7f9410101de0 2024-09-12T01:56:01.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:01 smithi191 ceph-mon[35770]: pgmap v453: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2024-09-12T01:56:02.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:01 smithi152 ceph-mon[35055]: pgmap v453: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 13 op/s 2024-09-12T01:56:02.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.082+0000 7f94149a6640 1 -- 172.21.15.70:0/4011758316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f941010a0f0 con 0x7f9410101de0 2024-09-12T01:56:02.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.083+0000 7f93ff7fe640 1 -- 172.21.15.70:0/4011758316 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11994 (secure 0 0 0) 0x7f94000c0210 con 0x7f9410101de0 2024-09-12T01:56:02.083 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:56:02.083 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"btime":"2024-09-12T01:54:37:622268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14571,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/158611905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":158611905},{"type":"v1","addr":"172.21.15.70:6835","nonce":158611905}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2540092631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2540092631},{"type":"v1","addr":"172.21.15.70:6837","nonce":2540092631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T01:49:57.864263+0000","modified":"2024-09-12T01:54:36.766931+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24452,"mds_1":24445,"mds_2":24437,"mds_3":24433,"mds_4":24427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14637":{"gid":14637,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6839/3076923681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":3076923681},{"type":"v1","addr":"172.21.15.70:6839","nonce":3076923681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14649":{"gid":14649,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6841/3509291516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3509291516},{"type":"v1","addr":"172.21.15.70:6841","nonce":3509291516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24392":{"gid":24392,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6833/2100585386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":2100585386},{"type":"v1","addr":"172.21.15.152:6833","nonce":2100585386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6833/1019939610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1019939610},{"type":"v1","addr":"172.21.15.191:6833","nonce":1019939610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.152:6835/2743921312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2743921312},{"type":"v1","addr":"172.21.15.152:6835","nonce":2743921312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24427":{"gid":24427,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6835/97556731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":97556731},{"type":"v1","addr":"172.21.15.191:6835","nonce":97556731}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.191:6837/1473295002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":1473295002},{"type":"v1","addr":"172.21.15.191:6837","nonce":1473295002}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.152:6837/3978171312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6836","nonce":3978171312},{"type":"v1","addr":"172.21.15.152:6837","nonce":3978171312}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.191:6839/1679121869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":1679121869},{"type":"v1","addr":"172.21.15.191:6839","nonce":1679121869}]},"join_fscid":-1,"export_targets":[0,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6839/3057936512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6838","nonce":3057936512},{"type":"v1","addr":"172.21.15.152:6839","nonce":3057936512}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24452,"qdb_cluster":[24452,24445,24437,24433,24427]},"id":1}]} 2024-09-12T01:56:02.083 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 37 2024-09-12T01:56:02.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.085+0000 7f94149a6640 1 -- 172.21.15.70:0/4011758316 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93f80a2c00 msgr2=0x7f93f80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.085+0000 7f94149a6640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93f80a2c00 0x7f93f80a50c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f94101088e0 tx=0x7f940400b390 comp rx=0 tx=0).stop 2024-09-12T01:56:02.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.085+0000 7f94149a6640 1 -- 172.21.15.70:0/4011758316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9410101de0 msgr2=0x7f9410198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:02.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.085+0000 7f94149a6640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9410101de0 0x7f9410198490 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9400006010 tx=0x7f94000042f0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.085+0000 7f94149a6640 1 -- 172.21.15.70:0/4011758316 shutdown_connections 2024-09-12T01:56:02.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.085+0000 7f94149a6640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f93f80a2c00 0x7f93f80a50c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.085+0000 7f94149a6640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9410106f10 0x7f941019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.085+0000 7f94149a6640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9410102790 0x7f94101989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.085+0000 7f94149a6640 1 --2- 172.21.15.70:0/4011758316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9410101de0 0x7f9410198490 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:02.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.085+0000 7f94149a6640 1 -- 172.21.15.70:0/4011758316 >> 172.21.15.70:0/4011758316 conn(0x7f94100fd8c0 msgr2=0x7f94100fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:02.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.085+0000 7f94149a6640 1 -- 172.21.15.70:0/4011758316 shutdown_connections 2024-09-12T01:56:02.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:02.085+0000 7f94149a6640 1 -- 172.21.15.70:0/4011758316 wait complete. 2024-09-12T01:56:02.898 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:02 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/4011758316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:02.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:56:02.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:02 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/4011758316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:03.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:02 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/4011758316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:56:03.174 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:03.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.640+0000 7f384af96640 1 -- 172.21.15.70:0/1298460460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3844100a90 msgr2=0x7f3844100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:03.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.640+0000 7f384af96640 1 --2- 172.21.15.70:0/1298460460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3844100a90 0x7f3844100ef0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3830009930 tx=0x7f383002a420 comp rx=0 tx=0).stop 2024-09-12T01:56:03.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.640+0000 7f384af96640 1 -- 172.21.15.70:0/1298460460 shutdown_connections 2024-09-12T01:56:03.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.640+0000 7f384af96640 1 --2- 172.21.15.70:0/1298460460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3844101430 0x7f384410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.640+0000 7f384af96640 1 --2- 172.21.15.70:0/1298460460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3844100a90 0x7f3844100ef0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.640+0000 7f384af96640 1 --2- 172.21.15.70:0/1298460460 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3844106a90 0x7f3844106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.640+0000 7f384af96640 1 -- 172.21.15.70:0/1298460460 >> 172.21.15.70:0/1298460460 conn(0x7f38440fc7d0 msgr2=0x7f38440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:03.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.640+0000 7f384af96640 1 -- 172.21.15.70:0/1298460460 shutdown_connections 2024-09-12T01:56:03.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.640+0000 7f384af96640 1 -- 172.21.15.70:0/1298460460 wait complete. 2024-09-12T01:56:03.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f384af96640 1 Processor -- start 2024-09-12T01:56:03.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f384af96640 1 -- start start 2024-09-12T01:56:03.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f384af96640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3844100a90 0x7f38441993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:03.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f384af96640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3844101430 0x7f3844199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:03.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f384af96640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3844106a90 0x7f38441a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:03.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f384af96640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3844110f70 con 0x7f3844106a90 2024-09-12T01:56:03.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f384af96640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3844110df0 con 0x7f3844100a90 2024-09-12T01:56:03.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f384af96640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f38441110f0 con 0x7f3844101430 2024-09-12T01:56:03.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f3849533640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3844106a90 0x7f38441a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:03.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f3849533640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3844106a90 0x7f38441a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41488/0 (socket says 172.21.15.70:41488) 2024-09-12T01:56:03.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f3849533640 1 -- 172.21.15.70:0/1459768841 learned_addr learned my addr 172.21.15.70:0/1459768841 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:56:03.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f3843fff640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3844101430 0x7f3844199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:03.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f3848d32640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3844100a90 0x7f38441993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:03.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f3849533640 1 -- 172.21.15.70:0/1459768841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3844101430 msgr2=0x7f3844199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:03.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f3849533640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3844101430 0x7f3844199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f3849533640 1 -- 172.21.15.70:0/1459768841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3844100a90 msgr2=0x7f38441993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:03.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f3849533640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3844100a90 0x7f38441993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.641+0000 7f3849533640 1 -- 172.21.15.70:0/1459768841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38441a4980 con 0x7f3844106a90 2024-09-12T01:56:03.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.642+0000 7f3849533640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3844106a90 0x7f38441a4440 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f383c00cad0 tx=0x7f383c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:03.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.642+0000 7f3841ffb640 1 -- 172.21.15.70:0/1459768841 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c00ae20 con 0x7f3844106a90 2024-09-12T01:56:03.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.642+0000 7f3841ffb640 1 -- 172.21.15.70:0/1459768841 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f383c004b20 con 0x7f3844106a90 2024-09-12T01:56:03.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.642+0000 7f384af96640 1 -- 172.21.15.70:0/1459768841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38441a4b50 con 0x7f3844106a90 2024-09-12T01:56:03.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.642+0000 7f3841ffb640 1 -- 172.21.15.70:0/1459768841 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c00f780 con 0x7f3844106a90 2024-09-12T01:56:03.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.642+0000 7f384af96640 1 -- 172.21.15.70:0/1459768841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38441a5010 con 0x7f3844106a90 2024-09-12T01:56:03.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.643+0000 7f384af96640 1 -- 172.21.15.70:0/1459768841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3844100ef0 con 0x7f3844106a90 2024-09-12T01:56:03.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.644+0000 7f3841ffb640 1 -- 172.21.15.70:0/1459768841 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f383c004cd0 con 0x7f3844106a90 2024-09-12T01:56:03.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.644+0000 7f3841ffb640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f38340a2b80 0x7f38340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:03.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.645+0000 7f3848d32640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f38340a2b80 0x7f38340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:03.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.645+0000 7f3841ffb640 1 -- 172.21.15.70:0/1459768841 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f383c0cf070 con 0x7f3844106a90 2024-09-12T01:56:03.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.645+0000 7f3848d32640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f38340a2b80 0x7f38340a5040 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3838005d00 tx=0x7f383800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:03.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.649+0000 7f3841ffb640 1 -- 172.21.15.70:0/1459768841 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f383c014030 con 0x7f3844106a90 2024-09-12T01:56:03.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.821+0000 7f384af96640 1 -- 172.21.15.70:0/1459768841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f384406ad80 con 0x7f3844106a90 2024-09-12T01:56:03.821 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:03 smithi070 ceph-mon[31177]: pgmap v454: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:56:03.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.823+0000 7f3841ffb640 1 -- 172.21.15.70:0/1459768841 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22713 (secure 0 0 0) 0x7f383c09b940 con 0x7f3844106a90 2024-09-12T01:56:03.823 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-12T01:56:03.824 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"2d8cad48-70a8-11ef-bcea-c7b262605968","created":"2024-09-12T01:42:34.901771+0000","modified":"2024-09-12T01:50:22.600430+0000","last_up_change":"2024-09-12T01:49:09.529447+0000","last_in_change":"2024-09-12T01:48:46.474366+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:45:33.697735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:49:54.140097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:49:56.005187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2470f1bd-a9b4-4fe8-ba99-4a3d5c931ff8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6803","nonce":4255694837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6805","nonce":4255694837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6809","nonce":4255694837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":4255694837},{"type":"v1","addr":"172.21.15.70:6807","nonce":4255694837}]},"public_addr":"172.21.15.70:6803/4255694837","cluster_addr":"172.21.15.70:6805/4255694837","heartbeat_back_addr":"172.21.15.70:6809/4255694837","heartbeat_front_addr":"172.21.15.70:6807/4255694837","state":["exists","up"]},{"osd":1,"uuid":"77805875-8e33-446f-8ab1-c4304ce84ac9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6801","nonce":3805912241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6803","nonce":3805912241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6807","nonce":3805912241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3805912241},{"type":"v1","addr":"172.21.15.152:6805","nonce":3805912241}]},"public_addr":"172.21.15.152:6801/3805912241","cluster_addr":"172.21.15.152:6803/3805912241","heartbeat_back_addr":"172.21.15.152:6807/3805912241","heartbeat_front_addr":"172.21.15.152:6805/3805912241","state":["exists","up"]},{"osd":2,"uuid":"87e4206e-8a05-4e9c-ac94-0d55652e9263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6801","nonce":3832730083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6803","nonce":3832730083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6807","nonce":3832730083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3832730083},{"type":"v1","addr":"172.21.15.191:6805","nonce":3832730083}]},"public_addr":"172.21.15.191:6801/3832730083","cluster_addr":"172.21.15.191:6803/3832730083","heartbeat_back_addr":"172.21.15.191:6807/3832730083","heartbeat_front_addr":"172.21.15.191:6805/3832730083","state":["exists","up"]},{"osd":3,"uuid":"e03f26a7-5373-473a-a56d-978c040682b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6811","nonce":934346909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6813","nonce":934346909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6817","nonce":934346909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":934346909},{"type":"v1","addr":"172.21.15.70:6815","nonce":934346909}]},"public_addr":"172.21.15.70:6811/934346909","cluster_addr":"172.21.15.70:6813/934346909","heartbeat_back_addr":"172.21.15.70:6817/934346909","heartbeat_front_addr":"172.21.15.70:6815/934346909","state":["exists","up"]},{"osd":4,"uuid":"fc6da5dc-12f4-4168-8daf-3d5dd7c02e9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6809","nonce":2197110857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6811","nonce":2197110857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6815","nonce":2197110857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2197110857},{"type":"v1","addr":"172.21.15.152:6813","nonce":2197110857}]},"public_addr":"172.21.15.152:6809/2197110857","cluster_addr":"172.21.15.152:6811/2197110857","heartbeat_back_addr":"172.21.15.152:6815/2197110857","heartbeat_front_addr":"172.21.15.152:6813/2197110857","state":["exists","up"]},{"osd":5,"uuid":"61d3e716-b2e4-4cd0-b90d-10c0d588e5bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6809","nonce":2424359422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6811","nonce":2424359422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6815","nonce":2424359422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":2424359422},{"type":"v1","addr":"172.21.15.191:6813","nonce":2424359422}]},"public_addr":"172.21.15.191:6809/2424359422","cluster_addr":"172.21.15.191:6811/2424359422","heartbeat_back_addr":"172.21.15.191:6815/2424359422","heartbeat_front_addr":"172.21.15.191:6813/2424359422","state":["exists","up"]},{"osd":6,"uuid":"54b45119-c39b-4fc3-a1a5-3ed1d28646ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6819","nonce":2771056283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6821","nonce":2771056283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6825","nonce":2771056283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2771056283},{"type":"v1","addr":"172.21.15.70:6823","nonce":2771056283}]},"public_addr":"172.21.15.70:6819/2771056283","cluster_addr":"172.21.15.70:6821/2771056283","heartbeat_back_addr":"172.21.15.70:6825/2771056283","heartbeat_front_addr":"172.21.15.70:6823/2771056283","state":["exists","up"]},{"osd":7,"uuid":"b0267631-52ff-4beb-80d8-70eb3fd0d237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6817","nonce":33447312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6819","nonce":33447312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6823","nonce":33447312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":33447312},{"type":"v1","addr":"172.21.15.152:6821","nonce":33447312}]},"public_addr":"172.21.15.152:6817/33447312","cluster_addr":"172.21.15.152:6819/33447312","heartbeat_back_addr":"172.21.15.152:6823/33447312","heartbeat_front_addr":"172.21.15.152:6821/33447312","state":["exists","up"]},{"osd":8,"uuid":"8c1e30c2-8ddb-4c88-bb8f-1e277c2e8e70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6817","nonce":1717172072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6819","nonce":1717172072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6823","nonce":1717172072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":1717172072},{"type":"v1","addr":"172.21.15.191:6821","nonce":1717172072}]},"public_addr":"172.21.15.191:6817/1717172072","cluster_addr":"172.21.15.191:6819/1717172072","heartbeat_back_addr":"172.21.15.191:6823/1717172072","heartbeat_front_addr":"172.21.15.191:6821/1717172072","state":["exists","up"]},{"osd":9,"uuid":"51b65e44-5204-4ce9-8626-3161eee23a6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6827","nonce":1622332043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6829","nonce":1622332043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6833","nonce":1622332043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1622332043},{"type":"v1","addr":"172.21.15.70:6831","nonce":1622332043}]},"public_addr":"172.21.15.70:6827/1622332043","cluster_addr":"172.21.15.70:6829/1622332043","heartbeat_back_addr":"172.21.15.70:6833/1622332043","heartbeat_front_addr":"172.21.15.70:6831/1622332043","state":["exists","up"]},{"osd":10,"uuid":"69fd537a-46d7-418a-9952-57c3e716456b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6825","nonce":3382303437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6827","nonce":3382303437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6831","nonce":3382303437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3382303437},{"type":"v1","addr":"172.21.15.152:6829","nonce":3382303437}]},"public_addr":"172.21.15.152:6825/3382303437","cluster_addr":"172.21.15.152:6827/3382303437","heartbeat_back_addr":"172.21.15.152:6831/3382303437","heartbeat_front_addr":"172.21.15.152:6829/3382303437","state":["exists","up"]},{"osd":11,"uuid":"c4d88a79-ce4f-45f6-aa34-8b9c66a953d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6825","nonce":1166888530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6827","nonce":1166888530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6831","nonce":1166888530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1166888530},{"type":"v1","addr":"172.21.15.191:6829","nonce":1166888530}]},"public_addr":"172.21.15.191:6825/1166888530","cluster_addr":"172.21.15.191:6827/1166888530","heartbeat_back_addr":"172.21.15.191:6831/1166888530","heartbeat_front_addr":"172.21.15.191:6829/1166888530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:44:40.225528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:05.970843+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:30.524368+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:45:54.623614+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:19.351520+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:46:44.265769+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:07.829290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:32.292157+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:47:56.630546+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:20.340300+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:48:43.895171+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:49:07.513415+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/2778664397":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/745799282":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6800/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/896141869":"2024-09-13T01:43:21.394738+0000","172.21.15.70:6801/1352687155":"2024-09-13T01:43:21.394738+0000","172.21.15.70:0/687202663":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6801/1934942517":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/445870040":"2024-09-13T01:42:58.411979+0000","172.21.15.70:0/1799979884":"2024-09-13T01:42:58.411979+0000","172.21.15.70:6800/1934942517":"2024-09-13T01:42:58.411979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:56:03.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.825+0000 7f384af96640 1 -- 172.21.15.70:0/1459768841 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f38340a2b80 msgr2=0x7f38340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.825+0000 7f384af96640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f38340a2b80 0x7f38340a5040 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3838005d00 tx=0x7f383800b410 comp rx=0 tx=0).stop 2024-09-12T01:56:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.825+0000 7f384af96640 1 -- 172.21.15.70:0/1459768841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3844106a90 msgr2=0x7f38441a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.825+0000 7f384af96640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3844106a90 0x7f38441a4440 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f383c00cad0 tx=0x7f383c00cf90 comp rx=0 tx=0).stop 2024-09-12T01:56:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.825+0000 7f384af96640 1 -- 172.21.15.70:0/1459768841 shutdown_connections 2024-09-12T01:56:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.825+0000 7f384af96640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f38340a2b80 0x7f38340a5040 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.825+0000 7f384af96640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3844106a90 0x7f38441a4440 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.825+0000 7f384af96640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3844101430 0x7f3844199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.825+0000 7f384af96640 1 --2- 172.21.15.70:0/1459768841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3844100a90 0x7f38441993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.825+0000 7f384af96640 1 -- 172.21.15.70:0/1459768841 >> 172.21.15.70:0/1459768841 conn(0x7f38440fc7d0 msgr2=0x7f38440fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.825+0000 7f384af96640 1 -- 172.21.15.70:0/1459768841 shutdown_connections 2024-09-12T01:56:03.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:03.825+0000 7f384af96640 1 -- 172.21.15.70:0/1459768841 wait complete. 2024-09-12T01:56:03.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:03 smithi191 ceph-mon[35770]: pgmap v454: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:56:04.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:03 smithi152 ceph-mon[35055]: pgmap v454: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-12T01:56:04.545 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T01:56:04.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:04 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1459768841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:04.790 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:04.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:04 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1459768841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:05.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:04 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1459768841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:56:05.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.269+0000 7fdc96271640 1 -- 172.21.15.70:0/46154610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc90106f10 msgr2=0x7fdc9010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.269+0000 7fdc96271640 1 --2- 172.21.15.70:0/46154610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc90106f10 0x7fdc9010ea90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009ca0 tx=0x7fdc8802a8c0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.269+0000 7fdc96271640 1 -- 172.21.15.70:0/46154610 shutdown_connections 2024-09-12T01:56:05.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.269+0000 7fdc96271640 1 --2- 172.21.15.70:0/46154610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc90106f10 0x7fdc9010ea90 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.269+0000 7fdc96271640 1 --2- 172.21.15.70:0/46154610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc90102790 0x7fdc901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.269+0000 7fdc96271640 1 --2- 172.21.15.70:0/46154610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc90101de0 0x7fdc901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.269+0000 7fdc96271640 1 -- 172.21.15.70:0/46154610 >> 172.21.15.70:0/46154610 conn(0x7fdc900fd8c0 msgr2=0x7fdc900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:05.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.269+0000 7fdc96271640 1 -- 172.21.15.70:0/46154610 shutdown_connections 2024-09-12T01:56:05.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.269+0000 7fdc96271640 1 -- 172.21.15.70:0/46154610 wait complete. 2024-09-12T01:56:05.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc96271640 1 Processor -- start 2024-09-12T01:56:05.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc96271640 1 -- start start 2024-09-12T01:56:05.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc96271640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc90101de0 0x7fdc90198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc96271640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc90102790 0x7fdc90198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc96271640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc90106f10 0x7fdc9019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc96271640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc90112150 con 0x7fdc90101de0 2024-09-12T01:56:05.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc96271640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdc90111fd0 con 0x7fdc90106f10 2024-09-12T01:56:05.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc96271640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdc901122d0 con 0x7fdc90102790 2024-09-12T01:56:05.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc8ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc90101de0 0x7fdc90198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc8ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc90101de0 0x7fdc90198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41520/0 (socket says 172.21.15.70:41520) 2024-09-12T01:56:05.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc8ffff640 1 -- 172.21.15.70:0/867117135 learned_addr learned my addr 172.21.15.70:0/867117135 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:56:05.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc8ffff640 1 -- 172.21.15.70:0/867117135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc90102790 msgr2=0x7fdc90198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc8ffff640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc90102790 0x7fdc90198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.270+0000 7fdc9480e640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc90106f10 0x7fdc9019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.271+0000 7fdc8ffff640 1 -- 172.21.15.70:0/867117135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc90106f10 msgr2=0x7fdc9019cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.271+0000 7fdc8ffff640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc90106f10 0x7fdc9019cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.271+0000 7fdc8ffff640 1 -- 172.21.15.70:0/867117135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9019d620 con 0x7fdc90101de0 2024-09-12T01:56:05.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.271+0000 7fdc9480e640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc90106f10 0x7fdc9019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:05.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.271+0000 7fdc8ffff640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc90101de0 0x7fdc90198670 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000b4a0 tx=0x7fdc8000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:05.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.271+0000 7fdc8d7fa640 1 -- 172.21.15.70:0/867117135 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc80014070 con 0x7fdc90101de0 2024-09-12T01:56:05.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.271+0000 7fdc96271640 1 -- 172.21.15.70:0/867117135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9019d910 con 0x7fdc90101de0 2024-09-12T01:56:05.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.271+0000 7fdc8d7fa640 1 -- 172.21.15.70:0/867117135 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdc80010b10 con 0x7fdc90101de0 2024-09-12T01:56:05.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.271+0000 7fdc8d7fa640 1 -- 172.21.15.70:0/867117135 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc80017d60 con 0x7fdc90101de0 2024-09-12T01:56:05.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.271+0000 7fdc96271640 1 -- 172.21.15.70:0/867117135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc901a51f0 con 0x7fdc90101de0 2024-09-12T01:56:05.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.272+0000 7fdc96271640 1 -- 172.21.15.70:0/867117135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc90102240 con 0x7fdc90101de0 2024-09-12T01:56:05.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.273+0000 7fdc8d7fa640 1 -- 172.21.15.70:0/867117135 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdc80017070 con 0x7fdc90101de0 2024-09-12T01:56:05.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.274+0000 7fdc8d7fa640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdc780a2b80 0x7fdc780a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:05.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.274+0000 7fdc8f7fe640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdc780a2b80 0x7fdc780a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:05.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.274+0000 7fdc8d7fa640 1 -- 172.21.15.70:0/867117135 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fdc800ce500 con 0x7fdc90101de0 2024-09-12T01:56:05.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.274+0000 7fdc8f7fe640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdc780a2b80 0x7fdc780a5040 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdc900fdd50 tx=0x7fdc84006c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:05.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.278+0000 7fdc8d7fa640 1 -- 172.21.15.70:0/867117135 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc8009b460 con 0x7fdc90101de0 2024-09-12T01:56:05.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.483+0000 7fdc96271640 1 -- 172.21.15.70:0/867117135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdc90109b60 con 0x7fdc90101de0 2024-09-12T01:56:05.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.485+0000 7fdc8d7fa640 1 -- 172.21.15.70:0/867117135 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) ==== 161+0+0 (secure 0 0 0) 0x7fdc8009ad60 con 0x7fdc90101de0 2024-09-12T01:56:05.485 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:56:05.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.489+0000 7fdc96271640 1 -- 172.21.15.70:0/867117135 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdc780a2b80 msgr2=0x7fdc780a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.489+0000 7fdc96271640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdc780a2b80 0x7fdc780a5040 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdc900fdd50 tx=0x7fdc84006c90 comp rx=0 tx=0).stop 2024-09-12T01:56:05.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.489+0000 7fdc96271640 1 -- 172.21.15.70:0/867117135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc90101de0 msgr2=0x7fdc90198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:05.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.489+0000 7fdc96271640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc90101de0 0x7fdc90198670 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000b4a0 tx=0x7fdc8000b960 comp rx=0 tx=0).stop 2024-09-12T01:56:05.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.489+0000 7fdc96271640 1 -- 172.21.15.70:0/867117135 shutdown_connections 2024-09-12T01:56:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.489+0000 7fdc96271640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7fdc780a2b80 0x7fdc780a5040 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.489+0000 7fdc96271640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc90106f10 0x7fdc9019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.489+0000 7fdc96271640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc90102790 0x7fdc90198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.489+0000 7fdc96271640 1 --2- 172.21.15.70:0/867117135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc90101de0 0x7fdc90198670 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.489+0000 7fdc96271640 1 -- 172.21.15.70:0/867117135 >> 172.21.15.70:0/867117135 conn(0x7fdc900fd8c0 msgr2=0x7fdc900fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.489+0000 7fdc96271640 1 -- 172.21.15.70:0/867117135 shutdown_connections 2024-09-12T01:56:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:05.489+0000 7fdc96271640 1 -- 172.21.15.70:0/867117135 wait complete. 2024-09-12T01:56:05.669 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/867117135' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T01:56:05.670 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-mon[35770]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:56:05.670 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-mon[35770]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:56:05.670 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/867117135' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T01:56:05.670 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-c[66795]: ignoring --setuser ceph since I am not root 2024-09-12T01:56:05.670 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-c[66795]: ignoring --setgroup ceph since I am not root 2024-09-12T01:56:05.670 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-mds[66799]: -- 172.21.15.191:0/2398921236 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bae1ca1860 con 0x55bae1c7e800 2024-09-12T01:56:05.670 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-c[66795]: starting mds.c at 2024-09-12T01:56:05.671 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-f[66487]: ignoring --setuser ceph since I am not root 2024-09-12T01:56:05.671 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-f[66487]: ignoring --setgroup ceph since I am not root 2024-09-12T01:56:05.671 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-mds[66491]: -- 172.21.15.191:0/3163339867 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561e4420bc20 con 0x561e441e9400 2024-09-12T01:56:05.671 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-f[66487]: starting mds.f at 2024-09-12T01:56:05.671 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-i[67099]: ignoring --setuser ceph since I am not root 2024-09-12T01:56:05.671 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-i[67099]: ignoring --setgroup ceph since I am not root 2024-09-12T01:56:05.671 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-mds[67103]: -- 172.21.15.191:0/288522426 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5636da963860 con 0x5636da941400 2024-09-12T01:56:05.672 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-i[67099]: starting mds.i at 2024-09-12T01:56:05.672 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-l[66185]: ignoring --setuser ceph since I am not root 2024-09-12T01:56:05.672 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-l[66185]: ignoring --setgroup ceph since I am not root 2024-09-12T01:56:05.672 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-mds[66189]: -- 172.21.15.191:0/2399773684 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5633d6d97860 con 0x5633d6d75400 2024-09-12T01:56:05.672 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-l[66185]: starting mds.l at 2024-09-12T01:56:05.769 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a[72189]: ignoring --setuser ceph since I am not root 2024-09-12T01:56:05.769 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a[72189]: ignoring --setgroup ceph since I am not root 2024-09-12T01:56:05.769 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-mds[72193]: -- 172.21.15.70:0/3167534262 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eb4fadf860 con 0x55eb4fabd400 2024-09-12T01:56:05.769 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a[72189]: starting mds.a at 2024-09-12T01:56:05.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a[31173]: 2024-09-12T01:56:05.484+0000 7fed47889640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:56:05.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/867117135' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T01:56:05.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-mon[31177]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:56:05.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-mon[31177]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:56:05.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/867117135' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T01:56:05.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-mon[31177]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T01:56:05.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-mon[31177]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T01:56:05.771 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-mon[31177]: pgmap v456: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-12T01:56:05.771 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-g[71784]: ignoring --setuser ceph since I am not root 2024-09-12T01:56:05.771 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-g[71784]: ignoring --setgroup ceph since I am not root 2024-09-12T01:56:05.771 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-mds[71793]: -- 172.21.15.70:0/3240806158 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55914e343c20 con 0x55914e320800 2024-09-12T01:56:05.771 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:56:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-g[71784]: starting mds.g at 2024-09-12T01:56:05.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-mon[35770]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T01:56:05.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-mon[35770]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T01:56:05.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:05 smithi191 ceph-mon[35770]: pgmap v456: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-12T01:56:06.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/867117135' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T01:56:06.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-mon[35055]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:56:06.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-mon[35055]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:56:06.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/867117135' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T01:56:06.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-mon[35055]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T01:56:06.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-mon[35055]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T01:56:06.013 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-mon[35055]: pgmap v456: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-12T01:56:06.013 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b[65045]: ignoring --setuser ceph since I am not root 2024-09-12T01:56:06.013 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b[65045]: ignoring --setgroup ceph since I am not root 2024-09-12T01:56:06.013 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b[65045]: starting mds.b at 2024-09-12T01:56:06.014 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h[64743]: ignoring --setuser ceph since I am not root 2024-09-12T01:56:06.014 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h[64743]: ignoring --setgroup ceph since I am not root 2024-09-12T01:56:06.014 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-mds[64747]: -- 172.21.15.152:0/276620993 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f401f8d860 con 0x55f401f6a800 2024-09-12T01:56:06.014 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h[64743]: starting mds.h at 2024-09-12T01:56:06.014 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h[64743]: 2024-09-12T01:56:05.533+0000 7f073df7f640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6834/0: (98) Address already in use 2024-09-12T01:56:06.014 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-k[64126]: ignoring --setuser ceph since I am not root 2024-09-12T01:56:06.014 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-k[64126]: ignoring --setgroup ceph since I am not root 2024-09-12T01:56:06.014 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-mds[64130]: -- 172.21.15.152:0/767430882 <== mon.2 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d25b7e5860 con 0x55d25b7c3400 2024-09-12T01:56:06.014 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-k[64126]: starting mds.k at 2024-09-12T01:56:06.015 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-e[64439]: ignoring --setuser ceph since I am not root 2024-09-12T01:56:06.015 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-e[64439]: ignoring --setgroup ceph since I am not root 2024-09-12T01:56:06.015 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-mds[64443]: -- 172.21.15.152:0/2352421084 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564573e4f860 con 0x564573e2d000 2024-09-12T01:56:06.015 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:56:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-e[64439]: starting mds.e at 2024-09-12T01:56:06.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:56:06.396 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:06.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.817+0000 7f9c32899640 1 -- 172.21.15.70:0/4190819515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c2c101de0 msgr2=0x7f9c2c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.817+0000 7f9c32899640 1 --2- 172.21.15.70:0/4190819515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c2c101de0 0x7f9c2c1021c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009900 tx=0x7f9c1c02a410 comp rx=0 tx=0).stop 2024-09-12T01:56:06.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.817+0000 7f9c32899640 1 -- 172.21.15.70:0/4190819515 shutdown_connections 2024-09-12T01:56:06.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.817+0000 7f9c32899640 1 --2- 172.21.15.70:0/4190819515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2c106f10 0x7f9c2c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.817+0000 7f9c32899640 1 --2- 172.21.15.70:0/4190819515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c2c102790 0x7f9c2c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.817+0000 7f9c32899640 1 --2- 172.21.15.70:0/4190819515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c2c101de0 0x7f9c2c1021c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.817+0000 7f9c32899640 1 -- 172.21.15.70:0/4190819515 >> 172.21.15.70:0/4190819515 conn(0x7f9c2c0fd8c0 msgr2=0x7f9c2c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:06.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.817+0000 7f9c32899640 1 -- 172.21.15.70:0/4190819515 shutdown_connections 2024-09-12T01:56:06.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.817+0000 7f9c32899640 1 -- 172.21.15.70:0/4190819515 wait complete. 2024-09-12T01:56:06.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c32899640 1 Processor -- start 2024-09-12T01:56:06.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c32899640 1 -- start start 2024-09-12T01:56:06.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c32899640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c2c101de0 0x7f9c2c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:06.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c32899640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2c102790 0x7f9c2c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:06.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c32899640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c2c106f10 0x7f9c2c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:06.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c32899640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c1120d0 con 0x7f9c2c106f10 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c32899640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c111f50 con 0x7f9c2c102790 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c32899640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c112250 con 0x7f9c2c101de0 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c30e36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c2c106f10 0x7f9c2c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c30e36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c2c106f10 0x7f9c2c19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41570/0 (socket says 172.21.15.70:41570) 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c30e36640 1 -- 172.21.15.70:0/1820991640 learned_addr learned my addr 172.21.15.70:0/1820991640 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c2bfff640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c2c101de0 0x7f9c2c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c2b7fe640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2c102790 0x7f9c2c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c30e36640 1 -- 172.21.15.70:0/1820991640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c2c101de0 msgr2=0x7f9c2c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c30e36640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c2c101de0 0x7f9c2c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c30e36640 1 -- 172.21.15.70:0/1820991640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2c102790 msgr2=0x7f9c2c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.818+0000 7f9c30e36640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2c102790 0x7f9c2c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.819+0000 7f9c30e36640 1 -- 172.21.15.70:0/1820991640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c19d430 con 0x7f9c2c106f10 2024-09-12T01:56:06.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.819+0000 7f9c2bfff640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c2c101de0 0x7f9c2c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:06.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.819+0000 7f9c2b7fe640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2c102790 0x7f9c2c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:06.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.819+0000 7f9c30e36640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c2c106f10 0x7f9c2c19cd50 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400b970 tx=0x7f9c2400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:06.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.819+0000 7f9c297fa640 1 -- 172.21.15.70:0/1820991640 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24019070 con 0x7f9c2c106f10 2024-09-12T01:56:06.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.819+0000 7f9c32899640 1 -- 172.21.15.70:0/1820991640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2c19d720 con 0x7f9c2c106f10 2024-09-12T01:56:06.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.819+0000 7f9c297fa640 1 -- 172.21.15.70:0/1820991640 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9c2400cb40 con 0x7f9c2c106f10 2024-09-12T01:56:06.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.819+0000 7f9c297fa640 1 -- 172.21.15.70:0/1820991640 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24007700 con 0x7f9c2c106f10 2024-09-12T01:56:06.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.819+0000 7f9c32899640 1 -- 172.21.15.70:0/1820991640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2c1a5000 con 0x7f9c2c106f10 2024-09-12T01:56:06.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.820+0000 7f9c32899640 1 -- 172.21.15.70:0/1820991640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c2c1021c0 con 0x7f9c2c106f10 2024-09-12T01:56:06.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.821+0000 7f9c297fa640 1 -- 172.21.15.70:0/1820991640 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9c2401c070 con 0x7f9c2c106f10 2024-09-12T01:56:06.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.822+0000 7f9c297fa640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9c140a2b80 0x7f9c140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:06.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.822+0000 7f9c2bfff640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9c140a2b80 0x7f9c140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:06.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.822+0000 7f9c297fa640 1 -- 172.21.15.70:0/1820991640 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8670+0+0 (secure 0 0 0) 0x7f9c240ced30 con 0x7f9c2c106f10 2024-09-12T01:56:06.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.822+0000 7f9c2bfff640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9c140a2b80 0x7f9c140a5040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c000c00 tx=0x7f9c1c032d60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:06.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:06.825+0000 7f9c297fa640 1 -- 172.21.15.70:0/1820991640 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9c2409bae0 con 0x7f9c2c106f10 2024-09-12T01:56:07.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.027+0000 7f9c32899640 1 -- 172.21.15.70:0/1820991640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9c2c1a52a0 con 0x7f9c2c106f10 2024-09-12T01:56:07.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.498+0000 7f9c297fa640 1 -- 172.21.15.70:0/1820991640 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) ==== 104+0+0 (secure 0 0 0) 0x7f9c2409b3e0 con 0x7f9c2c106f10 2024-09-12T01:56:07.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.501+0000 7f9c32899640 1 -- 172.21.15.70:0/1820991640 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9c140a2b80 msgr2=0x7f9c140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:07.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.501+0000 7f9c32899640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9c140a2b80 0x7f9c140a5040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c000c00 tx=0x7f9c1c032d60 comp rx=0 tx=0).stop 2024-09-12T01:56:07.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.501+0000 7f9c32899640 1 -- 172.21.15.70:0/1820991640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c2c106f10 msgr2=0x7f9c2c19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:07.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.501+0000 7f9c32899640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c2c106f10 0x7f9c2c19cd50 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400b970 tx=0x7f9c2400be30 comp rx=0 tx=0).stop 2024-09-12T01:56:07.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.501+0000 7f9c32899640 1 -- 172.21.15.70:0/1820991640 shutdown_connections 2024-09-12T01:56:07.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.501+0000 7f9c32899640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f9c140a2b80 0x7f9c140a5040 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.501+0000 7f9c32899640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c2c106f10 0x7f9c2c19cd50 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.501+0000 7f9c32899640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c2c102790 0x7f9c2c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.501+0000 7f9c32899640 1 --2- 172.21.15.70:0/1820991640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c2c101de0 0x7f9c2c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.501+0000 7f9c32899640 1 -- 172.21.15.70:0/1820991640 >> 172.21.15.70:0/1820991640 conn(0x7f9c2c0fd8c0 msgr2=0x7f9c2c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.501+0000 7f9c32899640 1 -- 172.21.15.70:0/1820991640 shutdown_connections 2024-09-12T01:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:07.501+0000 7f9c32899640 1 -- 172.21.15.70:0/1820991640 wait complete. 2024-09-12T01:56:07.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.70:6838/562061317,v1:172.21.15.70:6839/562061317] up:boot 2024-09-12T01:56:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.152:6832/2743526359,v1:172.21.15.152:6834/2743526359] up:boot 2024-09-12T01:56:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.152:6833/4215941020,v1:172.21.15.152:6835/4215941020] up:boot 2024-09-12T01:56:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.70:6840/576034496,v1:172.21.15.70:6841/576034496] up:boot 2024-09-12T01:56:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.152:6836/3822798974,v1:172.21.15.152:6837/3822798974] up:boot 2024-09-12T01:56:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.191:6832/274214988,v1:172.21.15.191:6836/274214988] up:boot 2024-09-12T01:56:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.191:6833/4174140783,v1:172.21.15.191:6837/4174140783] up:boot 2024-09-12T01:56:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.191:6835/2968516705,v1:172.21.15.191:6839/2968516705] up:boot 2024-09-12T01:56:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.191:6834/267556493,v1:172.21.15.191:6838/267556493] up:boot 2024-09-12T01:56:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: mds.? [v2:172.21.15.152:6838/2185106610,v1:172.21.15.152:6839/2185106610] up:boot 2024-09-12T01:56:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T01:56:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:56:07.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:56:07.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:56:07.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:56:07.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:56:07.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:56:07.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:56:07.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:56:07.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:56:07.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:56:07.764 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:07 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1820991640' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:56:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.70:6838/562061317,v1:172.21.15.70:6839/562061317] up:boot 2024-09-12T01:56:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.152:6832/2743526359,v1:172.21.15.152:6834/2743526359] up:boot 2024-09-12T01:56:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.152:6833/4215941020,v1:172.21.15.152:6835/4215941020] up:boot 2024-09-12T01:56:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.70:6840/576034496,v1:172.21.15.70:6841/576034496] up:boot 2024-09-12T01:56:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.152:6836/3822798974,v1:172.21.15.152:6837/3822798974] up:boot 2024-09-12T01:56:07.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.191:6832/274214988,v1:172.21.15.191:6836/274214988] up:boot 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.191:6833/4174140783,v1:172.21.15.191:6837/4174140783] up:boot 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.191:6835/2968516705,v1:172.21.15.191:6839/2968516705] up:boot 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.191:6834/267556493,v1:172.21.15.191:6838/267556493] up:boot 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: mds.? [v2:172.21.15.152:6838/2185106610,v1:172.21.15.152:6839/2185106610] up:boot 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:56:07.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:56:07.771 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:56:07.771 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:07 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1820991640' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:56:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.70:6838/562061317,v1:172.21.15.70:6839/562061317] up:boot 2024-09-12T01:56:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.152:6832/2743526359,v1:172.21.15.152:6834/2743526359] up:boot 2024-09-12T01:56:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.152:6833/4215941020,v1:172.21.15.152:6835/4215941020] up:boot 2024-09-12T01:56:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.70:6840/576034496,v1:172.21.15.70:6841/576034496] up:boot 2024-09-12T01:56:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.152:6836/3822798974,v1:172.21.15.152:6837/3822798974] up:boot 2024-09-12T01:56:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.191:6832/274214988,v1:172.21.15.191:6836/274214988] up:boot 2024-09-12T01:56:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.191:6833/4174140783,v1:172.21.15.191:6837/4174140783] up:boot 2024-09-12T01:56:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.191:6835/2968516705,v1:172.21.15.191:6839/2968516705] up:boot 2024-09-12T01:56:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.191:6834/267556493,v1:172.21.15.191:6838/267556493] up:boot 2024-09-12T01:56:07.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: mds.? [v2:172.21.15.152:6838/2185106610,v1:172.21.15.152:6839/2185106610] up:boot 2024-09-12T01:56:07.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T01:56:07.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T01:56:07.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T01:56:07.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T01:56:07.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T01:56:07.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T01:56:07.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T01:56:07.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T01:56:07.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T01:56:07.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T01:56:07.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: from='mgr.14148 172.21.15.70:0/162539229' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T01:56:07.939 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:07 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1820991640' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:56:08.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:56:08.525 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:08.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:08 smithi152 ceph-mon[35055]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:56:08.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:08 smithi152 ceph-mon[35055]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:56:08.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:08 smithi152 ceph-mon[35055]: Cluster is now healthy 2024-09-12T01:56:08.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:08 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1820991640' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:56:08.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:08 smithi152 ceph-mon[35055]: fsmap 12 up:standby 2024-09-12T01:56:08.763 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:08 smithi152 ceph-mon[35055]: pgmap v457: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-12T01:56:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:08 smithi070 ceph-mon[31177]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:56:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:08 smithi070 ceph-mon[31177]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:56:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:08 smithi070 ceph-mon[31177]: Cluster is now healthy 2024-09-12T01:56:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:08 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1820991640' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:56:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:08 smithi070 ceph-mon[31177]: fsmap 12 up:standby 2024-09-12T01:56:08.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:08 smithi070 ceph-mon[31177]: pgmap v457: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-12T01:56:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:08 smithi191 ceph-mon[35770]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:56:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:08 smithi191 ceph-mon[35770]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:56:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:08 smithi191 ceph-mon[35770]: Cluster is now healthy 2024-09-12T01:56:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:08 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1820991640' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:56:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:08 smithi191 ceph-mon[35770]: fsmap 12 up:standby 2024-09-12T01:56:08.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:08 smithi191 ceph-mon[35770]: pgmap v457: 97 pgs: 97 active+clean; 43 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-12T01:56:09.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.005+0000 7f724f7bd640 1 -- 172.21.15.70:0/2007691249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7248102570 msgr2=0x7f72481029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:09.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.005+0000 7f724f7bd640 1 --2- 172.21.15.70:0/2007691249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7248102570 0x7f72481029b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f723c009900 tx=0x7f723c02a480 comp rx=0 tx=0).stop 2024-09-12T01:56:09.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.005+0000 7f724f7bd640 1 -- 172.21.15.70:0/2007691249 shutdown_connections 2024-09-12T01:56:09.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.005+0000 7f724f7bd640 1 --2- 172.21.15.70:0/2007691249 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7248102ef0 0x7f724810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.005+0000 7f724f7bd640 1 --2- 172.21.15.70:0/2007691249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7248102570 0x7f72481029b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.005+0000 7f724f7bd640 1 --2- 172.21.15.70:0/2007691249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248100e20 0x7f7248101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.005+0000 7f724f7bd640 1 -- 172.21.15.70:0/2007691249 >> 172.21.15.70:0/2007691249 conn(0x7f72480fc7d0 msgr2=0x7f72480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:09.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.005+0000 7f724f7bd640 1 -- 172.21.15.70:0/2007691249 shutdown_connections 2024-09-12T01:56:09.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.005+0000 7f724f7bd640 1 -- 172.21.15.70:0/2007691249 wait complete. 2024-09-12T01:56:09.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.005+0000 7f724f7bd640 1 Processor -- start 2024-09-12T01:56:09.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.005+0000 7f724f7bd640 1 -- start start 2024-09-12T01:56:09.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724f7bd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248100e20 0x7f7248199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724f7bd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7248102570 0x7f7248199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724f7bd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7248102ef0 0x7f72481a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724f7bd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72481110a0 con 0x7f7248102ef0 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724f7bd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7248110f20 con 0x7f7248102570 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724f7bd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7248111220 con 0x7f7248100e20 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724dd5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7248102ef0 0x7f72481a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724dd5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7248102ef0 0x7f72481a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41598/0 (socket says 172.21.15.70:41598) 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724dd5a640 1 -- 172.21.15.70:0/2383092944 learned_addr learned my addr 172.21.15.70:0/2383092944 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724d559640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248100e20 0x7f7248199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724dd5a640 1 -- 172.21.15.70:0/2383092944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248100e20 msgr2=0x7f7248199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724dd5a640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248100e20 0x7f7248199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724dd5a640 1 -- 172.21.15.70:0/2383092944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7248102570 msgr2=0x7f7248199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:09.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724dd5a640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7248102570 0x7f7248199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724dd5a640 1 -- 172.21.15.70:0/2383092944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72481a49f0 con 0x7f7248102ef0 2024-09-12T01:56:09.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724dd5a640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7248102ef0 0x7f72481a44b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f724000eaa0 tx=0x7f724000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:09.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f723a7fc640 1 -- 172.21.15.70:0/2383092944 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724000cdb0 con 0x7f7248102ef0 2024-09-12T01:56:09.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f724f7bd640 1 -- 172.21.15.70:0/2383092944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72481a4bc0 con 0x7f7248102ef0 2024-09-12T01:56:09.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f723a7fc640 1 -- 172.21.15.70:0/2383092944 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7240004b20 con 0x7f7248102ef0 2024-09-12T01:56:09.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.006+0000 7f723a7fc640 1 -- 172.21.15.70:0/2383092944 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240011760 con 0x7f7248102ef0 2024-09-12T01:56:09.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.007+0000 7f724f7bd640 1 -- 172.21.15.70:0/2383092944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72481a5080 con 0x7f7248102ef0 2024-09-12T01:56:09.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.008+0000 7f724f7bd640 1 -- 172.21.15.70:0/2383092944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7248101200 con 0x7f7248102ef0 2024-09-12T01:56:09.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.009+0000 7f723a7fc640 1 -- 172.21.15.70:0/2383092944 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7240004cd0 con 0x7f7248102ef0 2024-09-12T01:56:09.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.009+0000 7f723a7fc640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f72340a2b80 0x7f72340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:09.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.009+0000 7f724d559640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f72340a2b80 0x7f72340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:09.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.009+0000 7f723a7fc640 1 -- 172.21.15.70:0/2383092944 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8670+0+0 (secure 0 0 0) 0x7f72400cf4a0 con 0x7f7248102ef0 2024-09-12T01:56:09.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.010+0000 7f724d559640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f72340a2b80 0x7f72340a5040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7244005fd0 tx=0x7f7244005e20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:09.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.014+0000 7f723a7fc640 1 -- 172.21.15.70:0/2383092944 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7240016030 con 0x7f7248102ef0 2024-09-12T01:56:09.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.180+0000 7f724f7bd640 1 -- 172.21.15.70:0/2383092944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f724806a560 con 0x7f7248102ef0 2024-09-12T01:56:09.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.508+0000 7f723a7fc640 1 -- 172.21.15.70:0/2383092944 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v85) ==== 181+0+0 (secure 0 0 0) 0x7f724806a560 con 0x7f7248102ef0 2024-09-12T01:56:09.508 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:56:09.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.511+0000 7f724f7bd640 1 -- 172.21.15.70:0/2383092944 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f72340a2b80 msgr2=0x7f72340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:09.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.511+0000 7f724f7bd640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f72340a2b80 0x7f72340a5040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7244005fd0 tx=0x7f7244005e20 comp rx=0 tx=0).stop 2024-09-12T01:56:09.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.511+0000 7f724f7bd640 1 -- 172.21.15.70:0/2383092944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7248102ef0 msgr2=0x7f72481a44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:09.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.511+0000 7f724f7bd640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7248102ef0 0x7f72481a44b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f724000eaa0 tx=0x7f724000ef60 comp rx=0 tx=0).stop 2024-09-12T01:56:09.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.512+0000 7f724f7bd640 1 -- 172.21.15.70:0/2383092944 shutdown_connections 2024-09-12T01:56:09.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.512+0000 7f724f7bd640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f72340a2b80 0x7f72340a5040 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.512+0000 7f724f7bd640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7248102ef0 0x7f72481a44b0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.512+0000 7f724f7bd640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7248102570 0x7f7248199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.512+0000 7f724f7bd640 1 --2- 172.21.15.70:0/2383092944 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248100e20 0x7f7248199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:09.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.512+0000 7f724f7bd640 1 -- 172.21.15.70:0/2383092944 >> 172.21.15.70:0/2383092944 conn(0x7f72480fc7d0 msgr2=0x7f7248105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:09.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.512+0000 7f724f7bd640 1 -- 172.21.15.70:0/2383092944 shutdown_connections 2024-09-12T01:56:09.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:09.512+0000 7f724f7bd640 1 -- 172.21.15.70:0/2383092944 wait complete. 2024-09-12T01:56:09.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:09 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2383092944' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:56:09.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:09 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2383092944' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:56:09.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:09 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2383092944' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:56:10.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:56:10.505 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T01:56:10.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:10 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/2383092944' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:56:10.847 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:10 smithi070 ceph-mon[31177]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T01:56:10.847 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:10 smithi070 ceph-mon[31177]: pgmap v459: 65 pgs: 65 active+clean; 577 KiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:10.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:10 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/2383092944' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:56:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:10 smithi191 ceph-mon[35770]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T01:56:10.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:10 smithi191 ceph-mon[35770]: pgmap v459: 65 pgs: 65 active+clean; 577 KiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:10.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.954+0000 7f02e75ea640 1 -- 172.21.15.70:0/3093766814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e0100a80 msgr2=0x7f02e0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:10.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.954+0000 7f02e75ea640 1 --2- 172.21.15.70:0/3093766814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e0100a80 0x7f02e0100ee0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009930 tx=0x7f02d002a420 comp rx=0 tx=0).stop 2024-09-12T01:56:10.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.954+0000 7f02e75ea640 1 -- 172.21.15.70:0/3093766814 shutdown_connections 2024-09-12T01:56:10.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.954+0000 7f02e75ea640 1 --2- 172.21.15.70:0/3093766814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02e0101420 0x7f02e010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:10.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.954+0000 7f02e75ea640 1 --2- 172.21.15.70:0/3093766814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e0100a80 0x7f02e0100ee0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:10.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.954+0000 7f02e75ea640 1 --2- 172.21.15.70:0/3093766814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e0106a80 0x7f02e0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:10.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.954+0000 7f02e75ea640 1 -- 172.21.15.70:0/3093766814 >> 172.21.15.70:0/3093766814 conn(0x7f02e00fc7a0 msgr2=0x7f02e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:10.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.955+0000 7f02e75ea640 1 -- 172.21.15.70:0/3093766814 shutdown_connections 2024-09-12T01:56:10.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.955+0000 7f02e75ea640 1 -- 172.21.15.70:0/3093766814 wait complete. 2024-09-12T01:56:10.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.955+0000 7f02e75ea640 1 Processor -- start 2024-09-12T01:56:10.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.955+0000 7f02e75ea640 1 -- start start 2024-09-12T01:56:10.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e75ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e0100a80 0x7f02e0197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:10.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e75ea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02e0101420 0x7f02e0197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:10.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e75ea640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e0106a80 0x7f02e019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:10.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e75ea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f02e0110fa0 con 0x7f02e0100a80 2024-09-12T01:56:10.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e75ea640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f02e0110e20 con 0x7f02e0101420 2024-09-12T01:56:10.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e75ea640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f02e0111120 con 0x7f02e0106a80 2024-09-12T01:56:10.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e5386640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e0100a80 0x7f02e0197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:10.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e5386640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e0100a80 0x7f02e0197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40070/0 (socket says 172.21.15.70:40070) 2024-09-12T01:56:10.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e5386640 1 -- 172.21.15.70:0/1064346477 learned_addr learned my addr 172.21.15.70:0/1064346477 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-12T01:56:10.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e4b85640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02e0101420 0x7f02e0197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:10.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e5b87640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e0106a80 0x7f02e019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:10.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e5386640 1 -- 172.21.15.70:0/1064346477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e0106a80 msgr2=0x7f02e019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:10.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e5386640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e0106a80 0x7f02e019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:10.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e5386640 1 -- 172.21.15.70:0/1064346477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02e0101420 msgr2=0x7f02e0197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:10.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e5386640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02e0101420 0x7f02e0197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:10.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e5386640 1 -- 172.21.15.70:0/1064346477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e019c3f0 con 0x7f02e0100a80 2024-09-12T01:56:10.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e5b87640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e0106a80 0x7f02e019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:56:10.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02e5386640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e0100a80 0x7f02e0197440 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009860 tx=0x7f02dc009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:10.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.956+0000 7f02d67fc640 1 -- 172.21.15.70:0/1064346477 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc005020 con 0x7f02e0100a80 2024-09-12T01:56:10.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.957+0000 7f02e75ea640 1 -- 172.21.15.70:0/1064346477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e019c6e0 con 0x7f02e0100a80 2024-09-12T01:56:10.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.957+0000 7f02d67fc640 1 -- 172.21.15.70:0/1064346477 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f02dc0047a0 con 0x7f02e0100a80 2024-09-12T01:56:10.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.957+0000 7f02d67fc640 1 -- 172.21.15.70:0/1064346477 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc007c40 con 0x7f02e0100a80 2024-09-12T01:56:10.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.957+0000 7f02e75ea640 1 -- 172.21.15.70:0/1064346477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e006a790 con 0x7f02e0100a80 2024-09-12T01:56:10.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.958+0000 7f02e75ea640 1 -- 172.21.15.70:0/1064346477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e01021c0 con 0x7f02e0100a80 2024-09-12T01:56:10.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.959+0000 7f02d67fc640 1 -- 172.21.15.70:0/1064346477 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f02dc004950 con 0x7f02e0100a80 2024-09-12T01:56:10.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.959+0000 7f02d67fc640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f02cc0a2b80 0x7f02cc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:56:10.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.959+0000 7f02d67fc640 1 -- 172.21.15.70:0/1064346477 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8116+0+0 (secure 0 0 0) 0x7f02dc0d0ba0 con 0x7f02e0100a80 2024-09-12T01:56:10.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.959+0000 7f02e4b85640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f02cc0a2b80 0x7f02cc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:56:10.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.960+0000 7f02e4b85640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f02cc0a2b80 0x7f02cc0a5040 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009900 tx=0x7f02d00058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:56:10.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:10.963+0000 7f02d67fc640 1 -- 172.21.15.70:0/1064346477 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f02dc09dbc0 con 0x7f02e0100a80 2024-09-12T01:56:11.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:10 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/2383092944' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:56:11.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:10 smithi152 ceph-mon[35055]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T01:56:11.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:10 smithi152 ceph-mon[35055]: pgmap v459: 65 pgs: 65 active+clean; 577 KiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:11.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.131+0000 7f02e75ea640 1 -- 172.21.15.70:0/1064346477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f02e01987d0 con 0x7f02e0100a80 2024-09-12T01:56:11.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.519+0000 7f02d67fc640 1 -- 172.21.15.70:0/1064346477 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v86) ==== 169+0+0 (secure 0 0 0) 0x7f02e01987d0 con 0x7f02e0100a80 2024-09-12T01:56:11.519 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2024-09-12T01:56:11.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.522+0000 7f02e75ea640 1 -- 172.21.15.70:0/1064346477 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f02cc0a2b80 msgr2=0x7f02cc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:11.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.522+0000 7f02e75ea640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f02cc0a2b80 0x7f02cc0a5040 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009900 tx=0x7f02d00058d0 comp rx=0 tx=0).stop 2024-09-12T01:56:11.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.522+0000 7f02e75ea640 1 -- 172.21.15.70:0/1064346477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e0100a80 msgr2=0x7f02e0197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:56:11.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.522+0000 7f02e75ea640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e0100a80 0x7f02e0197440 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009860 tx=0x7f02dc009d20 comp rx=0 tx=0).stop 2024-09-12T01:56:11.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.522+0000 7f02e75ea640 1 -- 172.21.15.70:0/1064346477 shutdown_connections 2024-09-12T01:56:11.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.522+0000 7f02e75ea640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.70:6800/633920150,v1:172.21.15.70:6801/633920150] conn(0x7f02cc0a2b80 0x7f02cc0a5040 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:11.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.522+0000 7f02e75ea640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e0106a80 0x7f02e019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:11.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.522+0000 7f02e75ea640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02e0101420 0x7f02e0197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:11.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.522+0000 7f02e75ea640 1 --2- 172.21.15.70:0/1064346477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e0100a80 0x7f02e0197440 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:56:11.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.522+0000 7f02e75ea640 1 -- 172.21.15.70:0/1064346477 >> 172.21.15.70:0/1064346477 conn(0x7f02e00fc7a0 msgr2=0x7f02e00fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:56:11.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.522+0000 7f02e75ea640 1 -- 172.21.15.70:0/1064346477 shutdown_connections 2024-09-12T01:56:11.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-12T01:56:11.523+0000 7f02e75ea640 1 -- 172.21.15.70:0/1064346477 wait complete. 2024-09-12T01:56:11.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:11 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1064346477' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:56:11.937 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:11 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1064346477' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:56:12.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:11 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1064346477' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T01:56:12.194 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:56:12.220 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:56:12.250 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:56:12.285 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T01:56:12.285 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:56:12.300 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:56:12.317 DEBUG:teuthology.orchestra.run.smithi191:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:56:12.342 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T01:56:12.343 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T01:56:12.343 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.a 2024-09-12T01:56:12.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:12 smithi070 systemd[1]: Stopping Ceph mon.a for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:12.687 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:12 smithi191 ceph-mon[35770]: from='client.? 172.21.15.70:0/1064346477' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:56:12.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:12 smithi191 ceph-mon[35770]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T01:56:12.688 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:12 smithi191 ceph-mon[35770]: pgmap v461: 1 pgs: 1 active+clean; 577 KiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:12.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:12 smithi070 ceph-mon[31177]: from='client.? 172.21.15.70:0/1064346477' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:56:12.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:12 smithi070 ceph-mon[31177]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T01:56:12.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:12 smithi070 ceph-mon[31177]: pgmap v461: 1 pgs: 1 active+clean; 577 KiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:12.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:12 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a[31173]: 2024-09-12T01:56:12.646+0000 7fed4d094640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:12.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:12 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a[31173]: 2024-09-12T01:56:12.646+0000 7fed4d094640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T01:56:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:12 smithi152 ceph-mon[35055]: from='client.? 172.21.15.70:0/1064346477' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T01:56:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:12 smithi152 ceph-mon[35055]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T01:56:13.012 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:12 smithi152 ceph-mon[35055]: pgmap v461: 1 pgs: 1 active+clean; 577 KiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T01:56:13.229 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:12 smithi070 podman[98241]: 2024-09-12 01:56:12.88167463 +0000 UTC m=+0.345667915 container died 88b95e97367a1353e941e7e1260eff825dcbf424dfca6d610f0c77a9ebd7771f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:56:13.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:13 smithi070 podman[98241]: 2024-09-12 01:56:13.229995747 +0000 UTC m=+0.693989036 container cleanup 88b95e97367a1353e941e7e1260eff825dcbf424dfca6d610f0c77a9ebd7771f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3) 2024-09-12T01:56:13.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 12 01:56:13 smithi070 bash[98241]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-a 2024-09-12T01:56:13.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T01:56:13.762 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:13.762 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T01:56:13.762 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T01:56:13.763 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.b 2024-09-12T01:56:14.089 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:13 smithi152 systemd[1]: Stopping Ceph mon.b for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:14.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:14 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-b[35051]: 2024-09-12T01:56:14.088+0000 7f2bee1a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:14.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:14 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-b[35051]: 2024-09-12T01:56:14.088+0000 7f2bee1a3640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T01:56:14.431 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:14 smithi152 podman[68099]: 2024-09-12 01:56:14.16075731 +0000 UTC m=+0.196569710 container died f2113509adab52818249c664e454ce813d7516ce5192f6521fc2a86b1dfe4121 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T01:56:14.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:14 smithi152 podman[68099]: 2024-09-12 01:56:14.530989767 +0000 UTC m=+0.566802170 container cleanup f2113509adab52818249c664e454ce813d7516ce5192f6521fc2a86b1dfe4121 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-12T01:56:14.762 INFO:journalctl@ceph.mon.b.smithi152.stdout:Sep 12 01:56:14 smithi152 bash[68099]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-b 2024-09-12T01:56:15.007 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T01:56:15.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:15.050 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T01:56:15.050 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T01:56:15.051 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.c 2024-09-12T01:56:15.438 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:15 smithi191 systemd[1]: Stopping Ceph mon.c for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:15.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:15 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-c[35766]: 2024-09-12T01:56:15.565+0000 7fc217a8d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:15.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:15 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-c[35766]: 2024-09-12T01:56:15.565+0000 7fc217a8d640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T01:56:15.938 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:15 smithi191 podman[70081]: 2024-09-12 01:56:15.657198515 +0000 UTC m=+0.410910917 container died b63bfce1942a6151386fc5cb8472c4845d27ff13bbab42ac84b283656386400f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-12T01:56:16.260 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:16 smithi191 podman[70081]: 2024-09-12 01:56:16.049867896 +0000 UTC m=+0.803580296 container cleanup b63bfce1942a6151386fc5cb8472c4845d27ff13bbab42ac84b283656386400f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:16.260 INFO:journalctl@ceph.mon.c.smithi191.stdout:Sep 12 01:56:16 smithi191 bash[70081]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mon-c 2024-09-12T01:56:16.479 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T01:56:16.520 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:16.520 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T01:56:16.520 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T01:56:16.521 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.x 2024-09-12T01:56:16.843 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:56:16 smithi070 systemd[1]: Stopping Ceph mgr.x for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:17.269 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:56:16 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x[31401]: 2024-09-12T01:56:16.842+0000 7f27d2be0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:17.269 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:56:16 smithi070 podman[98361]: 2024-09-12 01:56:16.873939198 +0000 UTC m=+0.152512485 container died d7b907f8f25794301e619104a6e9c9cdd00fa531a2850e48c6f3b0c900e622f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T01:56:17.671 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:56:17 smithi070 podman[98361]: 2024-09-12 01:56:17.519552952 +0000 UTC m=+0.798126236 container cleanup d7b907f8f25794301e619104a6e9c9cdd00fa531a2850e48c6f3b0c900e622f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T01:56:17.671 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 12 01:56:17 smithi070 bash[98361]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-x 2024-09-12T01:56:17.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T01:56:17.925 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:17.925 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T01:56:17.925 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T01:56:17.925 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.y 2024-09-12T01:56:18.262 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:56:17 smithi152 systemd[1]: Stopping Ceph mgr.y for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:18.944 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:56:18 smithi152 podman[68222]: 2024-09-12 01:56:18.540127843 +0000 UTC m=+0.411146697 container died fbb0fe756767e871f68e2ecf93634d83db004119410a2d35c5b4d75c6acb9791 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:19.262 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:56:19 smithi152 podman[68222]: 2024-09-12 01:56:19.027506697 +0000 UTC m=+0.898525550 container cleanup fbb0fe756767e871f68e2ecf93634d83db004119410a2d35c5b4d75c6acb9791 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T01:56:19.262 INFO:journalctl@ceph.mgr.y.smithi152.stdout:Sep 12 01:56:19 smithi152 bash[68222]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-y 2024-09-12T01:56:19.510 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T01:56:19.544 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:19.544 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T01:56:19.544 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T01:56:19.544 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.z 2024-09-12T01:56:19.909 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:56:19 smithi191 systemd[1]: Stopping Ceph mgr.z for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:20.187 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:56:19 smithi191 podman[70206]: 2024-09-12 01:56:19.909471254 +0000 UTC m=+0.163005245 container died b867e3395aeb5d02699ea74f96da8b17b45f2d742ad784f6ff0a0bf5dad4ff5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T01:56:20.507 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:56:20 smithi191 podman[70206]: 2024-09-12 01:56:20.323417571 +0000 UTC m=+0.576951554 container cleanup b867e3395aeb5d02699ea74f96da8b17b45f2d742ad784f6ff0a0bf5dad4ff5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T01:56:20.508 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:56:20 smithi191 bash[70206]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z 2024-09-12T01:56:20.751 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T01:56:20.773 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:56:20 smithi191 podman[70220]: 2024-09-12 01:56:20.508399066 +0000 UTC m=+0.594336380 container remove b867e3395aeb5d02699ea74f96da8b17b45f2d742ad784f6ff0a0bf5dad4ff5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T01:56:20.773 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:56:20 smithi191 systemd[1]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-12T01:56:20.773 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:56:20 smithi191 systemd[1]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-12T01:56:20.773 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:56:20 smithi191 systemd[1]: Stopped Ceph mgr.z for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:56:20.773 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Sep 12 01:56:20 smithi191 systemd[1]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mgr.z.service: Consumed 6.201s CPU time. 2024-09-12T01:56:20.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:20.786 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T01:56:20.786 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T01:56:20.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.0 2024-09-12T01:56:21.098 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:20 smithi070 systemd[1]: Stopping Ceph osd.0 for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:21.519 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:21 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0[44877]: 2024-09-12T01:56:21.098+0000 7f6ade79a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:21.519 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:21 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0[44877]: 2024-09-12T01:56:21.098+0000 7f6ade79a640 -1 osd.0 86 *** Got signal Terminated *** 2024-09-12T01:56:21.519 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:21 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0[44877]: 2024-09-12T01:56:21.098+0000 7f6ade79a640 -1 osd.0 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:56:26.769 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:26 smithi070 podman[98479]: 2024-09-12 01:56:26.485307912 +0000 UTC m=+5.509018884 container died 9e26145734a75444df31e4dcb4b1374bc98654e62abcdea6156b6b88d67b2812 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T01:56:27.142 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:26 smithi070 podman[98479]: 2024-09-12 01:56:26.923753596 +0000 UTC m=+5.947464609 container cleanup 9e26145734a75444df31e4dcb4b1374bc98654e62abcdea6156b6b88d67b2812 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T01:56:27.142 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:26 smithi070 bash[98479]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0 2024-09-12T01:56:27.519 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:27 smithi070 podman[98499]: 2024-09-12 01:56:27.142424351 +0000 UTC m=+0.652021998 container remove 9e26145734a75444df31e4dcb4b1374bc98654e62abcdea6156b6b88d67b2812 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:27.896 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:27 smithi070 podman[98587]: 2024-09-12 01:56:27.483590112 +0000 UTC m=+0.015933703 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:27.896 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:27 smithi070 podman[98587]: 2024-09-12 01:56:27.585092518 +0000 UTC m=+0.117436158 container create d49b3adfec5a7a11dbea064786c9ee258c79cf036dc2fcb221d6b8f2e2f4fe47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T01:56:27.896 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:27 smithi070 podman[98587]: 2024-09-12 01:56:27.82128065 +0000 UTC m=+0.353624241 container init d49b3adfec5a7a11dbea064786c9ee258c79cf036dc2fcb221d6b8f2e2f4fe47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T01:56:27.896 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:27 smithi070 podman[98587]: 2024-09-12 01:56:27.824620598 +0000 UTC m=+0.356964190 container start d49b3adfec5a7a11dbea064786c9ee258c79cf036dc2fcb221d6b8f2e2f4fe47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T01:56:27.896 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:27 smithi070 podman[98587]: 2024-09-12 01:56:27.896252271 +0000 UTC m=+0.428595887 container attach d49b3adfec5a7a11dbea064786c9ee258c79cf036dc2fcb221d6b8f2e2f4fe47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T01:56:28.269 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 12 01:56:28 smithi070 podman[98587]: 2024-09-12 01:56:28.010101988 +0000 UTC m=+0.542445580 container died d49b3adfec5a7a11dbea064786c9ee258c79cf036dc2fcb221d6b8f2e2f4fe47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T01:56:28.732 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T01:56:28.772 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:28.772 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T01:56:28.773 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T01:56:28.773 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.1 2024-09-12T01:56:29.083 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:28 smithi152 systemd[1]: Stopping Ceph osd.1 for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:29.512 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:29 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1[39427]: 2024-09-12T01:56:29.082+0000 7f5804e60640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:29.513 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:29 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1[39427]: 2024-09-12T01:56:29.082+0000 7f5804e60640 -1 osd.1 86 *** Got signal Terminated *** 2024-09-12T01:56:29.513 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:29 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1[39427]: 2024-09-12T01:56:29.082+0000 7f5804e60640 -1 osd.1 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:56:34.716 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:34 smithi152 podman[68343]: 2024-09-12 01:56:34.397055071 +0000 UTC m=+5.428077966 container died 7009d45db28af39d8a7c972aa2025f033f2ac0fc119c521d61986df019aa214f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T01:56:35.012 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:34 smithi152 podman[68343]: 2024-09-12 01:56:34.823855489 +0000 UTC m=+5.854878375 container cleanup 7009d45db28af39d8a7c972aa2025f033f2ac0fc119c521d61986df019aa214f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T01:56:35.012 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:34 smithi152 bash[68343]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1 2024-09-12T01:56:35.442 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:35 smithi152 podman[68361]: 2024-09-12 01:56:35.016894554 +0000 UTC m=+0.611630285 container remove 7009d45db28af39d8a7c972aa2025f033f2ac0fc119c521d61986df019aa214f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T01:56:35.745 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:35 smithi152 podman[68452]: 2024-09-12 01:56:35.345905701 +0000 UTC m=+0.016269171 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:35.745 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:35 smithi152 podman[68452]: 2024-09-12 01:56:35.477399244 +0000 UTC m=+0.147762703 container create 30d5f5913a5404eadf0a2d466ecd925e72bb6eb849b14b3e03e9e3eb9bce8f23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T01:56:35.745 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:35 smithi152 podman[68452]: 2024-09-12 01:56:35.745768889 +0000 UTC m=+0.416132357 container init 30d5f5913a5404eadf0a2d466ecd925e72bb6eb849b14b3e03e9e3eb9bce8f23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T01:56:36.013 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:35 smithi152 podman[68452]: 2024-09-12 01:56:35.749211071 +0000 UTC m=+0.419574534 container start 30d5f5913a5404eadf0a2d466ecd925e72bb6eb849b14b3e03e9e3eb9bce8f23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD) 2024-09-12T01:56:36.013 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:35 smithi152 podman[68452]: 2024-09-12 01:56:35.829094987 +0000 UTC m=+0.499458450 container attach 30d5f5913a5404eadf0a2d466ecd925e72bb6eb849b14b3e03e9e3eb9bce8f23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:56:36.013 INFO:journalctl@ceph.osd.1.smithi152.stdout:Sep 12 01:56:35 smithi152 podman[68452]: 2024-09-12 01:56:35.936361178 +0000 UTC m=+0.606724647 container died 30d5f5913a5404eadf0a2d466ecd925e72bb6eb849b14b3e03e9e3eb9bce8f23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:36.619 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T01:56:36.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:36.659 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T01:56:36.660 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T01:56:36.660 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.2 2024-09-12T01:56:36.938 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:36 smithi191 systemd[1]: Stopping Ceph osd.2 for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:37.195 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:36 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2[40746]: 2024-09-12T01:56:36.977+0000 7f9648774640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:37.195 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:36 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2[40746]: 2024-09-12T01:56:36.977+0000 7f9648774640 -1 osd.2 86 *** Got signal Terminated *** 2024-09-12T01:56:37.195 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:36 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2[40746]: 2024-09-12T01:56:36.977+0000 7f9648774640 -1 osd.2 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:56:42.753 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:42 smithi191 podman[70332]: 2024-09-12 01:56:42.439637197 +0000 UTC m=+5.584692479 container died 7586d7940e7ddb05c3c2fcc95441c595b8884c7cc03937342aac9b6ddfabe40d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-12T01:56:43.187 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:42 smithi191 podman[70332]: 2024-09-12 01:56:42.753472773 +0000 UTC m=+5.898528061 container cleanup 7586d7940e7ddb05c3c2fcc95441c595b8884c7cc03937342aac9b6ddfabe40d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T01:56:43.188 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:42 smithi191 bash[70332]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2 2024-09-12T01:56:43.188 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:42 smithi191 podman[70360]: 2024-09-12 01:56:42.955440968 +0000 UTC m=+0.513257413 container remove 7586d7940e7ddb05c3c2fcc95441c595b8884c7cc03937342aac9b6ddfabe40d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T01:56:43.642 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:43 smithi191 podman[70450]: 2024-09-12 01:56:43.274075797 +0000 UTC m=+0.015833598 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:43.642 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:43 smithi191 podman[70450]: 2024-09-12 01:56:43.423290046 +0000 UTC m=+0.165047834 container create 6a96dbff3edbad2d5051776e13682ed593d1067179da4fab75e52735c743c179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T01:56:43.938 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:43 smithi191 podman[70450]: 2024-09-12 01:56:43.643108168 +0000 UTC m=+0.384865956 container init 6a96dbff3edbad2d5051776e13682ed593d1067179da4fab75e52735c743c179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T01:56:43.938 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:43 smithi191 podman[70450]: 2024-09-12 01:56:43.646533483 +0000 UTC m=+0.388291273 container start 6a96dbff3edbad2d5051776e13682ed593d1067179da4fab75e52735c743c179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T01:56:43.938 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:43 smithi191 podman[70450]: 2024-09-12 01:56:43.701476065 +0000 UTC m=+0.443233865 container attach 6a96dbff3edbad2d5051776e13682ed593d1067179da4fab75e52735c743c179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T01:56:43.938 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:43 smithi191 podman[70450]: 2024-09-12 01:56:43.82999387 +0000 UTC m=+0.571751674 container died 6a96dbff3edbad2d5051776e13682ed593d1067179da4fab75e52735c743c179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T01:56:44.412 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T01:56:44.419 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:44 smithi191 podman[70473]: 2024-09-12 01:56:44.381155273 +0000 UTC m=+0.545120978 container remove 6a96dbff3edbad2d5051776e13682ed593d1067179da4fab75e52735c743c179 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-09-12T01:56:44.419 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:44 smithi191 systemd[1]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-12T01:56:44.419 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:44 smithi191 systemd[1]: Stopped Ceph osd.2 for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:56:44.419 INFO:journalctl@ceph.osd.2.smithi191.stdout:Sep 12 01:56:44 smithi191 systemd[1]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.2.service: Consumed 16.913s CPU time. 2024-09-12T01:56:44.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:44.455 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T01:56:44.455 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T01:56:44.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.3 2024-09-12T01:56:44.768 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:44 smithi070 systemd[1]: Stopping Ceph osd.3 for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:45.019 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:44 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3[51367]: 2024-09-12T01:56:44.767+0000 7f7f98ddf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:45.019 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:44 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3[51367]: 2024-09-12T01:56:44.767+0000 7f7f98ddf640 -1 osd.3 86 *** Got signal Terminated *** 2024-09-12T01:56:45.019 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:44 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3[51367]: 2024-09-12T01:56:44.767+0000 7f7f98ddf640 -1 osd.3 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:56:47.519 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:47 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3[51367]: 2024-09-12T01:56:47.198+0000 7f7f953e4640 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.427729+0000 front 2024-09-12T01:56:25.427763+0000 (oldest deadline 2024-09-12T01:56:47.127924+0000) 2024-09-12T01:56:47.931 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:47 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:47.561+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:48.187 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:47 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:47.930+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:56:48.519 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:48 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3[51367]: 2024-09-12T01:56:48.210+0000 7f7f953e4640 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.427729+0000 front 2024-09-12T01:56:25.427763+0000 (oldest deadline 2024-09-12T01:56:47.127924+0000) 2024-09-12T01:56:48.937 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:48 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:48.586+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:49.019 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:48 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:48.549+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:56:49.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:48 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:48.968+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:56:49.519 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:49 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3[51367]: 2024-09-12T01:56:49.207+0000 7f7f953e4640 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.427729+0000 front 2024-09-12T01:56:25.427763+0000 (oldest deadline 2024-09-12T01:56:47.127924+0000) 2024-09-12T01:56:49.937 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:49 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:49.563+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:50.019 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:49 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:49.549+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:56:50.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:49 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:49.658+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:56:50.437 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:49 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:49.981+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:56:50.519 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:50 smithi070 podman[98701]: 2024-09-12 01:56:50.248412685 +0000 UTC m=+5.593112902 container died 1c33780e9e12d7b29ecfce3f15563a6554f075289a3d74d78a2291360113b301 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:56:50.877 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:50 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:50.613+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:56:50.878 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:50 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:50.562+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:56:50.878 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:50 smithi070 podman[98701]: 2024-09-12 01:56:50.726477719 +0000 UTC m=+6.071177977 container cleanup 1c33780e9e12d7b29ecfce3f15563a6554f075289a3d74d78a2291360113b301 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:50.878 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:50 smithi070 bash[98701]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3 2024-09-12T01:56:50.937 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:50 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:50.537+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:51.269 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:50 smithi070 podman[98717]: 2024-09-12 01:56:50.878012476 +0000 UTC m=+0.627165791 container remove 1c33780e9e12d7b29ecfce3f15563a6554f075289a3d74d78a2291360113b301 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-12T01:56:51.437 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:50 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:50.938+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:56:51.534 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:51 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:51.530+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:56:51.535 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:51 smithi070 podman[98808]: 2024-09-12 01:56:51.186282067 +0000 UTC m=+0.015775979 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:51.535 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:51 smithi070 podman[98808]: 2024-09-12 01:56:51.320851103 +0000 UTC m=+0.150345045 container create 2f975d4f240461fd526ff59bd46f54f578a4bae47e0d60a07c900c768f3702c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T01:56:51.535 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:51 smithi070 podman[98808]: 2024-09-12 01:56:51.531586443 +0000 UTC m=+0.361080353 container init 2f975d4f240461fd526ff59bd46f54f578a4bae47e0d60a07c900c768f3702c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-12T01:56:51.535 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:51 smithi070 podman[98808]: 2024-09-12 01:56:51.535101358 +0000 UTC m=+0.364595257 container start 2f975d4f240461fd526ff59bd46f54f578a4bae47e0d60a07c900c768f3702c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T01:56:51.938 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:51 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:51.550+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:52.010 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:51 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:51.612+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:56:52.010 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:51 smithi070 podman[98808]: 2024-09-12 01:56:51.640052717 +0000 UTC m=+0.469546633 container attach 2f975d4f240461fd526ff59bd46f54f578a4bae47e0d60a07c900c768f3702c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T01:56:52.010 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 12 01:56:51 smithi070 podman[98808]: 2024-09-12 01:56:51.721389623 +0000 UTC m=+0.550883532 container died 2f975d4f240461fd526ff59bd46f54f578a4bae47e0d60a07c900c768f3702c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T01:56:52.012 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:51 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:51.611+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:56:52.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T01:56:52.374 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:52.374 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T01:56:52.374 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T01:56:52.374 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.4 2024-09-12T01:56:52.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:51 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:51.987+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:56:52.702 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:52 smithi152 systemd[1]: Stopping Ceph osd.4 for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:56:52.703 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:52 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:52.563+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:56:52.937 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:52 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:52.597+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:53.012 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:52 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4[46386]: 2024-09-12T01:56:52.702+0000 7f318cb1e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:53.012 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:52 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4[46386]: 2024-09-12T01:56:52.702+0000 7f318cb1e640 -1 osd.4 86 *** Got signal Terminated *** 2024-09-12T01:56:53.012 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:52 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4[46386]: 2024-09-12T01:56:52.702+0000 7f318cb1e640 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:56:53.019 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:52 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:52.564+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:56:53.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:52 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:52.632+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:56:53.437 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:52 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:52.960+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:56:53.937 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:53 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:53.620+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:54.012 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:53 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:53.611+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:56:54.019 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:53 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:53.585+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:56:54.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:53 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:53.589+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:56:54.437 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:53 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:53.946+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:56:54.938 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:54 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:54.617+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:55.012 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:54 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:54.602+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:56:55.019 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:54 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:54.550+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:56:55.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:54 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:54.561+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:56:55.437 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:54 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:54.975+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:56:55.762 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:55 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4[46386]: 2024-09-12T01:56:55.427+0000 7f3189123640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:29.860425+0000 front 2024-09-12T01:56:29.860443+0000 (oldest deadline 2024-09-12T01:56:55.160625+0000) 2024-09-12T01:56:55.762 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:55 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:55.607+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:56:55.937 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:55 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:55.601+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:56.019 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:55 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:55.532+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:56:56.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:55 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:55.598+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:56:56.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:55 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:55.598+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:56:56.437 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:56 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:56.008+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:56:56.762 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:56 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4[46386]: 2024-09-12T01:56:56.388+0000 7f3189123640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:29.860425+0000 front 2024-09-12T01:56:29.860443+0000 (oldest deadline 2024-09-12T01:56:55.160625+0000) 2024-09-12T01:56:56.762 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:56 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:56.576+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:56:56.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:56 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:56.576+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:56:56.892 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:56 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:56.613+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:56.893 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:56 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:56.613+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.413856+0000 front 2024-09-12T01:56:31.413752+0000 (oldest deadline 2024-09-12T01:56:56.113678+0000) 2024-09-12T01:56:56.920 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:56 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:56.538+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:56:56.921 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:56 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:56.564+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:56:56.921 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:56 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:56.564+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:56:57.187 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:56:56 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:56:56.892+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:56:57.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:56 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:56.984+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:56:57.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:56 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:56.984+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:56:57.762 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:57 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4[46386]: 2024-09-12T01:56:57.415+0000 7f3189123640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:29.860425+0000 front 2024-09-12T01:56:29.860443+0000 (oldest deadline 2024-09-12T01:56:55.160625+0000) 2024-09-12T01:56:57.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:57 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:57.544+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:56:57.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:57 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:57.544+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:56:57.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:57.569+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:56:57.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:57.569+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:56:57.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:57.507+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:56:57.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:57 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:57.507+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:56:57.938 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:56:57 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:56:57.847+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:56:57.938 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:57 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:57.627+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:57.938 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:57 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:57.627+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.413856+0000 front 2024-09-12T01:56:31.413752+0000 (oldest deadline 2024-09-12T01:56:56.113678+0000) 2024-09-12T01:56:58.352 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:58 smithi152 podman[68566]: 2024-09-12 01:56:58.095275749 +0000 UTC m=+5.526271257 container died 7fd0e7adac470f1d7e4a8cb3d23cbd2cb5cec060f5f7d3d501306ee143c77e02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T01:56:58.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:57 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:57.977+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:56:58.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:57 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:57.977+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:56:58.710 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:58 smithi152 podman[68566]: 2024-09-12 01:56:58.451586099 +0000 UTC m=+5.882581593 container cleanup 7fd0e7adac470f1d7e4a8cb3d23cbd2cb5cec060f5f7d3d501306ee143c77e02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T01:56:58.711 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:58 smithi152 bash[68566]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4 2024-09-12T01:56:58.711 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:58 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:58.576+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:56:58.711 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:58 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:58.576+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:56:58.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:58 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:58.521+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:56:58.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:58 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:58.521+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:56:58.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:58 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:58.499+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:56:58.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:58 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:58.499+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:56:58.892 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:58 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:58.638+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:58.892 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:58 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:58.638+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.413856+0000 front 2024-09-12T01:56:31.413752+0000 (oldest deadline 2024-09-12T01:56:56.113678+0000) 2024-09-12T01:56:59.012 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:58 smithi152 podman[68583]: 2024-09-12 01:56:58.711224553 +0000 UTC m=+0.614041155 container remove 7fd0e7adac470f1d7e4a8cb3d23cbd2cb5cec060f5f7d3d501306ee143c77e02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T01:56:59.187 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:56:58 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:56:58.892+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:56:59.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:58 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:58.962+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:56:59.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:56:58 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:56:58.962+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:56:59.339 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:59 smithi152 podman[68669]: 2024-09-12 01:56:59.020377789 +0000 UTC m=+0.108798907 container create 34a19704617ac1ecf4f01d3ab6a09e14744742e69f14433b18ed3ccb92c2ad47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T01:56:59.339 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:59 smithi152 podman[68669]: 2024-09-12 01:56:58.927850039 +0000 UTC m=+0.016271173 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:59.339 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:59 smithi152 podman[68669]: 2024-09-12 01:56:59.247833679 +0000 UTC m=+0.336254807 container init 34a19704617ac1ecf4f01d3ab6a09e14744742e69f14433b18ed3ccb92c2ad47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T01:56:59.339 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:59 smithi152 podman[68669]: 2024-09-12 01:56:59.25118949 +0000 UTC m=+0.339610614 container start 34a19704617ac1ecf4f01d3ab6a09e14744742e69f14433b18ed3ccb92c2ad47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:59.340 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:59 smithi152 podman[68669]: 2024-09-12 01:56:59.339663459 +0000 UTC m=+0.428084578 container attach 34a19704617ac1ecf4f01d3ab6a09e14744742e69f14433b18ed3ccb92c2ad47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T01:56:59.625 INFO:journalctl@ceph.osd.4.smithi152.stdout:Sep 12 01:56:59 smithi152 podman[68669]: 2024-09-12 01:56:59.442663447 +0000 UTC m=+0.531084566 container died 34a19704617ac1ecf4f01d3ab6a09e14744742e69f14433b18ed3ccb92c2ad47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T01:56:59.626 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:56:59 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:56:59.491+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:56:59.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:59 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:59.548+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:56:59.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:56:59 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:56:59.548+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:56:59.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:59 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:59.476+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:56:59.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:56:59 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:56:59.476+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:56:59.905 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:59 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:59.619+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:56:59.905 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:56:59 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:56:59.619+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.413856+0000 front 2024-09-12T01:56:31.413752+0000 (oldest deadline 2024-09-12T01:56:56.113678+0000) 2024-09-12T01:56:59.992 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:59 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:59.626+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:56:59.993 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:56:59 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:56:59.626+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:00.019 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T01:57:00.057 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:57:00.058 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T01:57:00.058 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T01:57:00.058 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.5 2024-09-12T01:57:00.187 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:00 smithi191 systemd[1]: Stopping Ceph osd.5 for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:57:00.188 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:56:59 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:56:59.905+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:00.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:00 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:00.006+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:00.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:00 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:00.006+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:00.595 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:00 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:00.333+0000 7fece72c4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:57:00.595 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:00 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:00.333+0000 7fece72c4640 -1 osd.5 86 *** Got signal Terminated *** 2024-09-12T01:57:00.595 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:00 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:00.333+0000 7fece72c4640 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:57:00.595 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:00 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:00.595+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:57:00.596 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:00 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:00.595+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.413856+0000 front 2024-09-12T01:56:31.413752+0000 (oldest deadline 2024-09-12T01:56:56.113678+0000) 2024-09-12T01:57:00.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:00 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:00.509+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:00.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:00 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:00.636+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:00.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:00 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:00.636+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:00.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:00.586+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:00.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:00.586+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:00.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:00.440+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:00.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:00 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:00.440+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:01.187 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:00 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:00.884+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:01.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:01 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:01.051+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:01.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:01 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:01.051+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:01.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:01 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:01.482+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:01.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:01 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:01.672+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:01.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:01 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:01.672+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:01.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:01 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:01.607+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:01.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:01 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:01.607+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:01.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:01 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:01.392+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:01.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:01 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:01.392+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:01.884 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:01 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:01.580+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:57:01.884 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:01 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:01.580+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.413856+0000 front 2024-09-12T01:56:31.413752+0000 (oldest deadline 2024-09-12T01:56:56.113678+0000) 2024-09-12T01:57:02.188 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:01 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:01.884+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:02.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:02 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:02.021+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:02.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:02 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:02.021+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:02.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:02 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:02.501+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:02.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:02 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:02.679+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:02.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:02 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:02.679+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:02.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:02 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:02.606+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:02.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:02 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:02.606+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:02.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:02 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:02.368+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:02.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:02 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:02.368+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:02.878 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:02 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:02.624+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:57:02.878 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:02 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:02.624+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.413856+0000 front 2024-09-12T01:56:31.413752+0000 (oldest deadline 2024-09-12T01:56:56.113678+0000) 2024-09-12T01:57:03.187 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:02 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:02.878+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:03.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:02 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:02.982+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:03.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:02 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:02.982+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:03.650 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:03.387+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:03.651 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:03.387+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:03.651 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:03.387+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:03.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:03 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:03.470+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:03.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:03 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:03.661+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:03.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:03 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:03.661+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:03.872 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:03 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:03.601+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:57:03.872 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:03 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:03.601+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.413856+0000 front 2024-09-12T01:56:31.413752+0000 (oldest deadline 2024-09-12T01:56:56.113678+0000) 2024-09-12T01:57:04.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:03.650+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:04.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:03.650+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:04.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:03 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:03.650+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:39.904842+0000 front 2024-09-12T01:56:39.904782+0000 (oldest deadline 2024-09-12T01:57:02.804755+0000) 2024-09-12T01:57:04.187 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:03 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:03.872+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:04.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:04 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:04.007+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:04.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:04 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:04.007+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:04.188 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:04 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:04.007+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:04.762 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:04 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:04.656+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:04.762 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:04 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:04.656+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:04.763 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:04 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:04.492+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:04.763 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:04 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:04.492+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:04.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:04 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:04.412+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:04.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:04 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:04.412+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:04.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:04 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:04.412+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:04.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:04 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:04.643+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:04.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:04 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:04.643+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:04.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:04 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:04.643+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:39.904842+0000 front 2024-09-12T01:56:39.904782+0000 (oldest deadline 2024-09-12T01:57:02.804755+0000) 2024-09-12T01:57:04.880 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:04 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:04.612+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.012910+0000 front 2024-09-12T01:56:25.012769+0000 (oldest deadline 2024-09-12T01:56:46.712707+0000) 2024-09-12T01:57:04.880 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:04 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5[47670]: 2024-09-12T01:57:04.612+0000 7fece38c9640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.413856+0000 front 2024-09-12T01:56:31.413752+0000 (oldest deadline 2024-09-12T01:56:56.113678+0000) 2024-09-12T01:57:05.189 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:04 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:04.879+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:05.189 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:05.028+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:05.189 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:05.028+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:05.189 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:05.028+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:05.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:05.647+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:05.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:05.647+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:05.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:05.647+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:39.904842+0000 front 2024-09-12T01:56:39.904782+0000 (oldest deadline 2024-09-12T01:57:02.804755+0000) 2024-09-12T01:57:05.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:05.459+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:05.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:05.459+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:05.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:05 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:05.459+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:05.893 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:05.692+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:05.893 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:05.692+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:05.893 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:05.516+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:05.894 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:05 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:05.516+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:06.001 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:05 smithi191 podman[70553]: 2024-09-12 01:57:05.752232297 +0000 UTC m=+5.495863788 container died 734b3075299ed1a37a0d0c4d5e857e24093b3ba5f7c4275eab35ea55959d5c81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T01:57:06.002 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:05.883+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:06.002 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:05.883+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:06.002 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:05.989+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:06.002 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:05.989+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:06.002 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:05 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:05.989+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:06.369 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:06 smithi191 podman[70553]: 2024-09-12 01:57:06.101966843 +0000 UTC m=+5.845598325 container cleanup 734b3075299ed1a37a0d0c4d5e857e24093b3ba5f7c4275eab35ea55959d5c81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T01:57:06.370 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:06 smithi191 bash[70553]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5 2024-09-12T01:57:06.688 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:06 smithi191 podman[70568]: 2024-09-12 01:57:06.370271898 +0000 UTC m=+0.612486818 container remove 734b3075299ed1a37a0d0c4d5e857e24093b3ba5f7c4275eab35ea55959d5c81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T01:57:06.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:06 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:06.631+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:06.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:06 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:06.631+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:06.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:06 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:06.631+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:39.904842+0000 front 2024-09-12T01:56:39.904782+0000 (oldest deadline 2024-09-12T01:57:02.804755+0000) 2024-09-12T01:57:06.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:06 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:06.431+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:06.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:06 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:06.431+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:06.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:06 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:06.431+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:06.962 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:06 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:06.913+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:06.962 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:06 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:06.913+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:06.962 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:06 smithi191 podman[70659]: 2024-09-12 01:57:06.614728985 +0000 UTC m=+0.015921880 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:57:06.962 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:06 smithi191 podman[70659]: 2024-09-12 01:57:06.713075048 +0000 UTC m=+0.114267935 container create c9e12cf3d3ec0cece436351f769292c7a4219a36fd928c2487bdfd58e445e710 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T01:57:06.962 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:06 smithi191 podman[70659]: 2024-09-12 01:57:06.907983678 +0000 UTC m=+0.309176563 container init c9e12cf3d3ec0cece436351f769292c7a4219a36fd928c2487bdfd58e445e710 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T01:57:06.962 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:06 smithi191 podman[70659]: 2024-09-12 01:57:06.911333129 +0000 UTC m=+0.312526015 container start c9e12cf3d3ec0cece436351f769292c7a4219a36fd928c2487bdfd58e445e710 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T01:57:07.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:06 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:06.540+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:07.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:06 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:06.540+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:07.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:06 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:06.730+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:07.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:06 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:06.730+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:07.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:06 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:06.730+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:07.403 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:07 smithi191 podman[70659]: 2024-09-12 01:57:07.00843395 +0000 UTC m=+0.409626843 container attach c9e12cf3d3ec0cece436351f769292c7a4219a36fd928c2487bdfd58e445e710 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:57:07.403 INFO:journalctl@ceph.osd.5.smithi191.stdout:Sep 12 01:57:07 smithi191 podman[70659]: 2024-09-12 01:57:07.106628868 +0000 UTC m=+0.507821771 container died c9e12cf3d3ec0cece436351f769292c7a4219a36fd928c2487bdfd58e445e710 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:57:07.404 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:06 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:06.961+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:07.404 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:06 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:06.961+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:07.404 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:06 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:06.961+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:07.676 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T01:57:07.715 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:57:07.715 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T01:57:07.715 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T01:57:07.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.6 2024-09-12T01:57:07.743 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:07 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:07.413+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:07.743 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:07 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:07.413+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:07.743 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:07 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:07.413+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:07.743 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:07 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:07.634+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:07.743 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:07 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:07.634+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:07.744 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:07 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:07.634+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:39.904842+0000 front 2024-09-12T01:56:39.904782+0000 (oldest deadline 2024-09-12T01:57:02.804755+0000) 2024-09-12T01:57:07.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:07 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:07.511+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:07.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:07 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:07.511+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:07.762 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:07 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:07.681+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:07.762 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:07 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:07.681+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:07.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:07 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:07.681+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:08.013 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:07 smithi070 systemd[1]: Stopping Ceph osd.6 for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:57:08.013 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:08 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:08.012+0000 7f9073994640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:57:08.269 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:08 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:08.012+0000 7f9073994640 -1 osd.6 86 *** Got signal Terminated *** 2024-09-12T01:57:08.269 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:08 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:08.012+0000 7f9073994640 -1 osd.6 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:57:08.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:07 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:07.960+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:08.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:07 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:07.960+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:08.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:07 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:07.965+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:08.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:07 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:07.965+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:08.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:07 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:07.965+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:08.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:08 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:08.625+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:08.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:08 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:08.626+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:08.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:08 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:08.626+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:39.904842+0000 front 2024-09-12T01:56:39.904782+0000 (oldest deadline 2024-09-12T01:57:02.804755+0000) 2024-09-12T01:57:08.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:08 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:08.407+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:08.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:08 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:08.407+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:08.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:08 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:08.407+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:09.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:08 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:08.556+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:09.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:08 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:08.556+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:09.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:08 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:08.723+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:09.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:08 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:08.723+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:09.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:08 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:08.723+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:09.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:08 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:08.980+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:09.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:08 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:08.980+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:09.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:09 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:09.003+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:09.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:09 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:09.003+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:09.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:09 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:09.003+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:09.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:09 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:09.585+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:09.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:09 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:09.585+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:09.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:09 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:09.585+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:39.904842+0000 front 2024-09-12T01:56:39.904782+0000 (oldest deadline 2024-09-12T01:57:02.804755+0000) 2024-09-12T01:57:09.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:09 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:09.405+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:09.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:09 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:09.405+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:09.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:09 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:09.405+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:10.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:09 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:09.544+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:10.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:09 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:09.544+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:10.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:09 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:09.759+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:10.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:09 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:09.759+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:10.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:09 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:09.759+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:10.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:10 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:10.019+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:10.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:10 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:10.019+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:10.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:10 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:10.000+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:10.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:10 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:10.000+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:10.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:10 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:10.000+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:10.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:10 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:10.501+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:10.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:10 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:10.501+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:10.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:10 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:10.589+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:10.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:10 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:10.589+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:10.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:10 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:10.589+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:39.904842+0000 front 2024-09-12T01:56:39.904782+0000 (oldest deadline 2024-09-12T01:57:02.804755+0000) 2024-09-12T01:57:10.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:10 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:10.387+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:10.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:10 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:10.387+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:10.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:10 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:10.387+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:11.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:10 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:10.769+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:11.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:10 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:10.769+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:11.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:10 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:10.769+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:11.437 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:11 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:11.029+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:11.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:11 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:11.029+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:11.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:11 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:11.029+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:11.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:10 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:10.981+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:11.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:10 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:10.981+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:11.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:10 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:10.981+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:11.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:11 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:11.615+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:11.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:11 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:11.615+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:11.769 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:11 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:11.615+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:39.904842+0000 front 2024-09-12T01:56:39.904782+0000 (oldest deadline 2024-09-12T01:57:02.804755+0000) 2024-09-12T01:57:11.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:11 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:11.374+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:11.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:11 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:11.374+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:11.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:11 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:11.374+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:11.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:11 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:11.374+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:12.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:11 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:11.531+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:12.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:11 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:11.531+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:12.012 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:11 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:11.722+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:12.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:11 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:11.722+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:12.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:11 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:11.722+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:12.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:12 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:12.009+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:12.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:12 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:12.009+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:12.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:12 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:12.009+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:12.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:12 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:12.055+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:12.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:12 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:12.055+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:12.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:12 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:12.055+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:12.622 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:12 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:12.335+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:12.623 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:12 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:12.335+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:12.623 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:12 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:12.335+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:12.623 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:12 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:12.335+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:13.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:12 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:12.532+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:13.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:12 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:12.532+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:13.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:12 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:12.748+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:13.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:12 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:12.748+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:13.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:12 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:12.748+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:13.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:12 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:12.749+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:13.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:12 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:12.622+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:26.002022+0000 front 2024-09-12T01:56:26.002062+0000 (oldest deadline 2024-09-12T01:56:49.502137+0000) 2024-09-12T01:57:13.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:12 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:12.622+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:30.003283+0000 front 2024-09-12T01:56:30.003265+0000 (oldest deadline 2024-09-12T01:56:54.703405+0000) 2024-09-12T01:57:13.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:12 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:12.622+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:39.904842+0000 front 2024-09-12T01:56:39.904782+0000 (oldest deadline 2024-09-12T01:57:02.804755+0000) 2024-09-12T01:57:13.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:12 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6[58317]: 2024-09-12T01:57:12.622+0000 7f906bf91640 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.607578+0000 front 2024-09-12T01:56:49.607537+0000 (oldest deadline 2024-09-12T01:57:12.507740+0000) 2024-09-12T01:57:13.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:12 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:12.990+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:13.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:12 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:12.990+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:13.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:12 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:12.990+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:13.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:13 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:13.030+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:13.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:13 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:13.030+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:13.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:13 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:13.030+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:13.695 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:13 smithi070 podman[98921]: 2024-09-12 01:57:13.406317194 +0000 UTC m=+5.496585762 container died 7410b1c77cfb8a347ac7906bf0d6306128170ba7b0348351bdc88929ccd1864e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T01:57:13.696 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:13 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:13.310+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:13.696 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:13 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:13.310+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:13.696 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:13 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:13.310+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:13.696 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:13 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:13.310+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:14.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:13 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:13.548+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:14.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:13 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:13.548+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:14.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:13 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:13.549+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.052397+0000 front 2024-09-12T01:56:49.052413+0000 (oldest deadline 2024-09-12T01:57:13.152391+0000) 2024-09-12T01:57:14.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:13 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:13.772+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:14.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:13 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:13.772+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:14.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:13 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:13.772+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:14.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:13 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:13.772+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:14.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:13 smithi070 podman[98921]: 2024-09-12 01:57:13.88706122 +0000 UTC m=+5.977329833 container cleanup 7410b1c77cfb8a347ac7906bf0d6306128170ba7b0348351bdc88929ccd1864e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T01:57:14.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:13 smithi070 bash[98921]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6 2024-09-12T01:57:14.437 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:13 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:13.967+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:14.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:13 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:13.967+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:14.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:13 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:13.967+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:14.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:14 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:14.029+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:14.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:14 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:14.029+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:14.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:14 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:14.029+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:14.448 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:14 smithi070 podman[98938]: 2024-09-12 01:57:14.138315054 +0000 UTC m=+0.723126439 container remove 7410b1c77cfb8a347ac7906bf0d6306128170ba7b0348351bdc88929ccd1864e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T01:57:14.449 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:14 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:14.264+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:14.449 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:14 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:14.264+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:14.449 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:14 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:14.264+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:14.449 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:14 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:14.264+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:14.700 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:14 smithi070 podman[99029]: 2024-09-12 01:57:14.351978254 +0000 UTC m=+0.015485670 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:57:14.700 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:14 smithi070 podman[99029]: 2024-09-12 01:57:14.47279 +0000 UTC m=+0.136297446 container create fd360035c9fb211c936f6e003692dec58224ea987550f7366ec70730cf7a5c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T01:57:14.700 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:14 smithi070 podman[99029]: 2024-09-12 01:57:14.70053195 +0000 UTC m=+0.364039357 container init fd360035c9fb211c936f6e003692dec58224ea987550f7366ec70730cf7a5c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:14.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:14 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:14.506+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:14.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:14 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:14.506+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:14.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:14 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:14.506+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.052397+0000 front 2024-09-12T01:56:49.052413+0000 (oldest deadline 2024-09-12T01:57:13.152391+0000) 2024-09-12T01:57:15.012 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:14 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:14.761+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:15.012 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:14 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:14.761+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:15.012 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:14 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:14.761+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:15.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:14 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:14.761+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:15.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:14 smithi070 podman[99029]: 2024-09-12 01:57:14.704043444 +0000 UTC m=+0.367550859 container start fd360035c9fb211c936f6e003692dec58224ea987550f7366ec70730cf7a5c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T01:57:15.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:14 smithi070 podman[99029]: 2024-09-12 01:57:14.792180711 +0000 UTC m=+0.455688116 container attach fd360035c9fb211c936f6e003692dec58224ea987550f7366ec70730cf7a5c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:57:15.019 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 12 01:57:14 smithi070 podman[99029]: 2024-09-12 01:57:14.890801456 +0000 UTC m=+0.554308872 container died fd360035c9fb211c936f6e003692dec58224ea987550f7366ec70730cf7a5c5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T01:57:15.437 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:15 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:15.008+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:15.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:15 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:15.008+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:15.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:15 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:15.008+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:15.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:15 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:15.067+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:15.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:15 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:15.067+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:15.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:15 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:15.067+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:15.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:15 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:15.239+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:15.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:15 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:15.239+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:15.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:15 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:15.239+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:15.495 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:15 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:15.239+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:15.515 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T01:57:15.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:57:15.594 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T01:57:15.594 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T01:57:15.595 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.7 2024-09-12T01:57:15.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:15 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:15.465+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:15.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:15 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:15.465+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:15.763 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:15 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:15.465+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.052397+0000 front 2024-09-12T01:56:49.052413+0000 (oldest deadline 2024-09-12T01:57:13.152391+0000) 2024-09-12T01:57:15.763 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:15 smithi152 systemd[1]: Stopping Ceph osd.7 for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:57:16.262 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:15 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:15.895+0000 7ffb68f39640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:57:16.262 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:15 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:15.895+0000 7ffb68f39640 -1 osd.7 86 *** Got signal Terminated *** 2024-09-12T01:57:16.262 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:15 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:15.895+0000 7ffb68f39640 -1 osd.7 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:57:16.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:15 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:15.807+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:16.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:15 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:15.807+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:16.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:15 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:15.807+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:16.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:15 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:15.807+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:16.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:15 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:15.982+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:16.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:15 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:15.982+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:16.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:15 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:15.982+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:16.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:16 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:16.115+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:16.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:16 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:16.115+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:16.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:16 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:16.115+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:16.519 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:16 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:16.243+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:16.519 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:16 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:16.243+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:16.519 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:16 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:16.243+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:16.519 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:16 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:16.243+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:16.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:16 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:16.492+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:16.763 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:16 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:16.492+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:16.763 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:16 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:16.492+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.052397+0000 front 2024-09-12T01:56:49.052413+0000 (oldest deadline 2024-09-12T01:57:13.152391+0000) 2024-09-12T01:57:17.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:16 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:16.835+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:17.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:16 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:16.835+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:17.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:16 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:16.835+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:17.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:16 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:16.835+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:17.437 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:16 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:16.944+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:17.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:16 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:16.944+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:17.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:16 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:16.944+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:17.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:17 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:17.154+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:17.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:17 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:17.154+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:17.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:17 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:17.154+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:17.519 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:17 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:17.266+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:17.519 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:17 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:17.266+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:17.519 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:17 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:17.266+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:17.519 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:17 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:17.266+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:17.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:17 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:17.450+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:17.805 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:17 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:17.450+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:17.805 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:17 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:17.450+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.052397+0000 front 2024-09-12T01:56:49.052413+0000 (oldest deadline 2024-09-12T01:57:13.152391+0000) 2024-09-12T01:57:18.265 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:17 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:17.850+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:18.265 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:17 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:17.850+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:18.265 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:17 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:17.850+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:18.265 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:17 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:17.850+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:18.437 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:17 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:17.988+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:18.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:17 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:17.988+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:18.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:17 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:17.988+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:18.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:18 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:18.135+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:18.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:18 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:18.135+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:18.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:18 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:18.135+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:18.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:18 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:18.414+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:18.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:18 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:18.414+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:18.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:18 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:18.414+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.052397+0000 front 2024-09-12T01:56:49.052413+0000 (oldest deadline 2024-09-12T01:57:13.152391+0000) 2024-09-12T01:57:18.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:18 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:18.290+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:18.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:18 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:18.290+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:18.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:18 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:18.290+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:18.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:18 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:18.290+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:19.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:18 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:18.822+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:19.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:18 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:18.822+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:19.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:18 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:18.822+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:19.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:18 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:18.822+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:19.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:18 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:18.988+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:19.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:18 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:18.988+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:19.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:18 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:18.988+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:19.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:19 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:19.110+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:19.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:19 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:19.110+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:19.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:19 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:19.110+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:19.763 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:19.441+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:19.763 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:19.441+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:19.763 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:19.441+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.052397+0000 front 2024-09-12T01:56:49.052413+0000 (oldest deadline 2024-09-12T01:57:13.152391+0000) 2024-09-12T01:57:19.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:19 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:19.280+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:19.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:19 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:19.280+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:19.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:19 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:19.280+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:19.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:19 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:19.280+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:20.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:19.872+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:20.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:19.872+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:20.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:19.872+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:20.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:19 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:19.872+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:20.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:20 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:20.024+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:20.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:20 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:20.024+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:20.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:20 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:20.024+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:20.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:20 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:20.124+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:20.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:20 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:20.124+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:20.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:20 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:20.124+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:20.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:20.454+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:34.049178+0000 front 2024-09-12T01:56:34.049247+0000 (oldest deadline 2024-09-12T01:56:58.749314+0000) 2024-09-12T01:57:20.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:20.454+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.551222+0000 front 2024-09-12T01:56:41.551078+0000 (oldest deadline 2024-09-12T01:57:04.450880+0000) 2024-09-12T01:57:20.762 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7[53070]: 2024-09-12T01:57:20.454+0000 7ffb6553e640 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.052397+0000 front 2024-09-12T01:56:49.052413+0000 (oldest deadline 2024-09-12T01:57:13.152391+0000) 2024-09-12T01:57:20.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:20.309+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:20.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:20.309+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:20.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:20.309+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:20.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:20 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:20.309+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:21.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:20.825+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:21.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:20.825+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:21.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:20.825+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:21.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:20 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:20.825+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:21.437 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:21 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:20.999+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:21.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:21 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:20.999+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:21.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:21 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:20.999+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:21.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:21 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:20.999+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.890108+0000 front 2024-09-12T01:56:54.890172+0000 (oldest deadline 2024-09-12T01:57:20.189954+0000) 2024-09-12T01:57:21.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:21 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:21.118+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:21.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:21 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:21.118+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:21.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:21 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:21.118+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:21.670 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:21 smithi152 podman[68783]: 2024-09-12 01:57:21.37979642 +0000 UTC m=+5.585195364 container stop ccc59aa7a32bc07acf4896b9c509dbc867fbedb73da4ab739929b3117c7deb75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T01:57:21.670 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:21 smithi152 podman[68783]: 2024-09-12 01:57:21.405968731 +0000 UTC m=+5.611367668 container died ccc59aa7a32bc07acf4896b9c509dbc867fbedb73da4ab739929b3117c7deb75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:21.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:21 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:21.359+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:21.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:21 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:21.359+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:21.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:21 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:21.359+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:21.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:21 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:21.359+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:21.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:21 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:21.359+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:22.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:21 smithi152 podman[68783]: 2024-09-12 01:57:21.778832195 +0000 UTC m=+5.984231132 container cleanup ccc59aa7a32bc07acf4896b9c509dbc867fbedb73da4ab739929b3117c7deb75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7, ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T01:57:22.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:21 smithi152 bash[68783]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7 2024-09-12T01:57:22.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:21 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:21.842+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:22.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:21 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:21.842+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:22.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:21 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:21.842+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:22.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:21 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:21.842+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:22.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:21 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:21.842+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:22.338 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:22 smithi152 podman[68801]: 2024-09-12 01:57:22.038365676 +0000 UTC m=+0.646258308 container remove ccc59aa7a32bc07acf4896b9c509dbc867fbedb73da4ab739929b3117c7deb75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:22.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:22 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:22.039+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:22.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:22 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:22.039+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:22.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:22 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:22.039+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:22.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:22 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:22.039+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.890108+0000 front 2024-09-12T01:56:54.890172+0000 (oldest deadline 2024-09-12T01:57:20.189954+0000) 2024-09-12T01:57:22.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:22 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:22.102+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:22.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:22 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:22.102+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:22.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:22 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:22.102+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:22.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:22 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:22.102+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:22.658 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:22 smithi152 podman[68888]: 2024-09-12 01:57:22.339197231 +0000 UTC m=+0.103504679 container create bd293a4c9e387d24895eafddbdc03be3de6dba2ccfc46a082557ed8ac1f7a5ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T01:57:22.658 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:22 smithi152 podman[68888]: 2024-09-12 01:57:22.251728618 +0000 UTC m=+0.016036073 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:57:22.658 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:22 smithi152 podman[68888]: 2024-09-12 01:57:22.583289552 +0000 UTC m=+0.347597001 container init bd293a4c9e387d24895eafddbdc03be3de6dba2ccfc46a082557ed8ac1f7a5ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:22.658 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:22 smithi152 podman[68888]: 2024-09-12 01:57:22.586498319 +0000 UTC m=+0.350805778 container start bd293a4c9e387d24895eafddbdc03be3de6dba2ccfc46a082557ed8ac1f7a5ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T01:57:22.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:22.368+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:22.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:22.368+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:22.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:22.368+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:22.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:22.368+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:22.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:22 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:22.368+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:23.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:22 smithi152 podman[68888]: 2024-09-12 01:57:22.658178488 +0000 UTC m=+0.422485938 container attach bd293a4c9e387d24895eafddbdc03be3de6dba2ccfc46a082557ed8ac1f7a5ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-12T01:57:23.012 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:22 smithi152 podman[68888]: 2024-09-12 01:57:22.784098492 +0000 UTC m=+0.548405953 container died bd293a4c9e387d24895eafddbdc03be3de6dba2ccfc46a082557ed8ac1f7a5ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:23.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:22.857+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:23.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:22.857+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:23.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:22.857+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:23.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:22.857+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:23.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:22.857+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:23.355 INFO:journalctl@ceph.osd.7.smithi152.stdout:Sep 12 01:57:23 smithi152 podman[68911]: 2024-09-12 01:57:23.353865544 +0000 UTC m=+0.560146697 container remove bd293a4c9e387d24895eafddbdc03be3de6dba2ccfc46a082557ed8ac1f7a5ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T01:57:23.373 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T01:57:23.411 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:57:23.411 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T01:57:23.411 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T01:57:23.412 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.8 2024-09-12T01:57:23.437 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:23 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:23.001+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:23.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:23 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:23.001+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:23.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:23 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:23.001+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:23.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:23 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:23.001+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.890108+0000 front 2024-09-12T01:56:54.890172+0000 (oldest deadline 2024-09-12T01:57:20.189954+0000) 2024-09-12T01:57:23.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:23 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:23.148+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:23.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:23 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:23.148+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:23.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:23 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:23.148+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:23.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:23 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:23.148+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:23.707 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:23 smithi191 systemd[1]: Stopping Ceph osd.8 for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:57:23.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:23 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:23.356+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:23.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:23 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:23.356+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:23.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:23 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:23.356+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:23.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:23 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:23.356+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:23.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:23 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:23.356+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:24.012 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:23 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:23.831+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:24.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:23 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:23.831+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:24.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:23 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:23.831+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:24.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:23 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:23.831+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:24.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:23 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:23.831+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:24.047 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:23 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:23.707+0000 7fa6d7149640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:57:24.047 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:23 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:23.707+0000 7fa6d7149640 -1 osd.8 86 *** Got signal Terminated *** 2024-09-12T01:57:24.047 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:23 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:23.707+0000 7fa6d7149640 -1 osd.8 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:57:24.047 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:24 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:24.047+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:24.047 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:24 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:24.047+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:24.048 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:24 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:24.047+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:24.048 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:24 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:24.047+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.890108+0000 front 2024-09-12T01:56:54.890172+0000 (oldest deadline 2024-09-12T01:57:20.189954+0000) 2024-09-12T01:57:24.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:24 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:24.121+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:24.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:24 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:24.121+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:24.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:24 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:24.121+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:24.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:24 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:24.121+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:24.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:24 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:24.398+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:24.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:24 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:24.398+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:24.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:24 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:24.398+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:24.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:24 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:24.398+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:24.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:24 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:24.398+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:25.012 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:24 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:24.789+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:25.012 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:24 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:24.789+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:25.012 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:24 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:24.789+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:25.012 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:24 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:24.789+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:25.013 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:24 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:24.789+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:25.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:25 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:25.014+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:25.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:25 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:25.014+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:25.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:25 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:25.014+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:25.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:25 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:25.014+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.890108+0000 front 2024-09-12T01:56:54.890172+0000 (oldest deadline 2024-09-12T01:57:20.189954+0000) 2024-09-12T01:57:25.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:25 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:25.091+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:25.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:25 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:25.091+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:25.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:25 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:25.091+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:25.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:25 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:25.091+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:25.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:25 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:25.417+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:25.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:25 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:25.417+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:25.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:25 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:25.417+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:25.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:25 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:25.417+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:25.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:25 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:25.417+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:26.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:25 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:25.795+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:26.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:25 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:25.795+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:26.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:25 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:25.795+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:26.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:25 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:25.795+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:26.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:25 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:25.795+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:26.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:25 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:25.987+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:26.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:25 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:25.987+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:26.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:25 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:25.987+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:26.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:25 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:25.987+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.890108+0000 front 2024-09-12T01:56:54.890172+0000 (oldest deadline 2024-09-12T01:57:20.189954+0000) 2024-09-12T01:57:26.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:26 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:26.048+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:26.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:26 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:26.048+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:26.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:26 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:26.048+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:26.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:26 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:26.048+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:26.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:26 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:26.426+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:26.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:26 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:26.426+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:26.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:26 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:26.426+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:26.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:26 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:26.426+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:26.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:26 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:26.426+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:27.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:26 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:26.838+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:27.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:26 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:26.838+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:27.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:26 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:26.838+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:27.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:26 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:26.838+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:27.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:26 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:26.838+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:27.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:26 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:26.838+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:27.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:26 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:26.946+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:27.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:26 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:26.946+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:27.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:26 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:26.946+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:27.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:26 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:26.946+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.890108+0000 front 2024-09-12T01:56:54.890172+0000 (oldest deadline 2024-09-12T01:57:20.189954+0000) 2024-09-12T01:57:27.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:27 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:27.099+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:27.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:27 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:27.099+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:27.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:27 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:27.099+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:27.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:27 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:27.099+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:27.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:27 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:27.099+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:27.687 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:27 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:27.434+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:27.687 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:27 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:27.434+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:27.687 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:27 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:27.434+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:27.687 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:27 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:27.434+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:27.687 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:27 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:27.434+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:28.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:27 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:27.867+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:28.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:27 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:27.867+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:28.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:27 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:27.867+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:28.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:27 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:27.867+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:28.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:27 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:27.867+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:28.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:27 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:27.867+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:28.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:27 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:27.985+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:33.887070+0000 front 2024-09-12T01:56:33.887160+0000 (oldest deadline 2024-09-12T01:56:56.787038+0000) 2024-09-12T01:57:28.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:27 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:27.985+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:40.287910+0000 front 2024-09-12T01:56:40.287992+0000 (oldest deadline 2024-09-12T01:57:04.988043+0000) 2024-09-12T01:57:28.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:27 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:27.985+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:44.988718+0000 front 2024-09-12T01:56:44.988590+0000 (oldest deadline 2024-09-12T01:57:10.888477+0000) 2024-09-12T01:57:28.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:27 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:27.985+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.890108+0000 front 2024-09-12T01:56:54.890172+0000 (oldest deadline 2024-09-12T01:57:20.189954+0000) 2024-09-12T01:57:28.438 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:27 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8[54641]: 2024-09-12T01:57:27.985+0000 7fa6d374e640 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:04.890937+0000 front 2024-09-12T01:57:04.890960+0000 (oldest deadline 2024-09-12T01:57:27.791026+0000) 2024-09-12T01:57:28.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:28 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:28.055+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:28.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:28 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:28.055+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:28.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:28 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:28.055+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:28.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:28 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:28.055+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:28.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:28 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:28.055+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:28.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:28 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:28.469+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:28.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:28 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:28.469+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:28.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:28 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:28.469+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:28.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:28 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:28.469+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:28.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:28 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:28.469+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:28.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:28 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:28.469+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:05.087537+0000 front 2024-09-12T01:57:05.087689+0000 (oldest deadline 2024-09-12T01:57:27.887769+0000) 2024-09-12T01:57:29.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:28 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:28.832+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:29.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:28 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:28.832+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:29.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:28 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:28.832+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:29.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:28 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:28.832+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:29.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:28 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:28.832+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:29.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:28 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:28.832+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:29.358 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:29 smithi191 podman[70763]: 2024-09-12 01:57:29.069875308 +0000 UTC m=+5.455895108 container died ef547b349123f5aef42ddeb475484f322fefd1d4e4ce3492a3012c7f823691ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T01:57:29.358 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:29 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:29.097+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:29.358 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:29 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:29.097+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:29.358 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:29 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:29.097+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:29.358 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:29 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:29.097+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:29.358 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:29 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:29.097+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:29.617 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:29 smithi191 podman[70763]: 2024-09-12 01:57:29.432766754 +0000 UTC m=+5.818786553 container cleanup ef547b349123f5aef42ddeb475484f322fefd1d4e4ce3492a3012c7f823691ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T01:57:29.617 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:29 smithi191 bash[70763]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8 2024-09-12T01:57:29.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:29 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:29.484+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:29.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:29 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:29.484+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:29.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:29 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:29.484+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:29.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:29 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:29.484+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:29.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:29 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:29.484+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:29.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:29 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:29.484+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:05.087537+0000 front 2024-09-12T01:57:05.087689+0000 (oldest deadline 2024-09-12T01:57:27.887769+0000) 2024-09-12T01:57:29.937 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:29 smithi191 podman[70779]: 2024-09-12 01:57:29.617950717 +0000 UTC m=+0.545489164 container remove ef547b349123f5aef42ddeb475484f322fefd1d4e4ce3492a3012c7f823691ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T01:57:30.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:29 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:29.873+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:30.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:29 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:29.873+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:30.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:29 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:29.873+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:30.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:29 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:29.873+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:30.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:29 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:29.873+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:30.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:29 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:29.873+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:30.313 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:30 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:30.137+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:30.313 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:30 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:30.137+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:30.313 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:30 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:30.137+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:30.313 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:30 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:30.137+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:30.313 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:30 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:30.137+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:30.314 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:30 smithi191 podman[70868]: 2024-09-12 01:57:30.018930501 +0000 UTC m=+0.093446126 container create 52a6c4c4bf2b2cb750c6aeda534759b3143428eba12e0915bd7fb7c61d0a4ebd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T01:57:30.314 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:30 smithi191 podman[70868]: 2024-09-12 01:57:29.941110211 +0000 UTC m=+0.015625720 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:57:30.314 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:30 smithi191 podman[70868]: 2024-09-12 01:57:30.238824481 +0000 UTC m=+0.313339991 container init 52a6c4c4bf2b2cb750c6aeda534759b3143428eba12e0915bd7fb7c61d0a4ebd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T01:57:30.314 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:30 smithi191 podman[70868]: 2024-09-12 01:57:30.242054944 +0000 UTC m=+0.316570463 container start 52a6c4c4bf2b2cb750c6aeda534759b3143428eba12e0915bd7fb7c61d0a4ebd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T01:57:30.314 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:30 smithi191 podman[70868]: 2024-09-12 01:57:30.313797117 +0000 UTC m=+0.388312640 container attach 52a6c4c4bf2b2cb750c6aeda534759b3143428eba12e0915bd7fb7c61d0a4ebd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T01:57:30.687 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:30 smithi191 podman[70868]: 2024-09-12 01:57:30.438318886 +0000 UTC m=+0.512834404 container died 52a6c4c4bf2b2cb750c6aeda534759b3143428eba12e0915bd7fb7c61d0a4ebd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:30.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:30 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:30.485+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:30.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:30 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:30.485+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:30.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:30 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:30.485+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:30.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:30 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:30.485+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:30.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:30 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:30.485+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:30.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:30 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:30.485+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:05.087537+0000 front 2024-09-12T01:57:05.087689+0000 (oldest deadline 2024-09-12T01:57:27.887769+0000) 2024-09-12T01:57:31.035 INFO:journalctl@ceph.osd.8.smithi191.stdout:Sep 12 01:57:31 smithi191 podman[70891]: 2024-09-12 01:57:31.018215025 +0000 UTC m=+0.570455173 container remove 52a6c4c4bf2b2cb750c6aeda534759b3143428eba12e0915bd7fb7c61d0a4ebd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:31.041 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T01:57:31.120 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:57:31.120 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T01:57:31.120 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T01:57:31.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.9 2024-09-12T01:57:31.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:30 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:30.831+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:31.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:30 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:30.831+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:31.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:30 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:30.831+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:31.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:30 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:30.831+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:31.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:30 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:30.831+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:31.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:30 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:30.831+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:31.297 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:31 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:31.160+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:31.297 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:31 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:31.160+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:31.297 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:31 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:31.160+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:31.297 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:31 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:31.160+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:31.297 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:31 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:31.160+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:31.405 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:31 smithi070 systemd[1]: Stopping Ceph osd.9 for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:57:31.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:31 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:31.405+0000 7f1b143dc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:57:31.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:31 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:31.405+0000 7f1b143dc640 -1 osd.9 86 *** Got signal Terminated *** 2024-09-12T01:57:31.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:31 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:31.405+0000 7f1b143dc640 -1 osd.9 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:57:31.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:31 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:31.475+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:31.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:31 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:31.475+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:31.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:31 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:31.475+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:31.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:31 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:31.475+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:31.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:31 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:31.475+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:31.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:31 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:31.475+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:05.087537+0000 front 2024-09-12T01:57:05.087689+0000 (oldest deadline 2024-09-12T01:57:27.887769+0000) 2024-09-12T01:57:32.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:31 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:31.832+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:32.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:31 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:31.832+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:32.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:31 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:31.832+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:32.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:31 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:31.832+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:32.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:31 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:31.832+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:32.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:31 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:31.832+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:32.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:32 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:32.208+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:32.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:32 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:32.208+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:32.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:32 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:32.208+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:32.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:32 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:32.208+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:32.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:32 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:32.208+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:32.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:32 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:32.491+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:32.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:32 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:32.491+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:32.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:32 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:32.491+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:32.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:32 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:32.491+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:32.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:32 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:32.491+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:32.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:32 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:32.491+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:05.087537+0000 front 2024-09-12T01:57:05.087689+0000 (oldest deadline 2024-09-12T01:57:27.887769+0000) 2024-09-12T01:57:33.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:32 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:32.793+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:33.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:32 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:32.793+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:33.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:32 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:32.793+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:33.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:32 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:32.793+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:33.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:32 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:32.793+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:33.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:32 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:32.793+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:33.687 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:33 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:33.199+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:33.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:33 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:33.199+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:33.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:33 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:33.199+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:33.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:33 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:33.199+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:33.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:33 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:33.199+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:33.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:33 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:33.444+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:33.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:33 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:33.444+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:33.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:33 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:33.444+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:33.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:33 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:33.444+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:33.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:33 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:33.444+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:33.770 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:33 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:33.444+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:05.087537+0000 front 2024-09-12T01:57:05.087689+0000 (oldest deadline 2024-09-12T01:57:27.887769+0000) 2024-09-12T01:57:34.092 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:33 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:33.842+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:34.093 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:33 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:33.842+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:34.093 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:33 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:33.842+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:34.093 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:33 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:33.842+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:34.093 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:33 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:33.842+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:34.093 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:33 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:33.842+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:34.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:34 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:34.233+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:34.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:34 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:34.233+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:34.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:34 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:34.233+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:34.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:34 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:34.233+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:34.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:34 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:34.233+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:34.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:34 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:34.429+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:34.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:34 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:34.429+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:34.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:34 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:34.429+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:34.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:34 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:34.429+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:34.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:34 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:34.429+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:34.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:34 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:34.429+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:05.087537+0000 front 2024-09-12T01:57:05.087689+0000 (oldest deadline 2024-09-12T01:57:27.887769+0000) 2024-09-12T01:57:35.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:34 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:34.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:35.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:34 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:34.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:35.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:34 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:34.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:35.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:34 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:34.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:35.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:34 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:34.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:35.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:34 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:34.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:35.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:35 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:35.281+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:35.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:35 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:35.281+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:35.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:35 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:35.281+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:35.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:35 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:35.281+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:35.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:35 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:35.281+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:35.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:35 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:35.281+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:35.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:35 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:35.420+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:25.480774+0000 front 2024-09-12T01:56:25.480833+0000 (oldest deadline 2024-09-12T01:56:48.380899+0000) 2024-09-12T01:57:35.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:35 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:35.420+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:32.481935+0000 front 2024-09-12T01:56:32.481980+0000 (oldest deadline 2024-09-12T01:56:57.181827+0000) 2024-09-12T01:57:35.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:35 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:35.420+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:37.182293+0000 front 2024-09-12T01:56:37.182452+0000 (oldest deadline 2024-09-12T01:57:02.482351+0000) 2024-09-12T01:57:35.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:35 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:35.420+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:49.483895+0000 front 2024-09-12T01:56:49.483915+0000 (oldest deadline 2024-09-12T01:57:10.484588+0000) 2024-09-12T01:57:35.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:35 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:35.420+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:54.486273+0000 front 2024-09-12T01:56:54.486397+0000 (oldest deadline 2024-09-12T01:57:20.386188+0000) 2024-09-12T01:57:35.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:35 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9[65007]: 2024-09-12T01:57:35.420+0000 7f1b109e1640 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:05.087537+0000 front 2024-09-12T01:57:05.087689+0000 (oldest deadline 2024-09-12T01:57:27.887769+0000) 2024-09-12T01:57:36.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:35 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:35.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:36.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:35 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:35.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:36.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:35 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:35.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:36.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:35 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:35.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:36.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:35 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:35.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:36.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:35 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:35.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:36.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:35 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:35.870+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.846729+0000 front 2024-09-12T01:57:09.846662+0000 (oldest deadline 2024-09-12T01:57:35.746662+0000) 2024-09-12T01:57:36.589 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:36 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:36.299+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:36.589 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:36 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:36.299+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:36.589 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:36 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:36.299+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:36.589 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:36 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:36.299+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:36.589 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:36 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:36.299+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:36.589 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:36 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:36.299+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:37.105 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:36 smithi070 podman[99144]: 2024-09-12 01:57:36.800744784 +0000 UTC m=+5.484467354 container died bb42edc9693b3d910f071718a789ca08bd5856f890ab028d0d3e76f46e44ed02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T01:57:37.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:36 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:36.856+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:37.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:36 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:36.856+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:37.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:36 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:36.856+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:37.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:36 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:36.856+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:37.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:36 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:36.856+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:37.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:36 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:36.856+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:37.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:36 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:36.856+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.846729+0000 front 2024-09-12T01:57:09.846662+0000 (oldest deadline 2024-09-12T01:57:35.746662+0000) 2024-09-12T01:57:37.506 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:37 smithi070 podman[99144]: 2024-09-12 01:57:37.280384783 +0000 UTC m=+5.964107348 container cleanup bb42edc9693b3d910f071718a789ca08bd5856f890ab028d0d3e76f46e44ed02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T01:57:37.507 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:37 smithi070 bash[99144]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9 2024-09-12T01:57:37.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:37 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:37.252+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:37.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:37 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:37.252+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:37.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:37 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:37.252+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:37.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:37 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:37.252+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:37.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:37 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:37.252+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:37.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:37 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:37.252+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:37.769 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:37 smithi070 podman[99159]: 2024-09-12 01:57:37.506720942 +0000 UTC m=+0.707523292 container remove bb42edc9693b3d910f071718a789ca08bd5856f890ab028d0d3e76f46e44ed02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:57:38.151 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:37 smithi070 podman[99247]: 2024-09-12 01:57:37.742484703 +0000 UTC m=+0.015559479 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:57:38.151 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:37 smithi070 podman[99247]: 2024-09-12 01:57:37.866070093 +0000 UTC m=+0.139144860 container create 23bd5b4e4699b02604ac64146a0de97dd02ebbff31a900be5e306a9e74f3ff4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:57:38.151 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:38 smithi070 podman[99247]: 2024-09-12 01:57:38.076833287 +0000 UTC m=+0.349908059 container init 23bd5b4e4699b02604ac64146a0de97dd02ebbff31a900be5e306a9e74f3ff4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T01:57:38.151 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:38 smithi070 podman[99247]: 2024-09-12 01:57:38.080241158 +0000 UTC m=+0.353315925 container start 23bd5b4e4699b02604ac64146a0de97dd02ebbff31a900be5e306a9e74f3ff4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T01:57:38.151 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:38 smithi070 podman[99247]: 2024-09-12 01:57:38.151781173 +0000 UTC m=+0.424855957 container attach 23bd5b4e4699b02604ac64146a0de97dd02ebbff31a900be5e306a9e74f3ff4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:57:38.266 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:37 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:37.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:38.266 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:37 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:37.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:38.266 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:37 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:37.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:38.267 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:37 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:37.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:38.267 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:37 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:37.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:38.267 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:37 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:37.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:38.267 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:37 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:37.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.846729+0000 front 2024-09-12T01:57:09.846662+0000 (oldest deadline 2024-09-12T01:57:35.746662+0000) 2024-09-12T01:57:38.519 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 12 01:57:38 smithi070 podman[99247]: 2024-09-12 01:57:38.262849916 +0000 UTC m=+0.535924691 container died 23bd5b4e4699b02604ac64146a0de97dd02ebbff31a900be5e306a9e74f3ff4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T01:57:38.687 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:38 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:38.210+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:38.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:38 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:38.210+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:38.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:38 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:38.210+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:38.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:38 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:38.210+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:38.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:38 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:38.210+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:38.688 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:38 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:38.210+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:38.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T01:57:38.930 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:57:38.930 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T01:57:38.930 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T01:57:38.931 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.10 2024-09-12T01:57:39.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:38 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:38.833+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:39.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:38 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:38.833+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:39.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:38 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:38.833+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:39.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:38 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:38.833+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:39.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:38 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:38.833+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:39.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:38 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:38.833+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:39.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:38 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:38.833+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.846729+0000 front 2024-09-12T01:57:09.846662+0000 (oldest deadline 2024-09-12T01:57:35.746662+0000) 2024-09-12T01:57:39.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:38 smithi152 systemd[1]: Stopping Ceph osd.10 for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:57:39.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:39 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:39.172+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:39.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:39 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:39.172+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:39.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:39 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:39.172+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:39.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:39 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:39.172+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:39.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:39 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:39.172+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:39.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:39 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:39.172+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:39.762 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:39 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:39.264+0000 7f05877ba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:57:39.762 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:39 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:39.264+0000 7f05877ba640 -1 osd.10 86 *** Got signal Terminated *** 2024-09-12T01:57:39.763 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:39 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:39.264+0000 7f05877ba640 -1 osd.10 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:57:40.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:39 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:39.817+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:40.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:39 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:39.817+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:40.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:39 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:39.817+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:40.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:39 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:39.817+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:40.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:39 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:39.817+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:40.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:39 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:39.817+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:40.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:39 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:39.817+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.846729+0000 front 2024-09-12T01:57:09.846662+0000 (oldest deadline 2024-09-12T01:57:35.746662+0000) 2024-09-12T01:57:40.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:40 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:40.167+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:40.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:40 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:40.167+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:40.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:40 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:40.167+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:40.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:40 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:40.167+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:40.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:40 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:40.167+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:40.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:40 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:40.167+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:41.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:40 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:40.840+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:41.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:40 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:40.840+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:41.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:40 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:40.840+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:41.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:40 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:40.840+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:41.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:40 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:40.840+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:41.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:40 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:40.840+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:41.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:40 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:40.840+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.846729+0000 front 2024-09-12T01:57:09.846662+0000 (oldest deadline 2024-09-12T01:57:35.746662+0000) 2024-09-12T01:57:41.437 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:41 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:41.135+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:41.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:41 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:41.135+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:41.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:41 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:41.135+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:41.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:41 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:41.135+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:41.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:41 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:41.135+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:41.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:41 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:41.135+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:42.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:41 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:41.858+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:42.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:41 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:41.858+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:42.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:41 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:41.858+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:42.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:41 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:41.858+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:42.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:41 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:41.858+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:42.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:41 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:41.858+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:42.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:41 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:41.858+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.846729+0000 front 2024-09-12T01:57:09.846662+0000 (oldest deadline 2024-09-12T01:57:35.746662+0000) 2024-09-12T01:57:42.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:42 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:42.121+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:42.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:42 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:42.121+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:42.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:42 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:42.121+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:42.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:42 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:42.121+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:42.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:42 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:42.121+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:42.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:42 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:42.121+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:43.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:42 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:42.876+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:43.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:42 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:42.876+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:43.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:42 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:42.876+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:43.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:42 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:42.876+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:43.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:42 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:42.876+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:43.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:42 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:42.876+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:43.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:42 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:42.876+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.846729+0000 front 2024-09-12T01:57:09.846662+0000 (oldest deadline 2024-09-12T01:57:35.746662+0000) 2024-09-12T01:57:43.437 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:43 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:43.081+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:43.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:43 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:43.081+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:43.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:43 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:43.081+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:43.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:43 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:43.081+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:43.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:43 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:43.081+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:43.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:43 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:43.081+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:44.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:43 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:43.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.840188+0000 front 2024-09-12T01:56:24.840201+0000 (oldest deadline 2024-09-12T01:56:50.740049+0000) 2024-09-12T01:57:44.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:43 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:43.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.240975+0000 front 2024-09-12T01:56:31.241137+0000 (oldest deadline 2024-09-12T01:56:55.841646+0000) 2024-09-12T01:57:44.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:43 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:43.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:41.142865+0000 front 2024-09-12T01:56:41.142885+0000 (oldest deadline 2024-09-12T01:57:06.442742+0000) 2024-09-12T01:57:44.262 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:43 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:43.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-12T01:56:46.443376+0000 front 2024-09-12T01:56:46.443273+0000 (oldest deadline 2024-09-12T01:57:11.743271+0000) 2024-09-12T01:57:44.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:43 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:43.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:55.844209+0000 front 2024-09-12T01:56:55.844259+0000 (oldest deadline 2024-09-12T01:57:21.744322+0000) 2024-09-12T01:57:44.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:43 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:43.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.245654+0000 front 2024-09-12T01:57:02.245555+0000 (oldest deadline 2024-09-12T01:57:26.345550+0000) 2024-09-12T01:57:44.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:43 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10[59829]: 2024-09-12T01:57:43.854+0000 7f057fdb7640 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.846729+0000 front 2024-09-12T01:57:09.846662+0000 (oldest deadline 2024-09-12T01:57:35.746662+0000) 2024-09-12T01:57:44.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:44 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:44.126+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:44.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:44 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:44.126+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:44.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:44 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:44.126+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:44.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:44 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:44.126+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:44.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:44 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:44.126+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:44.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:44 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:44.126+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:44.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:44 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:44.126+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-09-12T01:57:20.225244+0000 front 2024-09-12T01:57:20.225264+0000 (oldest deadline 2024-09-12T01:57:43.725274+0000) 2024-09-12T01:57:45.031 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:44 smithi152 podman[69008]: 2024-09-12 01:57:44.765956419 +0000 UTC m=+5.633113362 container died 0a266905d0cb0de38b6b0875ae36d59eea2497ace9174d684cb80cfbe823537e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:45.365 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:45 smithi152 podman[69008]: 2024-09-12 01:57:45.130865414 +0000 UTC m=+5.998022356 container cleanup 0a266905d0cb0de38b6b0875ae36d59eea2497ace9174d684cb80cfbe823537e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T01:57:45.365 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:45 smithi152 bash[69008]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10 2024-09-12T01:57:45.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:45 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:45.093+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:45.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:45 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:45.093+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:45.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:45 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:45.093+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:45.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:45 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:45.093+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:45.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:45 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:45.093+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:45.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:45 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:45.093+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:45.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:45 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:45.093+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-09-12T01:57:20.225244+0000 front 2024-09-12T01:57:20.225264+0000 (oldest deadline 2024-09-12T01:57:43.725274+0000) 2024-09-12T01:57:45.697 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:45 smithi152 podman[69024]: 2024-09-12 01:57:45.365363454 +0000 UTC m=+0.592496896 container remove 0a266905d0cb0de38b6b0875ae36d59eea2497ace9174d684cb80cfbe823537e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T01:57:45.845 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:45 smithi152 podman[69117]: 2024-09-12 01:57:45.601129947 +0000 UTC m=+0.016411818 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:57:45.846 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:45 smithi152 podman[69117]: 2024-09-12 01:57:45.716530183 +0000 UTC m=+0.131812095 container create 618f3fd68a268fdb3f8407989b65749d3359cd55d92b82cb01b7d5475b356a86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T01:57:46.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:45 smithi152 podman[69117]: 2024-09-12 01:57:45.968773014 +0000 UTC m=+0.384054884 container init 618f3fd68a268fdb3f8407989b65749d3359cd55d92b82cb01b7d5475b356a86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T01:57:46.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:45 smithi152 podman[69117]: 2024-09-12 01:57:45.972017085 +0000 UTC m=+0.387298955 container start 618f3fd68a268fdb3f8407989b65749d3359cd55d92b82cb01b7d5475b356a86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T01:57:46.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:46 smithi152 podman[69117]: 2024-09-12 01:57:46.043738277 +0000 UTC m=+0.459020152 container attach 618f3fd68a268fdb3f8407989b65749d3359cd55d92b82cb01b7d5475b356a86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:57:46.263 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:46 smithi152 podman[69117]: 2024-09-12 01:57:46.160610248 +0000 UTC m=+0.575892118 container died 618f3fd68a268fdb3f8407989b65749d3359cd55d92b82cb01b7d5475b356a86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:46.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:46 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:46.092+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:46.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:46 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:46.092+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:46.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:46 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:46.092+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:46.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:46 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:46.092+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:46.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:46 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:46.092+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:46.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:46 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:46.092+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:46.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:46 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:46.092+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-09-12T01:57:20.225244+0000 front 2024-09-12T01:57:20.225264+0000 (oldest deadline 2024-09-12T01:57:43.725274+0000) 2024-09-12T01:57:46.700 INFO:journalctl@ceph.osd.10.smithi152.stdout:Sep 12 01:57:46 smithi152 podman[69141]: 2024-09-12 01:57:46.680315889 +0000 UTC m=+0.513697476 container remove 618f3fd68a268fdb3f8407989b65749d3359cd55d92b82cb01b7d5475b356a86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:46.705 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T01:57:46.745 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:57:46.745 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T01:57:46.746 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T01:57:46.746 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.11 2024-09-12T01:57:47.029 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:46 smithi191 systemd[1]: Stopping Ceph osd.11 for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:57:47.029 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:47 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:47.028+0000 7f9695ca9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:57:47.029 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:47 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:47.028+0000 7f9695ca9640 -1 osd.11 86 *** Got signal Terminated *** 2024-09-12T01:57:47.029 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:47 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:47.028+0000 7f9695ca9640 -1 osd.11 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:57:47.437 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:47 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:47.076+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:47.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:47 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:47.076+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:47.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:47 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:47.076+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:47.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:47 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:47.076+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:47.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:47 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:47.076+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:47.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:47 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:47.076+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:47.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:47 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:47.076+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-09-12T01:57:20.225244+0000 front 2024-09-12T01:57:20.225264+0000 (oldest deadline 2024-09-12T01:57:43.725274+0000) 2024-09-12T01:57:48.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:48 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:48.038+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:48.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:48 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:48.038+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:48.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:48 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:48.038+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:48.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:48 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:48.038+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:48.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:48 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:48.038+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:48.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:48 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:48.038+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:48.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:48 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:48.038+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-09-12T01:57:20.225244+0000 front 2024-09-12T01:57:20.225264+0000 (oldest deadline 2024-09-12T01:57:43.725274+0000) 2024-09-12T01:57:49.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:49 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:49.023+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:49.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:49 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:49.023+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:49.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:49 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:49.023+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:49.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:49 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:49.023+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:49.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:49 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:49.023+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:49.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:49 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:49.023+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:49.439 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:49 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:49.023+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-09-12T01:57:20.225244+0000 front 2024-09-12T01:57:20.225264+0000 (oldest deadline 2024-09-12T01:57:43.725274+0000) 2024-09-12T01:57:50.437 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:50 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:50.044+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:50.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:50 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:50.044+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:50.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:50 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:50.044+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:50.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:50 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:50.044+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:50.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:50 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:50.044+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:50.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:50 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:50.044+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:50.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:50 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:50.044+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-09-12T01:57:20.225244+0000 front 2024-09-12T01:57:20.225264+0000 (oldest deadline 2024-09-12T01:57:43.725274+0000) 2024-09-12T01:57:51.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:51 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:51.074+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:51.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:51 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:51.074+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:51.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:51 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:51.074+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:51.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:51 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:51.074+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:51.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:51 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:51.074+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:51.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:51 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:51.074+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:51.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:51 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:51.074+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-09-12T01:57:20.225244+0000 front 2024-09-12T01:57:20.225264+0000 (oldest deadline 2024-09-12T01:57:43.725274+0000) 2024-09-12T01:57:51.438 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:51 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:51.074+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6820 osd.8 since back 2024-09-12T01:57:27.826201+0000 front 2024-09-12T01:57:27.826229+0000 (oldest deadline 2024-09-12T01:57:50.126212+0000) 2024-09-12T01:57:52.346 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:52 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:52.028+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-12T01:56:24.917826+0000 front 2024-09-12T01:56:24.917557+0000 (oldest deadline 2024-09-12T01:56:47.817517+0000) 2024-09-12T01:57:52.346 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:52 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:52.028+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6804 osd.1 since back 2024-09-12T01:56:31.318460+0000 front 2024-09-12T01:56:31.318518+0000 (oldest deadline 2024-09-12T01:56:56.018348+0000) 2024-09-12T01:57:52.347 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:52 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:52.028+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-09-12T01:56:38.319416+0000 front 2024-09-12T01:56:38.319449+0000 (oldest deadline 2024-09-12T01:57:03.019549+0000) 2024-09-12T01:57:52.347 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:52 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:52.028+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6812 osd.4 since back 2024-09-12T01:56:57.021766+0000 front 2024-09-12T01:56:57.021745+0000 (oldest deadline 2024-09-12T01:57:21.721733+0000) 2024-09-12T01:57:52.347 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:52 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:52.028+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-09-12T01:57:02.222501+0000 front 2024-09-12T01:57:02.222559+0000 (oldest deadline 2024-09-12T01:57:26.922545+0000) 2024-09-12T01:57:52.347 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:52 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:52.028+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-12T01:57:09.123933+0000 front 2024-09-12T01:57:09.123874+0000 (oldest deadline 2024-09-12T01:57:34.423753+0000) 2024-09-12T01:57:52.347 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:52 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:52.028+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.152:6820 osd.7 since back 2024-09-12T01:57:20.225244+0000 front 2024-09-12T01:57:20.225264+0000 (oldest deadline 2024-09-12T01:57:43.725274+0000) 2024-09-12T01:57:52.347 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:52 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11[61474]: 2024-09-12T01:57:52.028+0000 7f96922ae640 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.191:6820 osd.8 since back 2024-09-12T01:57:27.826201+0000 front 2024-09-12T01:57:27.826229+0000 (oldest deadline 2024-09-12T01:57:50.126212+0000) 2024-09-12T01:57:52.670 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:52 smithi191 podman[70982]: 2024-09-12 01:57:52.346849526 +0000 UTC m=+5.410122298 container died 68b0974bae61f793c420fcae86b91d715e75e15cd104ab703e7d85035231ac18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T01:57:52.670 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:52 smithi191 podman[70982]: 2024-09-12 01:57:52.67101705 +0000 UTC m=+5.734289813 container cleanup 68b0974bae61f793c420fcae86b91d715e75e15cd104ab703e7d85035231ac18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:57:52.937 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:52 smithi191 bash[70982]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11 2024-09-12T01:57:52.938 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:52 smithi191 podman[70998]: 2024-09-12 01:57:52.864422431 +0000 UTC m=+0.515851156 container remove 68b0974bae61f793c420fcae86b91d715e75e15cd104ab703e7d85035231ac18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T01:57:53.551 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:53 smithi191 podman[71087]: 2024-09-12 01:57:53.163765964 +0000 UTC m=+0.015892937 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:57:53.551 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:53 smithi191 podman[71087]: 2024-09-12 01:57:53.273737573 +0000 UTC m=+0.125864533 container create bb81f692ea7d86c99626678f182a1d6d0952e20e7b99b404096142524a84d392 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T01:57:53.551 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:53 smithi191 podman[71087]: 2024-09-12 01:57:53.485239687 +0000 UTC m=+0.337366647 container init bb81f692ea7d86c99626678f182a1d6d0952e20e7b99b404096142524a84d392 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T01:57:53.551 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:53 smithi191 podman[71087]: 2024-09-12 01:57:53.488449743 +0000 UTC m=+0.340576710 container start bb81f692ea7d86c99626678f182a1d6d0952e20e7b99b404096142524a84d392 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:57:53.552 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:53 smithi191 podman[71087]: 2024-09-12 01:57:53.551982677 +0000 UTC m=+0.404109645 container attach bb81f692ea7d86c99626678f182a1d6d0952e20e7b99b404096142524a84d392 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T01:57:53.937 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:53 smithi191 podman[71087]: 2024-09-12 01:57:53.672812372 +0000 UTC m=+0.524939345 container died bb81f692ea7d86c99626678f182a1d6d0952e20e7b99b404096142524a84d392 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T01:57:54.185 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T01:57:54.208 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:54 smithi191 podman[71110]: 2024-09-12 01:57:54.156569685 +0000 UTC m=+0.477883757 container remove bb81f692ea7d86c99626678f182a1d6d0952e20e7b99b404096142524a84d392 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T01:57:54.208 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:54 smithi191 systemd[1]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.11.service: Deactivated successfully. 2024-09-12T01:57:54.208 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:54 smithi191 systemd[1]: Stopped Ceph osd.11 for 2d8cad48-70a8-11ef-bcea-c7b262605968. 2024-09-12T01:57:54.208 INFO:journalctl@ceph.osd.11.smithi191.stdout:Sep 12 01:57:54 smithi191 systemd[1]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@osd.11.service: Consumed 13.627s CPU time. 2024-09-12T01:57:54.224 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:57:54.224 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T01:57:54.224 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T01:57:54.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.a 2024-09-12T01:57:54.519 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:57:54 smithi070 systemd[1]: Stopping Ceph mds.a for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:57:55.019 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:57:54 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a[72189]: 2024-09-12T01:57:54.639+0000 7fa62032c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:57:55.019 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:57:54 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a[72189]: 2024-09-12T01:57:54.639+0000 7fa62032c640 -1 mds.a *** got signal Terminated *** 2024-09-12T01:57:57.838 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:57:57 smithi070 podman[99352]: 2024-09-12 01:57:57.549530849 +0000 UTC m=+3.122780522 container died 40ba78fa839cf61f2de9ca719bdc6824c836719f02ad28dc11074ee51859860a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T01:57:58.519 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:57:58 smithi070 podman[99352]: 2024-09-12 01:57:58.089237181 +0000 UTC m=+3.662486850 container cleanup 40ba78fa839cf61f2de9ca719bdc6824c836719f02ad28dc11074ee51859860a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T01:57:58.519 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:57:58 smithi070 bash[99352]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a 2024-09-12T01:57:58.519 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 12 01:57:58 smithi070 podman[99364]: 2024-09-12 01:57:58.282698957 +0000 UTC m=+0.729228966 container remove 40ba78fa839cf61f2de9ca719bdc6824c836719f02ad28dc11074ee51859860a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T01:57:58.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T01:57:58.586 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:57:58.586 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T01:57:58.586 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T01:57:58.586 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.d 2024-09-12T01:57:58.902 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:57:58 smithi070 systemd[1]: Stopping Ceph mds.d for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:57:59.269 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:57:58 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-d[71001]: 2024-09-12T01:57:58.900+0000 7f63d3ddd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:57:59.269 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:57:58 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-d[71001]: 2024-09-12T01:57:58.900+0000 7f63d3ddd640 -1 mds.d *** got signal Terminated *** 2024-09-12T01:58:03.269 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:58:02 smithi070 podman[99483]: 2024-09-12 01:58:02.914718649 +0000 UTC m=+4.109169452 container died 88ed23c9454f413befdb20b227e86bf9fc7d79781341c739e3716cc9f91044bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T01:58:03.769 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:58:03 smithi070 podman[99483]: 2024-09-12 01:58:03.518276168 +0000 UTC m=+4.712726974 container cleanup 88ed23c9454f413befdb20b227e86bf9fc7d79781341c739e3716cc9f91044bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T01:58:03.769 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 12 01:58:03 smithi070 bash[99483]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-d 2024-09-12T01:58:03.945 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T01:58:03.979 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:58:03.979 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T01:58:03.979 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T01:58:03.980 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.g 2024-09-12T01:58:04.519 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:58:04 smithi070 systemd[1]: Stopping Ceph mds.g for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:58:04.519 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:58:04 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-g[71784]: 2024-09-12T01:58:04.279+0000 7f62ca74b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:58:04.519 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:58:04 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-g[71784]: 2024-09-12T01:58:04.279+0000 7f62ca74b640 -1 mds.g *** got signal Terminated *** 2024-09-12T01:58:05.814 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:58:05 smithi070 podman[99607]: 2024-09-12 01:58:05.54988256 +0000 UTC m=+1.353778012 container died a64769e3ebcbc917869c5b2ba49879b9e643ea9e8ba56d828ef962a036ec7d68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:58:06.156 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:58:05 smithi070 podman[99607]: 2024-09-12 01:58:05.955942127 +0000 UTC m=+1.759837611 container cleanup a64769e3ebcbc917869c5b2ba49879b9e643ea9e8ba56d828ef962a036ec7d68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:58:06.156 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 12 01:58:05 smithi070 bash[99607]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-g 2024-09-12T01:58:06.308 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T01:58:06.342 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:58:06.342 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T01:58:06.342 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T01:58:06.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.j 2024-09-12T01:58:06.769 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 12 01:58:06 smithi070 systemd[1]: Stopping Ceph mds.j for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:58:06.769 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 12 01:58:06 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-j[70582]: 2024-09-12T01:58:06.633+0000 7fd8c7551640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:58:06.769 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 12 01:58:06 smithi070 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-j[70582]: 2024-09-12T01:58:06.633+0000 7fd8c7551640 -1 mds.j *** got signal Terminated *** 2024-09-12T01:58:10.917 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 12 01:58:10 smithi070 podman[99730]: 2024-09-12 01:58:10.646522108 +0000 UTC m=+4.088177441 container died 0321d20843898f8c31e185e718adbf021797c86b4506ad1c81cfdfec6063cda5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-12T01:58:11.243 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 12 01:58:11 smithi070 podman[99730]: 2024-09-12 01:58:11.092809732 +0000 UTC m=+4.534465099 container cleanup 0321d20843898f8c31e185e718adbf021797c86b4506ad1c81cfdfec6063cda5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-j, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T01:58:11.243 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 12 01:58:11 smithi070 bash[99730]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-j 2024-09-12T01:58:11.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T01:58:11.499 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:58:11.500 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T01:58:11.500 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T01:58:11.500 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.b 2024-09-12T01:58:11.789 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:58:11 smithi152 systemd[1]: Stopping Ceph mds.b for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:58:12.051 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:58:11 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b[65045]: 2024-09-12T01:58:11.788+0000 7f84df757640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:58:12.051 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:58:11 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b[65045]: 2024-09-12T01:58:11.788+0000 7f84df757640 -1 mds.b *** got signal Terminated *** 2024-09-12T01:58:14.012 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:58:13 smithi152 podman[69220]: 2024-09-12 01:58:13.569092482 +0000 UTC m=+1.872979371 container died fe19a7587df021f421f5d67434f3d17e72511ee401884141816b48bc3f8726f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T01:58:14.490 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:58:14 smithi152 podman[69220]: 2024-09-12 01:58:14.239181571 +0000 UTC m=+2.543068448 container cleanup fe19a7587df021f421f5d67434f3d17e72511ee401884141816b48bc3f8726f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-12T01:58:14.490 INFO:journalctl@ceph.mds.b.smithi152.stdout:Sep 12 01:58:14 smithi152 bash[69220]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-b 2024-09-12T01:58:14.626 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T01:58:14.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:58:14.666 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T01:58:14.666 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T01:58:14.666 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.e 2024-09-12T01:58:15.012 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:58:14 smithi152 systemd[1]: Stopping Ceph mds.e for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:58:15.012 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:58:14 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-e[64439]: 2024-09-12T01:58:14.992+0000 7f0bdab4f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:58:15.012 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:58:14 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-e[64439]: 2024-09-12T01:58:14.992+0000 7f0bdab4f640 -1 mds.e *** got signal Terminated *** 2024-09-12T01:58:18.012 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:58:17 smithi152 podman[69353]: 2024-09-12 01:58:17.564480392 +0000 UTC m=+2.674604631 container died a9649aa599899b1d634ed38c1a802b70dc02a1a9c48265e868abeeb3341ffb0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T01:58:18.402 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:58:18 smithi152 podman[69353]: 2024-09-12 01:58:18.159663518 +0000 UTC m=+3.269787747 container cleanup a9649aa599899b1d634ed38c1a802b70dc02a1a9c48265e868abeeb3341ffb0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-12T01:58:18.402 INFO:journalctl@ceph.mds.e.smithi152.stdout:Sep 12 01:58:18 smithi152 bash[69353]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-e 2024-09-12T01:58:18.534 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T01:58:18.567 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:58:18.567 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T01:58:18.568 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T01:58:18.568 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.h 2024-09-12T01:58:19.012 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:58:18 smithi152 systemd[1]: Stopping Ceph mds.h for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:58:19.013 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:58:18 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h[64743]: 2024-09-12T01:58:18.896+0000 7f073bf7b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:58:19.013 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:58:18 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h[64743]: 2024-09-12T01:58:18.896+0000 7f073bf7b640 -1 mds.h *** got signal Terminated *** 2024-09-12T01:58:21.822 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:58:21 smithi152 podman[69474]: 2024-09-12 01:58:21.551375282 +0000 UTC m=+2.757600503 container died 7ac0545caa724a41f7b4cd8a87268c00c550a985cbbbba9fb91dbae9c7d07428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T01:58:22.205 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:58:21 smithi152 podman[69474]: 2024-09-12 01:58:21.905158333 +0000 UTC m=+3.111383540 container cleanup 7ac0545caa724a41f7b4cd8a87268c00c550a985cbbbba9fb91dbae9c7d07428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T01:58:22.206 INFO:journalctl@ceph.mds.h.smithi152.stdout:Sep 12 01:58:21 smithi152 bash[69474]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-h 2024-09-12T01:58:22.384 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T01:58:22.417 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:58:22.418 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T01:58:22.418 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T01:58:22.418 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.k 2024-09-12T01:58:22.750 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:58:22 smithi152 systemd[1]: Stopping Ceph mds.k for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:58:23.012 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:58:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-k[64126]: 2024-09-12T01:58:22.750+0000 7f156ff6a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:58:23.013 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:58:22 smithi152 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-k[64126]: 2024-09-12T01:58:22.750+0000 7f156ff6a640 -1 mds.k *** got signal Terminated *** 2024-09-12T01:58:25.817 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:58:25 smithi152 podman[69596]: 2024-09-12 01:58:25.555652124 +0000 UTC m=+2.912061540 container died 56d78402e3e0ef7b3cc3c5ca14811c896c72bdcc92bc798d11f5304fd6e5a938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:58:26.193 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:58:25 smithi152 podman[69596]: 2024-09-12 01:58:25.917828096 +0000 UTC m=+3.274237521 container cleanup 56d78402e3e0ef7b3cc3c5ca14811c896c72bdcc92bc798d11f5304fd6e5a938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T01:58:26.193 INFO:journalctl@ceph.mds.k.smithi152.stdout:Sep 12 01:58:25 smithi152 bash[69596]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-k 2024-09-12T01:58:26.353 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T01:58:26.385 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:58:26.385 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T01:58:26.386 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T01:58:26.386 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.c 2024-09-12T01:58:26.672 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:58:26 smithi191 systemd[1]: Stopping Ceph mds.c for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:58:26.937 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:58:26 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-c[66795]: 2024-09-12T01:58:26.672+0000 7f074b128640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:58:26.938 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:58:26 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-c[66795]: 2024-09-12T01:58:26.672+0000 7f074b128640 -1 mds.c *** got signal Terminated *** 2024-09-12T01:58:29.856 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:58:29 smithi191 podman[71186]: 2024-09-12 01:58:29.560284389 +0000 UTC m=+2.981519499 container died 67d5c27f25c655bd1584f387d0b8556b49a53ba6f230d7933d04eb2ba8b79ac8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-c, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T01:58:30.165 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:58:29 smithi191 podman[71186]: 2024-09-12 01:58:29.930927581 +0000 UTC m=+3.352162679 container cleanup 67d5c27f25c655bd1584f387d0b8556b49a53ba6f230d7933d04eb2ba8b79ac8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:58:30.165 INFO:journalctl@ceph.mds.c.smithi191.stdout:Sep 12 01:58:29 smithi191 bash[71186]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-c 2024-09-12T01:58:30.297 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T01:58:30.330 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:58:30.331 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T01:58:30.331 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T01:58:30.331 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.f 2024-09-12T01:58:30.437 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:58:30 smithi191 systemd[1]: Stopping Ceph mds.f for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:58:30.937 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:58:30 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-f[66487]: 2024-09-12T01:58:30.634+0000 7f5f57d66640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:58:30.938 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:58:30 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-f[66487]: 2024-09-12T01:58:30.634+0000 7f5f57d66640 -1 mds.f *** got signal Terminated *** 2024-09-12T01:58:33.837 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:58:33 smithi191 podman[71309]: 2024-09-12 01:58:33.565802257 +0000 UTC m=+3.014408787 container died afaa17d49462e67667dc38d05cf6098afed61f0ca332c72860b2ac1e9be00cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T01:58:34.154 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:58:33 smithi191 podman[71309]: 2024-09-12 01:58:33.910935513 +0000 UTC m=+3.359542042 container cleanup afaa17d49462e67667dc38d05cf6098afed61f0ca332c72860b2ac1e9be00cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T01:58:34.154 INFO:journalctl@ceph.mds.f.smithi191.stdout:Sep 12 01:58:33 smithi191 bash[71309]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-f 2024-09-12T01:58:34.302 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T01:58:34.334 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:58:34.334 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T01:58:34.334 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T01:58:34.334 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.i 2024-09-12T01:58:34.687 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:58:34 smithi191 systemd[1]: Stopping Ceph mds.i for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:58:34.688 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:58:34 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-i[67099]: 2024-09-12T01:58:34.639+0000 7fb57b970640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:58:34.688 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:58:34 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-i[67099]: 2024-09-12T01:58:34.639+0000 7fb57b970640 -1 mds.i *** got signal Terminated *** 2024-09-12T01:58:37.815 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:58:37 smithi191 podman[71433]: 2024-09-12 01:58:37.557860941 +0000 UTC m=+3.010669943 container died 1c863ba550a443560c1c389f0325fbdae9d79eac6025f3d9721477c0ab386bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-12T01:58:38.169 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:58:37 smithi191 podman[71433]: 2024-09-12 01:58:37.907373942 +0000 UTC m=+3.360182943 container cleanup 1c863ba550a443560c1c389f0325fbdae9d79eac6025f3d9721477c0ab386bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T01:58:38.169 INFO:journalctl@ceph.mds.i.smithi191.stdout:Sep 12 01:58:37 smithi191 bash[71433]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-i 2024-09-12T01:58:38.345 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T01:58:38.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:58:38.377 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T01:58:38.377 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T01:58:38.378 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.l 2024-09-12T01:58:38.688 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:58:38 smithi191 systemd[1]: Stopping Ceph mds.l for 2d8cad48-70a8-11ef-bcea-c7b262605968... 2024-09-12T01:58:39.187 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:58:38 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-l[66185]: 2024-09-12T01:58:38.687+0000 7f91aa517640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:58:39.188 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:58:38 smithi191 ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-l[66185]: 2024-09-12T01:58:38.687+0000 7f91aa517640 -1 mds.l *** got signal Terminated *** 2024-09-12T01:58:41.863 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:58:41 smithi191 podman[71555]: 2024-09-12 01:58:41.565587298 +0000 UTC m=+2.964197807 container died cadebaaa594d814696ec9bf8288e6d4852c36efeebacd1b7a4a24473fe16d0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:58:42.187 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:58:41 smithi191 podman[71555]: 2024-09-12 01:58:41.955986779 +0000 UTC m=+3.354597282 container cleanup cadebaaa594d814696ec9bf8288e6d4852c36efeebacd1b7a4a24473fe16d0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T01:58:42.188 INFO:journalctl@ceph.mds.l.smithi191.stdout:Sep 12 01:58:41 smithi191 bash[71555]: ceph-2d8cad48-70a8-11ef-bcea-c7b262605968-mds-l 2024-09-12T01:58:42.320 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-2d8cad48-70a8-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T01:58:42.351 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:58:42.352 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T01:58:42.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T01:58:42.560 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:58:45.136 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T01:58:45.339 INFO:teuthology.orchestra.run.smithi152.stdout:Deleting cluster with fsid: 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:58:47.899 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T01:58:48.101 INFO:teuthology.orchestra.run.smithi191.stdout:Deleting cluster with fsid: 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:58:50.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:58:50.432 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:58:50.466 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:58:50.492 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T01:58:50.494 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566/remote/smithi070/crash 2024-09-12T01:58:50.495 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/crash -- . 2024-09-12T01:58:50.523 INFO:teuthology.orchestra.run.smithi070.stderr:tar: /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T01:58:50.523 INFO:teuthology.orchestra.run.smithi070.stderr:tar: Error is not recoverable: exiting now 2024-09-12T01:58:50.525 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566/remote/smithi152/crash 2024-09-12T01:58:50.526 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/crash -- . 2024-09-12T01:58:50.560 INFO:teuthology.orchestra.run.smithi152.stderr:tar: /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T01:58:50.560 INFO:teuthology.orchestra.run.smithi152.stderr:tar: Error is not recoverable: exiting now 2024-09-12T01:58:50.562 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566/remote/smithi191/crash 2024-09-12T01:58:50.563 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/crash -- . 2024-09-12T01:58:50.600 INFO:teuthology.orchestra.run.smithi191.stderr:tar: /var/lib/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T01:58:50.600 INFO:teuthology.orchestra.run.smithi191.stderr:tar: Error is not recoverable: exiting now 2024-09-12T01:58:50.601 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T01:58:50.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T01:58:50.641 INFO:teuthology.orchestra.run.smithi070.stdout:2024-09-12T01:50:00.000171+0000 mon.a (mon.0) 1041 : cluster [WRN] application not enabled on pool 'cephfs_metadata' 2024-09-12T01:58:50.641 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-12T01:58:50.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[SEC\]' /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T01:58:50.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]' /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T01:58:50.791 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[WRN\]' /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T01:58:50.865 INFO:teuthology.orchestra.run.smithi070.stdout:2024-09-12T01:50:00.000171+0000 mon.a (mon.0) 1041 : cluster [WRN] application not enabled on pool 'cephfs_metadata' 2024-09-12T01:58:50.865 INFO:tasks.cephadm:Compressing logs... 2024-09-12T01:58:50.866 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:58:50.909 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:58:50.912 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:58:50.931 INFO:teuthology.orchestra.run.smithi070.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T01:58:50.931 INFO:teuthology.orchestra.run.smithi070.stderr:: No such file or directory 2024-09-12T01:58:50.932 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T01:58:50.932 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T01:58:50.933 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T01:58:50.933 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T01:58:50.933 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T01:58:50.934 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T01:58:50.934 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T01:58:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mon.a.log: 82.5% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T01:58:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T01:58:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log 2024-09-12T01:58:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.2% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T01:58:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T01:58:50.939 INFO:teuthology.orchestra.run.smithi191.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T01:58:50.939 INFO:teuthology.orchestra.run.smithi191.stderr:: No such file or directory 2024-09-12T01:58:50.939 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T01:58:50.939 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T01:58:50.939 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T01:58:50.939 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T01:58:50.939 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T01:58:50.939 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T01:58:50.939 INFO:teuthology.orchestra.run.smithi191.stderr: 82.5% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T01:58:50.939 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T01:58:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log: 86.0% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T01:58:50.942 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T01:58:50.944 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T01:58:50.944 INFO:teuthology.orchestra.run.smithi152.stderr:: No such file or directory 2024-09-12T01:58:50.944 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T01:58:50.944 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T01:58:50.945 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T01:58:50.945 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T01:58:50.945 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T01:58:50.945 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T01:58:50.945 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.k.log: -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T01:58:50.945 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T01:58:50.947 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log 2024-09-12T01:58:50.947 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.5.log: 90.4%gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T01:58:50.947 INFO:teuthology.orchestra.run.smithi191.stderr: -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T01:58:50.947 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T01:58:50.947 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log: /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.l.log: 86.0% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T01:58:50.947 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T01:58:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.d.log: 94.7% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T01:58:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T01:58:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mgr.x.log: 91.0% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T01:58:50.950 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T01:58:50.950 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T01:58:50.950 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.6% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T01:58:50.950 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log 2024-09-12T01:58:50.951 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.8.log: 90.9% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T01:58:50.954 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mgr.y.log: 92.2% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T01:58:50.954 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T01:58:50.955 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log: 90.9% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T01:58:50.956 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T01:58:50.957 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T01:58:50.957 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T01:58:50.958 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.h.log: 85.9% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T01:58:50.958 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T01:58:50.959 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T01:58:50.962 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mgr.z.log: 92.4% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T01:58:50.968 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T01:58:50.970 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T01:58:50.970 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T01:58:50.982 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T01:58:50.983 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T01:58:50.998 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T01:58:51.005 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T01:58:51.149 INFO:teuthology.orchestra.run.smithi070.stderr: 90.2% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T01:58:51.165 INFO:teuthology.orchestra.run.smithi070.stderr: 95.0% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T01:58:51.239 INFO:teuthology.orchestra.run.smithi152.stderr: 95.0% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T01:58:51.240 INFO:teuthology.orchestra.run.smithi191.stderr: 91.8% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T01:58:51.267 INFO:teuthology.orchestra.run.smithi152.stderr: 91.8% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T01:58:51.459 INFO:teuthology.orchestra.run.smithi070.stderr: 95.2% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T01:58:51.576 INFO:teuthology.orchestra.run.smithi070.stderr: 90.5% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T01:58:51.735 INFO:teuthology.orchestra.run.smithi191.stderr: 95.3% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T01:58:52.276 INFO:teuthology.orchestra.run.smithi070.stderr: 93.9% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T01:58:52.512 INFO:teuthology.orchestra.run.smithi152.stderr: 93.7% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T01:58:52.647 INFO:teuthology.orchestra.run.smithi070.stderr: 93.8% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T01:58:52.701 INFO:teuthology.orchestra.run.smithi070.stderr: 93.8% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T01:58:52.703 INFO:teuthology.orchestra.run.smithi191.stderr: 93.9% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T01:58:53.033 INFO:teuthology.orchestra.run.smithi152.stderr: 93.7% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T01:58:53.045 INFO:teuthology.orchestra.run.smithi070.stderr: 93.8% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T01:58:53.047 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-12T01:58:53.047 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m2.125s 2024-09-12T01:58:53.047 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m8.228s 2024-09-12T01:58:53.047 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m0.313s 2024-09-12T01:58:53.115 INFO:teuthology.orchestra.run.smithi191.stderr: 93.9% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T01:58:53.197 INFO:teuthology.orchestra.run.smithi191.stderr: 93.8% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T01:58:53.290 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T01:58:53.337 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T01:58:53.410 INFO:teuthology.orchestra.run.smithi152.stderr: 95.1% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T01:58:53.544 INFO:teuthology.orchestra.run.smithi191.stderr: 93.9% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T01:58:53.577 INFO:teuthology.orchestra.run.smithi191.stderr: 93.9% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T01:58:54.249 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T01:58:55.596 INFO:teuthology.orchestra.run.smithi191.stderr: 93.5% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T01:58:58.758 INFO:teuthology.orchestra.run.smithi191.stderr: 93.7% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T01:58:58.760 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-09-12T01:58:58.760 INFO:teuthology.orchestra.run.smithi191.stderr:real 0m7.833s 2024-09-12T01:58:58.760 INFO:teuthology.orchestra.run.smithi191.stderr:user 0m23.922s 2024-09-12T01:58:58.760 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m0.753s 2024-09-12T01:59:15.755 INFO:teuthology.orchestra.run.smithi152.stderr: 93.2% -- replaced with /var/log/ceph/2d8cad48-70a8-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T01:59:15.757 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-09-12T01:59:15.757 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m24.829s 2024-09-12T01:59:15.757 INFO:teuthology.orchestra.run.smithi152.stderr:user 0m38.071s 2024-09-12T01:59:15.757 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m1.207s 2024-09-12T01:59:15.757 INFO:tasks.cephadm:Archiving logs... 2024-09-12T01:59:15.758 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566/remote/smithi070/log 2024-09-12T01:59:15.759 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:59:16.840 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566/remote/smithi152/log 2024-09-12T01:59:16.841 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:59:21.878 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566/remote/smithi191/log 2024-09-12T01:59:21.879 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:59:24.686 INFO:tasks.cephadm:Removing cluster... 2024-09-12T01:59:24.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 --force 2024-09-12T01:59:24.888 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:59:25.152 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 --force 2024-09-12T01:59:25.355 INFO:teuthology.orchestra.run.smithi152.stdout:Deleting cluster with fsid: 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:59:25.648 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 2d8cad48-70a8-11ef-bcea-c7b262605968 --force 2024-09-12T01:59:25.850 INFO:teuthology.orchestra.run.smithi191.stdout:Deleting cluster with fsid: 2d8cad48-70a8-11ef-bcea-c7b262605968 2024-09-12T01:59:26.206 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T01:59:26.207 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T01:59:26.226 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T01:59:26.243 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T01:59:26.259 INFO:tasks.cephadm:Teardown complete 2024-09-12T01:59:26.260 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:59:26.271 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:59:26.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:59:26.274 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:59:26.286 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:59:26.609 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:59:26.978 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:59:26.979 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:59:26.982 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:59:26.984 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:59:26.994 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:59:26.997 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:59:26.998 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:59:26.998 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-12T01:59:26.998 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 61 -2513us[-2513us] +/- 50ms 2024-09-12T01:59:26.998 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv02.front.sepia.ceph.com 3 6 377 61 +590us[ +568us] +/- 58ms 2024-09-12T01:59:26.998 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +3009us[+3009us] +/- 71ms 2024-09-12T01:59:26.998 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:59:27.000 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:59:27.001 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:59:27.001 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-12T01:59:27.001 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 63 -2554us[-2557us] +/- 50ms 2024-09-12T01:59:27.001 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv02.front.sepia.ceph.com 3 6 377 62 +556us[ +553us] +/- 58ms 2024-09-12T01:59:27.001 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +2958us[+2955us] +/- 71ms 2024-09-12T01:59:27.001 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:59:27.004 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:59:27.004 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-09-12T01:59:27.004 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 61 -2523us[-2523us] +/- 50ms 2024-09-12T01:59:27.004 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv02.front.sepia.ceph.com 3 6 377 62 +572us[ +537us] +/- 58ms 2024-09-12T01:59:27.004 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +2997us[+2997us] +/- 71ms 2024-09-12T01:59:27.004 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:59:27.005 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:59:27.133 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:59:27.134 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:59:27.148 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:59:27.228 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:59:27.305 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:59:27.377 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:59:27.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:59:27.406 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:59:27.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:59:27.434 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:59:27.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:59:27.463 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:59:27.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:59:27.484 INFO:teuthology.task.internal:Duration was 1415.491307 seconds 2024-09-12T01:59:27.485 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:59:27.494 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:59:27.494 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:59:27.497 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:59:27.499 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:59:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:59:27.536 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:59:27.542 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:59:28.051 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:59:28.051 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-09-12T01:59:28.052 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:59:28.072 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-09-12T01:59:28.073 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:59:28.115 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2024-09-12T01:59:28.116 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:59:28.150 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:59:28.151 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:59:28.153 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:59:28.158 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:59:28.218 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:59:28.219 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:59:28.221 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:59:28.225 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:59:29.060 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:59:29.072 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:59:29.072 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:59:29.097 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:59:29.127 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:59:29.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:59:29.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:59:29.166 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:59:29.170 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:59:29.187 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-09-12T01:59:29.195 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-09-12T01:59:29.218 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2024-09-12T01:59:29.248 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:59:29.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:59:29.263 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:59:29.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:59:29.281 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:59:29.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:59:29.304 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:59:29.316 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:59:29.316 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566/remote/smithi070 2024-09-12T01:59:29.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:59:29.370 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566/remote/smithi152 2024-09-12T01:59:29.370 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:59:29.409 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901566/remote/smithi191 2024-09-12T01:59:29.409 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:59:29.445 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:59:29.445 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:59:29.448 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:59:29.451 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:59:29.495 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:59:29.509 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:59:29.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:59:29.520 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:59:29.521 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:59:29.523 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:59:29.525 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:59:29.536 INFO:teuthology.orchestra.run.smithi070.stdout: 265757 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:59 /home/ubuntu/cephtest 2024-09-12T01:59:29.539 INFO:teuthology.orchestra.run.smithi152.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:59 /home/ubuntu/cephtest 2024-09-12T01:59:29.551 INFO:teuthology.orchestra.run.smithi191.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:59 /home/ubuntu/cephtest 2024-09-12T01:59:29.552 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:59:29.564 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:59:29.650 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 1415.4913067817688 failure_reason: '"2024-09-12T01:50:00.000171+0000 mon.a (mon.0) 1041 : cluster [WRN] application not enabled on pool ''cephfs_metadata''" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-09-12T01:59:29.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:59:29.749 INFO:teuthology.run:FAIL